-- Logs begin at Tue 2022-05-10 01:05:46 UTC, end at Tue 2022-05-10 03:46:13 UTC. -- May 10 02:00:32.010647 n-d-841089-2 systemd[1]: Starting Devstack devstack@n-api.service... May 10 02:00:32.019233 n-d-841089-2 devstack@n-api.service[103594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 02:00:32 2022] *** May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: nodename: n-d-841089-2 May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: machine: x86_64 May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: clock source: unix May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: pcre jit disabled May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: detected number of CPU cores: 4 May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: current working directory: / May 10 02:00:32.021175 n-d-841089-2 devstack@n-api.service[103594]: detected binary path: /usr/bin/uwsgi-core May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: your processes number limit is 47680 May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: your memory page size is 4096 bytes May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: detected max file descriptor number: 2048 May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: lock engine: pthread robust mutexes May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: thunder lock: enabled May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 02:00:32.021789 n-d-841089-2 devstack@n-api.service[103594]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 02:00:32.066265 n-d-841089-2 devstack@n-api.service[103594]: Python main interpreter initialized at 0x5653d5cd89c0 May 10 02:00:32.066265 n-d-841089-2 devstack@n-api.service[103594]: python threads support enabled May 10 02:00:32.066265 n-d-841089-2 devstack@n-api.service[103594]: your server socket listen backlog is limited to 100 connections May 10 02:00:32.066265 n-d-841089-2 devstack@n-api.service[103594]: your mercy for graceful operations on workers is 90 seconds May 10 02:00:32.066617 n-d-841089-2 devstack@n-api.service[103594]: mapped 403077 bytes (393 KB) for 2 cores May 10 02:00:32.066698 n-d-841089-2 devstack@n-api.service[103594]: *** Operational MODE: preforking *** May 10 02:00:32.066920 n-d-841089-2 devstack@n-api.service[103594]: *** uWSGI is running in multiple interpreter mode *** May 10 02:00:32.066920 n-d-841089-2 devstack@n-api.service[103594]: spawned uWSGI master process (pid: 103594) May 10 02:00:32.067125 n-d-841089-2 systemd[1]: Started Devstack devstack@n-api.service. May 10 02:00:32.068140 n-d-841089-2 devstack@n-api.service[103594]: spawned uWSGI worker 1 (pid: 103595, cores: 1) May 10 02:00:32.068140 n-d-841089-2 devstack@n-api.service[103594]: spawned uWSGI worker 2 (pid: 103596, cores: 1) May 10 02:00:32.068140 n-d-841089-2 devstack@n-api.service[103594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 02:00:33.266238 n-d-841089-2 devstack@n-api.service[103596]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 02:00:33.266861 n-d-841089-2 devstack@n-api.service[103595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 02:00:33.994526 n-d-841089-2 devstack@n-api.service[103596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:00:33.994526 n-d-841089-2 devstack@n-api.service[103596]: from cryptography.utils import int_from_bytes May 10 02:00:33.994859 n-d-841089-2 devstack@n-api.service[103596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:00:33.994859 n-d-841089-2 devstack@n-api.service[103596]: from cryptography.utils import int_from_bytes May 10 02:00:33.995059 n-d-841089-2 devstack@n-api.service[103595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:00:33.995059 n-d-841089-2 devstack@n-api.service[103595]: from cryptography.utils import int_from_bytes May 10 02:00:33.995294 n-d-841089-2 devstack@n-api.service[103595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:00:33.995294 n-d-841089-2 devstack@n-api.service[103595]: from cryptography.utils import int_from_bytes May 10 02:00:36.624897 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:00:36.625512 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:00:36.625593 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:00:36.625947 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:00:36.626029 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:00:36.626099 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:00:36.626410 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:00:36.626513 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:00:36.626672 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:00:36.626761 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.626918 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:00:36.627013 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634005 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634150 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634150 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634292 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634292 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634420 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634491 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634569 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634656 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634724 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634816 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634883 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.634955 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635022 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635022 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635179 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635254 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635321 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635321 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635457 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-841089-2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635524 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635596 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635667 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-841089-2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635733 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635797 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635869 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.635935 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636010 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636076 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636140 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636204 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636276 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636352 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636436 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636502 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636566 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636667 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636735 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636799 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636872 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.636937 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637008 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637082 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637148 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637212 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637287 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637353 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637497 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637573 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637647 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637723 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637789 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637853 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.637929 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638002 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638073 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638146 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638146 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638277 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-841089-2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638277 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638392 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-841089-2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638468 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638539 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638610 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638684 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638684 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638815 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638815 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.638969 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.639035 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.640003 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.641301 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.641701 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.641905 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.642145 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.642349 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.642780 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643010 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643233 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643445 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643646 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643646 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643646 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.643646 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.644427 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.644630 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.644844 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.645043 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.645258 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.645457 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.645692 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.645905 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.646115 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.646811 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.646988 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.647306 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648024 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648182 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648333 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648470 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648605 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648748 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.648895 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649030 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649176 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649316 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649453 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649583 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649583 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649848 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.649848 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.650112 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.650245 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.650395 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.650537 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.650671 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651090 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651179 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651269 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651358 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651451 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651532 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651610 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651687 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651687 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651835 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.651926 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652005 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652134 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652269 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652364 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652445 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652535 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652615 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652699 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652788 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652868 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.652952 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653047 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653127 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653127 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653288 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653288 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653439 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653519 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653597 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653674 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653751 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653840 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.653931 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654011 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654096 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654175 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654252 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654329 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654418 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654498 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654576 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654661 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654747 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654826 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654912 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.654992 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655113 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655196 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655274 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655365 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655445 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655523 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655612 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655691 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655768 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655855 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.655942 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656028 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656114 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656200 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656279 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656366 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656445 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656535 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656614 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656691 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656831 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.656930 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.657144 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.657234 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.657459 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.657601 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.657773 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.657863 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.658077 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.658162 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.658384 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.658470 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.658693 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.658783 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659007 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659124 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659349 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659435 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659665 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659753 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.659978 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.660065 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.660287 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.660377 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.660596 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.660688 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.660905 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.661070 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.661211 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.661298 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.661522 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.661620 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.661830 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.662538 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.662706 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.662856 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663030 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663196 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663364 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663501 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663672 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663809 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.663995 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.664131 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.664308 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.664452 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.664615 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.664750 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.664939 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665038 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665243 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665330 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665554 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665650 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665870 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.665957 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.666177 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.666265 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.666483 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.666578 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.666789 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.666883 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.667113 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.667206 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.667423 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.667655 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.667747 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.667827 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668019 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668107 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668325 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668421 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668627 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668715 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.668933 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669019 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669246 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669342 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669553 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669640 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669857 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.669955 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.670161 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.670256 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.670482 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.670570 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.670792 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.670878 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.671124 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.671215 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.671454 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:00:36.671555 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.671793 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.671879 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.672128 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.672217 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.672461 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.672547 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.672783 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.672878 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.673095 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.673180 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.673413 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.673507 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.673740 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.673836 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674052 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674146 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674364 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674450 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674676 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674774 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.674996 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.675111 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.675342 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.675428 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.675662 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.675751 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.675977 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.676077 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.676296 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.676383 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.676615 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.676715 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.676930 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.677018 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.677252 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.677338 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.677601 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.677760 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.677923 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678019 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678239 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678332 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678573 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678669 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678901 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.678988 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.679235 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.679336 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.679566 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.679654 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.679888 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.679976 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.680203 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.680290 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.680516 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.680612 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.680827 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.680923 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.681151 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.681251 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.681466 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.681554 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.681782 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.681869 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.682099 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.682194 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.682413 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.682500 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.682724 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.682864 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683038 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683269 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683358 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683438 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683671 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683759 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.683991 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.684087 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.684310 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.684398 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.684625 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.684711 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.684938 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685034 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685255 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685344 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685573 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685667 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685887 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.685976 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.686199 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.686287 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.686507 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.686607 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.686814 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.686911 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.687145 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.687238 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.687459 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.687546 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.687763 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.687851 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.688073 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.688159 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.688391 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.688479 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.688700 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.688795 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689025 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689112 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689332 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689418 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689646 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689735 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.689958 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690046 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690270 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690366 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690578 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690667 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690892 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.690988 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.691224 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.691324 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.691533 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.691629 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.691847 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.691942 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.692155 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.692250 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.692464 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.692550 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.692786 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.692873 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.693108 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.693204 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.693425 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.693519 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.693744 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.693841 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694053 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694140 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694362 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694449 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694672 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694759 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.694984 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.695091 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.695325 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.695414 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.695644 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.695738 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.695954 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696048 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696280 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696367 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696598 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696694 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696903 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.696997 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.697228 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.697316 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.697553 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.697649 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.697859 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.697946 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.698160 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.698246 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.698469 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.698566 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.698772 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.698858 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.699107 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.699214 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.699401 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.699499 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.699713 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.699801 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700016 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700112 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700322 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700418 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700623 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700710 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.700925 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701012 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701228 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701317 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701534 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701621 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701844 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.701931 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.702144 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.702231 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.702447 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.702535 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.702751 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.702845 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.703056 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.703203 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.703396 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.703485 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.703704 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.703791 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.704052 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.704140 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.704362 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.704462 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.704701 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.704797 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705016 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705105 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705340 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705429 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705654 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705751 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.705967 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706061 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706281 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706368 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706595 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706697 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706911 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.706999 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.707244 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.707334 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.707560 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.707659 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.707872 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.707958 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.708190 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.708332 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.708494 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.708629 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.709334 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.709476 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.709644 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.709791 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.709962 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.710107 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.710287 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.710422 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.710601 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.710737 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.710923 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.711085 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.711269 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.711404 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.711583 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.711720 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.711899 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.712035 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.712209 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.712353 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.712522 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.712659 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.712870 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713017 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713184 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713314 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713435 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713532 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713747 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.713835 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714065 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714152 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714373 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714468 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714689 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714784 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.714997 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.715119 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.715340 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.715444 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.715648 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.715777 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.715963 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.716050 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.716282 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.716378 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.716593 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.716689 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.716914 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717009 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717226 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717321 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717550 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717639 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717865 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.717953 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.718177 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.718267 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.718487 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.718573 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.718793 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.718880 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.719122 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.719220 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.719434 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.719521 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.719741 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.719829 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720050 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720144 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720362 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720511 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720667 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720764 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.720981 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.721069 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.721290 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.721375 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.721597 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.721697 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.721905 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722004 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722219 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722305 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722529 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722625 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722839 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.722933 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.723179 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.723269 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.723504 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.723605 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.723812 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.723907 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.724120 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.724218 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.724497 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.725077 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.725295 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.725389 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.725599 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.725685 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.725913 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726002 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726220 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726308 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726566 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726661 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726833 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.726923 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.727165 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.727256 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.727498 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.727584 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.727818 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.727906 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.728128 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.728261 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.728444 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.728531 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.728756 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.728844 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.729066 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.729153 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.729381 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.729478 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.729695 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.729783 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730003 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730088 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730314 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730412 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730626 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730720 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.730937 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731024 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731273 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731375 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731588 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731676 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731896 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.731982 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.732222 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.732320 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.732519 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.732608 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.732826 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.732913 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.733139 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.733226 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.733454 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.733544 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.733764 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.734022 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.734119 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.734350 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.734438 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.734666 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.734951 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.735039 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.735320 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.735410 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.735646 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.735735 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.735974 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.736070 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.736300 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.736389 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.736627 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.736714 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.736936 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.737040 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.737248 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.737349 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.737555 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.737643 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.737861 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738024 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738172 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738306 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738479 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738577 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738784 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.738872 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.739114 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.739205 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.739430 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.739527 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.739733 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.739822 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740065 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740160 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740369 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740455 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740674 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740770 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.740979 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741075 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741283 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741371 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741590 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741676 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741891 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.741987 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.742203 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.742290 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.742513 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.742599 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.742819 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.742915 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.743172 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.743262 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.743492 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.743624 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.743803 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.743896 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.744119 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.744207 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.744428 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.744516 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.744778 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.744867 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.745089 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.745177 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.745411 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.745504 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.745716 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.745805 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746046 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746140 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746352 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746448 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746657 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746744 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.746959 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747046 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747294 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747395 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747606 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747693 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747911 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.747998 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.748223 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.748366 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.748536 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.748625 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.748845 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.748940 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.749153 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.749248 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.749455 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.749542 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.749765 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.749859 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750069 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750157 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750373 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750466 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750679 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750766 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.750984 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.751101 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.751311 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.751402 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.751622 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.751717 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.751932 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752020 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752234 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752322 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752544 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752631 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752847 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.752935 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.753152 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.753239 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.753454 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.753594 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.753758 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.753849 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754060 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754147 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754367 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754463 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754675 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754762 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.754977 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.755120 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.755315 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.755419 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.755642 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.755729 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.755954 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756041 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756254 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756349 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756564 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756651 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756866 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.756954 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.757169 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.757257 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.757476 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.757563 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.757781 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.757867 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.758089 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.758178 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.758391 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.758478 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.758701 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.758799 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.759005 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.759112 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.759335 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.759434 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.759639 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.759726 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760096 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760183 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760271 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760360 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760524 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760622 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760826 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.760915 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.761128 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.761224 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.761430 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.761526 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.761746 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.761833 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762053 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762139 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762355 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762453 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762661 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762749 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.762965 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.763054 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.763303 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.763450 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.763622 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.763711 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.763933 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764032 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764271 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764366 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764579 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764667 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764894 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.764980 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.765204 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.765293 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.765515 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.765603 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.765834 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.765928 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.766138 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.766228 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.766454 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.766542 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.766763 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.766850 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.767145 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.767238 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.767393 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.767478 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.767697 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.767786 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768017 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768105 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768328 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768423 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768637 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768740 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.768954 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769048 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769268 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769355 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769585 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769683 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769889 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.769976 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.770201 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.770289 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.770512 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.770609 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.770821 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.770916 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.771157 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.771732 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.771981 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.772081 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.772293 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.772381 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.772603 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.772701 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.772913 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773010 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773222 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773309 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773534 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773630 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773839 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.773931 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.774149 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.774244 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.774459 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.774547 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.774762 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.774851 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.775097 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.775188 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.775408 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.775495 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.775710 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776055 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776271 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776360 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776580 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776682 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776886 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.776979 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.777187 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.777273 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.777496 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.777617 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.777813 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.777929 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.778122 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.778240 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.778545 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.778643 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.778858 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.778960 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.779195 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.779297 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.779506 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.779603 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.779819 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.779905 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.780123 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.780211 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.780456 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.780586 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.780766 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.780861 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.781074 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.781169 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.781435 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.781522 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.781741 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.781828 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782044 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782130 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782366 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782460 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782691 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782785 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.782994 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.783095 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.783322 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.783420 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.783628 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.783725 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.783949 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784068 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784255 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784349 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784564 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784650 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784892 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.784993 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.785202 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.785288 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.785531 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.785616 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.785955 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.786050 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.786269 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.786365 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.786575 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.786660 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.786939 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.787548 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.787779 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.787866 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.788107 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.788193 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.788414 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.788508 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.788730 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.788836 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.789044 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.789151 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.789366 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.789454 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.789690 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.789778 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790002 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790096 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790316 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790401 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790620 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790707 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.790944 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.791039 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.791287 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.791376 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.791597 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.791685 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.791918 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792012 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792243 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792338 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792563 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792659 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792891 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.792985 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.793256 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.793350 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.793582 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.793692 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.793894 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.793990 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.794197 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.794292 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.794523 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.794610 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.794833 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.794919 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.795165 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.795272 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.795496 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.795584 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.795803 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.795889 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.796115 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.796209 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.796432 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.796518 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.796737 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.796823 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797040 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797127 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797346 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797433 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797657 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797743 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.797964 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798058 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798269 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798354 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798591 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798678 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798897 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.798991 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.799253 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.799352 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.799556 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.799642 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.799882 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.799971 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.800192 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.800345 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.800500 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.800595 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.800806 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.800893 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.801114 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.801206 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.801421 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.801519 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.801732 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.801819 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.802043 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.802129 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.802385 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.802479 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.802723 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.802810 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.803044 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.803160 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.803402 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.803498 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.803730 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.803856 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.804047 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.804135 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.804367 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.804455 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.804693 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.804781 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805000 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805090 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805305 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805400 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805618 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805705 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.805924 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806048 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806230 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806345 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806539 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806624 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806846 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.806932 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.807171 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.807262 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.807476 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.807563 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.807781 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.807880 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.808088 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.808182 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.808393 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.808479 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.808697 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.808790 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809013 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809099 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809320 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809417 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809623 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809718 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.809928 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810026 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810239 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810325 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810552 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810647 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810859 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.810945 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.811228 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.811318 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.811537 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.811624 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.811867 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.811952 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.812182 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.812275 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.812506 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.812593 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.812821 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.812907 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.813135 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.813228 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.813448 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.813535 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.813762 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.813850 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.814077 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.814205 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.814394 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.814480 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.814704 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.814789 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815013 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815141 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815354 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815442 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815668 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815767 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.815978 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.816078 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.816296 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.816505 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.816598 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.816838 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.816924 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.817156 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.817432 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.817519 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.817764 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.817852 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.818075 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.818169 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.818413 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.818653 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.818740 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.819032 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.819255 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.819357 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.819675 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.819829 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.819987 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.820301 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.820395 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.820614 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.820945 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.821031 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.821273 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.821558 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.821656 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.821929 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.822171 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.822257 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.822657 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.822812 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.823292 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.823382 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.823665 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.823897 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.823983 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.824311 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.824463 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.824641 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.824796 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.825012 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.825113 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.825400 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.825487 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.825736 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.825983 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.826070 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.826369 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.826602 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.826752 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.826998 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.827099 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.827366 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.827569 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.827692 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.828018 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.828182 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.828344 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.828670 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.828763 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.828992 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.829312 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.829396 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.829635 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.829900 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.829988 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.830248 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.830334 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.830601 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.830696 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.830926 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.831011 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.831280 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.831459 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.831622 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.831942 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.832030 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.832274 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.832479 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.832806 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.832892 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.833136 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.833223 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.833476 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.833562 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.834327 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.834654 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.834749 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.834980 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.835307 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.835407 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.835648 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.835743 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.835961 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836055 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836279 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836366 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836596 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836692 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836907 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.836993 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.837233 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.837320 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.837551 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.837648 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.837860 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.837948 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.838188 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.838273 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.838504 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.838599 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.838812 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.839060 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.839182 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.839438 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.839542 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.839763 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.839985 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.840094 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.840338 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.840425 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.840658 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.840750 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.840984 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.841071 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.841313 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.841400 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.841632 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.841720 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.841938 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842023 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842260 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842347 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842566 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842659 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842875 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.842968 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.843209 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.843319 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.843524 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.843610 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.843837 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.843923 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.844144 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.844244 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.844466 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.844587 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.844776 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.844876 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.845106 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.845203 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.845415 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.845501 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.845720 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.845806 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846023 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846117 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846338 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846426 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846644 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846729 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.846949 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847042 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847284 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847387 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847591 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847678 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847897 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.847996 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.848200 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.848286 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.848503 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.848590 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.848809 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.848895 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.849112 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.849198 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.849479 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.849572 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.849791 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.849904 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.850107 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.850206 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.850413 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.850521 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.850723 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.850820 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.851086 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.851184 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.851420 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.851533 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.851726 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.851822 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852033 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852132 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852353 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852458 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852663 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852768 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.852986 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.853083 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.853300 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.853409 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.853613 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.853855 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.853952 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.854196 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.854303 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.854530 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.854786 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.854905 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.855143 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.855243 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.855466 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.855558 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.855789 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.855891 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.856102 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.856198 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.856412 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.856501 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.856718 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.856814 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857031 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857120 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857344 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857434 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857656 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857743 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.857968 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.858134 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.858282 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.858455 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.858598 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.858769 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.858914 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.859101 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.859254 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.859417 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.859549 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.859730 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.859885 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860036 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860155 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860340 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860476 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860653 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860822 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.860965 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.861144 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.861277 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.861474 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.861595 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.861796 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.861938 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.862118 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.862258 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.862430 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.862577 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.862742 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.862895 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.863055 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.863246 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.863390 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.863562 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.863713 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.863872 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.864046 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.864180 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.864365 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.864491 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.864678 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.864808 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.865641 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.865742 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.865957 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866052 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866266 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866353 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866592 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866678 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866908 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.866996 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.867279 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.867368 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.867611 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.867698 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.867939 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868028 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868264 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868357 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868577 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868671 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868897 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.868991 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.869223 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.869310 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.869539 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.869634 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.869873 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.869960 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.870183 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.870272 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.870493 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.870655 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.870800 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.870888 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.871139 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.871231 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.871463 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.871562 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.871769 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.871864 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.872075 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.872161 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.872383 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.872470 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.872696 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.872781 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873001 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873094 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873306 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873393 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873609 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873703 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.873920 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874007 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874225 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874311 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874527 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874612 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874833 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.874975 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.875164 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.875256 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.875471 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.875618 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.875776 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.875877 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876080 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876166 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876385 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876473 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876688 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876783 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.876992 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877078 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877295 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877385 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877601 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877700 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877907 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.877992 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.878212 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.878307 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.878520 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.878616 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.878824 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.878920 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.879184 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.879287 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.879509 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.879596 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.879828 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.879914 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.880140 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.880226 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.880454 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.880734 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.880831 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.880912 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.881142 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.881228 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.881454 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.881542 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.881782 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.881868 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.882096 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.882182 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.882407 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.882495 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.882723 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.882809 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.883039 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.883154 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.883378 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.883465 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.883693 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.883780 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884006 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884102 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884320 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884407 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884636 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884731 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.884967 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.885074 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.885288 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.885374 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.885596 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.885721 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.885923 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886018 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886239 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886326 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886562 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886647 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886882 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.886969 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.887217 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.887306 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.887539 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.887624 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.887857 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.887945 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.888166 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.888260 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.888484 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.888579 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.888795 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.888881 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.889108 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.889195 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.889425 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.889520 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.889741 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.889829 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.890070 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.890164 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.890398 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.890497 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.890721 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.890808 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.891047 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.891157 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.891416 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.891512 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.891731 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.891833 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.892047 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.892133 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.892359 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.892457 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.892605 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:00:36.892693 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.893000 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.893309 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:00:36.893555 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:00:36.917252 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_db.sqlalchemy.engines [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:36.918648 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_db.sqlalchemy.engines [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:36.982156 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.context [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=103596) load_cells /opt/stack/nova/nova/context.py:464}} May 10 02:00:36.982556 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.context [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=103595) load_cells /opt/stack/nova/nova/context.py:464}} May 10 02:00:36.986477 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_concurrency.lockutils [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:00:36.986862 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:00:36.988091 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_concurrency.lockutils [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:00:36.988481 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:00:36.988884 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_concurrency.lockutils [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:00:36.989292 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:00:36.990853 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_concurrency.lockutils [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103596) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:00:36.991292 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:00:37.002037 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_db.sqlalchemy.engines [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:37.006243 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_db.sqlalchemy.engines [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:37.010249 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_db.sqlalchemy.engines [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:37.143916 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_db.sqlalchemy.engines [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:37.165817 n-d-841089-2 devstack@n-api.service[103596]: DEBUG oslo_db.sqlalchemy.engines [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:37.171795 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_db.sqlalchemy.engines [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:00:37.503137 n-d-841089-2 devstack@n-api.service[103595]: WARNING keystonemiddleware.auth_token [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:00:37.506252 n-d-841089-2 devstack@n-api.service[103596]: WARNING keystonemiddleware.auth_token [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:00:37.510899 n-d-841089-2 devstack@n-api.service[103595]: WARNING keystonemiddleware.auth_token [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:00:37.513573 n-d-841089-2 devstack@n-api.service[103596]: WARNING keystonemiddleware.auth_token [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:00:37.854778 n-d-841089-2 devstack@n-api.service[103595]: WARNING keystonemiddleware.auth_token [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:00:37.860937 n-d-841089-2 devstack@n-api.service[103595]: WARNING keystonemiddleware.auth_token [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:00:37.861679 n-d-841089-2 devstack@n-api.service[103596]: WARNING keystonemiddleware.auth_token [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:00:37.867220 n-d-841089-2 devstack@n-api.service[103595]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653d5cd89c0 pid: 103595 (default app) May 10 02:00:37.869025 n-d-841089-2 devstack@n-api.service[103596]: WARNING keystonemiddleware.auth_token [None req-a075dab2-73c2-44c2-90ed-114fd23c0894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:00:37.869273 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:00:37.870451 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 May 10 02:00:37.870858 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue May 10 02:00:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:00:37.875600 n-d-841089-2 devstack@n-api.service[103596]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653d5cd89c0 pid: 103596 (default app) May 10 02:01:55.713824 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:01:55.714819 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 10 02:01:55.715474 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:01:56.155257 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-66f9cc3d-ed49-4d65-a640-43218262c111 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:01:56.187787 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-66f9cc3d-ed49-4d65-a640-43218262c111 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465409 May 10 02:01:56.192535 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:01:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:01:58.493418 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:01:58.494651 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-46ffdb88-593e-44c6-abb0-8d77db5f86bb None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 May 10 02:01:58.495316 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:01:58.556617 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-14c165be-c7e7-4d12-9ada-1bfd04f35ca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:01:58.575837 n-d-841089-2 devstack@n-api.service[103596]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:01:58.575837 n-d-841089-2 devstack@n-api.service[103596]: warnings.warn(msg) May 10 02:01:58.604432 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-14c165be-c7e7-4d12-9ada-1bfd04f35ca9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103184 May 10 02:01:58.605256 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:01:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:01:58.835401 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-62672bfe-c1cb-4422-9dff-01cc0279ee70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:01:58.837852 n-d-841089-2 devstack@n-api.service[103595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:01:58.837852 n-d-841089-2 devstack@n-api.service[103595]: warnings.warn(msg) May 10 02:01:58.886255 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-62672bfe-c1cb-4422-9dff-01cc0279ee70 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.273165 May 10 02:01:58.887033 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Tue May 10 02:01:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:02:01.158333 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-14c165be-c7e7-4d12-9ada-1bfd04f35ca9 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:01.159924 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-14c165be-c7e7-4d12-9ada-1bfd04f35ca9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 10 02:02:01.160486 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:01.269694 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-b07e8afb-0bc7-4ea5-bb23-22f33ae46b44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:01.288341 n-d-841089-2 devstack@n-api.service[103595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:02:01.288341 n-d-841089-2 devstack@n-api.service[103595]: warnings.warn(msg) May 10 02:02:01.305693 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-b07e8afb-0bc7-4ea5-bb23-22f33ae46b44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139244 May 10 02:02:01.313019 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:01.318862 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-fcea4c2a-adec-4ac3-8db3-d1c2694147a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:01.320435 n-d-841089-2 devstack@n-api.service[103596]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:02:01.320435 n-d-841089-2 devstack@n-api.service[103596]: warnings.warn(msg) May 10 02:02:01.352089 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-fcea4c2a-adec-4ac3-8db3-d1c2694147a0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037113 May 10 02:02:01.352676 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Tue May 10 02:02:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:02:03.664537 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-b07e8afb-0bc7-4ea5-bb23-22f33ae46b44 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:03.665544 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-b07e8afb-0bc7-4ea5-bb23-22f33ae46b44 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 10 02:02:03.665946 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:03.743840 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-22e8bde8-b634-48f8-beb1-9c2bdec6a461 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "swap": 0, "ram": 1024}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:03.780998 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-22e8bde8-b634-48f8-beb1-9c2bdec6a461 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107295 May 10 02:02:03.782191 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:03.795343 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-a27b70d4-43bb-40e0-a004-f6dbf543fe0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:03.826130 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-a27b70d4-43bb-40e0-a004-f6dbf543fe0f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034789 May 10 02:02:03.831395 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Tue May 10 02:02:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:02:06.283356 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-22e8bde8-b634-48f8-beb1-9c2bdec6a461 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:06.285186 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-22e8bde8-b634-48f8-beb1-9c2bdec6a461 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002348 May 10 02:02:06.286057 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:06.347750 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-529b19dc-79b9-4a0c-94f4-3c8598c3dd6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:06.371180 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-529b19dc-79b9-4a0c-94f4-3c8598c3dd6b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079055 May 10 02:02:06.379668 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:02:06.385770 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-e4695d19-7076-44aa-906f-ad429b3aef1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:06.413845 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-e4695d19-7076-44aa-906f-ad429b3aef1f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031683 May 10 02:02:06.414870 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Tue May 10 02:02:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:02:08.825655 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-529b19dc-79b9-4a0c-94f4-3c8598c3dd6b admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:08.826662 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-529b19dc-79b9-4a0c-94f4-3c8598c3dd6b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 10 02:02:08.827339 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:08.887931 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-c92e9bb3-827e-42a2-96d7-572f94fb2588 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:08.908082 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-c92e9bb3-827e-42a2-96d7-572f94fb2588 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073726 May 10 02:02:08.910082 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:08.921741 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-610147b8-35e2-47f9-aafd-efd221a73cf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:08.945637 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-610147b8-35e2-47f9-aafd-efd221a73cf2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027809 May 10 02:02:08.947122 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Tue May 10 02:02:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:02:11.239564 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-c92e9bb3-827e-42a2-96d7-572f94fb2588 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:11.240654 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-c92e9bb3-827e-42a2-96d7-572f94fb2588 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004192 May 10 02:02:11.241062 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:11.308516 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-dcc91839-0815-4706-bd25-27919a02395a admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:11.368283 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-dcc91839-0815-4706-bd25-27919a02395a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.120859 May 10 02:02:11.369066 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:02:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:02:13.743218 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-c92e9bb3-827e-42a2-96d7-572f94fb2588 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:13.744799 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-c92e9bb3-827e-42a2-96d7-572f94fb2588 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 May 10 02:02:13.755416 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:13 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:13.806295 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-861b69c6-8912-4a2c-b3d0-afee49719db8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "disk": 1, "name": "m1.tiny", "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:13.829740 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-861b69c6-8912-4a2c-b3d0-afee49719db8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078354 May 10 02:02:13.831721 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:13.842852 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-3bd0fff3-8185-4054-ba8b-f7b49190f560 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:13.869353 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-3bd0fff3-8185-4054-ba8b-f7b49190f560 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030086 May 10 02:02:13.870698 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Tue May 10 02:02:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:02:16.203646 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-861b69c6-8912-4a2c-b3d0-afee49719db8 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:16.204657 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-861b69c6-8912-4a2c-b3d0-afee49719db8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 10 02:02:16.205363 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:16.290397 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-9e6966a0-f4e2-417a-bbc8-c1cd846ea71a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:16.316952 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-9e6966a0-f4e2-417a-bbc8-c1cd846ea71a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.103780 May 10 02:02:16.327344 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:16.331932 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-c034b3c4-3133-4b90-a3d4-02a26b220347 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:16.359267 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-c034b3c4-3133-4b90-a3d4-02a26b220347 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031072 May 10 02:02:16.375359 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Tue May 10 02:02:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:02:18.661740 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-9e6966a0-f4e2-417a-bbc8-c1cd846ea71a admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:18.662716 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-9e6966a0-f4e2-417a-bbc8-c1cd846ea71a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 10 02:02:18.663187 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:18.746136 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-7bad1ac7-7e6f-465d-81f0-0030a77288a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "id": "3"}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:18.770877 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-7bad1ac7-7e6f-465d-81f0-0030a77288a1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.101471 May 10 02:02:18.771809 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:18.786029 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-2b64875d-2d83-4dc0-8ae1-1cdda28803d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:18.809026 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-2b64875d-2d83-4dc0-8ae1-1cdda28803d3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026808 May 10 02:02:18.809711 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Tue May 10 02:02:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:02:21.239940 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-7bad1ac7-7e6f-465d-81f0-0030a77288a1 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:21.240944 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-7bad1ac7-7e6f-465d-81f0-0030a77288a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 10 02:02:21.241355 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:02:21.298530 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-52c3a02e-997b-4d79-bbd2-69a30f0738eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:21.316818 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-52c3a02e-997b-4d79-bbd2-69a30f0738eb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069672 May 10 02:02:21.317375 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:02:21.329532 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-31c582ea-8893-4ced-a487-cf7406d9ad9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:21.354535 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-31c582ea-8893-4ced-a487-cf7406d9ad9e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028585 May 10 02:02:21.355146 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Tue May 10 02:02:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:02:23.746086 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-52c3a02e-997b-4d79-bbd2-69a30f0738eb admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:23.747296 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-52c3a02e-997b-4d79-bbd2-69a30f0738eb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 May 10 02:02:23.747720 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:23.805452 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-084138ca-22b8-40bc-8806-7a8da4adfc77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:23.823276 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-084138ca-22b8-40bc-8806-7a8da4adfc77 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.069605 May 10 02:02:23.823833 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Tue May 10 02:02:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:23.835933 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-48d7a6dd-474b-4dd2-b4b4-7b62c46fb3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:23.857650 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-48d7a6dd-474b-4dd2-b4b4-7b62c46fb3d4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025362 May 10 02:02:23.858228 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Tue May 10 02:02:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:02:51.380957 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-084138ca-22b8-40bc-8806-7a8da4adfc77 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:51.381954 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-084138ca-22b8-40bc-8806-7a8da4adfc77 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 10 02:02:51.382356 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:02:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:51.437958 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-9f2ec82c-0a49-48f7-bb02-40ea48441198 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:51.455953 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-9f2ec82c-0a49-48f7-bb02-40ea48441198 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067462 May 10 02:02:51.456481 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:02:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:02:52.447370 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-084138ca-22b8-40bc-8806-7a8da4adfc77 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:52.448383 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-084138ca-22b8-40bc-8806-7a8da4adfc77 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 10 02:02:52.448802 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:52.652385 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-d62ab8dc-8af7-46d3-8e8f-d1da34e28abb admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:52.657996 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.wsgi [None req-d62ab8dc-8af7-46d3-8e8f-d1da34e28abb admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-d62ab8dc-8af7-46d3-8e8f-d1da34e28abb admin admin] Request method failure captured: May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Accept: application/json May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Accept-Encoding: gzip, deflate May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Connection: keep-alive May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Content-Length: 0 May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Host: 10.222.0.52 May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Openstack-Api-Version: compute 2.90 May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: Openstack-System-Scope: None May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: User-Agent: python-novaclient May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Auth-Token: gAAAAABiecfMZEZK8HgmZIh6EDk400l9g2YgDcwPaG5keY6MuFxOgNLp_H59HMglLkNVBkYrPqM8dGKHq3-rNN-uD_bWpXUKANklQKmsLwllNLJ0oyjVLzreELrTUIt7F1WYJ7w32Xk-TK-o30mHLUpqmqMQZjGAHx_rkldKi1_BYDwAzJ3xqZg May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Domain-Id: None May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Domain-Name: None May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Identity-Status: Confirmed May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Is-Admin-Project: True May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Openstack-Nova-Api-Version: 2.90 May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Domain-Id: default May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Domain-Name: Default May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Name: admin May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Role: member,admin,reader May 10 02:02:52.661912 n-d-841089-2 devstack@n-api.service[103596]: X-Roles: member,admin,reader May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6487944c35ca49cba6de133bfd07d5d4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant: admin May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant-Name: admin May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-User: admin May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-User-Domain-Id: default May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-User-Domain-Name: Default May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-User-Id: 4061b62a65004c63aa782dcafd12b735 May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: X-User-Name: admin May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: method: > May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: exception: Flavor 42 could not be found. May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: action_args: {'id': '42'} May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:02:52.663622 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:52.664682 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:52.666131 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-d62ab8dc-8af7-46d3-8e8f-d1da34e28abb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:02:52.667457 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-d62ab8dc-8af7-46d3-8e8f-d1da34e28abb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062897 May 10 02:02:52.667457 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:02:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 02:02:52.673021 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-40db725e-2462-4334-905b-d5ea2dd1eb12 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:52.693020 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-40db725e-2462-4334-905b-d5ea2dd1eb12 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023481 May 10 02:02:52.693561 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:02:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:02:52.709665 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-600bbe5d-bec9-4186-8796-04c96ba445cb admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:52.730879 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-600bbe5d-bec9-4186-8796-04c96ba445cb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025292 May 10 02:02:52.731450 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:02:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:02:52.740645 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-0f69ddd0-6dfe-43aa-bb07-084d73727137 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:52.746078 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.wsgi [None req-0f69ddd0-6dfe-43aa-bb07-084d73727137 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-0f69ddd0-6dfe-43aa-bb07-084d73727137 admin admin] Request method failure captured: May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Accept: application/json May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Accept-Encoding: gzip, deflate May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Connection: keep-alive May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Content-Length: 0 May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Host: 10.222.0.52 May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Openstack-Api-Version: compute 2.90 May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: Openstack-System-Scope: None May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: User-Agent: python-novaclient May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Auth-Token: gAAAAABiecfMZEZK8HgmZIh6EDk400l9g2YgDcwPaG5keY6MuFxOgNLp_H59HMglLkNVBkYrPqM8dGKHq3-rNN-uD_bWpXUKANklQKmsLwllNLJ0oyjVLzreELrTUIt7F1WYJ7w32Xk-TK-o30mHLUpqmqMQZjGAHx_rkldKi1_BYDwAzJ3xqZg May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Domain-Id: None May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Domain-Name: None May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Identity-Status: Confirmed May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Is-Admin-Project: True May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Openstack-Nova-Api-Version: 2.90 May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Domain-Id: default May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Domain-Name: Default May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Name: admin May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Role: member,admin,reader May 10 02:02:52.749301 n-d-841089-2 devstack@n-api.service[103595]: X-Roles: member,admin,reader May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6487944c35ca49cba6de133bfd07d5d4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant: admin May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant-Name: admin May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-User: admin May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Domain-Id: default May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Domain-Name: Default May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Id: 4061b62a65004c63aa782dcafd12b735 May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Name: admin May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: method: > May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: exception: Flavor 42 could not be found. May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: action_args: {'id': '42'} May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:02:52.750890 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:52.752077 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:52.753393 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-0f69ddd0-6dfe-43aa-bb07-084d73727137 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:02:52.754660 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-0f69ddd0-6dfe-43aa-bb07-084d73727137 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013516 May 10 02:02:52.754660 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:02:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 02:02:53.645031 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-600bbe5d-bec9-4186-8796-04c96ba445cb admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:53.646067 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-600bbe5d-bec9-4186-8796-04c96ba445cb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 10 02:02:53.646459 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:53.835223 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-cfdadc2b-20cf-4b28-ab16-70962a642fc8 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:53.840435 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.wsgi [None req-cfdadc2b-20cf-4b28-ab16-70962a642fc8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-cfdadc2b-20cf-4b28-ab16-70962a642fc8 admin admin] Request method failure captured: May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Accept: application/json May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Accept-Encoding: gzip, deflate May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Connection: keep-alive May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Content-Length: 0 May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Host: 10.222.0.52 May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Openstack-Api-Version: compute 2.90 May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: Openstack-System-Scope: None May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: User-Agent: python-novaclient May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Auth-Token: gAAAAABiecfNjrrrMAFaUk78Cz3JwNJkcwCAytKzsCfmPEfr0RL-aUVdxXooCJiu07zTuqJ6H6psOBNsdcVsi-uyyJi1F5VEA59FJptZBPuDrHEponPhTYDFGVn8RZUwhl4dp5ylH2UgukYXwEZGDP5QTYqHqnPopIds9zXoq7RIV0zNYuM_Fgg May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Domain-Id: None May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Domain-Name: None May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Identity-Status: Confirmed May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Is-Admin-Project: True May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Openstack-Nova-Api-Version: 2.90 May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Domain-Id: default May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Domain-Name: Default May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Name: admin May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Role: member,admin,reader May 10 02:02:53.841952 n-d-841089-2 devstack@n-api.service[103595]: X-Roles: member,admin,reader May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6487944c35ca49cba6de133bfd07d5d4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant: admin May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant-Name: admin May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-User: admin May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-User-Domain-Id: default May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-User-Domain-Name: Default May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-User-Id: 4061b62a65004c63aa782dcafd12b735 May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: X-User-Name: admin May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: method: > May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: exception: Flavor 84 could not be found. May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: action_args: {'id': '84'} May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:02:53.843365 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:53.844263 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:53.845590 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-cfdadc2b-20cf-4b28-ab16-70962a642fc8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:02:53.847520 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-cfdadc2b-20cf-4b28-ab16-70962a642fc8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058959 May 10 02:02:53.847520 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:02:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 02:02:53.853471 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-e9718c85-3c26-4afe-8d2b-e4f1da4478f1 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:53.867388 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-e9718c85-3c26-4afe-8d2b-e4f1da4478f1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017343 May 10 02:02:53.867854 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:02:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:02:53.876772 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-dfd90ef3-f4e5-4cf0-97f0-6a75662dc7f7 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:53.889914 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-dfd90ef3-f4e5-4cf0-97f0-6a75662dc7f7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016529 May 10 02:02:53.890429 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:02:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:02:53.899036 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-b6159dc2-a4a8-4f0b-ac93-9d858d98a9d2 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:53.904329 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.wsgi [None req-b6159dc2-a4a8-4f0b-ac93-9d858d98a9d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-b6159dc2-a4a8-4f0b-ac93-9d858d98a9d2 admin admin] Request method failure captured: May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Accept: application/json May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Accept-Encoding: gzip, deflate May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Connection: keep-alive May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Content-Length: 0 May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Host: 10.222.0.52 May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Openstack-Api-Version: compute 2.90 May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: Openstack-System-Scope: None May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: User-Agent: python-novaclient May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Auth-Token: gAAAAABiecfNjrrrMAFaUk78Cz3JwNJkcwCAytKzsCfmPEfr0RL-aUVdxXooCJiu07zTuqJ6H6psOBNsdcVsi-uyyJi1F5VEA59FJptZBPuDrHEponPhTYDFGVn8RZUwhl4dp5ylH2UgukYXwEZGDP5QTYqHqnPopIds9zXoq7RIV0zNYuM_Fgg May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Domain-Id: None May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Domain-Name: None May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Identity-Status: Confirmed May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Is-Admin-Project: True May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Openstack-Nova-Api-Version: 2.90 May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Domain-Id: default May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Domain-Name: Default May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Name: admin May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Role: member,admin,reader May 10 02:02:53.905803 n-d-841089-2 devstack@n-api.service[103596]: X-Roles: member,admin,reader May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6487944c35ca49cba6de133bfd07d5d4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant: admin May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant-Name: admin May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-User: admin May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-User-Domain-Id: default May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-User-Domain-Name: Default May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-User-Id: 4061b62a65004c63aa782dcafd12b735 May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: X-User-Name: admin May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: method: > May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: exception: Flavor 84 could not be found. May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: action_args: {'id': '84'} May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:02:53.907367 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:53.908329 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:53.910092 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-b6159dc2-a4a8-4f0b-ac93-9d858d98a9d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:02:53.911396 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-b6159dc2-a4a8-4f0b-ac93-9d858d98a9d2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011412 May 10 02:02:53.911396 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:02:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 02:02:54.792417 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-dfd90ef3-f4e5-4cf0-97f0-6a75662dc7f7 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:54.793407 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-dfd90ef3-f4e5-4cf0-97f0-6a75662dc7f7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 10 02:02:54.793803 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:54.984987 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-faf6af5e-31bb-4cfb-bab7-0a8e0ddbcd04 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:54.990591 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.wsgi [None req-faf6af5e-31bb-4cfb-bab7-0a8e0ddbcd04 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-faf6af5e-31bb-4cfb-bab7-0a8e0ddbcd04 admin admin] Request method failure captured: May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Accept: application/json May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Accept-Encoding: gzip, deflate May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Connection: keep-alive May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Content-Length: 0 May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Host: 10.222.0.52 May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Openstack-Api-Version: compute 2.90 May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: Openstack-System-Scope: None May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: User-Agent: python-novaclient May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Auth-Token: gAAAAABiecfODEv4f6JQ4fJ_2UngCdQgkjBy8GZJFmy6xqeVPmCmTDPHL20kQgh2FVVfEdRgAXbPvRhYl_ZuqM3x_ucPiirarDeX2DaeKgRWbWnOWQLkznDaSf8wNo37UhHK9EZUSiS6_gCjGkk_ClN4ZwZlsw6oZ6OcyqSCBzWZuHvk2B9-NYc May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Domain-Id: None May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Domain-Name: None May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Identity-Status: Confirmed May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Is-Admin-Project: True May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Openstack-Nova-Api-Version: 2.90 May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Domain-Id: default May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Domain-Name: Default May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Project-Name: admin May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Role: member,admin,reader May 10 02:02:54.992128 n-d-841089-2 devstack@n-api.service[103596]: X-Roles: member,admin,reader May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6487944c35ca49cba6de133bfd07d5d4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant: admin May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-Tenant-Name: admin May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-User: admin May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-User-Domain-Id: default May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-User-Domain-Name: Default May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-User-Id: 4061b62a65004c63aa782dcafd12b735 May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: X-User-Name: admin May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: method: > May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: exception: Flavor 451 could not be found. May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: action_args: {'id': '451'} May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:02:54.993703 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:54.994617 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: ERROR nova.api.openstack.wsgi May 10 02:02:54.995891 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-faf6af5e-31bb-4cfb-bab7-0a8e0ddbcd04 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:02:54.997290 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-faf6af5e-31bb-4cfb-bab7-0a8e0ddbcd04 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059059 May 10 02:02:54.997290 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:02:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 02:02:55.003156 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-3f7d7b2a-33b7-483c-9bd5-9d2c654e40bf admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:55.019004 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-3f7d7b2a-33b7-483c-9bd5-9d2c654e40bf admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018833 May 10 02:02:55.019565 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:02:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:02:55.029294 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:55.043322 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017809 May 10 02:02:55.043867 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:02:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:02:55.053455 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-0e550616-2fd2-4030-bb3f-0d415f25a859 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:55.058909 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.wsgi [None req-0e550616-2fd2-4030-bb3f-0d415f25a859 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-0e550616-2fd2-4030-bb3f-0d415f25a859 admin admin] Request method failure captured: May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Accept: application/json May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Accept-Encoding: gzip, deflate May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Connection: keep-alive May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Content-Length: 0 May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Host: 10.222.0.52 May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Openstack-Api-Version: compute 2.90 May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: Openstack-System-Scope: None May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: User-Agent: python-novaclient May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Auth-Token: gAAAAABiecfODEv4f6JQ4fJ_2UngCdQgkjBy8GZJFmy6xqeVPmCmTDPHL20kQgh2FVVfEdRgAXbPvRhYl_ZuqM3x_ucPiirarDeX2DaeKgRWbWnOWQLkznDaSf8wNo37UhHK9EZUSiS6_gCjGkk_ClN4ZwZlsw6oZ6OcyqSCBzWZuHvk2B9-NYc May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Domain-Id: None May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Domain-Name: None May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Identity-Status: Confirmed May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Is-Admin-Project: True May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Openstack-Nova-Api-Version: 2.90 May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Domain-Id: default May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Domain-Name: Default May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Project-Name: admin May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Role: member,admin,reader May 10 02:02:55.060370 n-d-841089-2 devstack@n-api.service[103595]: X-Roles: member,admin,reader May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6487944c35ca49cba6de133bfd07d5d4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6487944c35ca49cba6de133bfd07d5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant: admin May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant-Id: 6487944c35ca49cba6de133bfd07d5d4 May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-Tenant-Name: admin May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-User: admin May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Domain-Id: default May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Domain-Name: Default May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Id: 4061b62a65004c63aa782dcafd12b735 May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: X-User-Name: admin May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: method: > May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: exception: Flavor 451 could not be found. May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: action_args: {'id': '451'} May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:02:55.061890 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:55.062823 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: ERROR nova.api.openstack.wsgi May 10 02:02:55.064371 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-0e550616-2fd2-4030-bb3f-0d415f25a859 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:02:55.065601 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-0e550616-2fd2-4030-bb3f-0d415f25a859 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011883 May 10 02:02:55.065601 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:02:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 02:02:55.954052 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:55.955090 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 May 10 02:02:55.955481 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:56.141525 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-b1ed5eff-3432-4472-a9c4-3de39420c76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:56.159817 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-b1ed5eff-3432-4472-a9c4-3de39420c76b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067963 May 10 02:02:56.160360 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue May 10 02:02:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:57.053945 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:57.054942 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 10 02:02:57.055366 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:57.243868 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-1b932d1b-5a5c-48e5-93e7-38954efd50f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:57.260727 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-1b932d1b-5a5c-48e5-93e7-38954efd50f7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066564 May 10 02:02:57.261251 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue May 10 02:02:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:58.151410 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:58.152777 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 May 10 02:02:58.153492 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:58.344966 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-f335e097-1c7c-4da1-83ed-27e1c90660cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:58.361710 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-f335e097-1c7c-4da1-83ed-27e1c90660cf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067209 May 10 02:02:58.362207 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue May 10 02:02:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:02:59.252377 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:02:59.253903 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 May 10 02:02:59.254299 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:02:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:02:59.440180 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-c5d6f606-2c8e-458a-811d-397a2d180d1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:02:59.457442 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-c5d6f606-2c8e-458a-811d-397a2d180d1b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067730 May 10 02:02:59.457968 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue May 10 02:02:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:03:00.348715 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:03:00.349707 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 May 10 02:03:00.350101 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:03:00.542680 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-7c0c329f-564a-4c5d-b0f2-4f6dc9aaa7c4 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:03:00.562028 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-7c0c329f-564a-4c5d-b0f2-4f6dc9aaa7c4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075377 May 10 02:03:00.562506 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue May 10 02:03:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:04:02.513272 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:04:02.514272 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-efe9165c-1b67-46e5-b685-b9d28bd474b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 10 02:04:02.514674 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Tue May 10 02:04:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:04:02.573451 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-fc12f551-27c4-42ac-93ea-5ea81e551146 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:04:02.592864 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-fc12f551-27c4-42ac-93ea-5ea81e551146 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071229 May 10 02:04:02.593411 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:04:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:04:02.615848 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-d834e3d2-278a-42c8-910d-3b32b01a3784 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:04:02.624240 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-d834e3d2-278a-42c8-910d-3b32b01a3784 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012707 May 10 02:04:02.624801 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Tue May 10 02:04:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:04:02.637116 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-88cd33da-111f-4e2e-9980-924ca02124b0 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:04:02.645649 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-88cd33da-111f-4e2e-9980-924ca02124b0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012235 May 10 02:04:02.646208 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Tue May 10 02:04:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:04:02.657988 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-f59854f1-da92-4f51-97ab-5d1304fe2c50 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:04:02.666900 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-f59854f1-da92-4f51-97ab-5d1304fe2c50 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012552 May 10 02:04:02.667454 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Tue May 10 02:04:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:04:02.682083 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-ba1f2559-d67a-4a90-9597-5aeac9097f63 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:04:02.691178 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-ba1f2559-d67a-4a90-9597-5aeac9097f63 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012128 May 10 02:04:02.703190 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Tue May 10 02:04:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:09:28.139368 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-f59854f1-da92-4f51-97ab-5d1304fe2c50 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:09:28.140371 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-f59854f1-da92-4f51-97ab-5d1304fe2c50 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 10 02:09:28.140769 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:09:28.405308 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-81a69f3c-6648-4aa6-a1ad-b247ef549ba9 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:09:28.406756 n-d-841089-2 devstack@n-api.service[103595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:09:28.406756 n-d-841089-2 devstack@n-api.service[103595]: warnings.warn(msg) May 10 02:09:28.407997 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-81a69f3c-6648-4aa6-a1ad-b247ef549ba9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:09:28.408431 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-81a69f3c-6648-4aa6-a1ad-b247ef549ba9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:09:28.409207 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-81a69f3c-6648-4aa6-a1ad-b247ef549ba9 admin admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:09:28.409625 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-81a69f3c-6648-4aa6-a1ad-b247ef549ba9 admin admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:09:28.448831 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-81a69f3c-6648-4aa6-a1ad-b247ef549ba9 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.151785 May 10 02:09:28.449375 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:09:28 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:09:29.331757 n-d-841089-2 devstack@n-api.service[103596]: DEBUG nova.api.openstack.wsgi [None req-f59854f1-da92-4f51-97ab-5d1304fe2c50 admin admin] Calling method '>' {{(pid=103596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:09:29.332755 n-d-841089-2 devstack@n-api.service[103596]: INFO nova.api.openstack.requestlog [None req-f59854f1-da92-4f51-97ab-5d1304fe2c50 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 10 02:09:29.333153 n-d-841089-2 devstack@n-api.service[103596]: [pid: 103596|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue May 10 02:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:09:29.526135 n-d-841089-2 devstack@n-api.service[103595]: DEBUG nova.api.openstack.wsgi [None req-5af705fa-14b2-4841-aebe-5090af08efe3 admin admin] Calling method '>' {{(pid=103595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:09:29.527325 n-d-841089-2 devstack@n-api.service[103595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:09:29.527325 n-d-841089-2 devstack@n-api.service[103595]: warnings.warn(msg) May 10 02:09:29.528501 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-5af705fa-14b2-4841-aebe-5090af08efe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:09:29.529047 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-5af705fa-14b2-4841-aebe-5090af08efe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:09:29.529823 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-5af705fa-14b2-4841-aebe-5090af08efe3 admin admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:09:29.530242 n-d-841089-2 devstack@n-api.service[103595]: DEBUG oslo_concurrency.lockutils [None req-5af705fa-14b2-4841-aebe-5090af08efe3 admin admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:09:29.553728 n-d-841089-2 devstack@n-api.service[103595]: INFO nova.api.openstack.requestlog [None req-5af705fa-14b2-4841-aebe-5090af08efe3 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.079007 May 10 02:09:29.554274 n-d-841089-2 devstack@n-api.service[103595]: [pid: 103595|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:09:29 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:10:18.064866 n-d-841089-2 systemd[1]: Stopping Devstack devstack@n-api.service... May 10 02:10:18.065725 n-d-841089-2 devstack@n-api.service[103594]: Tue May 10 02:10:18 2022 - graceful shutdown triggered... May 10 02:10:18.066229 n-d-841089-2 devstack@n-api.service[103595]: Gracefully killing worker 1 (pid: 103595)... May 10 02:10:18.066896 n-d-841089-2 devstack@n-api.service[103596]: Gracefully killing worker 2 (pid: 103596)... May 10 02:10:19.066854 n-d-841089-2 devstack@n-api.service[103594]: worker 1 buried after 1 seconds May 10 02:10:19.067355 n-d-841089-2 devstack@n-api.service[103594]: worker 2 buried after 1 seconds May 10 02:10:19.067355 n-d-841089-2 devstack@n-api.service[103594]: goodbye to uWSGI. May 10 02:10:19.068491 n-d-841089-2 systemd[1]: devstack@n-api.service: Succeeded. May 10 02:10:19.069055 n-d-841089-2 systemd[1]: Stopped Devstack devstack@n-api.service. May 10 02:10:19.072484 n-d-841089-2 systemd[1]: Starting Devstack devstack@n-api.service... May 10 02:10:19.088304 n-d-841089-2 devstack@n-api.service[118700]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 02:10:19 2022] *** May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: nodename: n-d-841089-2 May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: machine: x86_64 May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: clock source: unix May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: pcre jit disabled May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: detected number of CPU cores: 4 May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: current working directory: / May 10 02:10:19.102619 n-d-841089-2 devstack@n-api.service[118700]: detected binary path: /usr/bin/uwsgi-core May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: your processes number limit is 47680 May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: your memory page size is 4096 bytes May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: detected max file descriptor number: 2048 May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: lock engine: pthread robust mutexes May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: thunder lock: enabled May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 02:10:19.103535 n-d-841089-2 devstack@n-api.service[118700]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 02:10:19.149851 n-d-841089-2 devstack@n-api.service[118700]: Python main interpreter initialized at 0x55c2189cf9c0 May 10 02:10:19.149851 n-d-841089-2 devstack@n-api.service[118700]: python threads support enabled May 10 02:10:19.149851 n-d-841089-2 devstack@n-api.service[118700]: your server socket listen backlog is limited to 100 connections May 10 02:10:19.149851 n-d-841089-2 devstack@n-api.service[118700]: your mercy for graceful operations on workers is 90 seconds May 10 02:10:19.150306 n-d-841089-2 devstack@n-api.service[118700]: mapped 403077 bytes (393 KB) for 2 cores May 10 02:10:19.150306 n-d-841089-2 devstack@n-api.service[118700]: *** Operational MODE: preforking *** May 10 02:10:19.150553 n-d-841089-2 devstack@n-api.service[118700]: *** uWSGI is running in multiple interpreter mode *** May 10 02:10:19.150553 n-d-841089-2 devstack@n-api.service[118700]: spawned uWSGI master process (pid: 118700) May 10 02:10:19.150772 n-d-841089-2 systemd[1]: Started Devstack devstack@n-api.service. May 10 02:10:19.152113 n-d-841089-2 devstack@n-api.service[118700]: spawned uWSGI worker 1 (pid: 118716, cores: 1) May 10 02:10:19.152504 n-d-841089-2 devstack@n-api.service[118700]: spawned uWSGI worker 2 (pid: 118717, cores: 1) May 10 02:10:19.152756 n-d-841089-2 devstack@n-api.service[118700]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 02:10:20.359260 n-d-841089-2 devstack@n-api.service[118717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 02:10:20.366758 n-d-841089-2 devstack@n-api.service[118716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 02:10:21.165491 n-d-841089-2 devstack@n-api.service[118717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:10:21.165491 n-d-841089-2 devstack@n-api.service[118717]: from cryptography.utils import int_from_bytes May 10 02:10:21.165827 n-d-841089-2 devstack@n-api.service[118717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:10:21.165827 n-d-841089-2 devstack@n-api.service[118717]: from cryptography.utils import int_from_bytes May 10 02:10:21.183670 n-d-841089-2 devstack@n-api.service[118716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:10:21.183670 n-d-841089-2 devstack@n-api.service[118716]: from cryptography.utils import int_from_bytes May 10 02:10:21.184074 n-d-841089-2 devstack@n-api.service[118716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 02:10:21.184074 n-d-841089-2 devstack@n-api.service[118716]: from cryptography.utils import int_from_bytes May 10 02:10:23.584963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:10:23.585385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:10:23.585757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:10:23.586127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:10:23.586934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:10:23.587354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.587692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.588023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.588351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.588691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.589014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.589346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.589677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.590015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.590286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.590613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.590946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-841089-2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.591319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.591643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.591963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.592294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.592608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.592940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.593257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.593770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.594227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.594549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.594899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.595246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.595573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.595893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.596222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.596542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.596876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.597198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.597604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-841089-2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.597933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.598256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.598583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.599011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.599365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.599690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.600022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.600355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.600675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.601014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.601344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.601677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.602567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.602895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.603239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.603560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.603892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.604207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.604522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.604784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.605102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.605432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.605762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.606093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.606355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.606616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.606945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.607299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.607620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.607940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.608256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.608574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.608891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.609207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.609526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.609848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.610169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.610496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.610829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.611171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.611507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.611915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.612178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.612496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.612852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.613182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.613500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.613830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.614161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.614478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.614795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.615140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.615473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.615812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.616129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.616390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.616703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.617017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.617347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.617690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.618006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.618324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.618635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.618952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.619295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.619611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.619927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.620243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.620558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.620874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.621190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.621510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.621838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.622166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.622483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.622800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.626939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 02:10:23.627361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.627449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 02:10:23.627531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.627531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.627678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 02:10:23.628134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 02:10:23.628333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 02:10:23.628529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.628890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.629870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.630996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.631230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.631329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-841089-2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.631557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.631667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.631874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.631969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.632196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.632297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.632531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.632648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.632853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.632957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.633309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.633498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.633594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.633695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.633877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.634052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.634220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.634380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.634551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.634697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.634877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.637930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.638101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.638241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.638389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.638522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.638659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.638789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.638917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.639055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.639223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.639365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.639503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.639632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.639768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.639911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.640048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.640177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-841089-2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.640305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.640441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.640607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.640930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.641505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.641596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.641689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.641689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.641861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.641956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.642047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.642132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.642218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.642317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.642411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.642505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.642600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.642600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.642773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.642773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.642948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.643032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.643148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.643234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.643336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.643483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.643615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.643712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.643796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.643887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.643983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.643983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.644143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.644234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.644318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.644409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.644502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.644595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.644696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.644781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.644871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.644984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.645125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.645223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.645308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.645450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.645545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.645644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.645786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.645881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.645967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.646105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.646245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.646345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.646437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.646522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.646671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.646765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.646997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.647128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.647347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.647440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.647667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.647764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.647983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.648082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.648298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.648396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.648612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.648704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.649438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.649541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.649761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.649860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.650075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.650183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.650404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.650496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.650724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.650830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.651177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.651310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.651410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.651505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.651705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.651806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.652033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.652136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.652355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.652448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.652675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.652768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.652993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.653103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.653315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.653414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.653636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.653738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.653951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.654054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.654268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.654362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.654588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.654678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.654903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.655006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.655265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.655359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.655855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.655968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.656095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.656189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.656413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.656515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.656733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.656825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.657065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.657164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.657387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.657495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.657705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.657807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.658024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.658133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.658339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.658431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.658657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.658748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.658975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.659133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.659322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.659427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.659644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.659737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.659966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.660104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.660286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.660386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.660607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.660700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.660917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.661161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.661258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.661343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.661533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.661636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.661850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.661943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.662163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.662327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.662479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.662571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.662787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.662879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.663120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.663229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.663438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.663540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.663750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.663855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.664062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.664164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.664394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.664526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.665247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.665339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.665563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.665663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.665887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.666039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.666189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.666290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.666505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.666599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.666836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.666930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.667184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.667290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.667508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.667608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.667839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.667931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.668161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.668252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.668482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.668616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.668800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.668940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.669117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.669218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.669430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.669522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.669749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.669840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.670061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.670210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.670380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.670472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.670692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.670791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.671017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.671291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.671387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.671479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.671685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.671785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.672005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.672171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.672326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.672425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.672636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.672738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 02:10:23.672963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.673064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.673315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.673410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.673658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.673805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.673984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.674077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.674311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.674458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.674633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.674732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.674955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.675056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.675302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.675408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.675625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.675724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.675944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.676995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.677232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.677332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.677552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.677654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.677884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.677976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.678204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.678305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.678532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.678636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.678840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.678941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.679187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.679295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.679519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.679620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.679854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.679952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.680200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.680302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.680523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.680647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.680855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.680956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.681175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.681420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.681528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.681621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.681798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.681901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.682117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.682209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.682431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.682535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.682750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.682849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.683109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.683205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.683417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.683519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.683736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.683882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.684048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.684156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.684372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.684465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.684689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.684789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.685958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.686059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.686276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.686409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.686606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.686699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.686934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.687137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.687285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.687384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.687601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.687701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.687927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.688026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.688254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.688347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.688581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.688680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.688900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.689954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.690173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.690273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.690495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.690596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.690826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.690920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.691167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.691265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.691495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.691599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.691815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.691917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.692136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.692234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.692462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.692563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.692781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.692882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.693096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.693188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.693413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.693518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.693734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.693833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.694054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.694182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.694374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.694494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.694699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.694810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.695013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.695163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.695358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.695472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.695697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.695800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.696977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.697229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.697335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.697570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.697671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.697895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.697989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.698223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.698333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.698550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.698652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.698877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.698972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.699239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.699348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.699559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.699659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.699899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.700942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.701175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.701283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.701497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.701599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.701833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.701933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.702105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.702215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.702413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.702535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.702729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.702830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.703037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.703154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.703377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.703492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.703690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.703793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.704948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.705981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.706199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.706295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.706511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.706614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.706828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.706993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.707206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.707311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.707508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.707603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.707858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.707972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.708198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.708356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.708515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.708667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.708809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.708958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.709138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.709289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.709462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.709606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.709756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.709908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.710055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.710196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.710367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.710518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.710704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.710854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.711017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.711136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.711924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.712976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.713168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.713277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.713481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.713583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.713801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.713902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.714113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.714216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.714441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.714604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.714750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.714903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.715089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.715185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.715380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.715483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.715700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.715792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.716957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.717996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.718217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.718318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.718535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.718637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.718853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.718945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.719189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.719296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.719522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.719630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.719841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.719942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.720155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.720255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.720468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.720573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.720791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.720897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.721101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.721194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.721414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.721519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.721729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.721820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.722992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.723123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.723333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.723433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.723648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.723748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.723957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.724051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.724480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.724718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.724863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.725928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.726901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.727816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.728017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.728112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.728383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.728484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.728698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.728832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.729987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.730088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.730310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.730412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.730658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.730771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.730944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.731040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.731289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.731386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.731611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.731706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.731920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.732978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.733205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.733313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.733527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.733620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.733852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.733946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.734184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.734288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.734497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.734599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.734821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.734989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.735154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.735264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.735467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.735561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.735783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.735877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.736102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.736204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.736421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.736679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.736788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.737982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.738101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.738300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.738400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.738618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.738720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.738932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.739039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.739292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.739394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.739613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.739758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.739924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.740018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.740242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.740336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.740558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.740651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.740873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.741946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.742160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.742439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.743025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.743139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.743393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.743487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.743715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.743818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.744991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.745087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.745309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.745410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.745645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.745748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.745967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.746061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.746287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.746380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.746605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.746706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.746919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.747033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.747279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.747868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.748912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.749139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.749239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.749552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.749645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.749873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.749973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.750186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.750292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.750500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.750615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.750825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.750926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.751180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.751381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.751545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.751697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.751852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.751992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.752137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.752310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.752532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.752686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.752832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.752984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.753135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.753287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.753428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.753572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.753714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.753855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.754031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.754170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.754313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.754454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.754613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.754756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.755997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.756138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.756287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.756434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.756592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.756736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.756893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.757976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.758117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.758355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.758499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.758726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.758878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.759060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.759230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.759401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.759546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.759735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.759873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.760051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.760195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.760373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.760523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.760694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.760844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.761947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.762129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.762279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.762530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.762760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.762932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.763994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.764174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.764354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.764504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.764655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.764804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.764976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.765128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.765221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.765387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.765514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.765740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.765843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.766052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.766155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.766383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.766486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.766720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.766815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.767051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.767177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.767395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.767535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.767733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.767841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.768064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.768158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.768390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.768486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.768719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.768828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.769987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.770089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.770298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.770391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.770608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.770724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.770924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.771992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.772202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.772315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.772535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.772754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.772898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.773041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.773213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.773364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.773515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.773660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.774299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.774441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.774580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.774691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.774893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.774989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.775276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.775374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.775594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.775690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.775912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.776987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.777199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.777293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.777521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.777624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.777846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.777941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.778166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.778260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.778488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.778637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.778811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.778921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.779146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.779258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.779477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.779572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.779797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.779898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.780115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.780233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.780448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.780863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.781010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.781184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.781335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.781502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.781654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.781864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.782061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.782217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.782390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.782557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.782800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.783985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.784127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.784277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.784453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.784598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.784698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.784785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.785943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.786102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.786259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.786408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.786551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.786691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.786867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.787021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.787228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.787375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.787545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.787642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.787862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.788952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.789140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.789291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.789521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.790164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.790348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.790508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.790669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.790810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.790980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.791171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.791332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.791505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.791672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.791824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.791966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.792151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.792294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.792488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.792642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.792810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.792977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.793285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.793451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.793605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.793746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.793886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.794980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.795159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.795339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.795447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.795674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.795779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.796977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.797072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.797314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.797415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.797629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.797738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.797947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.798107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.798263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.798407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.798557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.798705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.798885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.799944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.800176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.800278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.800496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.800600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.800829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.801040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.801134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.801400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.801503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.801732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.801839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.802059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.802171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.802392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.802494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.802706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.802802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.803024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.803207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.803381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.803494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.803710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.803812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.804982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.805100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.805323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.805446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.805641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.805787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.805957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.806051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.806270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.806378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.806592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.806697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.806906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.807008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.807270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.807380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.807585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.807690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.807900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.808983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.809164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.809260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.809477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.809579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.809788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.809883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.810108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.810226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.810425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.810596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.810747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.810908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.811099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.811194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.811380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.811544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.811706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.811895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.812940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.813991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.814139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.814281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.814433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.814581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.814753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.814904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.815130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.815244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.815451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.815556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.815801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.816019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.816136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.816360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.816470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.816690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.816786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.817030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.817133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.817370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.817475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.817686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.817783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.818971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.819178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.819355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.819546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.819724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.819872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.820958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.821108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.821253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.821480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.821798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.822117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.822434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.822758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.824228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.824228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.824567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.824722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.824876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.825874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.826935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.827218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.827329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.827562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.827671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.827903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.828986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.829216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.829335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.829539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.829659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.829868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.829960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.830189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.830302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.830526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.830635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.830872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.830985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.831234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.831346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.831572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.831667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.831885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.831980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.832201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.832309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.832514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.832654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.832832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.832935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.833160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.833301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.833486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.833632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.833799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.833909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.834109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.834211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.834428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.834530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.834742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.834846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.835055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.835235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.835388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.835485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.835701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.835810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.836016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.836115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.836857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.836962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.837173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.837283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.837486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.837587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.837798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.837893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.838108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.838411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.838514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.838724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.838819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.839036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.839170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.839374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.839476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.839690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.839794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.840997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.841103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.841321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.841417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.841643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.841795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.841960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.842062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.842274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.842373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.842594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.842732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.842920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.843014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.843263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.843411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.843592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.843730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.843912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.844007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.844250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.844461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.844565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.844822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.844919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.845153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.845249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.845486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.845592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.845807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.845903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.846126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.846230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.846444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.846546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.846781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.846876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.847109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.847219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.847430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.847533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.847760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.847855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.848086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.848215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.848407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.848540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.848725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.848848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.849049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.849172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.849371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.849500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.849685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.849805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.850959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.851146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.851310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.851441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.851630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.851751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.852956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.853061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.853275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.853387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.853603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.853731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.853921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.854995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.855228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.855388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:10:23.855552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.855922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.856261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.856583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.856902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.857233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.857560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.857896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.858223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.858549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.858921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.859283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.859836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.860182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.860520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.860872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.861273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.861529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.861875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.862254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.862605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.862830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.863183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.863576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.863834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.864156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.864483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.864808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.865132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.865456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.865781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.866104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.866431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.866759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.867133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.867472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.868324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.868660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.868992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.869326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.869652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.869976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.870300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.870629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.870973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.871330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.871649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.872088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.872419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.872753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.873089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.873413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.873750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.874086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.874409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.875015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.875198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.875803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.875803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.876091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.876494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.876776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.877076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.877395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.877724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.878063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.878389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.878707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.879031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.879381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.879699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.880018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.880257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:23.880369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.880679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.880948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.881263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.881579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.881897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.882227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.882533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.882852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.883248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.883571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.883893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.884212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.884530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.884846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.885192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.885540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.885870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.886208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.886532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.886868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.887215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.887554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.887888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.888222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.888546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.888891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.889222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.889548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.889874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.890197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.890522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.890846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.891204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.892107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.892107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.892373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.892515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.892848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.893151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.893473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.893817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.894203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.894469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.897963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.898737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.898737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.898737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.898737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.898737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.899712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.899935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.900253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 02:10:23.900511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 02:10:23.923944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_db.sqlalchemy.engines [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:23.947572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.context [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=118717) load_cells /opt/stack/nova/nova/context.py:464}} May 10 02:10:23.951991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:10:23.953596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:10:23.954414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:10:23.956387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:10:23.970328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:23.971707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:23.989463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.context [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=118716) load_cells /opt/stack/nova/nova/context.py:464}} May 10 02:10:23.993961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:10:23.995611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:10:23.996446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:10:23.998402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:10:24.011982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_db.sqlalchemy.engines [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:24.013237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_db.sqlalchemy.engines [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:24.133821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:24.176097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_db.sqlalchemy.engines [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 02:10:24.454149 n-d-841089-2 devstack@n-api.service[118717]: WARNING keystonemiddleware.auth_token [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:10:24.461783 n-d-841089-2 devstack@n-api.service[118717]: WARNING keystonemiddleware.auth_token [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:10:24.497363 n-d-841089-2 devstack@n-api.service[118716]: WARNING keystonemiddleware.auth_token [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:10:24.505423 n-d-841089-2 devstack@n-api.service[118716]: WARNING keystonemiddleware.auth_token [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:10:24.804746 n-d-841089-2 devstack@n-api.service[118717]: WARNING keystonemiddleware.auth_token [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:10:24.811613 n-d-841089-2 devstack@n-api.service[118717]: WARNING keystonemiddleware.auth_token [None req-b5f57f90-69bf-45f1-b0f1-723edf459330 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:10:24.816800 n-d-841089-2 devstack@n-api.service[118717]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c2189cf9c0 pid: 118717 (default app) May 10 02:10:24.849523 n-d-841089-2 devstack@n-api.service[118716]: WARNING keystonemiddleware.auth_token [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 02:10:24.856333 n-d-841089-2 devstack@n-api.service[118716]: WARNING keystonemiddleware.auth_token [None req-af5ca9f0-1f5e-4b5f-a59d-31036b03519e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 02:10:24.861711 n-d-841089-2 devstack@n-api.service[118716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c2189cf9c0 pid: 118716 (default app) May 10 02:11:12.042793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Calling method '.version_select at 0x7f3d45c09280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:12.045136 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:12.045136 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:12.051174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=118717) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 10 02:11:12.052014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.052452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.079932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.080837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.107357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.108529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.123047 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd77cf00-3925-4c11-b39a-7749d2115d1b tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.784428 May 10 02:11:12.125294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1207 bytes} [Tue May 10 02:11:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:12.476515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-127e7c47-f378-4b08-af75-097e66906824 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:12.478172 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:12.478172 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:12.479635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-127e7c47-f378-4b08-af75-097e66906824 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.480356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-127e7c47-f378-4b08-af75-097e66906824 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.481456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-127e7c47-f378-4b08-af75-097e66906824 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.482086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-127e7c47-f378-4b08-af75-097e66906824 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.531550 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-127e7c47-f378-4b08-af75-097e66906824 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.403180 May 10 02:11:12.538410 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2/2] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:11:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:12.677766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '.version_select at 0x7f3d45a8cee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:12.678137 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:12.678137 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:12.679963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.680647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.705419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.706108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.717243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:12.717748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:12.724100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50ee444f-f61f-4c45-a13d-7aac277f7899 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.190152 May 10 02:11:12.724885 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3/3] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:11:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:12.729619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7b3a7ad-822f-45be-af86-88315cc83609 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1534602758"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:12.747422 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:12.747422 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:12.748435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-c7b3a7ad-822f-45be-af86-88315cc83609 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Generated uuid f80ede34-4d72-4cd0-9c64-f6186f445c14 for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:12.788382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72a03fc3-6c62-4478-973a-800a9fbaf48d tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1906555354", "ram": 512, "vcpus": 1, "disk": 10, "id": 60018875, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:12.808133 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:12.808133 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:12.840619 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72a03fc3-6c62-4478-973a-800a9fbaf48d tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 1.437022 May 10 02:11:12.842412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1/4] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:11 2022] POST /compute/v2.1/flavors => generated 410 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:11:12.857459 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7b3a7ad-822f-45be-af86-88315cc83609 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.131686 May 10 02:11:12.858676 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 4/5] 10.222.0.52 () {62 vars in 1204 bytes} [Tue May 10 02:11:12 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:12.929522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af4fd1dc-f251-4284-99b1-9bce0fc24fd3 tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-432543485", "id": 1675635194, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:12.931580 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:12.931580 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:12.989266 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af4fd1dc-f251-4284-99b1-9bce0fc24fd3 tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.129159 May 10 02:11:12.992490 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 5/6] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:11:12 2022] POST /compute/v2.1/flavors => generated 448 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.039211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7004f23-ee44-43e5-af3d-c483b0389dd9 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1801756476", "id": 1510703580, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.076944 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7004f23-ee44-43e5-af3d-c483b0389dd9 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.233264 May 10 02:11:13.077652 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2/7] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:11:12 2022] POST /compute/v2.1/flavors => generated 468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.085859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a731049-e8b5-4f4a-bbfa-4dd3b438f7ae tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-504416217"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.184127 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.184127 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:13.243001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03fae137-e867-47ae-a24c-fe4567ebee27 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.282452 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-03fae137-e867-47ae-a24c-fe4567ebee27 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] HTTP exception thrown: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03fae137-e867-47ae-a24c-fe4567ebee27 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Request method failure captured: May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/flavors/60018875/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm8aSQSdG7zvEQ0LDUdiqZ435AMiU9Cihh4kWwYmhMGw-bVe14GD67hiaWkTE3-CYAg0FcwU-UxYXC-_vguZMT4vEFLao0jSVVhdVcvU7txin9YWvhtWIJv94tQCOClGdYeLCnt3iSf1kIsCNy6OtPm-7j6V4LWIZ0Mn18aXtjZwQs May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:11:13.285648 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b531f3aa97742c99d82a9a8ff1e3902", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b6b0cbf2e89249a390c3710aeedc7ff8 May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:13.286789 n-d-841089-2 devstack@n-api.service[118717]: exception: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'flavor_id': '60018875', 'id': 'hw:cpu_thread_policy'} May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:13.287468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03fae137-e867-47ae-a24c-fe4567ebee27 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Returning 404 to user: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-03fae137-e867-47ae-a24c-fe4567ebee27 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] 10.222.0.52 "GET /compute/v2.1/flavors/60018875/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.292247 May 10 02:11:13.289356 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 6/8] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:11:12 2022] GET /compute/v2.1/flavors/60018875/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:13.324335 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a731049-e8b5-4f4a-bbfa-4dd3b438f7ae tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.245431 May 10 02:11:13.325722 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3/9] 10.222.0.52 () {62 vars in 1209 bytes} [Tue May 10 02:11:13 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.556168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f941a968-03cc-483e-a9b9-ca56d72d6b5b tempest-FlavorsV255TestJSON-992742468 tempest-FlavorsV255TestJSON-992742468-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.573992 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f941a968-03cc-483e-a9b9-ca56d72d6b5b tempest-FlavorsV255TestJSON-992742468 tempest-FlavorsV255TestJSON-992742468-project] 10.222.0.52 "GET /compute/v2.1/flavors/1675635194" status: 200 len: 448 microversion: 2.55 time: 0.283532 May 10 02:11:13.574688 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 7/10] 10.222.0.52 () {60 vars in 1198 bytes} [Tue May 10 02:11:13 2022] GET /compute/v2.1/flavors/1675635194 => generated 448 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.588869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbe47381-cae3-421d-9ded-141dafebacef tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.590498 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.590498 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:13.591410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbe47381-cae3-421d-9ded-141dafebacef tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b6b0cbf2e89249a390c3710aeedc7ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b531f3aa97742c99d82a9a8ff1e3902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbe47381-cae3-421d-9ded-141dafebacef tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Request method failure captured: May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/flavors/60018875/os-extra_specs HTTP/1.1 May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 66 May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm8aSQSdG7zvEQ0LDUdiqZ435AMiU9Cihh4kWwYmhMGw-bVe14GD67hiaWkTE3-CYAg0FcwU-UxYXC-_vguZMT4vEFLao0jSVVhdVcvU7txin9YWvhtWIJv94tQCOClGdYeLCnt3iSf1kIsCNy6OtPm-7j6V4LWIZ0Mn18aXtjZwQs May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:11:13.593933 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b531f3aa97742c99d82a9a8ff1e3902", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b6b0cbf2e89249a390c3710aeedc7ff8 May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 10 02:11:13.595227 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'flavor_id': '60018875', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:13.595825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 10 02:11:13.596794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:13.607761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbe47381-cae3-421d-9ded-141dafebacef tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:13.612198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbe47381-cae3-421d-9ded-141dafebacef tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] 10.222.0.52 "POST /compute/v2.1/flavors/60018875/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.033163 May 10 02:11:13.613550 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 8/11] 10.222.0.52 () {60 vars in 1217 bytes} [Tue May 10 02:11:13 2022] POST /compute/v2.1/flavors/60018875/os-extra_specs => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:13.623206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e06e1bb3-add3-4710-962c-7a39cacd3835 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.627010 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.627010 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:13.663610 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e06e1bb3-add3-4710-962c-7a39cacd3835 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.048717 May 10 02:11:13.677449 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 9/12] 10.222.0.52 () {60 vars in 1189 bytes} [Tue May 10 02:11:13 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.686780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7f863393-0b9c-4b98-9c5d-d3e794511a86 tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] Action: 'update', calling method: .version_select at 0x7f3d45fcb1f0>, body: {"flavor": {"description": "new"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.705480 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.705480 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:13.723251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e1d4aff-349e-4617-a322-d3781ebc5812 tempest-FlavorsV261TestJSON-672239161 tempest-FlavorsV261TestJSON-672239161-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.749388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e1d4aff-349e-4617-a322-d3781ebc5812 tempest-FlavorsV261TestJSON-672239161 tempest-FlavorsV261TestJSON-672239161-project] 10.222.0.52 "GET /compute/v2.1/flavors/1510703580" status: 200 len: 468 microversion: 2.61 time: 0.421473 May 10 02:11:13.750574 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 4/13] 10.222.0.52 () {60 vars in 1198 bytes} [Tue May 10 02:11:13 2022] GET /compute/v2.1/flavors/1510703580 => generated 468 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.755416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3e7949b-4215-4c5d-b692-7d5cf3981b3b tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.758281 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.758281 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:13.780638 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7f863393-0b9c-4b98-9c5d-d3e794511a86 tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1675635194" status: 200 len: 449 microversion: 2.55 time: 0.100937 May 10 02:11:13.781252 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 10/14] 10.222.0.52 () {62 vars in 1218 bytes} [Tue May 10 02:11:13 2022] PUT /compute/v2.1/flavors/1675635194 => generated 449 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.789253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3b747232-9ab7-4932-af73-010211d63aff tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.793575 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.793575 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:13.805658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b747232-9ab7-4932-af73-010211d63aff tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:13.807374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b747232-9ab7-4932-af73-010211d63aff tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:13.814522 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e3e7949b-4215-4c5d-b692-7d5cf3981b3b tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/60018875/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062449 May 10 02:11:13.815753 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 5/15] 10.222.0.52 () {60 vars in 1217 bytes} [Tue May 10 02:11:13 2022] POST /compute/v2.1/flavors/60018875/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:11:13.821440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-499615a3-1b53-4a90-82fe-c71d153b4a45 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] Action: 'update', calling method: .version_select at 0x7f3d45fc9f70>, body: {"flavor": {"description": "new"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:13.832236 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.832236 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:13.870060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-499615a3-1b53-4a90-82fe-c71d153b4a45 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1510703580" status: 200 len: 469 microversion: 2.61 time: 0.053062 May 10 02:11:13.871594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 6/16] 10.222.0.52 () {62 vars in 1218 bytes} [Tue May 10 02:11:13 2022] PUT /compute/v2.1/flavors/1510703580 => generated 469 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:13.876413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cf0010bb-1481-4e80-a702-cf8c85a796a6 tempest-FlavorsV255TestJSON-992742468 tempest-FlavorsV255TestJSON-992742468-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.914812 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cf0010bb-1481-4e80-a702-cf8c85a796a6 tempest-FlavorsV255TestJSON-992742468 tempest-FlavorsV255TestJSON-992742468-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6585 microversion: 2.55 time: 0.041917 May 10 02:11:13.929245 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 7/17] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:11:13 2022] GET /compute/v2.1/flavors/detail => generated 6585 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:13.936197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93da3700-4efa-435f-b3e8-d589be39be7c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.937570 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:13.937570 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:13.939102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-93da3700-4efa-435f-b3e8-d589be39be7c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b6b0cbf2e89249a390c3710aeedc7ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b531f3aa97742c99d82a9a8ff1e3902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93da3700-4efa-435f-b3e8-d589be39be7c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Request method failure captured: May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes HTTP/1.1 May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8aSQSdG7zvEQ0LDUdiqZ435AMiU9Cihh4kWwYmhMGw-bVe14GD67hiaWkTE3-CYAg0FcwU-UxYXC-_vguZMT4vEFLao0jSVVhdVcvU7txin9YWvhtWIJv94tQCOClGdYeLCnt3iSf1kIsCNy6OtPm-7j6V4LWIZ0Mn18aXtjZwQs May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:13.942413 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b531f3aa97742c99d82a9a8ff1e3902", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b6b0cbf2e89249a390c3710aeedc7ff8 May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:13.943504 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'flavor_id': '60018875', 'id': 'hw:numa_nodes'} May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:13.944088 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 10 02:11:13.945022 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:13.946719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93da3700-4efa-435f-b3e8-d589be39be7c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:13.947913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-93da3700-4efa-435f-b3e8-d589be39be7c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] 10.222.0.52 "DELETE /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017434 May 10 02:11:13.949328 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 8/18] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:11:13 2022] DELETE /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:13.954412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19ca1d53-eb90-4d1e-8f45-eaab9f35f0bc tempest-FlavorsV261TestJSON-672239161 tempest-FlavorsV261TestJSON-672239161-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:13.982383 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19ca1d53-eb90-4d1e-8f45-eaab9f35f0bc tempest-FlavorsV261TestJSON-672239161 tempest-FlavorsV261TestJSON-672239161-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 7195 microversion: 2.61 time: 0.031548 May 10 02:11:13.983767 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 9/19] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:11:13 2022] GET /compute/v2.1/flavors/detail => generated 7195 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:13.988789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-778f09be-3ac7-48c7-8f15-955bd63b7244 tempest-FlavorsV255TestJSON-992742468 tempest-FlavorsV255TestJSON-992742468-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.014670 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-778f09be-3ac7-48c7-8f15-955bd63b7244 tempest-FlavorsV255TestJSON-992742468 tempest-FlavorsV255TestJSON-992742468-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3672 microversion: 2.55 time: 0.029552 May 10 02:11:14.025293 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1165 bytes} [Tue May 10 02:11:13 2022] GET /compute/v2.1/flavors => generated 3672 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:14.032496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a0baf56f-33f6-4c7b-b02b-a3f07503bcd4 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.056364 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a0baf56f-33f6-4c7b-b02b-a3f07503bcd4 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/60018875/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029536 May 10 02:11:14.057573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 11/21] 10.222.0.52 () {60 vars in 1217 bytes} [Tue May 10 02:11:14 2022] POST /compute/v2.1/flavors/60018875/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:11:14.063154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-762c5d09-7c0e-4768-9a7d-d7ee0a9e02a5 tempest-FlavorsV261TestJSON-672239161 tempest-FlavorsV261TestJSON-672239161-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.085564 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-762c5d09-7c0e-4768-9a7d-d7ee0a9e02a5 tempest-FlavorsV261TestJSON-672239161 tempest-FlavorsV261TestJSON-672239161-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3672 microversion: 2.61 time: 0.026655 May 10 02:11:14.086993 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 12/22] 10.222.0.52 () {60 vars in 1165 bytes} [Tue May 10 02:11:14 2022] GET /compute/v2.1/flavors => generated 3672 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:14.091899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88c69c57-72ba-41d1-bb9e-acd749b7701a tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.093033 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.093033 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:14.125654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88c69c57-72ba-41d1-bb9e-acd749b7701a tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1675635194" status: 202 len: 0 microversion: 2.55 time: 0.037115 May 10 02:11:14.129423 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 13/23] 10.222.0.52 () {60 vars in 1201 bytes} [Tue May 10 02:11:14 2022] DELETE /compute/v2.1/flavors/1675635194 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:11:14.135491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f309333-c129-4686-8081-ce9917ddba3c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.140934 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.140934 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:14.142344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f309333-c129-4686-8081-ce9917ddba3c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b6b0cbf2e89249a390c3710aeedc7ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b531f3aa97742c99d82a9a8ff1e3902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f309333-c129-4686-8081-ce9917ddba3c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Request method failure captured: May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes HTTP/1.1 May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 22 May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8aSQSdG7zvEQ0LDUdiqZ435AMiU9Cihh4kWwYmhMGw-bVe14GD67hiaWkTE3-CYAg0FcwU-UxYXC-_vguZMT4vEFLao0jSVVhdVcvU7txin9YWvhtWIJv94tQCOClGdYeLCnt3iSf1kIsCNy6OtPm-7j6V4LWIZ0Mn18aXtjZwQs May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:14.144816 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b531f3aa97742c99d82a9a8ff1e3902", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b531f3aa97742c99d82a9a8ff1e3902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1b531f3aa97742c99d82a9a8ff1e3902 May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b6b0cbf2e89249a390c3710aeedc7ff8 May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: {"hw:numa_nodes": "1"} May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:14.146091 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'flavor_id': '60018875', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:14.146973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 10 02:11:14.148200 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.150544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f309333-c129-4686-8081-ce9917ddba3c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:14.151732 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4f309333-c129-4686-8081-ce9917ddba3c tempest-FlavorsExtraSpecsNegativeTestJSON-199118396 tempest-FlavorsExtraSpecsNegativeTestJSON-199118396-project] 10.222.0.52 "PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024154 May 10 02:11:14.152753 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 14/24] 10.222.0.52 () {60 vars in 1258 bytes} [Tue May 10 02:11:14 2022] PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:14.158204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-479a70c1-a1f4-4faf-b8bf-d742bef9b537 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.182424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-479a70c1-a1f4-4faf-b8bf-d742bef9b537 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1510703580" status: 202 len: 0 microversion: 2.61 time: 0.028029 May 10 02:11:14.184029 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 15/25] 10.222.0.52 () {60 vars in 1201 bytes} [Tue May 10 02:11:14 2022] DELETE /compute/v2.1/flavors/1510703580 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:11:14.196347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b6f7f477-081a-457e-9101-67a6d90fadf4 tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.253652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b6f7f477-081a-457e-9101-67a6d90fadf4 tempest-FlavorsV255TestJSON-1402154068 tempest-FlavorsV255TestJSON-1402154068-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5706 microversion: 2.55 time: 0.066074 May 10 02:11:14.255131 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 16/26] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:11:14 2022] GET /compute/v2.1/flavors/detail => generated 5706 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:14.260000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b244865f-466d-4a3c-b133-597f561bc7c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.270792 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b244865f-466d-4a3c-b133-597f561bc7c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] HTTP exception thrown: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b244865f-466d-4a3c-b133-597f561bc7c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Request method failure captured: May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/flavors/60018875/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_S2svFlOFK_K4UZ0t0jAQPbLI5UBbl1tkHHsUd1KXfOQHE24JUpfDxesaTXZb8f1MsUhDc177RO7QqVFAVV0T4eAZC6Tv76KbGmulwskHJqe1VMQpApodsR4bRxTQHDv310sTJKkVCNi8RUD3xxHBtmN22qDZ6liF2KcxC6j-ZZA May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: eaad6e1457d84aaa8b74f0d58cd7cbb9 May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:14.272553 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eaad6e1457d84aaa8b74f0d58cd7cbb9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: eaad6e1457d84aaa8b74f0d58cd7cbb9 May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f044452d1cf24f02aa53d34baba3ab7f May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:14.273764 n-d-841089-2 devstack@n-api.service[118716]: exception: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'flavor_id': '60018875', 'id': 'hw:cpu_thread_policy'} May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:14.274349 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b244865f-466d-4a3c-b133-597f561bc7c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Returning 404 to user: Flavor 60018875 has no extra specs with key hw:cpu_thread_policy. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b244865f-466d-4a3c-b133-597f561bc7c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/60018875/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.017879 May 10 02:11:14.275577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 17/27] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:11:14 2022] DELETE /compute/v2.1/flavors/60018875/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:14.286488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d82ca347-01aa-45b7-96fb-a2b2a8af92d7 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.359809 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d82ca347-01aa-45b7-96fb-a2b2a8af92d7 tempest-FlavorsV261TestJSON-747567262 tempest-FlavorsV261TestJSON-747567262-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6278 microversion: 2.61 time: 0.084180 May 10 02:11:14.361159 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 18/28] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:11:14 2022] GET /compute/v2.1/flavors/detail => generated 6278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:14.384059 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3b747232-9ab7-4932-af73-010211d63aff tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.601425 May 10 02:11:14.387549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adc4fbb1-4220-4166-b69f-af253f8f1e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.389309 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 11/29] 10.222.0.52 () {62 vars in 1231 bytes} [Tue May 10 02:11:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-adc4fbb1-4220-4166-b69f-af253f8f1e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] HTTP exception thrown: Request body and URI mismatch May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adc4fbb1-4220-4166-b69f-af253f8f1e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Request method failure captured: May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes HTTP/1.1 May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 27 May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_S2svFlOFK_K4UZ0t0jAQPbLI5UBbl1tkHHsUd1KXfOQHE24JUpfDxesaTXZb8f1MsUhDc177RO7QqVFAVV0T4eAZC6Tv76KbGmulwskHJqe1VMQpApodsR4bRxTQHDv310sTJKkVCNi8RUD3xxHBtmN22qDZ6liF2KcxC6j-ZZA May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: eaad6e1457d84aaa8b74f0d58cd7cbb9 May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:14.394894 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eaad6e1457d84aaa8b74f0d58cd7cbb9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: eaad6e1457d84aaa8b74f0d58cd7cbb9 May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f044452d1cf24f02aa53d34baba3ab7f May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: {"hw:cpu_policy": "shared"} May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:14.396048 n-d-841089-2 devstack@n-api.service[118716]: exception: Request body and URI mismatch May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'flavor_id': '60018875', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.396736 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.397713 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:14.397713 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:14.397713 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 10 02:11:14.397713 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.397713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adc4fbb1-4220-4166-b69f-af253f8f1e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:14.397713 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-adc4fbb1-4220-4166-b69f-af253f8f1e78 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.033567 May 10 02:11:14.398627 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 19/30] 10.222.0.52 () {60 vars in 1258 bytes} [Tue May 10 02:11:14 2022] PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes => generated 73 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:11:14.406544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a653e907-dfbc-4081-9249-cc71cde76e31 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.407870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a356abdc-b8c2-488e-92d8-944249894a26 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.411029 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.411029 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a356abdc-b8c2-488e-92d8-944249894a26 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Request method failure captured: May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes HTTP/1.1 May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 49 May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_S2svFlOFK_K4UZ0t0jAQPbLI5UBbl1tkHHsUd1KXfOQHE24JUpfDxesaTXZb8f1MsUhDc177RO7QqVFAVV0T4eAZC6Tv76KbGmulwskHJqe1VMQpApodsR4bRxTQHDv310sTJKkVCNi8RUD3xxHBtmN22qDZ6liF2KcxC6j-ZZA May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: eaad6e1457d84aaa8b74f0d58cd7cbb9 May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:14.425627 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eaad6e1457d84aaa8b74f0d58cd7cbb9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eaad6e1457d84aaa8b74f0d58cd7cbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: eaad6e1457d84aaa8b74f0d58cd7cbb9 May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f044452d1cf24f02aa53d34baba3ab7f May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 10 02:11:14.426990 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'flavor_id': '60018875', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': ['string', May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'number']}}, May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance: May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 10 02:11:14.428018 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.429749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a356abdc-b8c2-488e-92d8-944249894a26 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a356abdc-b8c2-488e-92d8-944249894a26 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.024101 May 10 02:11:14.430695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 20/31] 10.222.0.52 () {60 vars in 1258 bytes} [Tue May 10 02:11:14 2022] PUT /compute/v2.1/flavors/60018875/os-extra_specs/hw:numa_nodes => generated 117 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:11:14.438412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43d97949-6ca2-491f-8f6e-14037964ee3a tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.441416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a653e907-dfbc-4081-9249-cc71cde76e31 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:14.443625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a653e907-dfbc-4081-9249-cc71cde76e31 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:14.470787 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43d97949-6ca2-491f-8f6e-14037964ee3a tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/60018875" status: 202 len: 0 microversion: 2.1 time: 0.036813 May 10 02:11:14.471859 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 21/32] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:14 2022] DELETE /compute/v2.1/flavors/60018875 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:11:14.484318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-394f9ca9-a26d-49e8-84df-6aa5382fe69f tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.533069 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-394f9ca9-a26d-49e8-84df-6aa5382fe69f tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879 tempest-FlavorsExtraSpecsNegativeTestJSON-1524934879-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056273 May 10 02:11:14.538150 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 22/33] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:11:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:14.664162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a653e907-dfbc-4081-9249-cc71cde76e31 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.263888 May 10 02:11:14.664835 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 12/34] 10.222.0.52 () {62 vars in 1231 bytes} [Tue May 10 02:11:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:14.675251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a09cba1-76f8-4b96-a1d3-7f99f3f4c570 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.676025 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.676025 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:14.732973 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a09cba1-76f8-4b96-a1d3-7f99f3f4c570 tempest-AggregatesAdminTestV241-1849259680 tempest-AggregatesAdminTestV241-1849259680-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.061424 May 10 02:11:14.733576 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 23/35] 10.222.0.52 () {60 vars in 1192 bytes} [Tue May 10 02:11:14 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:14.795947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b45c304c-d630-459d-9d0d-e455592429db tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1953768618", "name": "tempest-test_aggregate-1933585986"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.816766 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.816766 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:14.817848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-b45c304c-d630-459d-9d0d-e455592429db tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 2feb27dd-09d3-4876-92cb-fe4c96ae34d5 for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:14.849704 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b45c304c-d630-459d-9d0d-e455592429db tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.057493 May 10 02:11:14.850705 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 13/36] 10.222.0.52 () {60 vars in 1164 bytes} [Tue May 10 02:11:14 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:14.860345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6035b8ee-4fc9-4ca6-9734-3f43b130b83d tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:14.861126 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.861126 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:14.877094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6035b8ee-4fc9-4ca6-9734-3f43b130b83d tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.020334 May 10 02:11:14.883833 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 24/37] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:11:14 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:14.888859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-954b26d8-ca36-474f-b5a5-b7533c411bd9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:14.890108 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:14.890108 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:14.899474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-954b26d8-ca36-474f-b5a5-b7533c411bd9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:14.900112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-954b26d8-ca36-474f-b5a5-b7533c411bd9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:15.062438 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-954b26d8-ca36-474f-b5a5-b7533c411bd9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.177316 May 10 02:11:15.063687 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 14/38] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:15.745370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-858583657", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "availability_zone": "tempest-test_az-1953768618"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:15.771703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:15.773334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:15.774855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:15.777568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:16.958134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:11:17.352753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ca319ea-602d-479e-b551-de4a6150b2bd tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:17.355223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ca319ea-602d-479e-b551-de4a6150b2bd tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:17.355869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ca319ea-602d-479e-b551-de4a6150b2bd tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:17.356898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ca319ea-602d-479e-b551-de4a6150b2bd tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:17.357357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ca319ea-602d-479e-b551-de4a6150b2bd tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:17.415236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:11:17.415764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:11:17.416356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:11:17.416990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:11:17.417795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:11:17.429343 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ca319ea-602d-479e-b551-de4a6150b2bd tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.936700 May 10 02:11:17.432544 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 15/39] 10.222.0.52 () {58 vars in 1163 bytes} [Tue May 10 02:11:16 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:17.446176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f638e665-92e4-4a5e-a1bf-635847236a62 tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:17.446981 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:17.446981 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:17.448451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:17.448790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f638e665-92e4-4a5e-a1bf-635847236a62 tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:17.449250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f638e665-92e4-4a5e-a1bf-635847236a62 tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:17.450066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f638e665-92e4-4a5e-a1bf-635847236a62 tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:17.450519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f638e665-92e4-4a5e-a1bf-635847236a62 tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:17.451244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:17.452186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:17.453913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:17.478784 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f638e665-92e4-4a5e-a1bf-635847236a62 tempest-AZAdminV2TestJSON-1931050616 tempest-AZAdminV2TestJSON-1931050616-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.037256 May 10 02:11:17.479774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 16/40] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 02:11:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:11:17.527043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Getting quotas for project da85f31817b74746a6b028011e177611. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:17.540377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Getting quotas for user 116885a9c674485f9354df010698aada and project da85f31817b74746a6b028011e177611. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:17.569252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:11:17.577763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:11:17.708567 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed7e9d98-8179-415f-a3de-db88cccbf666 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.310056 May 10 02:11:17.713197 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 25/41] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:11:17.720302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62ac20c5-d1fc-4f4c-a735-d5a1710e4e85 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:17.723318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62ac20c5-d1fc-4f4c-a735-d5a1710e4e85 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:19.539578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62ac20c5-d1fc-4f4c-a735-d5a1710e4e85 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:19.578006 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62ac20c5-d1fc-4f4c-a735-d5a1710e4e85 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1242 microversion: 2.1 time: 1.861927 May 10 02:11:19.581265 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 17/42] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:17 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1242 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:20.597374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:20.598575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:20.642772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:20.643315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:20.648341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:20.648817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:21.105442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:21.132386 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-87c875a1-9e1b-4c3c-96a0-9d23ffe6ed60 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1290 microversion: 2.1 time: 0.537353 May 10 02:11:21.133495 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 26/43] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:20 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1290 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:22.151508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:22.152280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:22.171616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:22.172405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:22.173393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:22.173979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:22.417228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:22.438181 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6bc1e6a5-9ff6-4bff-91f4-3f8dda5c2818 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1296 microversion: 2.1 time: 0.291153 May 10 02:11:22.449793 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 18/44] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:22 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1296 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:23.463109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:23.464098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:23.480641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:23.481786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:23.485023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:23.486358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:23.934044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:23.946991 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19947a79-20f9-4d2e-87bd-113d9cf83e96 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1296 microversion: 2.1 time: 0.486317 May 10 02:11:23.947959 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 27/45] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:23 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1296 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:24.965098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:24.965962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:24.978122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:24.979418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:24.980972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:24.982293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:25.579875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:25.588432 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.627291 May 10 02:11:25.604626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Calling method '.version_select at 0x7f3d44175f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:25.604626 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:25.604626 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:25.605694 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 19/46] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:24 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:25.610723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:25.612297 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5133e4dc-99b0-4f1a-bd54-638dcf9126c7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001835 May 10 02:11:25.619838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 20/47] 10.222.0.52 () {56 vars in 885 bytes} [Tue May 10 02:11:25 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 10 02:11:25.622718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=118716) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 10 02:11:25.625692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:25.627922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:25.720652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:25.721212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:25.759656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:25.760451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:25.774448 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02d81baa-e979-4320-acb2-e345eab3f9ed tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.735687 May 10 02:11:25.779232 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 28/48] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:11:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:25.790618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5cd64fd-77eb-4a2b-befc-37bf99ab7297 tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Calling method '.version_select at 0x7f3d440b7670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:25.791693 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:25.791693 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:25.793321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5cd64fd-77eb-4a2b-befc-37bf99ab7297 tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:25.793927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5cd64fd-77eb-4a2b-befc-37bf99ab7297 tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:25.861686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5cd64fd-77eb-4a2b-befc-37bf99ab7297 tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:25.862846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5cd64fd-77eb-4a2b-befc-37bf99ab7297 tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:25.884607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5cd64fd-77eb-4a2b-befc-37bf99ab7297 tempest-HypervisorAdminV228Test-1767632097 tempest-HypervisorAdminV228Test-1767632097-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.100340 May 10 02:11:25.899917 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 21/49] 10.222.0.52 () {60 vars in 1192 bytes} [Tue May 10 02:11:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:26.619710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:26.622567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:26.637147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:26.639860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:26.640947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:26.643466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:27.751270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1069527717", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:27.904054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:27.921063 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f331e457-6387-476e-a3bf-94629962114c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 1.311684 May 10 02:11:27.926492 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 29/50] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:26 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:27.935445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:11:28.753214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a47335b-ec43-4c64-a62a-b2e3fbfe9943 tempest-AZAdminNegativeTestJSON-116703126 tempest-AZAdminNegativeTestJSON-116703126-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:28.753986 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:28.753986 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:28.754842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a47335b-ec43-4c64-a62a-b2e3fbfe9943 tempest-AZAdminNegativeTestJSON-116703126 tempest-AZAdminNegativeTestJSON-116703126-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '58f3d8cd34e84b668c2e571c6fd40118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d71a49aafc24426a0ab8ad7aa3f2bad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a47335b-ec43-4c64-a62a-b2e3fbfe9943 tempest-AZAdminNegativeTestJSON-116703126 tempest-AZAdminNegativeTestJSON-116703126-project] Request method failure captured: May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnNa_mjBL8P8zp2LqVG0sKIAp6BEWDDSrv_WQrAgkvCUSk85mRwj4ZboLm-rC4CXv783zWhNgIWDVyGMp6vDYymBX8hM_mVQFAhoBdV78nfOWrOrPJjZbAgiPZbkcC4LLKt_lS-hUpICQcuiDGB8-AvxG1zk8VIEeszDnxEP144Jb8 May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 4d71a49aafc24426a0ab8ad7aa3f2bad May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AZAdminNegativeTestJSON-116703126 May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:28.756778 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d71a49aafc24426a0ab8ad7aa3f2bad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d71a49aafc24426a0ab8ad7aa3f2bad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d71a49aafc24426a0ab8ad7aa3f2bad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d71a49aafc24426a0ab8ad7aa3f2bad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AZAdminNegativeTestJSON-116703126 May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 4d71a49aafc24426a0ab8ad7aa3f2bad May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-116703126 May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AZAdminNegativeTestJSON-116703126-project May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 58f3d8cd34e84b668c2e571c6fd40118 May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AZAdminNegativeTestJSON-116703126-project May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 10 02:11:28.758095 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:28.758782 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:28.759792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a47335b-ec43-4c64-a62a-b2e3fbfe9943 tempest-AZAdminNegativeTestJSON-116703126 tempest-AZAdminNegativeTestJSON-116703126-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:28.760713 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a47335b-ec43-4c64-a62a-b2e3fbfe9943 tempest-AZAdminNegativeTestJSON-116703126 tempest-AZAdminNegativeTestJSON-116703126-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.347017 May 10 02:11:28.767720 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 30/51] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 02:11:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 357 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:28.944876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:28.945516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:28.968546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:28.972322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:28.975809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:28.980534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:29.381662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:11:29.382198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:11:29.383052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:11:29.383497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:11:29.383973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:11:29.421499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:29.421962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:29.422782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:29.423299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:29.512762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Getting quotas for project 7572edeebc3c46f1aba4159acf54e224. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:29.539725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Getting quotas for user cee51d8b18db4c649c37b04cbd9f9842 and project 7572edeebc3c46f1aba4159acf54e224. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:29.599798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:11:29.610310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:11:29.778684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:29.786819 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9858c865-c2fa-4d1b-aa31-851a6c3b59c0 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.846325 May 10 02:11:29.808006 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 31/52] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:28 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:11:29.836697 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08e2e1fc-14c2-48f9-ad41-b9b20c882588 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.886728 May 10 02:11:29.842318 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 22/53] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:11:29.853528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d9ae3e77-f1c3-4491-9e34-85bcaca85598 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:29.854566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d9ae3e77-f1c3-4491-9e34-85bcaca85598 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:29.979909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d9ae3e77-f1c3-4491-9e34-85bcaca85598 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:29.999648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d9ae3e77-f1c3-4491-9e34-85bcaca85598 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1220 microversion: 2.1 time: 0.150412 May 10 02:11:30.002998 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 32/54] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:29 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:30.812457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:30.813083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:30.821935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:30.824032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:30.826396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:30.827594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:31.027680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b02fdf5-79d0-4fed-80ce-0beabfef765c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:31.028320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b02fdf5-79d0-4fed-80ce-0beabfef765c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:31.581901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b02fdf5-79d0-4fed-80ce-0beabfef765c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:31.594617 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b02fdf5-79d0-4fed-80ce-0beabfef765c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1220 microversion: 2.1 time: 0.578262 May 10 02:11:31.607328 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 33/55] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:31 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1220 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:31.925095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:31.934891 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-718ba8ea-10c0-489e-8999-3b8fce2a00b6 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 1.126268 May 10 02:11:31.939053 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 23/56] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:30 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:32.024298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c976cd2d-4f08-4032-a068-51f89ec3c30f req-81cbb666-6129-4b18-81ef-e5104a394e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083a14a6-3029-46fc-88f7-8e0e51435a62", "tag": "da96a1a0-af3f-411b-afd6-323db0255db1"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:32.073918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c976cd2d-4f08-4032-a068-51f89ec3c30f req-81cbb666-6129-4b18-81ef-e5104a394e1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:32.076579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c976cd2d-4f08-4032-a068-51f89ec3c30f req-81cbb666-6129-4b18-81ef-e5104a394e1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:32.150951 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c976cd2d-4f08-4032-a068-51f89ec3c30f req-81cbb666-6129-4b18-81ef-e5104a394e1b service nova] Creating event network-changed:da96a1a0-af3f-411b-afd6-323db0255db1 for instance 083a14a6-3029-46fc-88f7-8e0e51435a62 on n-h1-841089-2 May 10 02:11:32.155905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c976cd2d-4f08-4032-a068-51f89ec3c30f req-81cbb666-6129-4b18-81ef-e5104a394e1b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:11:32.158792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:32.161594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:32.164473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:32.171775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:32.218598 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.compute.rpcapi [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 02:11:32.222804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] Releasing lock "compute-rpcapi-router" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:11:32.266135 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bd652a8d-5cd1-4c48-a628-0650ebf9887e None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.657238 May 10 02:11:32.267231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 34/57] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:32.351525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1065515206", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "7fe840c0-65b0-4d12-94df-84e1e8a62759"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:32.468773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] validate_networks() for [('7fe840c0-65b0-4d12-94df-84e1e8a62759', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:11:32.614374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:32.615131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:32.630202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:32.630666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:32.639811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:32.640283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:32.980237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:32.999125 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b75412f-7e08-4301-9114-57a111a86749 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1272 microversion: 2.1 time: 0.389753 May 10 02:11:33.001504 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 35/58] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:32 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:33.677381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cfe318d-84e3-4194-9a15-e09b5e51900a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:33.697097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9cfe318d-84e3-4194-9a15-e09b5e51900a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.694174 May 10 02:11:33.705531 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 36/59] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:11:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:33.723646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:33.729888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:33.747815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:33.751940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:33.753020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:33.755134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:34.184566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:34.196408 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d26db9fa-4bde-4d85-9246-11aea29a2366 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.489323 May 10 02:11:34.200158 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 37/60] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:33 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:35.256615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a49d14e0-be92-46a6-8e01-0abd5c732be8 tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-101187423", "id": 85330213, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:35.261021 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:35.261021 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:35.328639 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a49d14e0-be92-46a6-8e01-0abd5c732be8 tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 1.125348 May 10 02:11:35.344573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 38/61] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:34 2022] POST /compute/v2.1/flavors => generated 418 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:35.388939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:35.389591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:35.414236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:35.417302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:35.426620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:35.427539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:35.433455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:11:35.433985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:11:35.434597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:11:35.435535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:11:35.436087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:11:35.447563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:35.453929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:35.462829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:35.465009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:35.658784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:35.677182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for user b31e1f4aa1eb4cceb37e10f1b8f7b3f2 and project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:35.744640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:11:35.750830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:11:35.984599 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-679dbeb8-5827-44ff-b76f-7e8bf3dcc002 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.041910 May 10 02:11:35.987038 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 24/62] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:11:36.010997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:36.014224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:36.050332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:36.050956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:36.051812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:36.052264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:36.489649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:36.505133 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d9bccc0c-3b8d-46f4-9e01-456f3ea6be29 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 1.155901 May 10 02:11:36.512116 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 39/63] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:35 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:36.532099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f158b004-a484-41e8-8467-8b628520b07f tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:36.570651 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f158b004-a484-41e8-8467-8b628520b07f tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039181 May 10 02:11:36.571860 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 40/64] 10.222.0.52 () {58 vars in 1181 bytes} [Tue May 10 02:11:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:11:36.597165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f583bd9-922e-44e9-84f0-828efe04c847 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:36.597925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f583bd9-922e-44e9-84f0-828efe04c847 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:36.659873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:36.672204 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44477a5c-258b-4f94-b5de-871319f4c258 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.682920 May 10 02:11:36.675047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 25/65] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:35 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:36.689624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c6635dc-0531-4284-9357-4868420927b3 tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-681118983", "id": 1296505445, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:36.692591 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:36.692591 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:36.725374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c6635dc-0531-4284-9357-4868420927b3 tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.045784 May 10 02:11:36.726985 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 26/66] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:36 2022] POST /compute/v2.1/flavors => generated 424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:36.737919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c99d311d-feb1-4158-ba29-539a75511473 tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:36.755999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c99d311d-feb1-4158-ba29-539a75511473 tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022490 May 10 02:11:36.762272 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 27/67] 10.222.0.52 () {58 vars in 1181 bytes} [Tue May 10 02:11:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:11:36.774078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb539081-d33a-4118-b086-1ebacdc464cb tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Action: 'create', calling method: .version_select at 0x7f3d37f7b1f0>, body: {"keypair": {"name": "tempest-keypair-1108535060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQYw8d49RL8vH2m1006OZGkidS/5SMXSp9XgomwP5XK9PvsMYJr3PSHjblTsIAzUIyLPWbm1WRXUCJqpE7xjXt6CRLlNNhPc2FjUFwhSUq5gygjsMZIbSy+7aUhKoUI6A=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:36.835599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-bb539081-d33a-4118-b086-1ebacdc464cb tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Getting quotas for project 28a9f22674ee4e27ad7c42db55473a93. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:36.853514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-bb539081-d33a-4118-b086-1ebacdc464cb tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Getting quotas for user 6587868068d641b88a68acaeff886cd9 and project 28a9f22674ee4e27ad7c42db55473a93. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:36.873969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f583bd9-922e-44e9-84f0-828efe04c847 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:36.900451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f583bd9-922e-44e9-84f0-828efe04c847 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:36.904970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f583bd9-922e-44e9-84f0-828efe04c847 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:36.908946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f583bd9-922e-44e9-84f0-828efe04c847 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1262 microversion: 2.25 time: 0.334152 May 10 02:11:36.914541 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 41/68] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:36 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1262 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:36.919214 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb539081-d33a-4118-b086-1ebacdc464cb tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149322 May 10 02:11:36.920435 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 28/69] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:11:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:11:37.533180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:37.533864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:37.555046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:37.560392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:37.565472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:37.565472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:37.692832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:37.694658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:37.707723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:37.714924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:37.716742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:37.717866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:37.990951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:38.006128 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-221f4aa1-b52d-4a6e-b74f-7dcedee2f51f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.477684 May 10 02:11:38.009884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 42/70] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:37 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:38.058061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:38.062617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:38.105142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:38.108946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:38.114702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:38.124817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:38.308783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:38.317046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7deaddbb-8a4d-4608-84d0-f5408bdb58b7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.628151 May 10 02:11:38.331527 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 29/71] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:37 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:11:38.389851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:38.410017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:38.415450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:38.423325 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7464e9b1-4499-4d8d-bf4f-d53b32a3fbb1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1266 microversion: 2.25 time: 0.410215 May 10 02:11:38.430440 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 43/72] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:38 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:38.895929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Calling method '.version_select at 0x7f3d37ec33a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:38.898483 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:38.898483 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:38.899726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:38.900186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:38.969830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:38.971883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.065518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e803e8ee-1541-49cc-a94c-2ef6ac5c5b9d tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Action: 'create', calling method: .version_select at 0x7f3d37f7bee0>, body: {"keypair": {"name": "tempest-keypair-164673043", "type": "ssh", "user_id": "87320f22237647e7a1dbc844ca7fb9c9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+DAeVMNl6VoJ3bkLXMsjcX+v7SPbCyTMO2h5RFNxEhn5gwi+FgV6dCTVuulAAs58EQs2zTGyM6h4S29cNfI+j4b63Vw+UCfaT2h7Qe9/UixIDrNj6/ICY0exEP0Tt0Q=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:39.101451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e803e8ee-1541-49cc-a94c-2ef6ac5c5b9d tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Getting quotas for project 01e9724e9b1b430eb66ffb44fe77139a. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:39.110845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e803e8ee-1541-49cc-a94c-2ef6ac5c5b9d tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Getting quotas for user 0daabfa0a0bb49f496499e56e2318361 and project 01e9724e9b1b430eb66ffb44fe77139a. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:39.111212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.111681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.157798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.158261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.167202 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e803e8ee-1541-49cc-a94c-2ef6ac5c5b9d tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.833946 May 10 02:11:39.168175 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 30/73] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:11:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 836 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:11:39.173388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:39.186833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:39.209565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.211258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.215661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.217171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.218203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.219760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.237194 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a9aeb49-eaf0-4598-a71b-c9c68f5d051f tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.674853 May 10 02:11:39.239362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 44/74] 10.222.0.52 () {60 vars in 1242 bytes} [Tue May 10 02:11:38 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:11:39.252156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26ae5ae1-5bd4-4406-8ee2-62f2c578b450 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Action: 'create', calling method: .version_select at 0x7f3d37ec3ee0>, body: {"keypair": {"name": "tempest-keypair-948945529", "type": "ssh", "user_id": "87320f22237647e7a1dbc844ca7fb9c9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxTQyuG4Ou3+QcQriAjZN3j0jJpE8dV6GJM8fpDgYyD6ijRwopMYK452c+GH6SubdA64XNiWefurxCGXu1uOL2ucos5Xfonha/1t1E8F1dgzRw+kM7OCtcoBcxd9e+D4Q=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:39.305366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-26ae5ae1-5bd4-4406-8ee2-62f2c578b450 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Getting quotas for project 01e9724e9b1b430eb66ffb44fe77139a. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:39.315576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-26ae5ae1-5bd4-4406-8ee2-62f2c578b450 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Getting quotas for user 0daabfa0a0bb49f496499e56e2318361 and project 01e9724e9b1b430eb66ffb44fe77139a. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:39.345219 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26ae5ae1-5bd4-4406-8ee2-62f2c578b450 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.104001 May 10 02:11:39.346923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 45/75] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:11:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:11:39.353440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Calling method '.version_select at 0x7f3d37fbe280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:39.355727 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:39.355727 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:39.358551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.359724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.383401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.384136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.413422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.414828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.431985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.432921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.466194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.466649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.481691 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65c0cef5-ddcf-4de9-835e-dc42075d0077 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.133374 May 10 02:11:39.487666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 46/76] 10.222.0.52 () {60 vars in 1221 bytes} [Tue May 10 02:11:39 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:39.487666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:39.491000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:39.515577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.516177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.516981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.517424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.764109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:39.773493 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-984eef2b-1936-4e15-893e-533211b950e7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.603602 May 10 02:11:39.783593 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 31/77] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:39 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:39.789271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f86b2e71-da48-48f8-b0bb-b33562adb081 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Calling method '.version_select at 0x7f3d37fcce50>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:39.798211 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f86b2e71-da48-48f8-b0bb-b33562adb081 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-164673043?user_id=87320f22237647e7a1dbc844ca7fb9c9" status: 200 len: 511 microversion: 2.10 time: 0.013245 May 10 02:11:39.799313 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 32/78] 10.222.0.52 () {60 vars in 1336 bytes} [Tue May 10 02:11:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-164673043?user_id=87320f22237647e7a1dbc844ca7fb9c9 => generated 511 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:39.805465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:39.806080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:39.812017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.812694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.813643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.814347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.910782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:39.919690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c8e9a1f5-3c57-4278-ab70-0e37921130a7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.435924 May 10 02:11:39.920294 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 47/79] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:39 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:39.931992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-397b6efb-409f-4bd5-95fa-451cbbf60e48 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Calling method '.version_select at 0x7f3d37ed0b80>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:39.933193 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:39.933193 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:39.934420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397b6efb-409f-4bd5-95fa-451cbbf60e48 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.934877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397b6efb-409f-4bd5-95fa-451cbbf60e48 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.956503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397b6efb-409f-4bd5-95fa-451cbbf60e48 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:39.956956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397b6efb-409f-4bd5-95fa-451cbbf60e48 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:39.966517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-397b6efb-409f-4bd5-95fa-451cbbf60e48 tempest-HypervisorAdminV253TestBase-326195233 tempest-HypervisorAdminV253TestBase-326195233-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/6cccb2fb-87d8-4a2f-b0cf-5c95d0ccc0b6" status: 200 len: 792 microversion: 2.53 time: 0.044476 May 10 02:11:39.975650 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 48/80] 10.222.0.52 () {60 vars in 1297 bytes} [Tue May 10 02:11:39 2022] GET /compute/v2.1/os-hypervisors/6cccb2fb-87d8-4a2f-b0cf-5c95d0ccc0b6 => generated 792 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:39.975988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:39.985705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:39.993363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:39.996435 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b20a2ff8-5a36-4ceb-8e32-549bec97913c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1314 microversion: 2.25 time: 0.194192 May 10 02:11:39.999858 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 33/81] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:39 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:40.005474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41190b5f-7bab-4999-bd52-4cb7d4debb09 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Action: 'create', calling method: .version_select at 0x7f3d37f3e0d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-417589217", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOsM7G49IgPMsF1wfgnAEVorCishTdgJD3HvWatZA6TCJOUwAPb31Kr8B6kHygzvqw4JPKnMPZY8CMXiukC1//kYls1gd9k3CgPIY1puoIHa/X8BHTeNsKMG/MC1+CKnQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:40.024976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-41190b5f-7bab-4999-bd52-4cb7d4debb09 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Getting quotas for project 01e9724e9b1b430eb66ffb44fe77139a. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:40.029929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-41190b5f-7bab-4999-bd52-4cb7d4debb09 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Getting quotas for user 0daabfa0a0bb49f496499e56e2318361 and project 01e9724e9b1b430eb66ffb44fe77139a. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:40.068872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41190b5f-7bab-4999-bd52-4cb7d4debb09 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.066640 May 10 02:11:40.070112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 34/82] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:11:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:11:40.092808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-10b934b9-c34a-4b1d-84d8-1bdef1a3596d req-0afdc868-9a65-4b40-a9e9-b3b6ac12bc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db1f99b-607f-4121-b793-8cd35916a89a", "tag": "969519d4-9210-4bb3-95f6-44d6b1420185"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:40.100304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ded099ac-60ef-403c-9f2f-bcfe2c7e2f79 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Calling method '.version_select at 0x7f3d37f7bb80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:40.103248 n-d-841089-2 devstack@n-api.service[118717]: WARNING oslo_db.sqlalchemy.utils [None req-ded099ac-60ef-403c-9f2f-bcfe2c7e2f79 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 10 02:11:40.119105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-10b934b9-c34a-4b1d-84d8-1bdef1a3596d req-0afdc868-9a65-4b40-a9e9-b3b6ac12bc97 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:40.120337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-10b934b9-c34a-4b1d-84d8-1bdef1a3596d req-0afdc868-9a65-4b40-a9e9-b3b6ac12bc97 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:40.146684 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ded099ac-60ef-403c-9f2f-bcfe2c7e2f79 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs?user_id=87320f22237647e7a1dbc844ca7fb9c9" status: 200 len: 724 microversion: 2.10 time: 0.064235 May 10 02:11:40.147353 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 35/83] 10.222.0.52 () {60 vars in 1258 bytes} [Tue May 10 02:11:40 2022] GET /compute/v2.1/os-keypairs?user_id=87320f22237647e7a1dbc844ca7fb9c9 => generated 724 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:40.158351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-257aca71-9e45-4a6c-b6da-0166b7060969 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Calling method '.version_select at 0x7f3d37ed8c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:40.161526 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-10b934b9-c34a-4b1d-84d8-1bdef1a3596d req-0afdc868-9a65-4b40-a9e9-b3b6ac12bc97 service nova] Creating event network-changed:969519d4-9210-4bb3-95f6-44d6b1420185 for instance 9db1f99b-607f-4121-b793-8cd35916a89a on n-h2-841089-2 May 10 02:11:40.176598 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-10b934b9-c34a-4b1d-84d8-1bdef1a3596d req-0afdc868-9a65-4b40-a9e9-b3b6ac12bc97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206290 May 10 02:11:40.179015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 49/84] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:40.197742 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-257aca71-9e45-4a6c-b6da-0166b7060969 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-417589217" status: 204 len: 0 microversion: 2.10 time: 0.044201 May 10 02:11:40.199434 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 36/85] 10.222.0.52 () {60 vars in 1321 bytes} [Tue May 10 02:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-417589217 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 02:11:40.222328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4572e39a-8cd6-40a1-8797-d661e651c44c tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Calling method '.version_select at 0x7f3d37ea3f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:40.302210 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4572e39a-8cd6-40a1-8797-d661e651c44c tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948945529?user_id=87320f22237647e7a1dbc844ca7fb9c9" status: 204 len: 0 microversion: 2.10 time: 0.093992 May 10 02:11:40.304744 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 50/86] 10.222.0.52 () {60 vars in 1339 bytes} [Tue May 10 02:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948945529?user_id=87320f22237647e7a1dbc844ca7fb9c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:11:40.316723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98bc2441-8b3f-4b29-94a1-e228d54d3ee4 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] Calling method '.version_select at 0x7f3d37ee9a60>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:40.379528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98bc2441-8b3f-4b29-94a1-e228d54d3ee4 tempest-KeyPairsV210TestJSON-1668311346 tempest-KeyPairsV210TestJSON-1668311346-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-164673043?user_id=87320f22237647e7a1dbc844ca7fb9c9" status: 204 len: 0 microversion: 2.10 time: 0.070761 May 10 02:11:40.380867 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 37/87] 10.222.0.52 () {60 vars in 1339 bytes} [Tue May 10 02:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-164673043?user_id=87320f22237647e7a1dbc844ca7fb9c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:11:40.806248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:40.806986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:40.827167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:40.830395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:40.833616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:40.834810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:40.845225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-dafd0451-59ab-46bc-a165-2cc947c369aa req-37cc2fb3-7d2f-4f78-ac77-ea14c7fc5cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083a14a6-3029-46fc-88f7-8e0e51435a62", "name": "network-vif-plugged", "status": "completed", "tag": "da96a1a0-af3f-411b-afd6-323db0255db1"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:40.867340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-dafd0451-59ab-46bc-a165-2cc947c369aa req-37cc2fb3-7d2f-4f78-ac77-ea14c7fc5cf3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:40.868080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-dafd0451-59ab-46bc-a165-2cc947c369aa req-37cc2fb3-7d2f-4f78-ac77-ea14c7fc5cf3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:40.882997 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-dafd0451-59ab-46bc-a165-2cc947c369aa req-37cc2fb3-7d2f-4f78-ac77-ea14c7fc5cf3 service nova] Creating event network-vif-plugged:da96a1a0-af3f-411b-afd6-323db0255db1 for instance 083a14a6-3029-46fc-88f7-8e0e51435a62 on n-h1-841089-2 May 10 02:11:40.889058 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-dafd0451-59ab-46bc-a165-2cc947c369aa req-37cc2fb3-7d2f-4f78-ac77-ea14c7fc5cf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426410 May 10 02:11:40.890711 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 51/88] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:40.940674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:40.941915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:40.984883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:40.987099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:40.987991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:40.991892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:41.290015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:41.297985 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdb1d786-35dd-4858-a92f-abccc6bd1f48 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.506351 May 10 02:11:41.307575 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 38/89] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:40 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:41.313953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1409637740", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "1296505445", "adminPass": "***", "networks": [{"uuid": "c89d42e3-f9fc-43d7-8c45-97defa9745eb"}], "security_groups": [{"name": "tempest-securitygroup--323684939"}], "key_name": "tempest-keypair-1108535060", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:41.525703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:41.535554 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-50f1d8a9-706a-421f-9fa7-2e9bd302fed4 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.600982 May 10 02:11:41.539224 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 52/90] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:40 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:41.544972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:41.548468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:41.562471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:41.562933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:41.566924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:41.570582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:41.729466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] validate_networks() for [('c89d42e3-f9fc-43d7-8c45-97defa9745eb', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:11:41.733046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:41.748013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:41.749632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:41.758186 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fae219eb-298f-4a7e-9536-93745dcc7af6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1314 microversion: 2.25 time: 0.213444 May 10 02:11:41.758821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 53/91] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:41 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:42.316245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:42.316975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:42.351290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:42.362001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:42.362769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:42.370978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:42.648686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:42.658908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b32ac3d-9b26-4914-a7dc-fe65b2dd1e38 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.347457 May 10 02:11:42.673971 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 54/92] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:42 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:11:42.683813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:42.684801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:42.696136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:42.699677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:42.703141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:42.703906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:42.752577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:11:42.752983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:11:42.753456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:11:42.754317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:11:42.754317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:11:42.770825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:42.770825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:42.774633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:42.801964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:42.878512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Getting quotas for project 28a9f22674ee4e27ad7c42db55473a93. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:42.908549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Getting quotas for user 6587868068d641b88a68acaeff886cd9 and project 28a9f22674ee4e27ad7c42db55473a93. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:42.932896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:11:42.938842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:11:43.003533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:43.011407 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9fc008a5-210a-4632-bdb2-9bc0df0fc863 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.702295 May 10 02:11:43.014323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c95ec5b2-3a77-472d-97ba-38976d1ece38 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1338 microversion: 2.1 time: 0.338978 May 10 02:11:43.017576 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 39/93] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:11:43.024576 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 55/94] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:42 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1338 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:43.029478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43005e00-f4c6-4d74-949c-2341cc9fd7d7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:43.029655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:43.030763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43005e00-f4c6-4d74-949c-2341cc9fd7d7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:43.033071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:43.055317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:43.055892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:43.057345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:43.058200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:43.255897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:43.267694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43005e00-f4c6-4d74-949c-2341cc9fd7d7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:43.276390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43005e00-f4c6-4d74-949c-2341cc9fd7d7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1265 microversion: 2.1 time: 0.250426 May 10 02:11:43.283354 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 56/95] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:43 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:43.284237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:43.288978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:43.290510 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46cce5ab-ff58-45ba-892a-648fd0952354 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1314 microversion: 2.25 time: 0.271684 May 10 02:11:43.311742 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 40/96] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:43 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:43.686833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:43.687416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:43.707581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:43.708052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:43.708919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:43.709368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.032543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:44.033786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:44.042769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.051097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.052791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.054297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.079531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:44.089407 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28db03e0-0188-4d0e-a57b-2fe8d0bc16ca tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.412465 May 10 02:11:44.102273 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 57/97] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:43 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:44.302279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:44.303685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:44.310359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:44.313898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.322711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.323719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8898986f-9ecd-4a82-9cf6-84c28edf6f8a tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1488 microversion: 2.1 time: 0.295689 May 10 02:11:44.323974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.324522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.345541 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 41/98] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:44 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1488 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:44.380994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:44.382815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:44.418793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.424880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.433944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.435678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.534858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:44.546853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0453a5d5-d5a8-4cb2-addc-074f31837a72 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1283 microversion: 2.1 time: 0.248667 May 10 02:11:44.548717 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 58/99] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:44 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:44.564298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:44.565183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:44.572495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.573185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.574164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.574764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.578756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:44.588464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:44.591945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:44.593406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbd09458-77bf-4a0d-8e1d-c0fa2bd8db9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1314 microversion: 2.25 time: 0.245453 May 10 02:11:44.594555 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 42/100] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:44 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:44.947480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a14b1403-f999-4253-9372-f122c8f1b33b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1639 microversion: 2.1 time: 0.386910 May 10 02:11:44.948636 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 59/101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:44 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1639 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:44.965809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:44.966323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:44.973776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.975028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:44.976361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:44.976826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.016700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:11:45.052591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-641016718", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "2f8708f8-b1bb-4099-8385-4858a3f8bcfb"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:45.186647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] validate_networks() for [('2f8708f8-b1bb-4099-8385-4858a3f8bcfb', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:11:45.348649 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69741d6c-66d7-41c1-8f25-cea48d3657cb tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "DELETE /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 204 len: 0 microversion: 2.1 time: 0.387316 May 10 02:11:45.351053 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 60/102] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:11:44 2022] DELETE /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:11:45.360101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:45.360101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:45.369632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.370164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.372209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.372673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.616899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:45.629411 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bfe764f1-210b-4708-9d10-b4b45630bf93 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.276840 May 10 02:11:45.630264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 61/103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:45 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:45.635787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:45.636408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:45.644680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.645144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.646446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.646894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.811922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:11:45.812583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:11:45.813290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:11:45.813960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:11:45.814492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:11:45.823784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.824236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.825037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.825474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.836020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:45.842074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:11:45.843881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afc9d283-83c2-4ca6-91d3-94e1b65a0bfd tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1494 microversion: 2.1 time: 0.212247 May 10 02:11:45.853892 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 62/104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:45 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1494 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:45.854058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for user f3afba6df0eb454cbfa342f196e6727f and project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:11:45.859330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:11:45.861455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:11:45.912462 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3bb68fdb-fe8e-4754-b7ef-1d23ed9f850c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074724 May 10 02:11:45.922615 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 43/105] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:11:45.930245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:45.931565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:45.937939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.938382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:45.939278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:45.939735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:46.035729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:46.046870 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5672a80b-3a76-4ccc-b6f1-1f6ab6c76654 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1345 microversion: 2.1 time: 0.122613 May 10 02:11:46.048220 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 44/106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:45 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:46.072322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:46.073044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:46.092933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b80d49d-c08d-4f16-85c6-c91da84191e2 tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] Calling method '.version_select at 0x7f3d37f55820>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:46.094596 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:46.094596 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:46.097701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:46.098164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:46.098970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:46.102251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:46.139759 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b80d49d-c08d-4f16-85c6-c91da84191e2 tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.292368 May 10 02:11:46.147412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 63/107] 10.222.0.52 () {60 vars in 1225 bytes} [Tue May 10 02:11:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:46.153348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e58ab40-91ba-44fc-a4c1-9d9e0e7cc17c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:46.154126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e58ab40-91ba-44fc-a4c1-9d9e0e7cc17c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:46.223969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:46.235510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:46.237043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:46.238177 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-658d44e9-8ced-4e67-8aaa-9b3165817264 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1322 microversion: 2.25 time: 0.181329 May 10 02:11:46.238765 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 45/108] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:46 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:46.248010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0e58ab40-91ba-44fc-a4c1-9d9e0e7cc17c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:46.254762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48161b75-d313-4d72-a566-eb6613c01e4e tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37ed8dc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:46.256171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e58ab40-91ba-44fc-a4c1-9d9e0e7cc17c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1210 microversion: 2.1 time: 0.106130 May 10 02:11:46.256975 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 64/109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:46 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:46.261085 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:46.261085 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:46.509790 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-48161b75-d313-4d72-a566-eb6613c01e4e tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.259711 May 10 02:11:46.510454 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 46/110] 10.222.0.52 () {62 vars in 1246 bytes} [Tue May 10 02:11:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:46.520054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9bac0964-4cc3-4347-bc0d-b66e0ffdf39d tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] Calling method '.version_select at 0x7f3d37ec33a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:46.521003 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:46.521003 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:46.532262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9bac0964-4cc3-4347-bc0d-b66e0ffdf39d tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015834 May 10 02:11:46.533268 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 65/111] 10.222.0.52 () {60 vars in 1225 bytes} [Tue May 10 02:11:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:46.545201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53fea34a-1d7b-46b3-a8e6-4c8028f1e090 tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37f7b9d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:46.632530 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53fea34a-1d7b-46b3-a8e6-4c8028f1e090 tempest-QuotaClassesAdmin257Test-94737365 tempest-QuotaClassesAdmin257Test-94737365-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.093132 May 10 02:11:46.633319 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 47/112] 10.222.0.52 () {62 vars in 1246 bytes} [Tue May 10 02:11:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:46.648342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:46.649465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:46.658684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:46.659194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:46.660203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:46.660652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:46.862995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:46.865149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:46.879978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:46.882771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:46.886447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:46.888706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.188625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.201731 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1188bcbd-5530-4cb9-8cd9-8b00dc68a03e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.558512 May 10 02:11:47.202448 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 66/113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:46 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:47.284603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.292630 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5cb2f85e-8a8a-41a9-915a-112c573ba7c8 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1494 microversion: 2.1 time: 0.434622 May 10 02:11:47.305346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 48/114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:46 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1494 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:47.314751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:47.321568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:47.334163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.335204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.336248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.336708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.449617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-512f3cc6-3648-459e-a5d3-4b51eb5312ad tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '.version_select at 0x7f3d37e59940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:47.504456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.520368 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50cd8323-cfe8-4101-b3b9-3db507d751c6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1345 microversion: 2.1 time: 0.211430 May 10 02:11:47.520575 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 49/115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:47 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1345 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:47.534569 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-512f3cc6-3648-459e-a5d3-4b51eb5312ad tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c" status: 200 len: 371 microversion: 2.1 time: 0.321159 May 10 02:11:47.535445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 67/116] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:11:47 2022] GET /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c => generated 371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:47.540350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:47.541393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:47.548945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:47.549593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:47.549817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.550427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.553050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.553965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.565636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.566096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.573223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.573751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.689350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.697846 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-30266939-14ca-4a9c-8018-2ea079cb9429 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1280 microversion: 2.1 time: 0.161100 May 10 02:11:47.698644 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 68/117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:47 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1280 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:47.703363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-233629b9-c977-4fec-b4fc-63ccff8174f8 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37d8d160>, body: {"quota_set": {"ram": "5120"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:47.720188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.727944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.729492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:47.730598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cb78914-5158-4916-afac-e98ce64c7c49 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1320 microversion: 2.25 time: 0.197417 May 10 02:11:47.740072 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 50/118] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:47 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:47.782847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-233629b9-c977-4fec-b4fc-63ccff8174f8 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.784519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-233629b9-c977-4fec-b4fc-63ccff8174f8 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.785522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-233629b9-c977-4fec-b4fc-63ccff8174f8 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:47.786131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-233629b9-c977-4fec-b4fc-63ccff8174f8 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:47.848435 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-233629b9-c977-4fec-b4fc-63ccff8174f8 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c" status: 200 len: 328 microversion: 2.1 time: 0.148407 May 10 02:11:47.849362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 69/119] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:11:47 2022] PUT /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c => generated 328 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:47.860296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8784ee55-29cf-49ad-a771-0e86194f799e tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:47.876162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8784ee55-29cf-49ad-a771-0e86194f799e tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c" status: 202 len: 0 microversion: 2.1 time: 0.020119 May 10 02:11:47.880178 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 51/120] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:11:47 2022] DELETE /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:11:47.888302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e47440f9-37df-449d-882d-f18cc0c27d56 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '.version_select at 0x7f3d37da30d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:47.976448 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e47440f9-37df-449d-882d-f18cc0c27d56 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c" status: 200 len: 371 microversion: 2.1 time: 0.093153 May 10 02:11:47.978471 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 70/121] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:11:47 2022] GET /compute/v2.1/os-quota-sets/24a1b67d42494151bd7f690d7082377c => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:48.105526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-74873aec-bff8-45c0-be8c-198a3dba9f48 req-97296abc-6a31-415d-a3ee-ce3a4e7d1eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083a14a6-3029-46fc-88f7-8e0e51435a62", "name": "network-vif-deleted", "tag": "da96a1a0-af3f-411b-afd6-323db0255db1"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:48.125373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-74873aec-bff8-45c0-be8c-198a3dba9f48 req-97296abc-6a31-415d-a3ee-ce3a4e7d1eb8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.125876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-74873aec-bff8-45c0-be8c-198a3dba9f48 req-97296abc-6a31-415d-a3ee-ce3a4e7d1eb8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.164450 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-74873aec-bff8-45c0-be8c-198a3dba9f48 req-97296abc-6a31-415d-a3ee-ce3a4e7d1eb8 service nova] Creating event network-vif-deleted:da96a1a0-af3f-411b-afd6-323db0255db1 for instance 083a14a6-3029-46fc-88f7-8e0e51435a62 on n-h1-841089-2 May 10 02:11:48.165400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-74873aec-bff8-45c0-be8c-198a3dba9f48 req-97296abc-6a31-415d-a3ee-ce3a4e7d1eb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:11:48.167028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.168299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.169332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.169861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.181162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.rpcapi [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 02:11:48.183537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] Releasing lock "compute-rpcapi-router" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:11:48.209736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bab671cb-f407-4dbb-90a2-b29c312e37de tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '.version_select at 0x7f3d37e19d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:48.228869 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5475663-2e26-40c4-9520-bf93e5c96b5f None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127379 May 10 02:11:48.229984 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 52/122] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:48.235409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:48.236111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:48.248821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.249278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.250074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.250535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.470409 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bab671cb-f407-4dbb-90a2-b29c312e37de tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218/defaults" status: 200 len: 371 microversion: 2.1 time: 0.266615 May 10 02:11:48.471441 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 71/123] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:11:48 2022] GET /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218/defaults => generated 371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:48.476624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:48.477471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:48.484790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.485475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.486441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.487110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.586408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:48.594263 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d139febd-d1ed-4b00-a89b-fed5f05dc159 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.362854 May 10 02:11:48.596866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.597327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.597843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lazy-loading 'fault' on Instance uuid 083a14a6-3029-46fc-88f7-8e0e51435a62 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:11:48.598143 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 53/124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:48 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:48.602808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:48.618348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:48.637408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.638208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.639259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.639913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.902168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116885a9c674485f9354df010698aada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da85f31817b74746a6b028011e177611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:48.909213 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00785647-be99-43cf-ad6a-d9e7b8e43c0c tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 200 len: 1328 microversion: 2.1 time: 0.436534 May 10 02:11:48.910387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 72/125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:48 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 1328 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:48.915239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:48.916249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:48.922455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.923255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:48.924265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:48.924904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.058297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:49.069103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e812aa7-fe1b-47a0-84f3-ee5a0a297265 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1268 microversion: 2.1 time: 0.157463 May 10 02:11:49.070307 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 73/126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:48 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:49.076145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:49.076568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:49.083237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.085093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.086181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.087483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.095513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:49.104953 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a4aec8d-9c63-489d-86e8-76157efb5d21 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1412 microversion: 2.1 time: 0.505615 May 10 02:11:49.106013 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 54/127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:48 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1412 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:49.112374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e65a65d-e50a-4ec0-b190-ce53bac0bc27 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37e49d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:49.391373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e65a65d-e50a-4ec0-b190-ce53bac0bc27 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.391835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e65a65d-e50a-4ec0-b190-ce53bac0bc27 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.392635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e65a65d-e50a-4ec0-b190-ce53bac0bc27 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.393069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e65a65d-e50a-4ec0-b190-ce53bac0bc27 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.432377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:49.447899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:49.451917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:49.455882 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3e95ce7-b650-4e5c-95e2-015ab4241c7d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.383946 May 10 02:11:49.456848 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 74/128] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:49 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:49.476984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e65a65d-e50a-4ec0-b190-ce53bac0bc27 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782" status: 200 len: 328 microversion: 2.1 time: 0.368946 May 10 02:11:49.478086 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 55/129] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:11:49 2022] PUT /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782 => generated 328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:49.488772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0725a35-9ff2-40a9-b94a-d929f617f0d6 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '.version_select at 0x7f3d37d4bca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:49.616374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:49.617645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:49.626900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.627750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.628885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.629564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.707563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0725a35-9ff2-40a9-b94a-d929f617f0d6 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.708265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0725a35-9ff2-40a9-b94a-d929f617f0d6 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.709077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0725a35-9ff2-40a9-b94a-d929f617f0d6 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.709513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0725a35-9ff2-40a9-b94a-d929f617f0d6 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.732239 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0725a35-9ff2-40a9-b94a-d929f617f0d6 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782/detail" status: 200 len: 916 microversion: 2.1 time: 0.248802 May 10 02:11:49.732852 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 75/130] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:11:49 2022] GET /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782/detail => generated 916 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:49.927914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:49.928848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:49.937402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.938064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.939236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:49.939823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:49.959105 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] HTTP exception thrown: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Request method failure captured: May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 HTTP/1.1 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8qhmfyT9dCwfiY-s7LY2NtBVR0EKVyFMlp9ug0ehhJBAs9XUVmanRWt_RsW7il0Y6o1tsdoZ_jy7zbTlCLYPdptRqM-jK9ZiNsxrirf0NFyK4N5yvtm_rILpubuNeHF02W3870n7JFZyKKycsCvVp-MP75QlauReAa4N0Fs3P3N8 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: da85f31817b74746a6b028011e177611 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:49.964398 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_da85f31817b74746a6b028011e177611", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da85f31817b74746a6b028011e177611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/da85f31817b74746a6b028011e177611"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da85f31817b74746a6b028011e177611"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: da85f31817b74746a6b028011e177611 May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminTestJSON-353255131-project May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 116885a9c674485f9354df010698aada May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminTestJSON-353255131-project May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:49.965582 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '083a14a6-3029-46fc-88f7-8e0e51435a62'} May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:49.966304 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:49.967456 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:49.968436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Returning 404 to user: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:49.968436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a4478b7-767c-4ea4-9df7-d2b57bf7352f tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 404 len: 111 microversion: 2.1 time: 0.044122 May 10 02:11:49.968436 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 76/131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:49 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:11:49.974194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37cb3dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:50.224467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.225088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.226001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.226683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.262902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.263413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.264397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.264850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.269111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:50.276352 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c67869b-fa6e-402d-8699-47f0a9d339b7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.666385 May 10 02:11:50.296957 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 56/132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:49 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:50.305029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e87826de-6f28-4265-ace4-ffffa68584d9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:50.307226 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:50.307226 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:50.316464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e87826de-6f28-4265-ace4-ffffa68584d9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.317193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e87826de-6f28-4265-ace4-ffffa68584d9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.337515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-147829fa-2841-4a48-a087-9245aa42eb90 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782?user_id=fb3129deb191419ca4798dbee6c6eb64" status: 200 len: 328 microversion: 2.1 time: 0.369446 May 10 02:11:50.338581 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 77/133] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:11:49 2022] PUT /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782?user_id=fb3129deb191419ca4798dbee6c6eb64 => generated 328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:50.349619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:50.350459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:50.363526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.364035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.365568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.365898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.435636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e87826de-6f28-4265-ace4-ffffa68584d9 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.137476 May 10 02:11:50.436825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 57/134] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:50.442128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:50.442972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:50.449136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.449592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.450393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:50.450820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:50.799170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:50.811929 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-92ca17dd-85c7-4e2e-8dd0-27d27bedf7ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.472116 May 10 02:11:50.813666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 78/135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:50 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:50.832676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2ff4d13-d953-4844-afd3-7394c7288b05 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '.version_select at 0x7f3d37d8d820>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:50.924931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:50.933160 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1777a66b-2b53-4a59-b986-161982d4ccc3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.495036 May 10 02:11:50.933763 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 58/136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:50 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:50.938132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-76f4e2bf-bf3a-44ae-98a2-7a021ff806a7 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:50.938885 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:50.938885 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:50.982347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-76f4e2bf-bf3a-44ae-98a2-7a021ff806a7 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.047113 May 10 02:11:50.992297 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 59/137] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:50 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:51.004571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:51.007000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:51.014994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.016624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.018503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.019316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.090637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2ff4d13-d953-4844-afd3-7394c7288b05 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782?user_id=fb3129deb191419ca4798dbee6c6eb64" status: 200 len: 370 microversion: 2.1 time: 0.275496 May 10 02:11:51.091500 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 79/138] 10.222.0.52 () {58 vars in 1322 bytes} [Tue May 10 02:11:50 2022] GET /compute/v2.1/os-quota-sets/e23904cabf354fda8cca52aa99dbd782?user_id=fb3129deb191419ca4798dbee6c6eb64 => generated 370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:51.096604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-23488109-961d-48c8-a35f-438238420c70 req-7bfb0fa8-6e13-448b-a531-c36f61e5ffe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb619058-700d-4b0a-8b3e-9c3c845c4538", "tag": "9a877a3d-b01e-4608-9e40-1aa136c12444"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:51.107471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-23488109-961d-48c8-a35f-438238420c70 req-7bfb0fa8-6e13-448b-a531-c36f61e5ffe8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.108029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-23488109-961d-48c8-a35f-438238420c70 req-7bfb0fa8-6e13-448b-a531-c36f61e5ffe8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.121730 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-23488109-961d-48c8-a35f-438238420c70 req-7bfb0fa8-6e13-448b-a531-c36f61e5ffe8 service nova] Creating event network-changed:9a877a3d-b01e-4608-9e40-1aa136c12444 for instance eb619058-700d-4b0a-8b3e-9c3c845c4538 on n-h1-841089-2 May 10 02:11:51.127625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-23488109-961d-48c8-a35f-438238420c70 req-7bfb0fa8-6e13-448b-a531-c36f61e5ffe8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 May 10 02:11:51.128317 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 80/139] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:51.134794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bb836fb-01c9-4e5e-905f-e39ba372aa1b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2122261030"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:51.137019 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:51.137019 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:51.137876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-3bb836fb-01c9-4e5e-905f-e39ba372aa1b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 8d760595-9889-4f30-bdc3-1bae7e2c1b7f for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:51.167869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3bb836fb-01c9-4e5e-905f-e39ba372aa1b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037872 May 10 02:11:51.168838 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 81/140] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:51.179887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56a314cf-7136-456d-8e20-831b31c57f1f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:51.181370 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:51.181370 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:51.189837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56a314cf-7136-456d-8e20-831b31c57f1f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.190297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56a314cf-7136-456d-8e20-831b31c57f1f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.530387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:51.539429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:51.541099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:51.542356 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7453b707-b21d-4c76-ae1a-a66263dafa2e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.548573 May 10 02:11:51.553344 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 60/141] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:50 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:51.559646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:51.560263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:51.567906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.568369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.569156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.569597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.625739 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56a314cf-7136-456d-8e20-831b31c57f1f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.450342 May 10 02:11:51.631381 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 82/142] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:51.638329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e53bf97c-4ba0-4d83-a526-5c516063c49a tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Calling method '.version_select at 0x7f3d37d05790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:51.821652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e53bf97c-4ba0-4d83-a526-5c516063c49a tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218/defaults" status: 200 len: 371 microversion: 2.1 time: 0.193716 May 10 02:11:51.827129 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 83/143] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:11:51 2022] GET /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218/defaults => generated 371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:51.831282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59aa2ab1-b10d-43d6-88bf-4cfd25b3ae73 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:51.832322 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:51.832322 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:51.839489 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59aa2ab1-b10d-43d6-88bf-4cfd25b3ae73 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.012667 May 10 02:11:51.840057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 84/144] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:11:51 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:51.857137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:51.857911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:51.865334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.866068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.866856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:51.867962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:51.979145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:51.986507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a85af07a-abaa-4165-8bb5-cc9e3541839c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.431242 May 10 02:11:51.987105 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 61/145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:51 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:52.001029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-926ac443-fcb1-4de9-82a3-54c1a92ac36f tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37e49dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:52.072157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-926ac443-fcb1-4de9-82a3-54c1a92ac36f tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.072719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-926ac443-fcb1-4de9-82a3-54c1a92ac36f tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.073747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-926ac443-fcb1-4de9-82a3-54c1a92ac36f tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.074307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-926ac443-fcb1-4de9-82a3-54c1a92ac36f tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.286317 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-926ac443-fcb1-4de9-82a3-54c1a92ac36f tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218" status: 200 len: 329 microversion: 2.1 time: 0.288767 May 10 02:11:52.288088 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 62/146] 10.222.0.52 () {60 vars in 1262 bytes} [Tue May 10 02:11:51 2022] PUT /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218 => generated 329 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:52.293484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80fb88f6-1c8d-446f-860b-51eb93807a10 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:52.294792 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:52.294792 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:52.304380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80fb88f6-1c8d-446f-860b-51eb93807a10 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.305166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80fb88f6-1c8d-446f-860b-51eb93807a10 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.443684 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80fb88f6-1c8d-446f-860b-51eb93807a10 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.153356 May 10 02:11:52.449392 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 63/147] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:52.454492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:52.455186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:52.461169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.461625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.462408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.462846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.477251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:52.486124 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8eb8f252-72bc-4c39-b3d9-18470b97ed5e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.645070 May 10 02:11:52.486922 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 85/148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:51 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:52.491767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6d2e481b-a882-48c5-8894-bf3adb5303e9 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37c73700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:52.555914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d2e481b-a882-48c5-8894-bf3adb5303e9 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.556297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d2e481b-a882-48c5-8894-bf3adb5303e9 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.557099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d2e481b-a882-48c5-8894-bf3adb5303e9 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.557531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d2e481b-a882-48c5-8894-bf3adb5303e9 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.810981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:52.818986 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-730df8b0-77e1-470a-b6ef-518b5c671767 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.368304 May 10 02:11:52.821141 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 64/149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:52 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:52.825765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b4f51b5-3ea7-4bc1-9d3e-ca49d9bb5d09 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:52.826626 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:52.826626 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:52.862745 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b4f51b5-3ea7-4bc1-9d3e-ca49d9bb5d09 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039768 May 10 02:11:52.863604 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 65/150] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:52 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:52.875226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6d2e481b-a882-48c5-8894-bf3adb5303e9 tempest-QuotasAdminTestJSON-860283748 tempest-QuotasAdminTestJSON-860283748-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218" status: 200 len: 329 microversion: 2.1 time: 0.387330 May 10 02:11:52.875747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:52.876184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:52.881047 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 86/151] 10.222.0.52 () {60 vars in 1262 bytes} [Tue May 10 02:11:52 2022] PUT /compute/v2.1/os-quota-sets/7070cbe3b5f94dcc9f67e7a6195c5218 => generated 329 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:52.885662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.886117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.886899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.887371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:52.890872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3081eaf4-ee7c-4843-8f3f-21e531e182f6 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-646296319"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:52.892215 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:52.892215 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:52.893104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-3081eaf4-ee7c-4843-8f3f-21e531e182f6 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 2c55cc5f-09a2-417d-b9ea-8c8b15c1e1ae for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:52.934261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3081eaf4-ee7c-4843-8f3f-21e531e182f6 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.051978 May 10 02:11:52.940500 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 87/152] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:52.945265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0a63a90-f21f-4fb3-9d62-95755cf63e84 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:52.946500 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:52.946500 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:52.956770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0a63a90-f21f-4fb3-9d62-95755cf63e84 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:52.957233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0a63a90-f21f-4fb3-9d62-95755cf63e84 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.120622 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0a63a90-f21f-4fb3-9d62-95755cf63e84 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.178431 May 10 02:11:53.123274 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 88/153] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:52 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:53.127896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:53.128734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:53.138276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.138892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.139897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.140700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.406291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:53.414307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:53.416115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:53.417438 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-84b3f2ee-acdc-49d5-8c1d-40ad5635632b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.545580 May 10 02:11:53.418078 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 66/154] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:52 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:53.422498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b242ab59-15e8-4d2a-adb2-29b66d473b94 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:53.423291 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:53.423291 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:53.433165 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b242ab59-15e8-4d2a-adb2-29b66d473b94 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.013930 May 10 02:11:53.434024 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 67/155] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:11:53 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:53.438517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-82999408-2c3f-4f2e-97ec-ea721ae59f76 req-57291bb6-292b-45b6-b9ef-c999f7534c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d0f290-23eb-448e-b203-33508b893b70", "tag": "3ee55356-a9bc-4bdf-844d-cc33b7229733"}, {"name": "network-changed", "server_uuid": "e97ad790-f1eb-49d6-b1c9-249fa0d34af8", "tag": "8ec5090a-4fb8-4b2b-b9cc-58d3443773c7"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:53.441674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:53.451287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ffa9e6a-ceb6-4961-b14f-0d54666b1be1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.328343 May 10 02:11:53.455139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 89/156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:53 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:53.467128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-82999408-2c3f-4f2e-97ec-ea721ae59f76 req-57291bb6-292b-45b6-b9ef-c999f7534c38 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.467581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-82999408-2c3f-4f2e-97ec-ea721ae59f76 req-57291bb6-292b-45b6-b9ef-c999f7534c38 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.481643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-82999408-2c3f-4f2e-97ec-ea721ae59f76 req-57291bb6-292b-45b6-b9ef-c999f7534c38 service nova] Creating event network-changed:3ee55356-a9bc-4bdf-844d-cc33b7229733 for instance 72d0f290-23eb-448e-b203-33508b893b70 on n-h2-841089-2 May 10 02:11:53.482295 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-82999408-2c3f-4f2e-97ec-ea721ae59f76 req-57291bb6-292b-45b6-b9ef-c999f7534c38 service nova] Creating event network-changed:8ec5090a-4fb8-4b2b-b9cc-58d3443773c7 for instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 on n-h2-841089-2 May 10 02:11:53.489203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-82999408-2c3f-4f2e-97ec-ea721ae59f76 req-57291bb6-292b-45b6-b9ef-c999f7534c38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054021 May 10 02:11:53.490115 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 68/157] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:53.495298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4677ee4e-926e-4982-b5b4-43bda04cc602 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:53.496621 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:53.496621 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:53.509586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4677ee4e-926e-4982-b5b4-43bda04cc602 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.510046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4677ee4e-926e-4982-b5b4-43bda04cc602 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.602489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ca34e06-c2f9-42a0-bab0-52c0f2c44da0 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37bc4670>, body: {"quota_set": {"ram": "5120"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:53.694195 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4677ee4e-926e-4982-b5b4-43bda04cc602 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.202976 May 10 02:11:53.697847 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 69/158] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:53.704938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ca34e06-c2f9-42a0-bab0-52c0f2c44da0 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.705972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:53.706639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ca34e06-c2f9-42a0-bab0-52c0f2c44da0 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.710094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ca34e06-c2f9-42a0-bab0-52c0f2c44da0 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.711394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:53.711512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ca34e06-c2f9-42a0-bab0-52c0f2c44da0 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.719370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.720211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.721237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.721890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.781006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ca34e06-c2f9-42a0-bab0-52c0f2c44da0 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907" status: 200 len: 148 microversion: 2.57 time: 0.327482 May 10 02:11:53.781818 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 90/159] 10.222.0.52 () {62 vars in 1302 bytes} [Tue May 10 02:11:53 2022] PUT /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907 => generated 148 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:53.788610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-845c2a71-5cc9-4ad2-96e3-d1fadf06d243 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:53.789396 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:53.789396 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:53.816829 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-845c2a71-5cc9-4ad2-96e3-d1fadf06d243 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.033730 May 10 02:11:53.817335 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 91/160] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:53 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:53.821953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3a8fa5d-640b-4d81-bc6e-c68f8fe5f9c6 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Calling method '.version_select at 0x7f3d37cb3f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:53.882753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:53.893876 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3dfb0749-8a44-4748-813b-c864ff41d7a3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.194411 May 10 02:11:53.896887 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 70/161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:53 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:53.912323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a8fa5d-640b-4d81-bc6e-c68f8fe5f9c6 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.913599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a8fa5d-640b-4d81-bc6e-c68f8fe5f9c6 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.916239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a8fa5d-640b-4d81-bc6e-c68f8fe5f9c6 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.917782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a8fa5d-640b-4d81-bc6e-c68f8fe5f9c6 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.924103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e67510af-e68e-43e9-a158-bf99ac6bd435 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-841073458"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:53.926006 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:53.926006 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:53.931808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-e67510af-e68e-43e9-a158-bf99ac6bd435 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 575b9029-d081-4ac8-88df-b018915c92dc for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:53.964690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3a8fa5d-640b-4d81-bc6e-c68f8fe5f9c6 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907/detail" status: 200 len: 463 microversion: 2.57 time: 0.146242 May 10 02:11:53.971400 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 92/162] 10.222.0.52 () {60 vars in 1303 bytes} [Tue May 10 02:11:53 2022] GET /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907/detail => generated 463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:53.971572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e67510af-e68e-43e9-a158-bf99ac6bd435 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.070668 May 10 02:11:53.971572 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 71/163] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:53.986092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:53.986754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:53.988171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49634468-c66a-4c05-ad07-922e50ae94d8 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:53.992463 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:53.992463 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:53.995226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.995913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:53.996988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:53.997760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.002768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49634468-c66a-4c05-ad07-922e50ae94d8 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.004168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49634468-c66a-4c05-ad07-922e50ae94d8 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.154152 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49634468-c66a-4c05-ad07-922e50ae94d8 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.170380 May 10 02:11:54.155747 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 72/164] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:53 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:54.167527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0eb62f8-dc22-4c67-9aaa-d996b449426f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:54.169751 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.169751 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:54.191590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0eb62f8-dc22-4c67-9aaa-d996b449426f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.192289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0eb62f8-dc22-4c67-9aaa-d996b449426f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.246042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:54.254532 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-322402ac-d301-45e5-b6f2-b419aa67ebdd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.283373 May 10 02:11:54.264038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 93/165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:53 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:54.264038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37bc4040>, body: {"quota_set": {"ram": "2048"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:54.365246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0eb62f8-dc22-4c67-9aaa-d996b449426f tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.202177 May 10 02:11:54.371547 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 73/166] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:54 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:11:54.377703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-978398a1-bc0d-40d6-8a9e-f6f0aa186282 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:54.378802 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.378802 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:54.419974 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-978398a1-bc0d-40d6-8a9e-f6f0aa186282 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.047009 May 10 02:11:54.420796 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 74/167] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:54 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:54.425834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-745f9bcd-1922-46d2-9205-10aa46fa68df req-74988a99-1a09-4746-93b1-deb1aeb12d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db1f99b-607f-4121-b793-8cd35916a89a", "name": "network-vif-plugged", "status": "completed", "tag": "969519d4-9210-4bb3-95f6-44d6b1420185"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:54.440362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-745f9bcd-1922-46d2-9205-10aa46fa68df req-74988a99-1a09-4746-93b1-deb1aeb12d63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.441166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-745f9bcd-1922-46d2-9205-10aa46fa68df req-74988a99-1a09-4746-93b1-deb1aeb12d63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.458689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-745f9bcd-1922-46d2-9205-10aa46fa68df req-74988a99-1a09-4746-93b1-deb1aeb12d63 service nova] Creating event network-vif-plugged:969519d4-9210-4bb3-95f6-44d6b1420185 for instance 9db1f99b-607f-4121-b793-8cd35916a89a on n-h2-841089-2 May 10 02:11:54.468912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-745f9bcd-1922-46d2-9205-10aa46fa68df req-74988a99-1a09-4746-93b1-deb1aeb12d63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046169 May 10 02:11:54.470067 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 75/168] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:54.477831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18265dd5-ac6b-40b0-8538-f6a196ac4a96 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1810574237"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:54.479836 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.479836 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:54.480950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-18265dd5-ac6b-40b0-8538-f6a196ac4a96 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid e8ac361d-9145-4cad-971b-15a05a10750e for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:54.517417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18265dd5-ac6b-40b0-8538-f6a196ac4a96 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044640 May 10 02:11:54.518265 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 76/169] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:54.525102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:54.526109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:54.535249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.535931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.536986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.537459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.544281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.545095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.546137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.546693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.579691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.580147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.581016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.581443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.643238 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79231ac0-e49d-4554-b628-b717b5adf06d tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907?user_id=a1e5924e80ac4c5a9007259a981bb1da" status: 200 len: 148 microversion: 2.57 time: 0.385926 May 10 02:11:54.644221 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 94/170] 10.222.0.52 () {62 vars in 1383 bytes} [Tue May 10 02:11:54 2022] PUT /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907?user_id=a1e5924e80ac4c5a9007259a981bb1da => generated 148 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:54.651678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:54.652375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:54.659687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.660245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.661286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.661797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.696084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:54.705119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:54.706885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:54.708467 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74306650-6129-4213-9cb7-9be3c4707f71 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.188242 May 10 02:11:54.709410 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 77/171] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:54 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:54.727957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d8ca015-dedf-492d-b99d-4bb20df10b6f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-477562267"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:54.729341 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.729341 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:54.730230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-9d8ca015-dedf-492d-b99d-4bb20df10b6f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid c39f052e-2ed3-48e7-8db7-454adf45a876 for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:54.756022 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d8ca015-dedf-492d-b99d-4bb20df10b6f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045374 May 10 02:11:54.756908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 78/172] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:54 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:54.762601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00383e21-32c3-493b-b678-60a87f8b181a tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:54.763361 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.763361 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:54.798318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00383e21-32c3-493b-b678-60a87f8b181a tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.039953 May 10 02:11:54.799430 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 79/173] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:54 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:54.806040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57a35552-00b0-43c6-9837-dc6d153e7887 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] Calling method '.version_select at 0x7f3d37f1c9d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:54.831875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:54.839628 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb8ea3a0-a6fe-49e0-89e1-9d1ff85eb96d tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.194234 May 10 02:11:54.840334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 95/174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:54 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:54.844999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2e3a519-ef73-4e7a-a68d-ce74229c419d tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:54.846341 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.846341 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:54.854708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2e3a519-ef73-4e7a-a68d-ce74229c419d tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:54.855444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2e3a519-ef73-4e7a-a68d-ce74229c419d tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:54.976652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2e3a519-ef73-4e7a-a68d-ce74229c419d tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.135052 May 10 02:11:54.979603 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 96/175] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:54 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:54.985561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0103fede-a7fb-49cd-a35d-487f69b7de17 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:54.986536 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:54.986536 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:54.996260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0103fede-a7fb-49cd-a35d-487f69b7de17 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0103fede-a7fb-49cd-a35d-487f69b7de17 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Request method failure captured: May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_wIbpH4PiynwAncjALIEgOs2cRirGHkrgMVQGf__A7bKC2e-l7wOQhC2Hu7NBDqMRgtdHTvoq8Ofz-who_cwQ3A_JCj01UBfunqJlU25em5Ueqhy_JSVEJxqhrak40oS7nYP6eF4mBl1thwLyvzyHk83zGE1PAEBSs0wYeGUZ-04 May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:55.001433 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f8d22f7a2d6849b2aed2cf245b670a3d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ad1cdd0b69f49cfb1005ee4d5984ffb May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: exception: Aggregate 6 could not be found. May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6'} May 10 02:11:55.002848 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6338, in get_aggregate May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.003744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:55.004991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0103fede-a7fb-49cd-a35d-487f69b7de17 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:55.006171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0103fede-a7fb-49cd-a35d-487f69b7de17 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.022162 May 10 02:11:55.007608 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 97/176] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:11:54 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:55.012905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.013694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:55.022949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.023583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.024465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.025026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.040131 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57a35552-00b0-43c6-9837-dc6d153e7887 tempest-QuotasAdminTestV257-280777388 tempest-QuotasAdminTestV257-280777388-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907?user_id=a1e5924e80ac4c5a9007259a981bb1da" status: 200 len: 190 microversion: 2.57 time: 0.239209 May 10 02:11:55.040728 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 80/177] 10.222.0.52 () {60 vars in 1363 bytes} [Tue May 10 02:11:54 2022] GET /compute/v2.1/os-quota-sets/637a2f9309374d3b9cade770685e9907?user_id=a1e5924e80ac4c5a9007259a981bb1da => generated 190 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:11:55.051036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.052867 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.052867 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.061488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.061959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.095858 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-841089-2. May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 39 May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:55.118427 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: {"add_host": {"host": "n-h1-841089-2"}} May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:55.119730 n-d-841089-2 devstack@n-api.service[118717]: exception: Aggregate 7 already has host n-h1-841089-2. May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-841089-2'}}} May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = self._query(query) May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi conn.query(q) May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result.read() May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 02:11:55.120571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-841089-2-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi session.flush() May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._flush(objects) May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 02:11:55.121625 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi compat.raise_( May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi flush_context.execute() May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi rec.execute(self) May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 02:11:55.127284 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = self._query(query) May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi conn.query(q) May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 02:11:55.128623 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result.read() May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-841089-2-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 10, 2, 11, 55, 82533), 'updated_at': None, 'host': 'n-h1-841089-2', 'aggregate_id': 7}] May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.129761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in add_host_to_aggregate May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-841089-2. May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.131132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-841089-2. May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:55.133349 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-841089-2. May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-841089-2. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-113dd4da-1471-4d04-99ef-713c8cf483a2 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.072900 May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 81/178] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5c825a8-7b0c-4efd-8a5d-c0b29aee24ae tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.134751 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.143209 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c5c825a8-7b0c-4efd-8a5d-c0b29aee24ae tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5c825a8-7b0c-4efd-8a5d-c0b29aee24ae tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Request method failure captured: May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_wIbpH4PiynwAncjALIEgOs2cRirGHkrgMVQGf__A7bKC2e-l7wOQhC2Hu7NBDqMRgtdHTvoq8Ofz-who_cwQ3A_JCj01UBfunqJlU25em5Ueqhy_JSVEJxqhrak40oS7nYP6eF4mBl1thwLyvzyHk83zGE1PAEBSs0wYeGUZ-04 May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:55.146412 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f8d22f7a2d6849b2aed2cf245b670a3d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ad1cdd0b69f49cfb1005ee4d5984ffb May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: exception: Aggregate 6 could not be found. May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6'} May 10 02:11:55.147831 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6391, in delete_aggregate May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:55.148664 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.149853 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.151125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.151125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:55.151125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:55.151125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 10 02:11:55.151125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.152221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5c825a8-7b0c-4efd-8a5d-c0b29aee24ae tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:55.153234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c5c825a8-7b0c-4efd-8a5d-c0b29aee24ae tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.030231 May 10 02:11:55.153992 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 82/179] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:55.160801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75867f63-fff5-4fa5-8e3b-650fc5beb425 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.162607 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.162607 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.174872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75867f63-fff5-4fa5-8e3b-650fc5beb425 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.176337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75867f63-fff5-4fa5-8e3b-650fc5beb425 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.190684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:55.200380 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4a98bda-b06b-403c-8852-db2f51e203c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.191633 May 10 02:11:55.202106 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 98/180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:55.216937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d185c0c1-7d2d-45e1-8169-6a34a1d85383 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1799749916", "name": "tempest-test_aggregate-783367241"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.238411 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.238411 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:55.239523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-d185c0c1-7d2d-45e1-8169-6a34a1d85383 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 073ccf20-562d-4908-84cf-ca9764f68f6b for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:55.296445 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d185c0c1-7d2d-45e1-8169-6a34a1d85383 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.092790 May 10 02:11:55.298205 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 99/181] 10.222.0.52 () {60 vars in 1164 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:55.305516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.306689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:55.316385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.317177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.324020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.332339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.346708 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75867f63-fff5-4fa5-8e3b-650fc5beb425 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.190225 May 10 02:11:55.348510 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 83/182] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:55.355194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4f917c13-7bba-4aa5-ad24-a9d8d10d1f5e tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.356233 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.356233 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.396207 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4f917c13-7bba-4aa5-ad24-a9d8d10d1f5e tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.044105 May 10 02:11:55.397611 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 84/183] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:55 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:55.405215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a4306fa-aef4-4f83-adc5-fe9eab99a49c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.406195 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.406195 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.431505 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a4306fa-aef4-4f83-adc5-fe9eab99a49c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.031092 May 10 02:11:55.433629 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 85/184] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:55 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:55.443829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22dd8d84-97cf-42c5-971b-2128c90c9c81 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.445354 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.445354 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.453903 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-22dd8d84-97cf-42c5-971b-2128c90c9c81 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] HTTP exception thrown: Aggregate 8 could not be found. May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22dd8d84-97cf-42c5-971b-2128c90c9c81 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Request method failure captured: May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_wIbpH4PiynwAncjALIEgOs2cRirGHkrgMVQGf__A7bKC2e-l7wOQhC2Hu7NBDqMRgtdHTvoq8Ofz-who_cwQ3A_JCj01UBfunqJlU25em5Ueqhy_JSVEJxqhrak40oS7nYP6eF4mBl1thwLyvzyHk83zGE1PAEBSs0wYeGUZ-04 May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:55.455540 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f8d22f7a2d6849b2aed2cf245b670a3d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ad1cdd0b69f49cfb1005ee4d5984ffb May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: exception: Aggregate 8 could not be found. May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8'} May 10 02:11:55.456991 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6338, in get_aggregate May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.458606 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. May 10 02:11:55.461513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.464632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22dd8d84-97cf-42c5-971b-2128c90c9c81 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:55.465229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-22dd8d84-97cf-42c5-971b-2128c90c9c81 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.029991 May 10 02:11:55.466729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 86/185] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:55.480692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98bc7eb9-1599-4025-921b-f1532acdce7a tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422470630"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.486195 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.486195 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.488394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-98bc7eb9-1599-4025-921b-f1532acdce7a tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 1c2f69f8-e027-4558-9cfc-5866ef677470 for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:55.512782 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98bc7eb9-1599-4025-921b-f1532acdce7a tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043540 May 10 02:11:55.513929 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 87/186] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:55.521850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b61f496-5753-4dad-b3c9-779d6221e1ec tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.523566 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.523566 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.541090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9b61f496-5753-4dad-b3c9-779d6221e1ec tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] HTTP exception thrown: Aggregate 8 could not be found. May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b61f496-5753-4dad-b3c9-779d6221e1ec tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Request method failure captured: May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_wIbpH4PiynwAncjALIEgOs2cRirGHkrgMVQGf__A7bKC2e-l7wOQhC2Hu7NBDqMRgtdHTvoq8Ofz-who_cwQ3A_JCj01UBfunqJlU25em5Ueqhy_JSVEJxqhrak40oS7nYP6eF4mBl1thwLyvzyHk83zGE1PAEBSs0wYeGUZ-04 May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:55.543533 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f8d22f7a2d6849b2aed2cf245b670a3d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f8d22f7a2d6849b2aed2cf245b670a3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f8d22f7a2d6849b2aed2cf245b670a3d May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-48490717 May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ad1cdd0b69f49cfb1005ee4d5984ffb May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminTestJSON-48490717-project-admin May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: exception: Aggregate 8 could not be found. May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8'} May 10 02:11:55.544979 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6391, in delete_aggregate May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:55.545695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.546797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.549823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.549823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:55.549823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:55.549823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. May 10 02:11:55.549823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.552912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b61f496-5753-4dad-b3c9-779d6221e1ec tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:55.554288 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b61f496-5753-4dad-b3c9-779d6221e1ec tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.039378 May 10 02:11:55.555193 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 88/187] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:55 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:55.622139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:55.635840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dcb404b8-50c6-4cd6-8839-56cee8666ea4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.336459 May 10 02:11:55.636761 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 100/188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:55.644025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a7a442c-55b2-43d3-bf24-2795dcb21fde tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-994336748"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.645381 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.645381 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:55.647028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-3a7a442c-55b2-43d3-bf24-2795dcb21fde tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid a724d63f-30af-4ae3-add0-7aafcc87ae9c for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:55.677440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a7a442c-55b2-43d3-bf24-2795dcb21fde tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038748 May 10 02:11:55.683247 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 101/189] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:55.688072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adc9bc26-35a1-4bc3-8afc-fc0e04a38a24 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.689057 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.689057 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:55.698026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-adc9bc26-35a1-4bc3-8afc-fc0e04a38a24 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.013625 May 10 02:11:55.698788 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 102/190] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:55.709583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d99dc920-e9da-478a-b384-8fca13e14f2b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.711302 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.711302 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:55.735397 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d99dc920-e9da-478a-b384-8fca13e14f2b tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.029890 May 10 02:11:55.736290 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 103/191] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:11:55.742325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.743056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:55.751643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.752097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.752940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:55.753496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:55.954897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a16d8a8a-b992-4c09-93d0-0ee167366d23 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:55.956186 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.956186 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.957227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a16d8a8a-b992-4c09-93d0-0ee167366d23 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0f75991401814cc69d7335be9510977b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a11dc1df04b478b5caa452f8d2223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a16d8a8a-b992-4c09-93d0-0ee167366d23 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Request method failure captured: May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 39 May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm8iD7ONo5e3In4AxgbNXb3SjiIwuPPOQ_kwHZNEWjgsFTRcXgVLJ-btbHGTb_mVn_k6Iyve6LGJmI7yAXQFKk614H5ltizvi6RZjYTtL_nTQjLwk0zN9oaQheUTza9KafjgsRIGU9WIlFuh4hcIxWZfu--lIrVbemST1Em7fzYmCk May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:11:55.959769 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_436a11dc1df04b478b5caa452f8d2223", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0f75991401814cc69d7335be9510977b May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: {"add_host": {"host": "n-h1-841089-2"}} May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:55.960968 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-841089-2'}}} May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:55.961679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 10 02:11:55.963416 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:55.964488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a16d8a8a-b992-4c09-93d0-0ee167366d23 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:55.964488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a16d8a8a-b992-4c09-93d0-0ee167366d23 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.405021 May 10 02:11:55.972480 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 89/192] 10.222.0.52 () {60 vars in 1190 bytes} [Tue May 10 02:11:55 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 417 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:55.980198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aa9cdbfa-d578-4e30-bd40-c5577f6d8431 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.981166 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:55.981166 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:55.988733 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aa9cdbfa-d578-4e30-bd40-c5577f6d8431 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.015136 May 10 02:11:55.990112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 90/193] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:55.994699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:55.995829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:56.004141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.005522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.006573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.007277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.008036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.021184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.024638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.026876 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2dc0da71-e7b9-4b94-965b-3c31dffd8bee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.288719 May 10 02:11:56.027920 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 104/194] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:56.034106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef6e84bf-7ba9-4704-82dd-074f4a88bdc0 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.035429 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.035429 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.078944 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef6e84bf-7ba9-4704-82dd-074f4a88bdc0 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.049843 May 10 02:11:56.079961 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 105/195] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:56 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:56.087028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-820e549e-d411-409a-bd00-fcf3154895f7 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.088511 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.088511 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.138333 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-820e549e-d411-409a-bd00-fcf3154895f7 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.057302 May 10 02:11:56.139776 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 106/196] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:56 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:56.151932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10938b53-8258-426f-b799-2f37a69776e4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-390774815"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.153287 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.153287 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.154311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-10938b53-8258-426f-b799-2f37a69776e4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 1360a7aa-8f9e-45c2-b5ba-db9adcaa9a55 for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:56.190026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10938b53-8258-426f-b799-2f37a69776e4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049213 May 10 02:11:56.190623 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 107/197] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.195969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8012a71-c571-4125-a3c3-c2639b971e94 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1204150001", "availability_zone": "tempest-test_az-1526676907"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.197467 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.197467 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.208161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-e8012a71-c571-4125-a3c3-c2639b971e94 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 6acd8ba6-01d7-4b56-be23-583c0ba2bfba for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:56.250989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.260496 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-193ec252-1fbf-4116-a1da-08335b69c893 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.268078 May 10 02:11:56.262669 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 91/198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:55 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:56.275376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1786604547"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.276640 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.276640 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:56.281975 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8012a71-c571-4125-a3c3-c2639b971e94 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.090139 May 10 02:11:56.282738 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 108/199] 10.222.0.52 () {60 vars in 1164 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.294515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.295158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:56.308548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.309024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.314374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.315034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.315852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.316289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.323639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.324250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.341142 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1786604547 could not be found. May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 58 May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:56.347386 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: {"add_host": {"host": "tempest-nonexist_host-1786604547"}} May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:56.349566 n-d-841089-2 devstack@n-api.service[118717]: exception: Compute host tempest-nonexist_host-1786604547 could not be found. May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1786604547'}}} May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5870, in _get_service_in_cell_by_host May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1786604547' is not mapped to any cell May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.350373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5938, in _find_service_in_cell May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6495, in add_host_to_aggregate May 10 02:11:56.353256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5878, in _get_service_in_cell_by_host May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1786604547 could not be found. May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1786604547 could not be found. May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.356111 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1786604547 could not be found. May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1786604547 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-150d5333-af14-4392-a11a-848454a9031b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.087822 May 10 02:11:56.358751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 92/200] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:56.362097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8420b130-6806-41b7-a7cf-d7ae7a5fcf35 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1204150001_new", "availability_zone": "tempest-test_az-1526676907_new"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.456758 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.456758 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:56.502242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8420b130-6806-41b7-a7cf-d7ae7a5fcf35 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.503159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8420b130-6806-41b7-a7cf-d7ae7a5fcf35 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.555952 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8420b130-6806-41b7-a7cf-d7ae7a5fcf35 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.200713 May 10 02:11:56.565117 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 93/201] 10.222.0.52 () {60 vars in 1172 bytes} [Tue May 10 02:11:56 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.566208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.575199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ad29d61-2e2e-4bef-a11c-a6ab5f4e8df1 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.576285 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.576285 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:56.587301 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3764bd4-2fc3-4145-9f72-4bb0d9abe259 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.292764 May 10 02:11:56.587301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 109/202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:56 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:56.587301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e332e724-7eb3-4a81-8df0-8ebca7bcafe0 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.587301 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.587301 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.600958 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e332e724-7eb3-4a81-8df0-8ebca7bcafe0 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 554 microversion: 2.1 time: 0.019850 May 10 02:11:56.602593 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 110/203] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:11:56 2022] GET /compute/v2.1/os-aggregates => generated 554 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.623102 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ad29d61-2e2e-4bef-a11c-a6ab5f4e8df1 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.054918 May 10 02:11:56.627666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 94/204] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:56 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:56.635127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6ebb67f3-7f16-4093-980d-ace7fb246050 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6ebb67f3-7f16-4093-980d-ace7fb246050 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 283 May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:56.641901 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:11:56.643379 n-d-841089-2 devstack@n-api.service[118717]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:11:56.644101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:11:56.644857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:11:56.646707 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:11:56.648001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:11:56.648001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:56.650090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6ebb67f3-7f16-4093-980d-ace7fb246050 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:56.651436 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6ebb67f3-7f16-4093-980d-ace7fb246050 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021667 May 10 02:11:56.652916 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 95/205] 10.222.0.52 () {60 vars in 1164 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:11:56.654012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0497dbf-7955-4516-b83c-e4a8a3b9bfd5 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.655435 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.655435 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.666455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.667861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:56.678447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.679636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.681508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.682605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.720578 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0497dbf-7955-4516-b83c-e4a8a3b9bfd5 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.110373 May 10 02:11:56.728470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 111/206] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:56 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:56.733575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce31b6c0-81d5-443d-bc40-b8698f6136bc tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce31b6c0-81d5-443d-bc40-b8698f6136bc tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 27 May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:56.737820 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: {"aggregate": {"name": ""}} May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:56.739099 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute name. Value: . '' is too short May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'aggregate': {'name': ''}}} May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '' May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:56.739858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 10 02:11:56.745589 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.746622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce31b6c0-81d5-443d-bc40-b8698f6136bc tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:56.746622 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce31b6c0-81d5-443d-bc40-b8698f6136bc tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009747 May 10 02:11:56.746622 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 112/207] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:11:56.746622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-775fa1c7-1def-4016-8efb-75a393e0da92 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-796486718"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.747414 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.747414 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.748665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-775fa1c7-1def-4016-8efb-75a393e0da92 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Generated uuid 6eb0c1a8-6fc0-4494-999e-e952a4b7f194 for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:56.781366 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-775fa1c7-1def-4016-8efb-75a393e0da92 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040021 May 10 02:11:56.782933 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 113/208] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.788942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36574169-9c0a-4977-8fee-7280f6537f8b tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-502914808"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.790655 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.790655 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.791901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36574169-9c0a-4977-8fee-7280f6537f8b tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0f75991401814cc69d7335be9510977b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a11dc1df04b478b5caa452f8d2223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36574169-9c0a-4977-8fee-7280f6537f8b tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Request method failure captured: May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 59 May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8iD7ONo5e3In4AxgbNXb3SjiIwuPPOQ_kwHZNEWjgsFTRcXgVLJ-btbHGTb_mVn_k6Iyve6LGJmI7yAXQFKk614H5ltizvi6RZjYTtL_nTQjLwk0zN9oaQheUTza9KafjgsRIGU9WIlFuh4hcIxWZfu--lIrVbemST1Em7fzYmCk May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:56.795027 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_436a11dc1df04b478b5caa452f8d2223", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0f75991401814cc69d7335be9510977b May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: {"aggregate": {"name": "tempest-test_aggregate-502914808"}} May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:56.796555 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-502914808'}}} May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:56.797488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:56.798634 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 10 02:11:56.799779 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.801415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36574169-9c0a-4977-8fee-7280f6537f8b tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:56.802537 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36574169-9c0a-4977-8fee-7280f6537f8b tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018588 May 10 02:11:56.803373 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 114/209] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:56.831999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a0b528d-42ce-43c8-9226-30232b39cd75 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.833485 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.833485 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.841282 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a0b528d-42ce-43c8-9226-30232b39cd75 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.036715 May 10 02:11:56.842291 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 115/210] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:11:56 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.848423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fe53efba-7fe6-4420-925b-4cea6e3c85e5 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-507122703"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.851312 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.851312 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.852675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-fe53efba-7fe6-4420-925b-4cea6e3c85e5 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 80bff1f9-941f-4780-ac37-e688d7098bf7 for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:56.887673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fe53efba-7fe6-4420-925b-4cea6e3c85e5 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044177 May 10 02:11:56.890366 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 116/211] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:56.903561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a680e220-4bfd-4a99-bd3b-6f3055c512e5 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.906000 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.906000 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.942138 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a680e220-4bfd-4a99-bd3b-6f3055c512e5 tempest-AggregatesAdminTestJSON-48490717 tempest-AggregatesAdminTestJSON-48490717-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.049757 May 10 02:11:56.943908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 117/212] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:56 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:56.949896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:56.953368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-982902d1-5f5e-4a24-98c6-79a1b76a181b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-507122703"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:56.954708 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:56.954708 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:56.961228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-982902d1-5f5e-4a24-98c6-79a1b76a181b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 5664c60e-65a7-4d89-87ba-f27a8c49c884 for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:56.962481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40150f72-bf22-4766-bde4-f803a0b9f9bc tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.304867 May 10 02:11:56.966292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 96/213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:56 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:56.980397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:56.981103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:56.986521 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-982902d1-5f5e-4a24-98c6-79a1b76a181b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-507122703 already exists. May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-982902d1-5f5e-4a24-98c6-79a1b76a181b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 59 May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:56.992700 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: {"aggregate": {"name": "tempest-test_aggregate-507122703"}} May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:56.994078 n-d-841089-2 devstack@n-api.service[118716]: exception: Aggregate tempest-test_aggregate-507122703 already exists. May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-507122703'}}} May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6332, in create_aggregate May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi aggregate.create() May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 10 02:11:56.994960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-507122703 already exists. May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:56.996315 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-507122703 already exists. May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-507122703 already exists. May 10 02:11:56.997623 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:56.998381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.998381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:56.999747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:56.999868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-982902d1-5f5e-4a24-98c6-79a1b76a181b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-507122703 already exists. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:56.999975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.000260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-982902d1-5f5e-4a24-98c6-79a1b76a181b tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.054082 May 10 02:11:57.001387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 118/214] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:56 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:57.012401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c929335-5ef9-49a6-9364-870165df0e56 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.015051 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.015051 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.039776 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c929335-5ef9-49a6-9364-870165df0e56 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.033066 May 10 02:11:57.040683 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 119/215] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:57 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:57.043256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] HTTP exception thrown: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.046813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.047502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Request method failure captured: May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 HTTP/1.1 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm8qhmfyT9dCwfiY-s7LY2NtBVR0EKVyFMlp9ug0ehhJBAs9XUVmanRWt_RsW7il0Y6o1tsdoZ_jy7zbTlCLYPdptRqM-jK9ZiNsxrirf0NFyK4N5yvtm_rILpubuNeHF02W3870n7JFZyKKycsCvVp-MP75QlauReAa4N0Fs3P3N8 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: da85f31817b74746a6b028011e177611 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:11:57.048381 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_da85f31817b74746a6b028011e177611", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da85f31817b74746a6b028011e177611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/da85f31817b74746a6b028011e177611"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da85f31817b74746a6b028011e177611"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: da85f31817b74746a6b028011e177611 May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminTestJSON-353255131-project May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 116885a9c674485f9354df010698aada May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminTestJSON-353255131-project May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.049774 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '083a14a6-3029-46fc-88f7-8e0e51435a62'} May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.050554 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.052031 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.055161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.055161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.055812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.056253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.057276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Returning 404 to user: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.058604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04667247-0ffb-48ae-9e90-c90cd45d6ea7 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "DELETE /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 404 len: 111 microversion: 2.1 time: 0.088883 May 10 02:11:57.059730 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 97/216] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:11:56 2022] DELETE /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:57.066625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28bda381-6380-4183-900e-e60c5ec36a4e tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1122366382"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:57.069081 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.069081 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:57.070326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-28bda381-6380-4183-900e-e60c5ec36a4e tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 72b8e976-e24e-4786-bc6b-a0581afa54bf for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:57.104030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28bda381-6380-4183-900e-e60c5ec36a4e tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043000 May 10 02:11:57.109897 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 98/217] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:57.114821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.115463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] [instance: 083a14a6-3029-46fc-88f7-8e0e51435a62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:57.125427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.125873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.126663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.127098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.154422 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] HTTP exception thrown: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Request method failure captured: May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 HTTP/1.1 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm8qhmfyT9dCwfiY-s7LY2NtBVR0EKVyFMlp9ug0ehhJBAs9XUVmanRWt_RsW7il0Y6o1tsdoZ_jy7zbTlCLYPdptRqM-jK9ZiNsxrirf0NFyK4N5yvtm_rILpubuNeHF02W3870n7JFZyKKycsCvVp-MP75QlauReAa4N0Fs3P3N8 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: da85f31817b74746a6b028011e177611 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:11:57.160074 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_da85f31817b74746a6b028011e177611", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da85f31817b74746a6b028011e177611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/da85f31817b74746a6b028011e177611"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/da85f31817b74746a6b028011e177611"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: da85f31817b74746a6b028011e177611 May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-353255131 May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminTestJSON-353255131-project May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 116885a9c674485f9354df010698aada May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminTestJSON-353255131-project May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.161578 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '083a14a6-3029-46fc-88f7-8e0e51435a62'} May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.162396 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. May 10 02:11:57.163767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.165011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] Returning 404 to user: Instance 083a14a6-3029-46fc-88f7-8e0e51435a62 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.165011 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-97849829-7a9d-4f51-b537-1d7c7c2fd744 tempest-AggregatesAdminTestJSON-353255131 tempest-AggregatesAdminTestJSON-353255131-project] 10.222.0.52 "GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62" status: 404 len: 111 microversion: 2.1 time: 0.050734 May 10 02:11:57.165390 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 99/218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/servers/083a14a6-3029-46fc-88f7-8e0e51435a62 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:57.170640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-137becbc-ac8d-44b3-bd1f-238864753678 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.171375 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.171375 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:57.172529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-137becbc-ac8d-44b3-bd1f-238864753678 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0f75991401814cc69d7335be9510977b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a11dc1df04b478b5caa452f8d2223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-137becbc-ac8d-44b3-bd1f-238864753678 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Request method failure captured: May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm8iD7ONo5e3In4AxgbNXb3SjiIwuPPOQ_kwHZNEWjgsFTRcXgVLJ-btbHGTb_mVn_k6Iyve6LGJmI7yAXQFKk614H5ltizvi6RZjYTtL_nTQjLwk0zN9oaQheUTza9KafjgsRIGU9WIlFuh4hcIxWZfu--lIrVbemST1Em7fzYmCk May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:11:57.173691 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_436a11dc1df04b478b5caa452f8d2223", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0f75991401814cc69d7335be9510977b May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 10 02:11:57.175080 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '15'} May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:57.175874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.177322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-137becbc-ac8d-44b3-bd1f-238864753678 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.178436 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-137becbc-ac8d-44b3-bd1f-238864753678 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.008566 May 10 02:11:57.178436 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 100/219] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:57.184175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d1e61dee-04d3-4276-bce6-e54924ae0a9f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.227648 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d1e61dee-04d3-4276-bce6-e54924ae0a9f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.047546 May 10 02:11:57.233279 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 101/220] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 10 02:11:57.240786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0269a23e-1ec7-4d01-bf33-60c4ac1cd15f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.242327 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.242327 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:57.256577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0269a23e-1ec7-4d01-bf33-60c4ac1cd15f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0269a23e-1ec7-4d01-bf33-60c4ac1cd15f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:11:57.258865 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: exception: Aggregate -1 could not be found. May 10 02:11:57.260278 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '-1'} May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6391, in delete_aggregate May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 10 02:11:57.261054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.262238 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0269a23e-1ec7-4d01-bf33-60c4ac1cd15f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.263536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0269a23e-1ec7-4d01-bf33-60c4ac1cd15f tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026047 May 10 02:11:57.266863 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 102/221] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:57 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:57.273117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28f55949-1cb1-40c2-a4bc-9b93c6c6d305 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-951965959"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:57.274627 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.274627 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:57.275633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-28f55949-1cb1-40c2-a4bc-9b93c6c6d305 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 1649b20c-b69c-4e1f-aa27-45af07728af7 for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:57.308912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28f55949-1cb1-40c2-a4bc-9b93c6c6d305 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039487 May 10 02:11:57.318764 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 103/222] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:57.327693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.332057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:57.350377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.352449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.353280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.354055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.359277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.372190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.373803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.377416 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8fe59f7-6d04-4280-a921-a18686323501 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.335370 May 10 02:11:57.380806 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 120/223] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:57.390241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54ba405f-f792-4454-82a5-568d6c10b9a7 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.391550 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.391550 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.392608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54ba405f-f792-4454-82a5-568d6c10b9a7 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0f75991401814cc69d7335be9510977b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a11dc1df04b478b5caa452f8d2223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54ba405f-f792-4454-82a5-568d6c10b9a7 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Request method failure captured: May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8iD7ONo5e3In4AxgbNXb3SjiIwuPPOQ_kwHZNEWjgsFTRcXgVLJ-btbHGTb_mVn_k6Iyve6LGJmI7yAXQFKk614H5ltizvi6RZjYTtL_nTQjLwk0zN9oaQheUTza9KafjgsRIGU9WIlFuh4hcIxWZfu--lIrVbemST1Em7fzYmCk May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:57.394889 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_436a11dc1df04b478b5caa452f8d2223", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0f75991401814cc69d7335be9510977b May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 10 02:11:57.396336 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '16'} May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:57.397371 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 10 02:11:57.398810 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.401292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54ba405f-f792-4454-82a5-568d6c10b9a7 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.402581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54ba405f-f792-4454-82a5-568d6c10b9a7 tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.020513 May 10 02:11:57.403762 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 121/224] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:57.414402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89fea332-af60-4ffd-aa1e-20350912110c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.415956 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.415956 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.448413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89fea332-af60-4ffd-aa1e-20350912110c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.039508 May 10 02:11:57.449387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 122/225] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:57 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 10 02:11:57.458727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1a70454-d64d-4aaa-af29-edfb5a081ee4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.460466 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.460466 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.467481 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d1a70454-d64d-4aaa-af29-edfb5a081ee4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1a70454-d64d-4aaa-af29-edfb5a081ee4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:57.469113 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: exception: Aggregate -1 could not be found. May 10 02:11:57.470535 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '-1'} May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6338, in get_aggregate May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.471397 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 10 02:11:57.472696 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.475023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1a70454-d64d-4aaa-af29-edfb5a081ee4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.476073 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1a70454-d64d-4aaa-af29-edfb5a081ee4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021410 May 10 02:11:57.477275 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 123/226] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 02:11:57.486079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7a5b177-e9ab-43b7-a0a3-f5933ab0019d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.487160 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.487160 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.488219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7a5b177-e9ab-43b7-a0a3-f5933ab0019d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0f75991401814cc69d7335be9510977b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a11dc1df04b478b5caa452f8d2223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7a5b177-e9ab-43b7-a0a3-f5933ab0019d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Request method failure captured: May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8iD7ONo5e3In4AxgbNXb3SjiIwuPPOQ_kwHZNEWjgsFTRcXgVLJ-btbHGTb_mVn_k6Iyve6LGJmI7yAXQFKk614H5ltizvi6RZjYTtL_nTQjLwk0zN9oaQheUTza9KafjgsRIGU9WIlFuh4hcIxWZfu--lIrVbemST1Em7fzYmCk May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:57.490796 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_436a11dc1df04b478b5caa452f8d2223", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0f75991401814cc69d7335be9510977b May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 10 02:11:57.492264 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:57.493074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 10 02:11:57.494299 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:57.495899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7a5b177-e9ab-43b7-a0a3-f5933ab0019d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:57.499445 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7a5b177-e9ab-43b7-a0a3-f5933ab0019d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017419 May 10 02:11:57.500445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 124/227] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 10 02:11:57.515057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9f6c84c-28e1-4033-9915-50a3b80c07d6 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-414839697"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:57.517276 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.517276 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.519054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-c9f6c84c-28e1-4033-9915-50a3b80c07d6 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 27fbf081-4077-4cad-9bd3-d46bed2eeeb1 for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:57.550524 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9f6c84c-28e1-4033-9915-50a3b80c07d6 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042317 May 10 02:11:57.552728 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 125/228] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:57.575678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e1b16ab-80a2-4d85-af8d-34e325d455b1 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:57.585310 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:57.585310 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:57.611758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e1b16ab-80a2-4d85-af8d-34e325d455b1 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.612514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e1b16ab-80a2-4d85-af8d-34e325d455b1 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.848307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e1b16ab-80a2-4d85-af8d-34e325d455b1 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.286688 May 10 02:11:57.855978 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 126/229] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:11:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:57.864008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:57.867669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:57.880937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.881447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.882274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:57.882722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:57.918473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:57.943826 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b3685d1-c1fd-49f7-a411-8a31ee68b4fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1320 microversion: 2.1 time: 0.623867 May 10 02:11:57.946574 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 104/230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:58.237671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c583882-b5f8-4518-81d7-937b1ed7ef1c tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Calling method '.version_select at 0x7f3d37b9edc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:58.316271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:58.325675 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8911a048-3435-422e-a3fd-41e5617b3285 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.468465 May 10 02:11:58.336724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 127/231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:58.343456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d3dc2c4-b9f0-429e-b83d-e54b36b9007d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:58.344935 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:58.344935 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:58.345787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d3dc2c4-b9f0-429e-b83d-e54b36b9007d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0f75991401814cc69d7335be9510977b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '436a11dc1df04b478b5caa452f8d2223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d3dc2c4-b9f0-429e-b83d-e54b36b9007d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Request method failure captured: May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 42 May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm8iD7ONo5e3In4AxgbNXb3SjiIwuPPOQ_kwHZNEWjgsFTRcXgVLJ-btbHGTb_mVn_k6Iyve6LGJmI7yAXQFKk614H5ltizvi6RZjYTtL_nTQjLwk0zN9oaQheUTza9KafjgsRIGU9WIlFuh4hcIxWZfu--lIrVbemST1Em7fzYmCk May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:11:58.351051 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_436a11dc1df04b478b5caa452f8d2223", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/436a11dc1df04b478b5caa452f8d2223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 436a11dc1df04b478b5caa452f8d2223 May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906 May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0f75991401814cc69d7335be9510977b May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1952986906-project May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: {"remove_host": {"host": "n-h1-841089-2"}} May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:58.352660 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-841089-2'}}} May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:58.353529 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 10 02:11:58.354744 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.357198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d3dc2c4-b9f0-429e-b83d-e54b36b9007d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:58.357198 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d3dc2c4-b9f0-429e-b83d-e54b36b9007d tempest-AggregatesAdminNegativeTestJSON-1952986906 tempest-AggregatesAdminNegativeTestJSON-1952986906-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014460 May 10 02:11:58.357198 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 128/232] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:11:58 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:11:58.360845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:58.361461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:58.377048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.377519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.378311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.378750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.550546 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c583882-b5f8-4518-81d7-937b1ed7ef1c tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 371 microversion: 2.1 time: 0.602428 May 10 02:11:58.556862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 105/233] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:11:57 2022] GET /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 371 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:58.556862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a56043d2-47fc-4039-9461-93001b6b7611 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:58.557382 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:58.557382 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:11:58.566447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a56043d2-47fc-4039-9461-93001b6b7611 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.567107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a56043d2-47fc-4039-9461-93001b6b7611 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.603275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:58.611640 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-892814fc-5052-4274-93ba-2ca56a2626de tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.254225 May 10 02:11:58.621019 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 129/234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:58 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:58.628419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:58.628419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:58.633387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.634022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.634982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.635603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.734610 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a56043d2-47fc-4039-9461-93001b6b7611 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.182010 May 10 02:11:58.736030 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 106/235] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:11:58 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:58.742361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9725349a-deba-4ead-9320-f61100d44183 req-2c1e72f8-23d5-4ed9-b609-cfca5aa0910a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb619058-700d-4b0a-8b3e-9c3c845c4538", "name": "network-vif-plugged", "status": "completed", "tag": "9a877a3d-b01e-4608-9e40-1aa136c12444"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:58.751615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9725349a-deba-4ead-9320-f61100d44183 req-2c1e72f8-23d5-4ed9-b609-cfca5aa0910a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.752068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9725349a-deba-4ead-9320-f61100d44183 req-2c1e72f8-23d5-4ed9-b609-cfca5aa0910a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.763976 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9725349a-deba-4ead-9320-f61100d44183 req-2c1e72f8-23d5-4ed9-b609-cfca5aa0910a service nova] Creating event network-vif-plugged:9a877a3d-b01e-4608-9e40-1aa136c12444 for instance eb619058-700d-4b0a-8b3e-9c3c845c4538 on n-h1-841089-2 May 10 02:11:58.769992 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9725349a-deba-4ead-9320-f61100d44183 req-2c1e72f8-23d5-4ed9-b609-cfca5aa0910a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 May 10 02:11:58.771625 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 107/236] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:58.790435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-231e0f6d-09ee-4c73-8fa7-f5d844d8783d tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37b47f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:58.810363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:58.821548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:58.823332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:58.824669 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8efd3ab1-4969-4f93-a375-85c431c8ea40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.202438 May 10 02:11:58.825383 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 130/237] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:11:58 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:11:58.830031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6cfdd3e9-549a-4e17-bf45-cb1ab947dfc4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:58.830968 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:58.830968 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:58.855529 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6cfdd3e9-549a-4e17-bf45-cb1ab947dfc4 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.028411 May 10 02:11:58.856908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 131/238] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:58 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:58.866869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f760d502-c9b9-4faa-a1a0-66e81719b59c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1397431194"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:58.868294 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:58.868294 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:58.869176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.aggregate [None req-f760d502-c9b9-4faa-a1a0-66e81719b59c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Generated uuid 7407c99c-9e7c-4ddc-aa3b-445572113b6a for aggregate {{(pid=118716) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:11:58.898454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f760d502-c9b9-4faa-a1a0-66e81719b59c tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.034949 May 10 02:11:58.900329 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 132/239] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:11:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:58.915213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:58.918097 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:58.918097 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:58.935280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.935739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.946164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.946821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.958077 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.compute.aggregates [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 10 02:11:58.959107 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Request method failure captured: May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 42 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecm_Ov-sF2aSq-QHpW_m8TCaX1QBHtzxnDX5x-a5YQ_b--and4x3SaJrGr0s_q64m7dTvbC6e5oYDF_PJJEtM2HF_4Bh8BLVCp0noXnWfFw-4syTNOIfs3tuKb3Q9H9zSC3M-cs_0YSxM-AXIRJgTJf1GcehWa_pnr9HkxRojdHh0vU May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:11:58.963153 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b09974fbd54154a9d6dc5828bb3192", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b09974fbd54154a9d6dc5828bb3192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f9b09974fbd54154a9d6dc5828bb3192 May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782 May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 03b04280e1f640948e06e9fa5618b060 May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: {"remove_host": {"host": "nonexist_host"}} May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:11:58.964671 n-d-841089-2 devstack@n-api.service[118716]: exception: Cannot remove host nonexist_host in aggregate 18 May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5870, in _get_service_in_cell_by_host May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 10 02:11:58.965513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5938, in _find_service_in_cell May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6557, in remove_host_from_aggregate May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 10 02:11:58.966817 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5878, in _get_service_in_cell_by_host May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.968176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:11:58.969547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:11:58.969547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:11:58.969547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:11:58.969547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:11:58.969547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 May 10 02:11:58.969547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:11:58.971356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:11:58.972586 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ba76b9b3-a78f-4c19-a8f1-4321e929b5f7 tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.063760 May 10 02:11:58.973374 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 133/240] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:11:58 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:11:58.979173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:58.980092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:58.998436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:58.998899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:58.999785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.000174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.159483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:59.180840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-934e4183-9561-4499-ae60-2e2b14e5a67f tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1470 microversion: 2.1 time: 0.206100 May 10 02:11:59.182655 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 134/241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:58 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:11:59.194422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e73b2073-cca5-4ba5-9852-ce7f9967440a tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:59.195365 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:11:59.195365 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:11:59.218544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e73b2073-cca5-4ba5-9852-ce7f9967440a tempest-AggregatesAdminNegativeTestJSON-1174810782 tempest-AggregatesAdminNegativeTestJSON-1174810782-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.034584 May 10 02:11:59.223186 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 135/242] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:11:59 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:11:59.269692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-231e0f6d-09ee-4c73-8fa7-f5d844d8783d tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.270220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-231e0f6d-09ee-4c73-8fa7-f5d844d8783d tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.270981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-231e0f6d-09ee-4c73-8fa7-f5d844d8783d tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.271454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-231e0f6d-09ee-4c73-8fa7-f5d844d8783d tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.329659 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-231e0f6d-09ee-4c73-8fa7-f5d844d8783d tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 328 microversion: 2.1 time: 0.554546 May 10 02:11:59.342417 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 108/243] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:11:58 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 328 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:11:59.345219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:59.346182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:59.353917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.354740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.355869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.356425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.504634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:11:59.513055 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4afc65ad-e2d6-44ef-bb79-b6fd5876c917 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.173218 May 10 02:11:59.513708 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 109/244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:59 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:11:59.612318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:59.612790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:59.619752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.620201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.621150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.621815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.666786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:11:59.800971 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db67023c-11d0-486e-8ceb-b1b684ad82cb tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 204 len: 0 microversion: 2.1 time: 0.579903 May 10 02:11:59.801588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 136/245] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:11:59 2022] DELETE /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:11:59.809252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:11:59.810367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:11:59.817626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.818455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.820243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:11:59.820843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:11:59.872421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-442104951", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:11:59.954791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:00.046663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:00.056199 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-da615286-11bb-4356-b741-4ea42798cc66 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1390 microversion: 2.1 time: 0.253108 May 10 02:12:00.056802 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 137/246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:11:59 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:00.062935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:00.064183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:00.074059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.074963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.076373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.076974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.315384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:00.316190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:00.316565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:00.316688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:00.317081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:00.341601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.342077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.342859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.343381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.380943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Getting quotas for project ffafa5204fb24b75ac7a8c62b0c64c67. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:00.388376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Getting quotas for user c7d46b7011324224ba49e4906fce5021 and project ffafa5204fb24b75ac7a8c62b0c64c67. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:00.406296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.utils [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] cores quota exceeded for ffafa5204fb24b75ac7a8c62b0c64c67, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=118717) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 10 02:12:00.407236 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Request method failure captured: May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 144 May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnsxWPcQ6MoOe7qjxwFQpEfkEp7KOPKuP7qS75Hfw7qlXCwkjphS5b8z6sT9QlF8R2tbe_QWqE7z2qPJVHbtqJXeH5cYcgY8mhkJRm4rzPWdFBe875z-DbvyMySZoa7hs1rFKVloLnumKxSbFYu-Ll7gqv3Q2RQkA66LFJ5zaFgTbk May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:00.411761 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ffafa5204fb24b75ac7a8c62b0c64c67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c7d46b7011324224ba49e4906fce5021 May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-442104951", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} May 10 02:12:00.413279 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-442104951', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452'}}} May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 10 02:12:00.414136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:00.415343 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.417964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:00.420246 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:00.420246 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:00.420246 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:00.420246 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:00.420246 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 10 02:12:00.420246 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:00.420684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:00.421868 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86ee406c-af93-43f7-8712-222382b2f872 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1476 microversion: 2.1 time: 0.363942 May 10 02:12:00.422344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:00.422479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 138/247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:00 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:00.423588 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cb206e7-f482-4944-b0ef-c3f8b32db1e5 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.805788 May 10 02:12:00.427165 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 110/248] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:11:59 2022] POST /compute/v2.1/servers => generated 111 bytes in 807 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 10 02:12:00.434442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19d6457b-fea1-455e-bc14-9d4b517b8bb7 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37af2af0>, body: {"quota_set": {"cores": 20}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:00.443459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:00.444085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:00.455268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.455836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.456638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.457665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.667764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:00.677642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:00.679749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:00.680990 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2f1389a-3a76-4bbd-bb3e-27e6ebd7d9ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.241975 May 10 02:12:00.691888 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 139/249] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:00 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:00.697862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:00.698467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:00.706277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.706945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.708453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.709047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.781638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d6457b-fea1-455e-bc14-9d4b517b8bb7 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.782096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d6457b-fea1-455e-bc14-9d4b517b8bb7 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.786357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d6457b-fea1-455e-bc14-9d4b517b8bb7 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.786870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d6457b-fea1-455e-bc14-9d4b517b8bb7 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.877125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:00.887365 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5f8ecda-09c3-4931-901d-a5686d8712d4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.193943 May 10 02:12:00.888359 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 140/250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:00 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:00.893747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06dc60e4-c3d1-457a-b526-947d3fbb4a03 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37b7cee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:00.903348 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19d6457b-fea1-455e-bc14-9d4b517b8bb7 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 329 microversion: 2.1 time: 0.473417 May 10 02:12:00.903836 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 111/251] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:12:00 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 329 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:00.916719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-5061c7f9-df56-46db-bb64-29c32f48f756 req-2e970a3a-5919-4bf0-b55e-d6326b18d9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d0f290-23eb-448e-b203-33508b893b70", "name": "network-vif-plugged", "status": "completed", "tag": "3ee55356-a9bc-4bdf-844d-cc33b7229733"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:00.928690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5061c7f9-df56-46db-bb64-29c32f48f756 req-2e970a3a-5919-4bf0-b55e-d6326b18d9a7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:00.929138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5061c7f9-df56-46db-bb64-29c32f48f756 req-2e970a3a-5919-4bf0-b55e-d6326b18d9a7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:00.946973 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06dc60e4-c3d1-457a-b526-947d3fbb4a03 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22" status: 200 len: 637 microversion: 2.1 time: 0.057249 May 10 02:12:00.948055 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 141/252] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:00 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22 => generated 637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:00.950393 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-5061c7f9-df56-46db-bb64-29c32f48f756 req-2e970a3a-5919-4bf0-b55e-d6326b18d9a7 service nova] Creating event network-vif-plugged:3ee55356-a9bc-4bdf-844d-cc33b7229733 for instance 72d0f290-23eb-448e-b203-33508b893b70 on n-h2-841089-2 May 10 02:12:00.956883 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-5061c7f9-df56-46db-bb64-29c32f48f756 req-2e970a3a-5919-4bf0-b55e-d6326b18d9a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043432 May 10 02:12:00.957787 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 112/253] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:00.960177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-97e1961c-8d43-4612-b081-94e5b63d9bc0 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Calling method '.version_select at 0x7f3d37b4b8b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:00.964202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-31138711-60af-41f9-b2d4-063c1089c10a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d37af2b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:01.015495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-31138711-60af-41f9-b2d4-063c1089c10a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:01.022160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-31138711-60af-41f9-b2d4-063c1089c10a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:01.319226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-97e1961c-8d43-4612-b081-94e5b63d9bc0 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 371 microversion: 2.1 time: 0.369902 May 10 02:12:01.325672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 142/254] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:12:00 2022] GET /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:01.331568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:01.332348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:01.339921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.340641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.341637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.342272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.401335 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-31138711-60af-41f9-b2d4-063c1089c10a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441778 May 10 02:12:01.402632 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 113/255] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:00 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:01.412663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-17aca072-60ff-4651-bebc-828504b564ee tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37aecc10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:01.516703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:01.525272 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3706404c-3b21-438c-8713-e2126e66dbaa tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1590 microversion: 2.1 time: 0.198174 May 10 02:12:01.537327 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 143/256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:01 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1590 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:01.546879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c3b7e3d-f9a2-4da3-96c5-78b2a281dd74 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37b7cee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:01.661666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17aca072-60ff-4651-bebc-828504b564ee tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.662127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17aca072-60ff-4651-bebc-828504b564ee tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.662940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17aca072-60ff-4651-bebc-828504b564ee tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.663412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17aca072-60ff-4651-bebc-828504b564ee tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.728241 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-17aca072-60ff-4651-bebc-828504b564ee tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 328 microversion: 2.1 time: 0.324149 May 10 02:12:01.728894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 114/257] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:12:01 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:01.740787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:01.741540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:01.747891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.748350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.749136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.749574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.905335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:01.913574 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-483cc4aa-60c3-4486-a03c-742898dfda2e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1476 microversion: 2.1 time: 0.180994 May 10 02:12:01.914422 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 115/258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:01 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1476 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:01.919768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:01.920441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:01.929983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.930729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.932083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:01.932672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:01.981946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c3b7e3d-f9a2-4da3-96c5-78b2a281dd74 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "DELETE /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.443320 May 10 02:12:01.982520 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 144/259] 10.222.0.52 () {58 vars in 1295 bytes} [Tue May 10 02:12:01 2022] DELETE /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata/os_version => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:02.106074 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d326932a-6516-4d5e-842d-a7972e4f302c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190442 May 10 02:12:02.111754 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 116/260] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:12:01 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:02.117610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:02.118173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:02.135892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:02.136348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:02.137146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:02.137587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:02.208630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d85be715-2df8-4c09-8ec3-83ee42a26474 tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-362267874", "id": 1199330386, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:02.210269 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:02.210269 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:02.247661 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d85be715-2df8-4c09-8ec3-83ee42a26474 tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.263639 May 10 02:12:02.253451 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 145/261] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:12:01 2022] POST /compute/v2.1/flavors => generated 470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:12:02.261673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1890370618", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:02.334566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:02.526868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:02.541481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:02.542995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:02.544164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f96742b-1325-4751-8c1e-0ae274cde0d6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1362 microversion: 2.25 time: 0.431152 May 10 02:12:02.544728 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 117/262] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:02 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:02.559192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:02.559819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:02.575610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:02.576149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:02.576953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:02.577392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:02.924093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:02.925305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:02.926277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:02.927034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:02.935189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:02.949583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:02.950752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:02.951730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:02.952558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:02.977905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Getting quotas for project ffafa5204fb24b75ac7a8c62b0c64c67. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:02.978102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:02.983793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Getting quotas for user c7d46b7011324224ba49e4906fce5021 and project ffafa5204fb24b75ac7a8c62b0c64c67. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:02.985170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec15ddde-f95d-4191-b882-4ff112e227eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.439454 May 10 02:12:02.987996 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 118/263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:02 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:02.995413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8b015af-e3bf-4e6c-b1f1-82ed1adaf91a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37a079d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:03.003508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.utils [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] instances quota exceeded for ffafa5204fb24b75ac7a8c62b0c64c67, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=118716) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 10 02:12:03.005763 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Request method failure captured: May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 145 May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnsxWPcQ6MoOe7qjxwFQpEfkEp7KOPKuP7qS75Hfw7qlXCwkjphS5b8z6sT9QlF8R2tbe_QWqE7z2qPJVHbtqJXeH5cYcgY8mhkJRm4rzPWdFBe875z-DbvyMySZoa7hs1rFKVloLnumKxSbFYu-Ll7gqv3Q2RQkA66LFJ5zaFgTbk May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:03.011724 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ffafa5204fb24b75ac7a8c62b0c64c67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c7d46b7011324224ba49e4906fce5021 May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1890370618", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} May 10 02:12:03.012997 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1890370618', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452'}}} May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 10 02:12:03.013677 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:03.014685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.015865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:03.017044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:03.017044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:03.017044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:03.017044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:03.017044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 10 02:12:03.017044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:03.020009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:03.021311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0003754a-f3fe-426a-a368-9b599d63cfad tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.768714 May 10 02:12:03.022305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 146/264] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:02 2022] POST /compute/v2.1/servers => generated 119 bytes in 770 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:03.027384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4355961-856f-4b83-9e3a-1c6bb212ba72 tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:03.030153 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:03.030153 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:03.054205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8b015af-e3bf-4e6c-b1f1-82ed1adaf91a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 37 microversion: 2.1 time: 0.064981 May 10 02:12:03.061327 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 119/265] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:02 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:03.067641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:03.068560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:03.074811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:03.075580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:03.076660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:03.077312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:03.288569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:03.300279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec7738d2-e10e-4d4a-9a9d-d80e087cc6b1 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 200 len: 1434 microversion: 2.1 time: 0.235610 May 10 02:12:03.313427 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 120/266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:03 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 1434 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:03.323399 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4355961-856f-4b83-9e3a-1c6bb212ba72 tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1199330386/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.299648 May 10 02:12:03.324014 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 147/267] 10.222.0.52 () {62 vars in 1264 bytes} [Tue May 10 02:12:03 2022] POST /compute/v2.1/flavors/1199330386/os-extra_specs => generated 62 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:03.326300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-55f9405b-296a-490c-89c5-0b5d86ee1cd0 req-0ba5fe89-f331-4fba-9982-add71863e606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97ad790-f1eb-49d6-b1c9-249fa0d34af8", "name": "network-vif-plugged", "status": "completed", "tag": "8ec5090a-4fb8-4b2b-b9cc-58d3443773c7"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:03.337824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50e4481d-779e-4b22-98f4-0c836d9f110a tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37b7c700>, body: {"quota_set": {"instances": 10}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:03.344132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-55f9405b-296a-490c-89c5-0b5d86ee1cd0 req-0ba5fe89-f331-4fba-9982-add71863e606 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:03.344808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-55f9405b-296a-490c-89c5-0b5d86ee1cd0 req-0ba5fe89-f331-4fba-9982-add71863e606 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:03.386689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-55f9405b-296a-490c-89c5-0b5d86ee1cd0 req-0ba5fe89-f331-4fba-9982-add71863e606 service nova] Creating event network-vif-plugged:8ec5090a-4fb8-4b2b-b9cc-58d3443773c7 for instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 on n-h2-841089-2 May 10 02:12:03.401284 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-55f9405b-296a-490c-89c5-0b5d86ee1cd0 req-0ba5fe89-f331-4fba-9982-add71863e606 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084193 May 10 02:12:03.401894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 121/268] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:03.428053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bfa95545-4970-4ead-b77a-84da62c249ab tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d37af2430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:03.486952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-bfa95545-4970-4ead-b77a-84da62c249ab tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:03.493259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-bfa95545-4970-4ead-b77a-84da62c249ab tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:03.794303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50e4481d-779e-4b22-98f4-0c836d9f110a tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:03.794765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50e4481d-779e-4b22-98f4-0c836d9f110a tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:03.796001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50e4481d-779e-4b22-98f4-0c836d9f110a tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:03.796717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50e4481d-779e-4b22-98f4-0c836d9f110a tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:03.891885 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-50e4481d-779e-4b22-98f4-0c836d9f110a tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 329 microversion: 2.1 time: 0.564478 May 10 02:12:03.892764 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 148/269] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:12:03 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 329 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:03.901352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38af444b-e03a-4ed3-96da-e783413223c5 tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:03.904152 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:03.904152 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:03.925128 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38af444b-e03a-4ed3-96da-e783413223c5 tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1199330386" status: 202 len: 0 microversion: 2.86 time: 0.030864 May 10 02:12:03.926636 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 149/270] 10.222.0.52 () {60 vars in 1201 bytes} [Tue May 10 02:12:03 2022] DELETE /compute/v2.1/flavors/1199330386 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:03.933142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c7c0e1c1-35fa-48b2-b749-59e218708be0 req-b44677bd-dddd-4a36-978c-76a2482b1ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db1f99b-607f-4121-b793-8cd35916a89a", "name": "network-vif-deleted", "tag": "969519d4-9210-4bb3-95f6-44d6b1420185"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:03.945617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c7c0e1c1-35fa-48b2-b749-59e218708be0 req-b44677bd-dddd-4a36-978c-76a2482b1ce9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:03.946452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c7c0e1c1-35fa-48b2-b749-59e218708be0 req-b44677bd-dddd-4a36-978c-76a2482b1ce9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:03.975922 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c7c0e1c1-35fa-48b2-b749-59e218708be0 req-b44677bd-dddd-4a36-978c-76a2482b1ce9 service nova] Creating event network-vif-deleted:969519d4-9210-4bb3-95f6-44d6b1420185 for instance 9db1f99b-607f-4121-b793-8cd35916a89a on n-h2-841089-2 May 10 02:12:04.000968 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c7c0e1c1-35fa-48b2-b749-59e218708be0 req-b44677bd-dddd-4a36-978c-76a2482b1ce9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072324 May 10 02:12:04.002240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 150/271] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:04.010281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.011129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:04.018613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.021171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.023142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.023912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.050308 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bfa95545-4970-4ead-b77a-84da62c249ab tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.642227 May 10 02:12:04.051589 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 122/272] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:03 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:04.056485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.057430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:04.077560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.078011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.078793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.079253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.369984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:04.377822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:04.379392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:04.383611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d069bc9d-e42c-4cc4-80b0-b1844b4bdb4f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1558 microversion: 2.25 time: 0.376905 May 10 02:12:04.384287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 151/273] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1558 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:04.405395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-18136ab0-245d-4bfa-9cab-be2c66535d6b req-c7499322-b645-4feb-b924-350e74ab26ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb619058-700d-4b0a-8b3e-9c3c845c4538", "tag": "9a877a3d-b01e-4608-9e40-1aa136c12444"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:04.421607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-18136ab0-245d-4bfa-9cab-be2c66535d6b req-c7499322-b645-4feb-b924-350e74ab26ee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.422065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-18136ab0-245d-4bfa-9cab-be2c66535d6b req-c7499322-b645-4feb-b924-350e74ab26ee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.447122 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-18136ab0-245d-4bfa-9cab-be2c66535d6b req-c7499322-b645-4feb-b924-350e74ab26ee service nova] Creating event network-changed:9a877a3d-b01e-4608-9e40-1aa136c12444 for instance eb619058-700d-4b0a-8b3e-9c3c845c4538 on n-h1-841089-2 May 10 02:12:04.457485 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-18136ab0-245d-4bfa-9cab-be2c66535d6b req-c7499322-b645-4feb-b924-350e74ab26ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071658 May 10 02:12:04.459327 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 152/274] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:04.478394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c93b5a9-5d45-4c60-bbe1-83006079e092 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Calling method '.version_select at 0x7f3d37b7c9d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.557161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:04.567755 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1bb6f47f-3270-478d-ba9c-0b1869e531ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 200 len: 1590 microversion: 2.1 time: 0.514404 May 10 02:12:04.572360 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 123/275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 1590 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:04.577226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-792aa6ea-91c4-4169-a1ac-50d967cd515a tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.646693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-792aa6ea-91c4-4169-a1ac-50d967cd515a tempest-FlavorMetadataValidation-2072631038 tempest-FlavorMetadataValidation-2072631038-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6677 microversion: 2.86 time: 0.072973 May 10 02:12:04.659563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 124/276] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/flavors/detail => generated 6677 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:04.666868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.671846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:04.692642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.693119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.693915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.694364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.788129 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c93b5a9-5d45-4c60-bbe1-83006079e092 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 371 microversion: 2.1 time: 0.326805 May 10 02:12:04.789680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 153/277] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:04.796125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5afe9875-4ff2-4864-a574-784ec9b4cc84 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37ae0d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.858094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5afe9875-4ff2-4864-a574-784ec9b4cc84 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.066723 May 10 02:12:04.859222 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 154/278] 10.222.0.52 () {58 vars in 1289 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata/os_distro => generated 33 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:04.869079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:04.870086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:04.877886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.878528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.879606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:04.880197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:04.897177 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] HTTP exception thrown: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Request method failure captured: May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a HTTP/1.1 May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnKZhvlE2C-1KufR1t5YnnURjQZ1po_002GyndpdCGLzgDnM7HaoSDTLdRGGYv6DryPn5SeXfaneeJe_KqTHuk_WBb-3Z-6bGsqyoLmCA9X1N8U_fol9sa_TodNCrmexYt6lwyW5A-0pR4_nn3nc3s7lf_gb-X_GGvskfIq2qEBVzI May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:04.899637 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7572edeebc3c46f1aba4159acf54e224", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: cee51d8b18db4c649c37b04cbd9f9842 May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:04.901148 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '9db1f99b-607f-4121-b793-8cd35916a89a'} May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:04.902031 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:04.903434 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:04.905755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Returning 404 to user: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:04.907013 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5538f39e-be6b-46f9-ba1f-727154816088 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 404 len: 111 microversion: 2.1 time: 0.046543 May 10 02:12:04.908780 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 155/279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:05.010881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:05.024054 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e79314f-be8e-49ac-a842-bd39465653bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1310 microversion: 2.1 time: 0.362845 May 10 02:12:05.025576 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 125/280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:05.317600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:05.318848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:05.326950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:05.327467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:05.328785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:05.329474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:05.403758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3d3e0a7-67dc-4a20-a724-0cef4d40e7b1 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1299996999", "id": 1483473228, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:05.405785 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:05.405785 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:05.434397 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d3d3e0a7-67dc-4a20-a724-0cef4d40e7b1 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.403397 May 10 02:12:05.437618 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 126/281] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:05 2022] POST /compute/v2.1/flavors => generated 439 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:05.447232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a689d531-74ac-497d-8f26-e7a13ff5bba9 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37b1a280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:05.532298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 72d0f290-23eb-448e-b203-33508b893b70 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:05.597232 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06227a4b-68e6-435f-80f3-1510e6178ea0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 2051 microversion: 2.25 time: 0.687157 May 10 02:12:05.598713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 156/282] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:04 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 2051 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:05.616556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3256e3b9-751c-480b-98fd-3f8b569bc934 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d37c73a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:05.645857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a689d531-74ac-497d-8f26-e7a13ff5bba9 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:05.646424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a689d531-74ac-497d-8f26-e7a13ff5bba9 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:05.647368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a689d531-74ac-497d-8f26-e7a13ff5bba9 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:05.647902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a689d531-74ac-497d-8f26-e7a13ff5bba9 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:05.677599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3256e3b9-751c-480b-98fd-3f8b569bc934 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:05.682847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3256e3b9-751c-480b-98fd-3f8b569bc934 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:05.709439 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a689d531-74ac-497d-8f26-e7a13ff5bba9 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 325 microversion: 2.1 time: 0.270286 May 10 02:12:05.711372 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 127/283] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:12:05 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:05.728953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1965553519", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:05.829850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:05.978682 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3256e3b9-751c-480b-98fd-3f8b569bc934 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.378484 May 10 02:12:05.979305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 157/284] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:05 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:05.985985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7ae30ee-d70c-45dc-90c0-48ff79b3a30a tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:05.987401 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:05.987401 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:06.075972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:06.076395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:06.076853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:06.077265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:06.080212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:06.091891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.092351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.093149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7ae30ee-d70c-45dc-90c0-48ff79b3a30a tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1483473228/action" status: 200 len: 97 microversion: 2.1 time: 0.112648 May 10 02:12:06.093253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.093586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.093957 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 158/285] 10.222.0.52 () {60 vars in 1199 bytes} [Tue May 10 02:12:05 2022] POST /compute/v2.1/flavors/1483473228/action => generated 97 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:06.099487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:06.100186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:06.107284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.108224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.109251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.109911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.120554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Getting quotas for project 7572edeebc3c46f1aba4159acf54e224. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:06.125868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Getting quotas for user cee51d8b18db4c649c37b04cbd9f9842 and project 7572edeebc3c46f1aba4159acf54e224. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:06.140710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:06.142969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:06.190784 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adbc8993-95c2-4e2a-bbe5-8b4b4e9dc919 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474798 May 10 02:12:06.191701 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 128/286] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:12:06.198211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1614046961", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:06.271954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:06.458361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 72d0f290-23eb-448e-b203-33508b893b70 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:06.474831 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5fc029ac-07a3-48b6-aef9-10a3790428b8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 2051 microversion: 2.25 time: 0.379758 May 10 02:12:06.488668 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 159/287] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:06 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 2051 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:06.509923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53afccbb-21fc-4e11-af70-d4dcdc950eb1 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37b7ce50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:06.577596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53afccbb-21fc-4e11-af70-d4dcdc950eb1 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.087025 May 10 02:12:06.578159 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 160/288] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:06 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:06.584040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:06.584670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:06.591338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.591883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.593015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.593450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.653308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:06.653883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:06.654700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:06.655650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:06.656151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:06.673217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.673831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.674883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.675585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.694762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Getting quotas for project ffafa5204fb24b75ac7a8c62b0c64c67. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:06.700244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Getting quotas for user c7d46b7011324224ba49e4906fce5021 and project ffafa5204fb24b75ac7a8c62b0c64c67. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:06.713965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.utils [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] ram quota exceeded for ffafa5204fb24b75ac7a8c62b0c64c67, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=118717) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 10 02:12:06.715660 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Request method failure captured: May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 145 May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnsxWPcQ6MoOe7qjxwFQpEfkEp7KOPKuP7qS75Hfw7qlXCwkjphS5b8z6sT9QlF8R2tbe_QWqE7z2qPJVHbtqJXeH5cYcgY8mhkJRm4rzPWdFBe875z-DbvyMySZoa7hs1rFKVloLnumKxSbFYu-Ll7gqv3Q2RQkA66LFJ5zaFgTbk May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:06.718392 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ffafa5204fb24b75ac7a8c62b0c64c67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c7d46b7011324224ba49e4906fce5021 May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1614046961", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} May 10 02:12:06.719662 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1614046961', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452'}}} May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 10 02:12:06.720767 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:06.722000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.724473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:06.726711 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:06.726711 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:06.726711 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:06.726711 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:06.726711 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 10 02:12:06.726711 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:06.728654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:06.730074 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-642942f3-1b61-4957-9b72-88c84d68ba2f tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.536939 May 10 02:12:06.730993 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 129/289] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:06 2022] POST /compute/v2.1/servers => generated 110 bytes in 539 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:06.741000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74c0fd31-2320-4612-8c92-6ba987ebdc66 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:06.743121 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:06.743121 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:06.774450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:06.782662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-04d8264e-d5da-44e7-841c-75349836d75b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1492 microversion: 2.1 time: 0.203101 May 10 02:12:06.783634 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 161/290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:06 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1492 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:06.801041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:06.802710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:06.809716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.810191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.810977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.811482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.877401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:06.885310 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5f44e0d-a770-4c38-9039-23539eebbdad tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1216 microversion: 2.1 time: 0.099700 May 10 02:12:06.886300 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 162/291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:06 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:06.900667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-27325c6f-2d37-4c1f-a921-8e1f1f9aa9f6 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:06.902724 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:06.902724 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:06.904174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27325c6f-2d37-4c1f-a921-8e1f1f9aa9f6 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.905107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27325c6f-2d37-4c1f-a921-8e1f1f9aa9f6 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.906098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27325c6f-2d37-4c1f-a921-8e1f1f9aa9f6 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:06.906721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27325c6f-2d37-4c1f-a921-8e1f1f9aa9f6 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:06.941679 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-27325c6f-2d37-4c1f-a921-8e1f1f9aa9f6 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054256 May 10 02:12:06.942919 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 163/292] 10.222.0.52 () {60 vars in 1216 bytes} [Tue May 10 02:12:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:12:06.948805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5d881b3-b84d-49bd-a231-35f24c6723fe tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d37b7c8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:07.001508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d5d881b3-b84d-49bd-a231-35f24c6723fe tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:07.006844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d5d881b3-b84d-49bd-a231-35f24c6723fe tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:07.060207 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-74c0fd31-2320-4612-8c92-6ba987ebdc66 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project a9869d53b38a4c20b828311c59767d93 combination. May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74c0fd31-2320-4612-8c92-6ba987ebdc66 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Request method failure captured: May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/flavors/1483473228/action HTTP/1.1 May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 67 May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnzXQOiNT6SbWGan6ClLVeYS7PYHbUfksv00kVpF7oybrg5Sc9bcsuTI8UyeKDVwse2SCQhB4-mguIFjx6tHDxlb2YojrpBB_8uwbmOwrL8O1PzjYv--BmgTyTwjFRdFPV1dlUDc3nHcROiXJX5gxnVLgi9puX-jbqCjxzSoyd9_jE May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1bd088d9ea5f42a5a66cc207662452ab May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:12:07.065155 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1bd088d9ea5f42a5a66cc207662452ab", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1bd088d9ea5f42a5a66cc207662452ab May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 769a9787ded149cfbdfd5762faee05e4 May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: {"addTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} May 10 02:12:07.066588 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: exception: Flavor access already exists for flavor 21 and project a9869d53b38a4c20b828311c59767d93 combination. May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1483473228', 'body': {'addTenantAccess': {'tenant': 'a9869d53b38a4c20b828311c59767d93'}}} May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = self._query(query) May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi conn.query(q) May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result.read() May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 02:12:07.067978 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-a9869d53b38a4c20b828311c59767d93' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi project.save(context.session) May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi session.flush() May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._flush(objects) May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 02:12:07.069310 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi compat.raise_( May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi flush_context.execute() May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi rec.execute(self) May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 02:12:07.073985 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = self._query(query) May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi conn.query(q) May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 02:12:07.075179 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result.read() May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-a9869d53b38a4c20b828311c59767d93' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 10, 2, 12, 7, 55363), 'updated_at': None, 'flavor_id': 21, 'project_id': 'a9869d53b38a4c20b828311c59767d93'}] May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:07.076361 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project a9869d53b38a4c20b828311c59767d93 combination. May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:07.077479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project a9869d53b38a4c20b828311c59767d93 combination. May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:07.078993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:07.080292 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project a9869d53b38a4c20b828311c59767d93 combination. May 10 02:12:07.080292 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:07.080292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74c0fd31-2320-4612-8c92-6ba987ebdc66 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project a9869d53b38a4c20b828311c59767d93 combination. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:07.080292 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74c0fd31-2320-4612-8c92-6ba987ebdc66 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1483473228/action" status: 409 len: 152 microversion: 2.1 time: 0.336836 May 10 02:12:07.080292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 130/293] 10.222.0.52 () {60 vars in 1199 bytes} [Tue May 10 02:12:06 2022] POST /compute/v2.1/flavors/1483473228/action => generated 152 bytes in 338 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:07.080292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-858fe1d0-5c53-47f5-aa43-4bcbec52cc72 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37a251f0>, body: {"quota_set": {"ram": 51200}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:07.274440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5d881b3-b84d-49bd-a231-35f24c6723fe tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.330240 May 10 02:12:07.275331 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 164/294] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:06 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:07.376965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-858fe1d0-5c53-47f5-aa43-4bcbec52cc72 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:07.377738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-858fe1d0-5c53-47f5-aa43-4bcbec52cc72 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:07.379094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-858fe1d0-5c53-47f5-aa43-4bcbec52cc72 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:07.379847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-858fe1d0-5c53-47f5-aa43-4bcbec52cc72 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:07.461945 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-858fe1d0-5c53-47f5-aa43-4bcbec52cc72 tempest-QuotasAdminNegativeTest-458247596 tempest-QuotasAdminNegativeTest-458247596-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 200 len: 329 microversion: 2.1 time: 0.388572 May 10 02:12:07.463259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 131/295] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:12:07 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:07.468580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-841089-2", "block_migration": "auto"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:07.469922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:07.479130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:07.479825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:07.481083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:07.481793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:07.529289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:07.531132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:07.538804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:07.539303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:07.540596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:07.541454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:07.591193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'flavor' on Instance uuid 72d0f290-23eb-448e-b203-33508b893b70 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:07.644031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Going to try to live migrate instance to n-h1-841089-2 {{(pid=118717) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:12:07.742072 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-354b9d38-702f-455b-8afc-0acc87456e96 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1643 microversion: 2.1 time: 0.461131 May 10 02:12:07.742669 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 165/296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:07 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1643 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:07.757882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-368b498c-7d15-434f-88ca-d83396b78969 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:07.759416 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:07.759416 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:08.064644 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-368b498c-7d15-434f-88ca-d83396b78969 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1483473228/action" status: 200 len: 21 microversion: 2.1 time: 0.309797 May 10 02:12:08.065644 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 166/297] 10.222.0.52 () {60 vars in 1199 bytes} [Tue May 10 02:12:07 2022] POST /compute/v2.1/flavors/1483473228/action => generated 21 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:08.075095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f227aa42-81de-435d-b0f9-b0deca12fde0 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d37ae0670>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:08.145267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f227aa42-81de-435d-b0f9-b0deca12fde0 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:08.150190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f227aa42-81de-435d-b0f9-b0deca12fde0 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:08.589200 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f227aa42-81de-435d-b0f9-b0deca12fde0 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 64 microversion: 2.1 time: 0.521749 May 10 02:12:08.589958 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 167/298] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:08 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 64 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:08.594785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c644aef-d3e9-4619-a121-ae7c63565682 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Action: 'update', calling method: .version_select at 0x7f3d37b7c790>, body: {"quota_set": {"ram": 0}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:08.597231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c644aef-d3e9-4619-a121-ae7c63565682 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c7d46b7011324224ba49e4906fce5021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffafa5204fb24b75ac7a8c62b0c64c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c644aef-d3e9-4619-a121-ae7c63565682 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Request method failure captured: May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 HTTP/1.1 May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 25 May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnsxWPcQ6MoOe7qjxwFQpEfkEp7KOPKuP7qS75Hfw7qlXCwkjphS5b8z6sT9QlF8R2tbe_QWqE7z2qPJVHbtqJXeH5cYcgY8mhkJRm4rzPWdFBe875z-DbvyMySZoa7hs1rFKVloLnumKxSbFYu-Ll7gqv3Q2RQkA66LFJ5zaFgTbk May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:08.599232 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ffafa5204fb24b75ac7a8c62b0c64c67", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ffafa5204fb24b75ac7a8c62b0c64c67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ffafa5204fb24b75ac7a8c62b0c64c67 May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-822327507 May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c7d46b7011324224ba49e4906fce5021 May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-QuotasAdminNegativeTest-822327507-project May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: {"quota_set": {"ram": 0}} May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 10 02:12:08.600403 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'ffafa5204fb24b75ac7a8c62b0c64c67', 'body': {'quota_set': {'ram': 0}}} May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:08.601179 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:08.602933 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c644aef-d3e9-4619-a121-ae7c63565682 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c644aef-d3e9-4619-a121-ae7c63565682 tempest-QuotasAdminNegativeTest-822327507 tempest-QuotasAdminNegativeTest-822327507-project] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67" status: 403 len: 116 microversion: 2.1 time: 0.009546 May 10 02:12:08.604796 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 168/299] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:12:08 2022] PUT /compute/v2.1/os-quota-sets/ffafa5204fb24b75ac7a8c62b0c64c67 => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:08.606691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:08.607335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:08.614867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:08.615558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:08.616526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:08.616976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:08.912037 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eab382e6-0ba1-43f9-b506-37dae21b5c23 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1643 microversion: 2.1 time: 0.309611 May 10 02:12:08.912622 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 169/300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:08 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1643 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:08.918080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:08.918973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:08.929264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:08.929779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:08.931018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:08.931501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.245106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:09.255898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4f3db21-3c6e-49b0-bc10-bf7b2fc66660 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.341603 May 10 02:12:09.263766 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 170/301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:08 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:09.276011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0eeb87df-1288-4c51-8c5f-9ba8b675315d tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:09.276900 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:09.276900 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:09.314030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0eeb87df-1288-4c51-8c5f-9ba8b675315d tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1483473228" status: 202 len: 0 microversion: 2.1 time: 0.048050 May 10 02:12:09.317818 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 171/302] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:09 2022] DELETE /compute/v2.1/flavors/1483473228 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:09.484211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ca0c4e4-8924-4965-aa95-6b28a3971980 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d37a09ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:09.485667 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:09.485667 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:09.486819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca0c4e4-8924-4965-aa95-6b28a3971980 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.487299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca0c4e4-8924-4965-aa95-6b28a3971980 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.488101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca0c4e4-8924-4965-aa95-6b28a3971980 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.488539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca0c4e4-8924-4965-aa95-6b28a3971980 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.530843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ca0c4e4-8924-4965-aa95-6b28a3971980 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.214049 May 10 02:12:09.549926 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 172/303] 10.222.0.52 () {58 vars in 1127 bytes} [Tue May 10 02:12:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:09.559120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-752954c1-2639-40a6-9ccf-875ffd0c25d9 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37a09f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:09.615170 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-752954c1-2639-40a6-9ccf-875ffd0c25d9 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 64 microversion: 2.1 time: 0.063300 May 10 02:12:09.615878 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 173/304] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:09 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 64 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:09.625290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b9feb119-9591-477b-836b-4897b48cfd25 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:09.627422 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:09.627422 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:09.629617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9feb119-9591-477b-836b-4897b48cfd25 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.630275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9feb119-9591-477b-836b-4897b48cfd25 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.633154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9feb119-9591-477b-836b-4897b48cfd25 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.633616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9feb119-9591-477b-836b-4897b48cfd25 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.670116 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b9feb119-9591-477b-836b-4897b48cfd25 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052095 May 10 02:12:09.670723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 174/305] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:12:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:09.675812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9a341ec7-9978-4a66-a710-ef8c3d862f31 req-c10ef8b8-1143-4ac8-99a0-bdff7a657e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff33c6c6-557b-4f01-bfff-80e8a6cb9356", "tag": "cc265bf7-b898-4047-8fdd-22ee6f896cbc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:09.686221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9a341ec7-9978-4a66-a710-ef8c3d862f31 req-c10ef8b8-1143-4ac8-99a0-bdff7a657e1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.686673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9a341ec7-9978-4a66-a710-ef8c3d862f31 req-c10ef8b8-1143-4ac8-99a0-bdff7a657e1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.697641 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9a341ec7-9978-4a66-a710-ef8c3d862f31 req-c10ef8b8-1143-4ac8-99a0-bdff7a657e1f service nova] Creating event network-changed:cc265bf7-b898-4047-8fdd-22ee6f896cbc for instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 on n-h1-841089-2 May 10 02:12:09.704071 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9a341ec7-9978-4a66-a710-ef8c3d862f31 req-c10ef8b8-1143-4ac8-99a0-bdff7a657e1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031955 May 10 02:12:09.704922 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 175/306] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:09.714000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c06b620-3e2c-4d28-b0fd-0154f5041bf2 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:09.737870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c06b620-3e2c-4d28-b0fd-0154f5041bf2 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.030892 May 10 02:12:09.749748 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 176/307] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:09 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:09.749748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f4723e5-3211-46d2-9a6f-d1e0a7e1ba55 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d37ae0a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:09.752713 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:09.752713 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:09.754896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4723e5-3211-46d2-9a6f-d1e0a7e1ba55 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.755704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4723e5-3211-46d2-9a6f-d1e0a7e1ba55 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.756723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4723e5-3211-46d2-9a6f-d1e0a7e1ba55 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:09.757189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4723e5-3211-46d2-9a6f-d1e0a7e1ba55 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:09.787746 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f4723e5-3211-46d2-9a6f-d1e0a7e1ba55 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.043406 May 10 02:12:09.788350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 177/308] 10.222.0.52 () {58 vars in 1138 bytes} [Tue May 10 02:12:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:09.799172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f76d0465-20c0-47e7-826a-c7d666e31d53 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d379ed9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:09.858056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f76d0465-20c0-47e7-826a-c7d666e31d53 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:09.863298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f76d0465-20c0-47e7-826a-c7d666e31d53 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:10.182584 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-888202b1-3d4c-4ac5-aa0d-5576d3525b36 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70/action" status: 202 len: 0 microversion: 2.25 time: 2.717985 May 10 02:12:10.183557 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 132/309] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:12:07 2022] POST /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70/action => generated 0 bytes in 2719 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:10.188648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-841089-2", "block_migration": true, "disk_over_commit": false}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:10.189768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:10.204552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:10.205012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:10.205805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:10.206262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:10.237281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lazy-loading 'flavor' on Instance uuid e97ad790-f1eb-49d6-b1c9-249fa0d34af8 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:10.248613 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f76d0465-20c0-47e7-826a-c7d666e31d53 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.451056 May 10 02:12:10.248613 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 178/310] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:09 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:10.253429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Going to try to live migrate instance to n-h1-841089-2 {{(pid=118717) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:12:10.255556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-941e0b8f-78aa-4d26-95aa-45cda2d6a4c3 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1055161309", "id": 833920219, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:10.294009 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:10.294009 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:10.312820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-941e0b8f-78aa-4d26-95aa-45cda2d6a4c3 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.063760 May 10 02:12:10.313723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 179/311] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:10 2022] POST /compute/v2.1/flavors => generated 435 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:10.319750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49210822-5fc8-4b74-9945-e141b7dcac02 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d3798dee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:10.321520 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:10.321520 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:10.323466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49210822-5fc8-4b74-9945-e141b7dcac02 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:10.324082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49210822-5fc8-4b74-9945-e141b7dcac02 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:10.325113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49210822-5fc8-4b74-9945-e141b7dcac02 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:10.325763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49210822-5fc8-4b74-9945-e141b7dcac02 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:10.351312 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49210822-5fc8-4b74-9945-e141b7dcac02 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.036252 May 10 02:12:10.351883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 180/312] 10.222.0.52 () {58 vars in 1144 bytes} [Tue May 10 02:12:10 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:10.363494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:10.364773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:10.371646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:10.372436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:10.373258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:10.373768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:10.515663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:10.524667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:10.526292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:10.527532 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d460b6d-8819-4d61-9a5e-e74ef7ad289e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.167725 May 10 02:12:10.528107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 181/313] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:10 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:10.549769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3875d778-c5c3-4c6d-b4c9-ee08f35ac906 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update', calling method: .version_select at 0x7f3d37b7c790>, body: {"meta": {"os_version": "alt"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:10.600201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3875d778-c5c3-4c6d-b4c9-ee08f35ac906 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:10.606773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3875d778-c5c3-4c6d-b4c9-ee08f35ac906 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:11.117580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3875d778-c5c3-4c6d-b4c9-ee08f35ac906 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.577622 May 10 02:12:11.120763 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 182/314] 10.222.0.52 () {60 vars in 1312 bytes} [Tue May 10 02:12:10 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata/os_version => generated 31 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:11.142247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.143147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:11.155117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:11.155581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:11.156472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:11.157058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:11.382823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:11.391698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ffb9733b-5a61-45ce-815b-d25ae3490400 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.269675 May 10 02:12:11.392284 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 183/315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:11.398607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d42104c-2f22-48b6-ba8e-c2e568f5b5f5 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.399403 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:11.399403 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:11.406422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5d42104c-2f22-48b6-ba8e-c2e568f5b5f5 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] HTTP exception thrown: Access list not available for public flavors. May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d42104c-2f22-48b6-ba8e-c2e568f5b5f5 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Request method failure captured: May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/flavors/833920219/os-flavor-access HTTP/1.1 May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnzXQOiNT6SbWGan6ClLVeYS7PYHbUfksv00kVpF7oybrg5Sc9bcsuTI8UyeKDVwse2SCQhB4-mguIFjx6tHDxlb2YojrpBB_8uwbmOwrL8O1PzjYv--BmgTyTwjFRdFPV1dlUDc3nHcROiXJX5gxnVLgi9puX-jbqCjxzSoyd9_jE May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1bd088d9ea5f42a5a66cc207662452ab May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:11.408360 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1bd088d9ea5f42a5a66cc207662452ab", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1bd088d9ea5f42a5a66cc207662452ab May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 769a9787ded149cfbdfd5762faee05e4 May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: exception: Access list not available for public flavors. May 10 02:12:11.409485 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'flavor_id': '833920219'} May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 10 02:12:11.410152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:11.411764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d42104c-2f22-48b6-ba8e-c2e568f5b5f5 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:11.411764 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d42104c-2f22-48b6-ba8e-c2e568f5b5f5 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/833920219/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.015930 May 10 02:12:11.414168 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 184/316] 10.222.0.52 () {58 vars in 1205 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/flavors/833920219/os-flavor-access => generated 91 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:11.418664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7bec2f65-a3c6-4575-8074-46543ca64117 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d379ed5e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.420118 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:11.420118 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:11.421312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bec2f65-a3c6-4575-8074-46543ca64117 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:11.421882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bec2f65-a3c6-4575-8074-46543ca64117 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:11.422793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bec2f65-a3c6-4575-8074-46543ca64117 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:11.423361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bec2f65-a3c6-4575-8074-46543ca64117 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:11.449810 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7bec2f65-a3c6-4575-8074-46543ca64117 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.034511 May 10 02:12:11.450688 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 185/317] 10.222.0.52 () {58 vars in 1127 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:11.455453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec1e49df-3ffb-4a37-8207-36533540284c tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d37b7c280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.496101 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec1e49df-3ffb-4a37-8207-36533540284c tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 58 microversion: 2.1 time: 0.044297 May 10 02:12:11.501769 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 186/318] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 58 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:11.506931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7a9e2c4-2992-4be2-8a1d-8eda77fb142f tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.507714 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:11.507714 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:11.524898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7a9e2c4-2992-4be2-8a1d-8eda77fb142f tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/833920219" status: 202 len: 0 microversion: 2.1 time: 0.021948 May 10 02:12:11.525695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 187/319] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:11 2022] DELETE /compute/v2.1/flavors/833920219 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:11.532498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16521930-e030-4ac5-8253-d18803c07ad9 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d379ed430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.533707 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:11.533707 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:11.534866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16521930-e030-4ac5-8253-d18803c07ad9 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:11.535342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16521930-e030-4ac5-8253-d18803c07ad9 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:11.536180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16521930-e030-4ac5-8253-d18803c07ad9 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:11.536792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16521930-e030-4ac5-8253-d18803c07ad9 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:11.562730 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16521930-e030-4ac5-8253-d18803c07ad9 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.035609 May 10 02:12:11.563786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 188/320] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:11.570975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b177426e-1ea5-44d3-938f-10676f0ab5c9 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'update_all', calling method: .version_select at 0x7f3d379ed310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:11.622670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b177426e-1ea5-44d3-938f-10676f0ab5c9 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:11.632588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b177426e-1ea5-44d3-938f-10676f0ab5c9 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:11.966483 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b177426e-1ea5-44d3-938f-10676f0ab5c9 tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 61 microversion: 2.1 time: 0.401534 May 10 02:12:11.967112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 189/321] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:12:11 2022] PUT /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 61 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:11.975240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58fe59d2-b052-48c5-89c4-0e98d8f2015a tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:11.995322 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58fe59d2-b052-48c5-89c4-0e98d8f2015a tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.027077 May 10 02:12:11.995900 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 190/322] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:12.000298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.000896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:12.007371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.008105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.008883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.009324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.144184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:12.152077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:12.153579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:12.154972 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c49c216e-fab1-4dce-98a2-9c1640934b61 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.157910 May 10 02:12:12.155569 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 191/323] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:11 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:12.159958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89a713ab-ae80-4552-a6ed-99b092dbaf4b tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d3798d3a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.161698 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:12.161698 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:12.162828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89a713ab-ae80-4552-a6ed-99b092dbaf4b tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.163306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89a713ab-ae80-4552-a6ed-99b092dbaf4b tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.164102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89a713ab-ae80-4552-a6ed-99b092dbaf4b tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.164537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89a713ab-ae80-4552-a6ed-99b092dbaf4b tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.187204 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89a713ab-ae80-4552-a6ed-99b092dbaf4b tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.030610 May 10 02:12:12.187800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 192/324] 10.222.0.52 () {58 vars in 1127 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.306038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56f57342-0ab6-4905-84c5-3970b49180eb tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.307333 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:12.307333 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:12.308529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f57342-0ab6-4905-84c5-3970b49180eb tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.308972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f57342-0ab6-4905-84c5-3970b49180eb tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.309806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f57342-0ab6-4905-84c5-3970b49180eb tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.310239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f57342-0ab6-4905-84c5-3970b49180eb tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.333882 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56f57342-0ab6-4905-84c5-3970b49180eb tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.145088 May 10 02:12:12.334449 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 193/325] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.338882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-892b17f8-7e8e-4bf8-b5e4-3f67daad149a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Action: 'create', calling method: .version_select at 0x7f3d3798db80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:12.384903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-892b17f8-7e8e-4bf8-b5e4-3f67daad149a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:12.389286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-892b17f8-7e8e-4bf8-b5e4-3f67daad149a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Getting quotas for user 98933c61450449e0822a5db9a954a2d9 and project 2147eecc8fd94a538502fd2aea5282bf. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:12.549512 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1f9d1813-c72a-480b-b398-40c8278b682b tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8/action" status: 202 len: 0 microversion: 2.1 time: 2.364007 May 10 02:12:12.550504 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 133/326] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:12:10 2022] POST /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8/action => generated 0 bytes in 2366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:12.555594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b846fb2d-1f2f-42c3-90ec-2b3e42753a7b tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1777810919", "id": 90968643, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:12.561277 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:12.561277 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:12.584360 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b846fb2d-1f2f-42c3-90ec-2b3e42753a7b tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.032371 May 10 02:12:12.584968 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 134/327] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:12 2022] POST /compute/v2.1/flavors => generated 433 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.589816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-92d4df29-e624-4603-bad8-da9e0b3aaca5 req-ee543f18-f931-41c9-bb53-606690303086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d0f290-23eb-448e-b203-33508b893b70", "name": "network-vif-unplugged", "status": "completed", "tag": "3ee55356-a9bc-4bdf-844d-cc33b7229733"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:12.600866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-92d4df29-e624-4603-bad8-da9e0b3aaca5 req-ee543f18-f931-41c9-bb53-606690303086 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.601252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-92d4df29-e624-4603-bad8-da9e0b3aaca5 req-ee543f18-f931-41c9-bb53-606690303086 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.613738 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-92d4df29-e624-4603-bad8-da9e0b3aaca5 req-ee543f18-f931-41c9-bb53-606690303086 service nova] Creating event network-vif-unplugged:3ee55356-a9bc-4bdf-844d-cc33b7229733 for instance 72d0f290-23eb-448e-b203-33508b893b70 on n-h2-841089-2 May 10 02:12:12.619315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-92d4df29-e624-4603-bad8-da9e0b3aaca5 req-ee543f18-f931-41c9-bb53-606690303086 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032990 May 10 02:12:12.620128 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 135/328] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.629013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f64cfb63-2d31-463c-a598-b78651259970 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d37a078b0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.630960 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:12.630960 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:12.641199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64cfb63-2d31-463c-a598-b78651259970 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.644511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64cfb63-2d31-463c-a598-b78651259970 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.662774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64cfb63-2d31-463c-a598-b78651259970 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.663866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64cfb63-2d31-463c-a598-b78651259970 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.693981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f64cfb63-2d31-463c-a598-b78651259970 tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h1-841089-2" status: 200 len: 598 microversion: 2.1 time: 0.068919 May 10 02:12:12.694562 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 136/329] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/os-hosts/n-h1-841089-2 => generated 598 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.699363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf55ae73-c373-4513-b95f-31b20a32c1ad tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.701312 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:12.701312 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:12.702783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55ae73-c373-4513-b95f-31b20a32c1ad tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.703496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55ae73-c373-4513-b95f-31b20a32c1ad tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.704458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55ae73-c373-4513-b95f-31b20a32c1ad tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.705068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55ae73-c373-4513-b95f-31b20a32c1ad tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.722037 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-892b17f8-7e8e-4bf8-b5e4-3f67daad149a tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "POST /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 85 microversion: 2.1 time: 0.386423 May 10 02:12:12.722626 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 194/330] 10.222.0.52 () {60 vars in 1280 bytes} [Tue May 10 02:12:12 2022] POST /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 85 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:12.728365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.728924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:12.731133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf55ae73-c373-4513-b95f-31b20a32c1ad tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-841089-2" status: 200 len: 578 microversion: 2.1 time: 0.035377 May 10 02:12:12.732100 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 137/331] 10.222.0.52 () {58 vars in 1171 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/os-services?host=n-d-841089-2 => generated 578 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.737878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.737878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:12.740719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.741300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.742161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.742698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.744166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.744622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.745614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.746214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.934247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:12.937220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:12.941652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9228bd4f-b612-4d97-83f7-fa2f1e3f4c5e tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.217101 May 10 02:12:12.942769 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 195/332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:12.945183 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8582ccf3-dc88-460b-b188-277559288dd1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.212031 May 10 02:12:12.945741 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 138/333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:12.951845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e23efc63-c65a-4dba-be92-3dd9e2f3289f tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Calling method '.version_select at 0x7f3d37880820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:12.952792 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:12.952792 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:12.959451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e23efc63-c65a-4dba-be92-3dd9e2f3289f tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.959910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e23efc63-c65a-4dba-be92-3dd9e2f3289f tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.972357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e23efc63-c65a-4dba-be92-3dd9e2f3289f tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:12.972812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e23efc63-c65a-4dba-be92-3dd9e2f3289f tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:12.988964 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e23efc63-c65a-4dba-be92-3dd9e2f3289f tempest-HostsAdminTestJSON-795377222 tempest-HostsAdminTestJSON-795377222-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h2-841089-2" status: 200 len: 598 microversion: 2.1 time: 0.041895 May 10 02:12:12.989902 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 139/334] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/os-hosts/n-h2-841089-2 => generated 598 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:12.995442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05394309-1ecb-4d0c-8676-4cc794a5d38c tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] Calling method '.version_select at 0x7f3d379b63a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.038039 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-05394309-1ecb-4d0c-8676-4cc794a5d38c tempest-ImagesMetadataTestJSON-2042680260 tempest-ImagesMetadataTestJSON-2042680260-project] 10.222.0.52 "GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata" status: 200 len: 85 microversion: 2.1 time: 0.046500 May 10 02:12:13.038855 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 140/335] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:12 2022] GET /compute/v2.1/images/57b22351-46bc-4243-bff0-4de56d76be22/metadata => generated 85 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:13.043035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77c08071-e81c-4d4e-99ba-999ed20e396c tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.050590 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.050590 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:13.052607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77c08071-e81c-4d4e-99ba-999ed20e396c tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.053075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77c08071-e81c-4d4e-99ba-999ed20e396c tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.053889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77c08071-e81c-4d4e-99ba-999ed20e396c tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.054490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77c08071-e81c-4d4e-99ba-999ed20e396c tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.056794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-610dee03-2735-45a0-95ee-d04f036ab6ed tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.058059 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.058059 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:13.059135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-610dee03-2735-45a0-95ee-d04f036ab6ed tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '918e353c5f4149dab988b3d772bead55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9869d53b38a4c20b828311c59767d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-610dee03-2735-45a0-95ee-d04f036ab6ed tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Request method failure captured: May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/flavors/90968643/action HTTP/1.1 May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 67 May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnyS6aQNCnkPk9BcdTphnFanYKvNx-XRf7w9ovATOMw6J52NeBeIEQQ3EB22qRrgSBMNB6LV7YmwE_xGpUohFvkOodUfFIA3S9wBm5PHL0adQlskxDER1TocQwIW5z8rb2KSpAuiW0idKtkkbbUApMBCT0T83_uN2rAfgPb00Dojzg May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a9869d53b38a4c20b828311c59767d93 May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1711951546 May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:13.060719 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9869d53b38a4c20b828311c59767d93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9869d53b38a4c20b828311c59767d93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9869d53b38a4c20b828311c59767d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9869d53b38a4c20b828311c59767d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1711951546 May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a9869d53b38a4c20b828311c59767d93 May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1711951546 May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsAccessNegativeTestJSON-1711951546-project May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 918e353c5f4149dab988b3d772bead55 May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1711951546-project May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: {"addTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} May 10 02:12:13.061916 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '90968643', 'body': {'addTenantAccess': {'tenant': 'a9869d53b38a4c20b828311c59767d93'}}} May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:13.062595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 10 02:12:13.063656 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:13.064717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-610dee03-2735-45a0-95ee-d04f036ab6ed tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:13.064717 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-610dee03-2735-45a0-95ee-d04f036ab6ed tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] 10.222.0.52 "POST /compute/v2.1/flavors/90968643/action" status: 403 len: 130 microversion: 2.1 time: 0.118262 May 10 02:12:13.064717 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 196/336] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:12:12 2022] POST /compute/v2.1/flavors/90968643/action => generated 130 bytes in 120 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:13.071094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4ebf564-18d8-4c26-9e12-c4cb580ff3db tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.072134 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.072134 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:13.085479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77c08071-e81c-4d4e-99ba-999ed20e396c tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045622 May 10 02:12:13.086473 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 141/337] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:12:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:13.098569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5a229582-d116-47ce-ae4a-6c4987255880 tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.098699 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4ebf564-18d8-4c26-9e12-c4cb580ff3db tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/90968643" status: 202 len: 0 microversion: 2.1 time: 0.030343 May 10 02:12:13.099206 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 197/338] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:12:13 2022] DELETE /compute/v2.1/flavors/90968643 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:12:13.099782 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.099782 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:13.100994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a229582-d116-47ce-ae4a-6c4987255880 tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.101664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a229582-d116-47ce-ae4a-6c4987255880 tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.102488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a229582-d116-47ce-ae4a-6c4987255880 tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.102928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a229582-d116-47ce-ae4a-6c4987255880 tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.110564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3561965-5f52-4983-9eb9-d878ee37e832 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.126061 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5a229582-d116-47ce-ae4a-6c4987255880 tempest-ServicesAdminTestJSON-2049511304 tempest-ServicesAdminTestJSON-2049511304-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.031485 May 10 02:12:13.126675 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 142/339] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:13.133586 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3561965-5f52-4983-9eb9-d878ee37e832 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.026487 May 10 02:12:13.134441 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 198/340] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:13 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:13.152114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7191be6-3210-4201-9077-014472f85fba tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-165437732", "id": 711293937, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.153940 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.153940 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:13.170457 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7191be6-3210-4201-9077-014472f85fba tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022332 May 10 02:12:13.171505 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 143/341] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:13 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:13.179029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.179725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:13.182150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0776aeb1-2768-4345-8a4c-09a02ed2bb3f tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.183396 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.183396 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:13.187102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.188133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.189669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.190138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.343605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:13.352604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:13.354345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:13.355701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-70436213-f0a5-436c-8686-767683b196ea tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.185317 May 10 02:12:13.356414 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 199/342] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:13 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:13.574592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0776aeb1-2768-4345-8a4c-09a02ed2bb3f tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/711293937/action" status: 200 len: 96 microversion: 2.1 time: 0.396351 May 10 02:12:13.576159 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 144/343] 10.222.0.52 () {60 vars in 1196 bytes} [Tue May 10 02:12:13 2022] POST /compute/v2.1/flavors/711293937/action => generated 96 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:12:13.589978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-324ec1ad-42e9-4280-a65b-1d3fcf0f6e89 tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.591610 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.591610 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:13.592802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-324ec1ad-42e9-4280-a65b-1d3fcf0f6e89 tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '918e353c5f4149dab988b3d772bead55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9869d53b38a4c20b828311c59767d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-324ec1ad-42e9-4280-a65b-1d3fcf0f6e89 tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Request method failure captured: May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/flavors/711293937/action HTTP/1.1 May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 70 May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnyS6aQNCnkPk9BcdTphnFanYKvNx-XRf7w9ovATOMw6J52NeBeIEQQ3EB22qRrgSBMNB6LV7YmwE_xGpUohFvkOodUfFIA3S9wBm5PHL0adQlskxDER1TocQwIW5z8rb2KSpAuiW0idKtkkbbUApMBCT0T83_uN2rAfgPb00Dojzg May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a9869d53b38a4c20b828311c59767d93 May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1711951546 May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:13.594846 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9869d53b38a4c20b828311c59767d93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9869d53b38a4c20b828311c59767d93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9869d53b38a4c20b828311c59767d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9869d53b38a4c20b828311c59767d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1711951546 May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a9869d53b38a4c20b828311c59767d93 May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1711951546 May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsAccessNegativeTestJSON-1711951546-project May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 918e353c5f4149dab988b3d772bead55 May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1711951546-project May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: {"removeTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} May 10 02:12:13.596198 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '711293937', 'body': {'removeTenantAccess': {'tenant': 'a9869d53b38a4c20b828311c59767d93'}}} May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can( May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:13.596930 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 10 02:12:13.598611 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:13.600743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-324ec1ad-42e9-4280-a65b-1d3fcf0f6e89 tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:13.602007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-324ec1ad-42e9-4280-a65b-1d3fcf0f6e89 tempest-FlavorsAccessNegativeTestJSON-1711951546 tempest-FlavorsAccessNegativeTestJSON-1711951546-project] 10.222.0.52 "POST /compute/v2.1/flavors/711293937/action" status: 403 len: 133 microversion: 2.1 time: 0.016855 May 10 02:12:13.606828 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 200/344] 10.222.0.52 () {60 vars in 1196 bytes} [Tue May 10 02:12:13 2022] POST /compute/v2.1/flavors/711293937/action => generated 133 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:13.611738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41fff1b7-64bc-438c-8666-7de6f1549ec1 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a9869d53b38a4c20b828311c59767d93"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.613140 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.613140 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:13.800718 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41fff1b7-64bc-438c-8666-7de6f1549ec1 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/711293937/action" status: 200 len: 21 microversion: 2.1 time: 0.192278 May 10 02:12:13.801751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 145/345] 10.222.0.52 () {60 vars in 1196 bytes} [Tue May 10 02:12:13 2022] POST /compute/v2.1/flavors/711293937/action => generated 21 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:13.812783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d6be53b-63bb-4971-a889-7bcfd05aa7fe tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.814051 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.814051 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:13.839120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d6be53b-63bb-4971-a889-7bcfd05aa7fe tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/711293937" status: 202 len: 0 microversion: 2.1 time: 0.031807 May 10 02:12:13.840693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 201/346] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:13 2022] DELETE /compute/v2.1/flavors/711293937 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:12:13.849725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-324753fb-8087-4e1f-ae4e-c91e62d74546 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.870538 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-324753fb-8087-4e1f-ae4e-c91e62d74546 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.025077 May 10 02:12:13.871374 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 146/347] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:13 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:13.887915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4eb04407-711a-4bf3-902c-260752e85c0d tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-737534924", "id": 780171474, "os-flavor-access:is_public": "False"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.889428 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:13.889428 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:13.905226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4eb04407-711a-4bf3-902c-260752e85c0d tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.020839 May 10 02:12:13.906100 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 202/348] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:13 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:13.917382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-575dbd53-87a0-4067-b0dc-e66c653b563e tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6fe485f2fb874634ba0a525dcbb3f07f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:13.962645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:13.963885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:13.972602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.973884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:13.974831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:13.975583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:14.184108 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-575dbd53-87a0-4067-b0dc-e66c653b563e tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] HTTP exception thrown: Flavor access not found for 25 / 6fe485f2fb874634ba0a525dcbb3f07f combination. May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-575dbd53-87a0-4067-b0dc-e66c653b563e tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Request method failure captured: May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/flavors/780171474/action HTTP/1.1 May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 70 May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnzXQOiNT6SbWGan6ClLVeYS7PYHbUfksv00kVpF7oybrg5Sc9bcsuTI8UyeKDVwse2SCQhB4-mguIFjx6tHDxlb2YojrpBB_8uwbmOwrL8O1PzjYv--BmgTyTwjFRdFPV1dlUDc3nHcROiXJX5gxnVLgi9puX-jbqCjxzSoyd9_jE May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1bd088d9ea5f42a5a66cc207662452ab May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:12:14.185991 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1bd088d9ea5f42a5a66cc207662452ab", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bd088d9ea5f42a5a66cc207662452ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1bd088d9ea5f42a5a66cc207662452ab May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-615838635 May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 769a9787ded149cfbdfd5762faee05e4 May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: {"removeTenantAccess": {"tenant": "6fe485f2fb874634ba0a525dcbb3f07f"}} May 10 02:12:14.187220 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: exception: Flavor access not found for 25 / 6fe485f2fb874634ba0a525dcbb3f07f combination. May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '780171474', 'body': {'removeTenantAccess': {'tenant': '6fe485f2fb874634ba0a525dcbb3f07f'}}} May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 10 02:12:14.187874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / 6fe485f2fb874634ba0a525dcbb3f07f combination. May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / 6fe485f2fb874634ba0a525dcbb3f07f combination. May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:14.193463 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / 6fe485f2fb874634ba0a525dcbb3f07f combination. May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-575dbd53-87a0-4067-b0dc-e66c653b563e tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Returning 404 to user: Flavor access not found for 25 / 6fe485f2fb874634ba0a525dcbb3f07f combination. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-575dbd53-87a0-4067-b0dc-e66c653b563e tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/780171474/action" status: 404 len: 124 microversion: 2.1 time: 0.274588 May 10 02:12:14.194519 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 147/349] 10.222.0.52 () {60 vars in 1196 bytes} [Tue May 10 02:12:13 2022] POST /compute/v2.1/flavors/780171474/action => generated 124 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:14.195357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:14.196253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:14.205525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:14.206264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:14.208184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:14.209068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:14.228715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:14.236999 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7012d99b-934c-4113-932a-833d8d7fffb7 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.279461 May 10 02:12:14.248629 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 203/350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:13 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:14.252646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5815a50e-4f5c-4e33-beb4-6d160532c4e4 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:14.253616 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:14.253616 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:14.283509 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5815a50e-4f5c-4e33-beb4-6d160532c4e4 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/780171474" status: 202 len: 0 microversion: 2.1 time: 0.034731 May 10 02:12:14.287566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 204/351] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:14 2022] DELETE /compute/v2.1/flavors/780171474 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:14.293041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-520b50de-549f-4c6e-881a-1a212b784102 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:14.314241 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-520b50de-549f-4c6e-881a-1a212b784102 tempest-FlavorsAccessNegativeTestJSON-615838635 tempest-FlavorsAccessNegativeTestJSON-615838635-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.025169 May 10 02:12:14.315240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 205/352] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:14 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:14.376401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:14.377163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:14.387394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:14.387776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:14.388578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:14.389022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:14.588735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:14.602944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71c68d96-47e1-484d-9861-de083c0b2284 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.412681 May 10 02:12:14.603853 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 148/353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:14 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:14.641059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:14.647695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:14.649511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:14.650704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56b979af-6a96-4635-9797-082b178c32e0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.280468 May 10 02:12:14.652122 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 206/354] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:14 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:12:14.665804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a9ef6195-0393-45a8-999d-ce9087a04481 req-7599d516-3900-4f47-9a9b-e9389e09d983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d0f290-23eb-448e-b203-33508b893b70", "tag": "3ee55356-a9bc-4bdf-844d-cc33b7229733"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:14.678764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a9ef6195-0393-45a8-999d-ce9087a04481 req-7599d516-3900-4f47-9a9b-e9389e09d983 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:14.679339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a9ef6195-0393-45a8-999d-ce9087a04481 req-7599d516-3900-4f47-9a9b-e9389e09d983 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:14.695845 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a9ef6195-0393-45a8-999d-ce9087a04481 req-7599d516-3900-4f47-9a9b-e9389e09d983 service nova] Creating event network-changed:3ee55356-a9bc-4bdf-844d-cc33b7229733 for instance 72d0f290-23eb-448e-b203-33508b893b70 on n-h2-841089-2 May 10 02:12:14.723527 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a9ef6195-0393-45a8-999d-ce9087a04481 req-7599d516-3900-4f47-9a9b-e9389e09d983 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076600 May 10 02:12:14.724824 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 149/355] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 10 02:12:15.254704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:15.255399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:15.265325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:15.265779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:15.266729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:15.267538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:15.623644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:15.624749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:15.652726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:15.653367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:15.654450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:15.655166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:15.829537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:15.854160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7567ffdb-6503-42c3-ac99-4bed01d9e7a0 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.604240 May 10 02:12:15.858633 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 207/356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:15 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:15.865228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:15.866099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:15.874569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:15.875286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:15.876745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:15.878755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:15.895435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:15.907431 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d711ecf-be39-4bf0-a85a-4ee608d01632 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.290075 May 10 02:12:15.908924 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 150/357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:15 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:16.041294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:16.054263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:16.056743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:16.058805 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88d65f66-d5e7-4372-abfd-657d3f6c73d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.198709 May 10 02:12:16.060101 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 208/358] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:15 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:16.334645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f271c6dc-cf80-4e4a-b00a-b5489b5d9b1b req-49fca153-a282-4b0d-bfc1-edfbe7b68afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33c6c6-557b-4f01-bfff-80e8a6cb9356", "name": "network-vif-plugged", "status": "completed", "tag": "cc265bf7-b898-4047-8fdd-22ee6f896cbc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:16.343997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f271c6dc-cf80-4e4a-b00a-b5489b5d9b1b req-49fca153-a282-4b0d-bfc1-edfbe7b68afd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.344852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f271c6dc-cf80-4e4a-b00a-b5489b5d9b1b req-49fca153-a282-4b0d-bfc1-edfbe7b68afd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:16.351808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1160164386", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:16.359546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f271c6dc-cf80-4e4a-b00a-b5489b5d9b1b req-49fca153-a282-4b0d-bfc1-edfbe7b68afd service nova] Creating event network-vif-plugged:cc265bf7-b898-4047-8fdd-22ee6f896cbc for instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 on n-h1-841089-2 May 10 02:12:16.368542 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f271c6dc-cf80-4e4a-b00a-b5489b5d9b1b req-49fca153-a282-4b0d-bfc1-edfbe7b68afd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 May 10 02:12:16.369875 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 209/359] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:16.475768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:16.766099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:16.766815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:16.767625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:16.768183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:16.768776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:16.783981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.784446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:16.785297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.785744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:16.805311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Getting quotas for project 26a35846a10642e48703cf9597c3e810. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:16.810089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Getting quotas for user c0819595c84d497194721e063f9c3170 and project 26a35846a10642e48703cf9597c3e810. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:16.822708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:16.824967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:16.877179 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0004e893-3b5f-4842-b528-b2e1e845b4e6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877342 May 10 02:12:16.878229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:16.878946 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 151/360] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:12:16.885625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:16.891911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.892090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f1d6f992-55f2-4b2e-8000-e65e8a95e3bf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:16.892381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:16.892692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f1d6f992-55f2-4b2e-8000-e65e8a95e3bf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:16.893374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.894361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:16.948269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f1d6f992-55f2-4b2e-8000-e65e8a95e3bf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:16.955259 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f1d6f992-55f2-4b2e-8000-e65e8a95e3bf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1217 microversion: 2.1 time: 0.067916 May 10 02:12:16.955833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 152/361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:16 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:16.964198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:16.964815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:16.971142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.971779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:16.973060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:16.973662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:17.183327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:17.194095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6d12025c-ef10-4d42-ad04-a35bd34e64fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.321094 May 10 02:12:17.195222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:17.196110 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 210/362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:16 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:17.204193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0d4d7e2-77e7-441c-9d01-e26717644e59 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.247371 May 10 02:12:17.204968 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 153/363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:16 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:17.213487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.214248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:17.226198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:17.227088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:17.228758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:17.229547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:17.439197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:17.452687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:17.455492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:17.457376 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ecfc30e9-7457-465d-8b09-93b09c4e8f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.259348 May 10 02:12:17.457952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 211/364] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:17.605280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-648e3586-1ddb-4873-ae18-c1bc1f45ea76 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.613546 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-648e3586-1ddb-4873-ae18-c1bc1f45ea76 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.406904 May 10 02:12:17.614533 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 154/365] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:17.626206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ce3b07c-f884-43c4-92f0-3a547e2771da tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.658934 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ce3b07c-f884-43c4-92f0-3a547e2771da tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3074 microversion: 2.1 time: 0.036814 May 10 02:12:17.659713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 212/366] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors => generated 3074 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:17.673323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c9fb79c-441e-46b4-8e42-c9cebbbc9246 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.693486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c9fb79c-441e-46b4-8e42-c9cebbbc9246 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024033 May 10 02:12:17.701603 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 155/367] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:17.709264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61f82d90-9f5d-433a-a154-9644e5e40981 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.730226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61f82d90-9f5d-433a-a154-9644e5e40981 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027283 May 10 02:12:17.730776 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 213/368] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:17.747188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e4210a28-ea54-496a-8b95-d2dfcbdf825f tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.779564 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e4210a28-ea54-496a-8b95-d2dfcbdf825f tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.038536 May 10 02:12:17.780564 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 156/369] 10.222.0.52 () {58 vars in 1164 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:17.795146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-64f33c95-cc34-40bf-a28f-76790e81af7c tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.803793 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-64f33c95-cc34-40bf-a28f-76790e81af7c tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012889 May 10 02:12:17.815210 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 214/370] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:17.816222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ca470a4-b7f1-4299-bf16-57dae3cfee49 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.841007 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ca470a4-b7f1-4299-bf16-57dae3cfee49 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029778 May 10 02:12:17.851158 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 157/371] 10.222.0.52 () {58 vars in 1168 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:17.855749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f582c40e-1c07-467a-88e0-d0965922d592 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.868241 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f582c40e-1c07-467a-88e0-d0965922d592 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016070 May 10 02:12:17.869005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 215/372] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:17.881621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16d94232-7f74-4810-991f-e20260f2edfd tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.890600 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-16d94232-7f74-4810-991f-e20260f2edfd tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013179 May 10 02:12:17.891772 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 158/373] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:17.902067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf490992-1d1e-4ff2-8321-a02081b0483f tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.941779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf490992-1d1e-4ff2-8321-a02081b0483f tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2908 microversion: 2.1 time: 0.043325 May 10 02:12:17.942538 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 216/374] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2908 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:17.955545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf206a47-86d1-441e-b68e-448e91efa0ab tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.964301 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf206a47-86d1-441e-b68e-448e91efa0ab tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012430 May 10 02:12:17.964767 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 159/375] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:17.972089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.972744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:17.976759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3d7713e-9fb3-4906-a7dc-997addbbec5c tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:17.979524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:17.979986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:17.981432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:17.981890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:17.996861 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c3d7713e-9fb3-4906-a7dc-997addbbec5c tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.025881 May 10 02:12:17.997644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 160/376] 10.222.0.52 () {58 vars in 1143 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:18.011235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fecd93d-fd1e-45f2-aff3-80bbdec79480 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.020919 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fecd93d-fd1e-45f2-aff3-80bbdec79480 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014617 May 10 02:12:18.021826 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 161/377] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:18.032686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-681d4116-1dd6-418d-a693-21f1761d84d6 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.054857 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-681d4116-1dd6-418d-a693-21f1761d84d6 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.025967 May 10 02:12:18.055727 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 162/378] 10.222.0.52 () {58 vars in 1147 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:18.067877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:18.069449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cec3fa1d-ae77-45a5-875d-361c4861d1cd tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.077285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afea815a-380c-494d-b013-fe0a76d92c7b tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1269 microversion: 2.1 time: 0.109166 May 10 02:12:18.086682 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 217/379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:17 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:18.094148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cec3fa1d-ae77-45a5-875d-361c4861d1cd tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.029486 May 10 02:12:18.095131 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 163/380] 10.222.0.52 () {58 vars in 1139 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:18.108876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5625556e-54b0-4fa6-be86-02a30b2b774e tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.118322 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5625556e-54b0-4fa6-be86-02a30b2b774e tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015609 May 10 02:12:18.119346 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 218/381] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:18.129849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e04a19e-47a2-4a0f-a6a8-821ae448eb6e tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.169707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e04a19e-47a2-4a0f-a6a8-821ae448eb6e tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1537 microversion: 2.1 time: 0.044021 May 10 02:12:18.170329 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 164/382] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors?marker=452 => generated 1537 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:18.184332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f51f0e7-a052-47a3-b1ee-33b6d6e99ee3 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.213907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.215424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:18.217045 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f51f0e7-a052-47a3-b1ee-33b6d6e99ee3 tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.037576 May 10 02:12:18.218032 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 219/383] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:18.224704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.225579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:18.233840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:18.234304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:18.234595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:18.235137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:18.235713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:18.237250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:18.239442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:18.241250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:18.640442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:18.643887 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3935ab5-3997-43e0-8ab7-8aed16401d7c tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1320 microversion: 2.1 time: 0.434757 May 10 02:12:18.645297 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 165/384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:18.649953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c433e53e-0966-41d6-acc4-24aa65982a0f tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.659961 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c433e53e-0966-41d6-acc4-24aa65982a0f tempest-FlavorsV2TestJSON-1832699835 tempest-FlavorsV2TestJSON-1832699835-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013453 May 10 02:12:18.661301 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 166/385] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:18.693396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:18.704616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e32a0ea6-fc6a-498b-9570-cfa91308260a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.483280 May 10 02:12:18.705222 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 220/386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:18.723720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:18.725515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:18.734334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:18.735734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:18.736832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:18.737435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.006997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d37afda60>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.009751 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.009751 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.014935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.016326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.028323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:19.039312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:19.040901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:19.044805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.046137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.052628 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36729f4b-3a1f-4c4c-af73-46086fa81810 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.335372 May 10 02:12:19.053225 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 221/387] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:19.073995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.074678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.085060 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dfcad708-747e-43ca-94de-d5f43ea82237 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.422363 May 10 02:12:19.086945 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 167/388] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.093734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.094072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:19.101114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.101563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.102813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.106424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d378678b0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.107507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.113870 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.113870 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.115674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.116343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.144121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.145005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.170763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.171320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.183512 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49e2ae5a-a48e-4bb0-8016-89ba764a9da2 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.085534 May 10 02:12:19.184792 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 168/389] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:19.202966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d378674c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.204058 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.204058 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.205536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.206068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.225875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:19.238247 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-465c7ddc-f075-4a2b-87d6-4ad3c7384534 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1275 microversion: 2.1 time: 0.146938 May 10 02:12:19.239178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.240422 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 222/390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:19.242781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.262188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.263235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.273607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc7943c3-f294-46aa-ab7e-bc9007a62036 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075380 May 10 02:12:19.274897 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 169/391] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:19.284907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fbfc78ea-3c88-496a-98a0-9c678a458c24 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d37a09a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.286018 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.286018 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:19.287757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbfc78ea-3c88-496a-98a0-9c678a458c24 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.288493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbfc78ea-3c88-496a-98a0-9c678a458c24 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.317536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbfc78ea-3c88-496a-98a0-9c678a458c24 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.318266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbfc78ea-3c88-496a-98a0-9c678a458c24 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.325119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fbfc78ea-3c88-496a-98a0-9c678a458c24 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.043866 May 10 02:12:19.325805 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 223/392] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.341454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-555bf08d-99de-461c-8be8-26d09474da44 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d378679d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.342302 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.342302 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.344851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-555bf08d-99de-461c-8be8-26d09474da44 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.345314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-555bf08d-99de-461c-8be8-26d09474da44 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.369410 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-555bf08d-99de-461c-8be8-26d09474da44 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.033869 May 10 02:12:19.370028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 170/393] 10.222.0.52 () {58 vars in 1178 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.382718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d37b4b3a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.383575 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.383575 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:19.384767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.385169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.414195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.414700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.427048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.427919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.434869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc35ed7e-c6ff-4dbe-a62c-85eb85158dc1 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056776 May 10 02:12:19.436068 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 224/394] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.450525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3f73a688-8a3e-4ef3-88af-bb1ce9a66bab tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d37867550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.452096 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.452096 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.454692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f73a688-8a3e-4ef3-88af-bb1ce9a66bab tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.455565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f73a688-8a3e-4ef3-88af-bb1ce9a66bab tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.477688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f73a688-8a3e-4ef3-88af-bb1ce9a66bab tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.478364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f73a688-8a3e-4ef3-88af-bb1ce9a66bab tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.486738 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3f73a688-8a3e-4ef3-88af-bb1ce9a66bab tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042145 May 10 02:12:19.487504 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 171/395] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.500248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b5cc1e2-02fe-4984-bed9-a18b21e9ef63 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d37a09e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.501446 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.501446 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:19.502980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b5cc1e2-02fe-4984-bed9-a18b21e9ef63 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.503686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b5cc1e2-02fe-4984-bed9-a18b21e9ef63 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.517866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b5cc1e2-02fe-4984-bed9-a18b21e9ef63 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.518665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b5cc1e2-02fe-4984-bed9-a18b21e9ef63 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.526161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b5cc1e2-02fe-4984-bed9-a18b21e9ef63 tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.029869 May 10 02:12:19.532017 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 225/396] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.541134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Calling method '.version_select at 0x7f3d378675e0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.542268 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.542268 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.544067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.544949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.563317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.564223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.580231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.581165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.610049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e4313484-cd4a-48c5-8bdc-4873f634776f tempest-HypervisorAdminTestJSON-1922063953 tempest-HypervisorAdminTestJSON-1922063953-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.073448 May 10 02:12:19.611988 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 172/397] 10.222.0.52 () {58 vars in 1172 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.664617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.665659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:19.677862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.685671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.688810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.690836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.879203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e9d489a-ee65-4dce-add5-dde8eb2993aa tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1202565743", "ram": 512, "vcpus": 1, "disk": 10, "id": 1685383186, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:19.881823 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.881823 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:19.916483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e9d489a-ee65-4dce-add5-dde8eb2993aa tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.221549 May 10 02:12:19.918641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 173/398] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:19 2022] POST /compute/v2.1/flavors => generated 416 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:19.938659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:19.939151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:19.939521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:19.949183 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e37c55ef-81c2-4cf1-9b4a-e0a140f74940 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1470 microversion: 2.1 time: 0.291258 May 10 02:12:19.958405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.958951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.959776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:19.960311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:19.965394 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 226/399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:19.970023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bc87ac2-8082-4b26-a7e3-6c2841903087 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:19.974265 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:19.974265 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:20.025994 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bc87ac2-8082-4b26-a7e3-6c2841903087 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059460 May 10 02:12:20.026825 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 227/400] 10.222.0.52 () {60 vars in 1223 bytes} [Tue May 10 02:12:19 2022] POST /compute/v2.1/flavors/1685383186/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:20.037631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:20.040588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:20.058735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.059229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.066077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.066787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.199314 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a9240d2-0a34-4fc2-8c70-e51798d0caf7 tempest-DeleteServersAdminTestJSON-2077625264 tempest-DeleteServersAdminTestJSON-2077625264-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356/action" status: 202 len: 0 microversion: 2.1 time: 0.170127 May 10 02:12:20.201126 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 228/401] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:12:20 2022] POST /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:20.339469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:20.349337 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e226c2b3-0ee7-47cb-82cd-3c1724f088c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.429221 May 10 02:12:20.350862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 174/402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:19 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:20.364126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:20.365356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:20.381264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.381937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.384125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.385790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.505694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53717020-0857-41fc-a251-afadc3a816f2 tempest-FlavorsExtraSpecsTestJSON-654548627 tempest-FlavorsExtraSpecsTestJSON-654548627-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:20.522128 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53717020-0857-41fc-a251-afadc3a816f2 tempest-FlavorsExtraSpecsTestJSON-654548627 tempest-FlavorsExtraSpecsTestJSON-654548627-project] 10.222.0.52 "GET /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.319652 May 10 02:12:20.522924 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 229/403] 10.222.0.52 () {58 vars in 1202 bytes} [Tue May 10 02:12:20 2022] GET /compute/v2.1/flavors/1685383186/os-extra_specs => generated 66 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:20.540155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:20.541208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:20.548074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.548968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.549976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.550930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.597670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.598453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.602480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lazy-loading 'fault' on Instance uuid ff33c6c6-557b-4f01-bfff-80e8a6cb9356 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:20.865179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:20.877638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:20.883034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:20.885100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f27b10f-901f-483e-8008-0edd30871922 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1568 microversion: 2.25 time: 0.530266 May 10 02:12:20.885869 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 175/404] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:20 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1568 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:20.893623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:20.895797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:20.904553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.906604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.907783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:20.908772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:20.916877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:20.932909 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ed12000-4f0f-4b84-9320-ba135f9f718a tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1453 microversion: 2.1 time: 0.396309 May 10 02:12:20.936045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 230/405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:20 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1453 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:20.951416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28ebc977-95d7-4300-bd58-79dff2b8ad8a tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:20.957794 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:20.957794 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:21.102568 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28ebc977-95d7-4300-bd58-79dff2b8ad8a tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.163289 May 10 02:12:21.104152 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 231/406] 10.222.0.52 () {60 vars in 1223 bytes} [Tue May 10 02:12:20 2022] POST /compute/v2.1/flavors/1685383186/os-extra_specs => generated 66 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:21.111412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.112237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:21.120728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.121535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.122645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.123358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.164657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:12:21.340636 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1edcb00-e32c-42b7-8db5-db95c760bb68 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 204 len: 0 microversion: 2.1 time: 0.234512 May 10 02:12:21.341495 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 232/407] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:21 2022] DELETE /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:21.354323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54075e09-b030-4c93-92b4-b9348337ba44 tempest-FlavorsExtraSpecsTestJSON-654548627 tempest-FlavorsExtraSpecsTestJSON-654548627-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.379423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54075e09-b030-4c93-92b4-b9348337ba44 tempest-FlavorsExtraSpecsTestJSON-654548627 tempest-FlavorsExtraSpecsTestJSON-654548627-project] 10.222.0.52 "GET /compute/v2.1/flavors/1685383186/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.036416 May 10 02:12:21.380389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 233/408] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:12:21 2022] GET /compute/v2.1/flavors/1685383186/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:21.386358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.387410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:21.393781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.394237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.395784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.396571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.434665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.435470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.436148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lazy-loading 'fault' on Instance uuid ff33c6c6-557b-4f01-bfff-80e8a6cb9356 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:21.469842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:21.485278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-159dc384-860b-478a-8cd6-30065942e076 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1317 microversion: 2.1 time: 0.597617 May 10 02:12:21.487039 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 176/409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:20 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:21.493605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.494849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:21.504742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.505196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.506210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.506684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.740417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:21.751121 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5e69581-5fe2-4e48-9588-8a5a251fbecf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.262234 May 10 02:12:21.753496 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 177/410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:21 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:21.776331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:21.780674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a327bc1-d318-4b9d-8b03-079b6d2d15ab tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:21.782752 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:21.782752 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:21.789712 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5168f6d6-4e73-4347-b5ce-a098af697836 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1459 microversion: 2.1 time: 0.406137 May 10 02:12:21.791259 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 234/411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:21 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1459 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:21.799938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-01911dd3-200b-4998-943e-26fcd0ece78e req-3fb3dcfc-b700-45f4-b393-925dfb32421e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:21.811777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-01911dd3-200b-4998-943e-26fcd0ece78e req-3fb3dcfc-b700-45f4-b393-925dfb32421e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.812510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-01911dd3-200b-4998-943e-26fcd0ece78e req-3fb3dcfc-b700-45f4-b393-925dfb32421e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.824636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a327bc1-d318-4b9d-8b03-079b6d2d15ab tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068750 May 10 02:12:21.825388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 178/412] 10.222.0.52 () {60 vars in 1223 bytes} [Tue May 10 02:12:21 2022] POST /compute/v2.1/flavors/1685383186/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:21.833069 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-01911dd3-200b-4998-943e-26fcd0ece78e req-3fb3dcfc-b700-45f4-b393-925dfb32421e service nova] Creating event network-changed:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:12:21.836256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db25901b-8bf5-4972-8f84-f38309c1f275 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.839824 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-01911dd3-200b-4998-943e-26fcd0ece78e req-3fb3dcfc-b700-45f4-b393-925dfb32421e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046502 May 10 02:12:21.841822 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 235/413] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:21.850022 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db25901b-8bf5-4972-8f84-f38309c1f275 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018819 May 10 02:12:21.850608 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 179/414] 10.222.0.52 () {58 vars in 1202 bytes} [Tue May 10 02:12:21 2022] GET /compute/v2.1/flavors/1685383186/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:21.861765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9756e7ff-2f81-45d1-a9c4-87eee5667403 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:21.863404 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:21.863404 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:21.893962 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9756e7ff-2f81-45d1-a9c4-87eee5667403 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1685383186/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.037632 May 10 02:12:21.894632 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 236/415] 10.222.0.52 () {60 vars in 1264 bytes} [Tue May 10 02:12:21 2022] PUT /compute/v2.1/flavors/1685383186/os-extra_specs/hw:numa_nodes => generated 22 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:21.902957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3168d28-2d4e-4e2a-96ef-e7e89c3ec724 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.903148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.903780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:21.913061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.913493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.913623 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3168d28-2d4e-4e2a-96ef-e7e89c3ec724 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014125 May 10 02:12:21.914257 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 237/416] 10.222.0.52 () {58 vars in 1202 bytes} [Tue May 10 02:12:21 2022] GET /compute/v2.1/flavors/1685383186/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:21.914410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:21.914711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:21.923824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75a8a98b-9283-4a10-9b03-ccf5cafedf90 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.925137 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:21.925137 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:21.958003 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75a8a98b-9283-4a10-9b03-ccf5cafedf90 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1685383186/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.038335 May 10 02:12:21.962071 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 238/417] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:12:21 2022] DELETE /compute/v2.1/flavors/1685383186/os-extra_specs/hw:numa_nodes => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 10 02:12:21.968487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0d650af-f583-4277-ac0b-976164bdab81 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:21.999989 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0d650af-f583-4277-ac0b-976164bdab81 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1685383186/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.035833 May 10 02:12:22.003280 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 239/418] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:12:21 2022] DELETE /compute/v2.1/flavors/1685383186/os-extra_specs/hw:cpu_policy => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:12:22.011308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-913f5f85-947f-4cd4-9de3-b9352031c959 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.020053 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-913f5f85-947f-4cd4-9de3-b9352031c959 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1685383186/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012532 May 10 02:12:22.020632 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 240/419] 10.222.0.52 () {58 vars in 1202 bytes} [Tue May 10 02:12:22 2022] GET /compute/v2.1/flavors/1685383186/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:12:22.035997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99956d10-ad27-4816-99b5-e2b6c3ec2de8 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.036878 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:22.036878 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:22.054726 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99956d10-ad27-4816-99b5-e2b6c3ec2de8 tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1685383186" status: 202 len: 0 microversion: 2.1 time: 0.023166 May 10 02:12:22.055603 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 241/420] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:22 2022] DELETE /compute/v2.1/flavors/1685383186 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:22.064099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1cdcc20b-4109-4aa1-81d5-2d83b068b32e tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.085339 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1cdcc20b-4109-4aa1-81d5-2d83b068b32e tempest-FlavorsExtraSpecsTestJSON-834203558 tempest-FlavorsExtraSpecsTestJSON-834203558-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.025310 May 10 02:12:22.086179 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 242/421] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:22 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:22.088237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:22.100288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:22.102632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:22.104528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c1a1af1-5fbd-476c-bb13-90f20b3d714c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1558 microversion: 2.25 time: 0.205249 May 10 02:12:22.105207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 180/422] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:21 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:12:22.122409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09174b41-eecf-4bfe-8ec5-3e2ce3855cc8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '.version_select at 0x7f3d37b7c040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.127347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09174b41-eecf-4bfe-8ec5-3e2ce3855cc8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.127347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09174b41-eecf-4bfe-8ec5-3e2ce3855cc8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:22.195834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09174b41-eecf-4bfe-8ec5-3e2ce3855cc8 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1343 microversion: 2.25 time: 0.077463 May 10 02:12:22.196865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 243/423] 10.222.0.52 () {60 vars in 1183 bytes} [Tue May 10 02:12:22 2022] GET /compute/v2.1/os-migrations => generated 1343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:22.210147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.210773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:22.222463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.223760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:22.229229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.229945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:22.502841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.504750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:22.517221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.520368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:22.522668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.523384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:22.768777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 72d0f290-23eb-448e-b203-33508b893b70 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:22.913658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab133188-e513-42d5-934d-b2de345c438b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 2051 microversion: 2.25 time: 0.708852 May 10 02:12:22.914525 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 181/424] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:22 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 2051 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:22.919783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:22.920639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:22.927647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.928407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:22.929637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:22.930299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:23.059505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:23.074953 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4075efcc-9865-4c46-b3de-7f9d2edb78c1 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1317 microversion: 2.1 time: 0.569165 May 10 02:12:23.075641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 244/425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:22 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:23.080241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:23.080859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:23.099473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:23.099931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:23.100721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:23.101166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:23.161697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:23.162158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:23.162622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lazy-loading 'fault' on Instance uuid ff33c6c6-557b-4f01-bfff-80e8a6cb9356 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:23.478786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:23.494406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb08f29a-58c8-4ac2-afb8-4fd39eef9227 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.578090 May 10 02:12:23.495100 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 182/426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:22 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:23.509791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1486131959", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "7fe840c0-65b0-4d12-94df-84e1e8a62759"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:23.538307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:23.552098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32fcb215-c23d-4dc8-9955-719a1f915132 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1459 microversion: 2.1 time: 0.475385 May 10 02:12:23.561577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 245/427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:23 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1459 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:23.579561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] validate_networks() for [('7fe840c0-65b0-4d12-94df-84e1e8a62759', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:24.092232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:24.093149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:24.105958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:24.106906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:24.108896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:24.109625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:24.985307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:25.005263 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb6186ae-a186-4168-b97e-11d170139b61 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1317 microversion: 2.1 time: 0.917108 May 10 02:12:25.029855 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 246/428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:24 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:25.041886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b8cc2ae2-b124-4d8c-808b-b0ad30cd543a req-442d7db4-8220-4d3c-82ec-76e0c6bdff0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97ad790-f1eb-49d6-b1c9-249fa0d34af8", "name": "network-vif-unplugged", "status": "completed", "tag": "8ec5090a-4fb8-4b2b-b9cc-58d3443773c7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:25.068962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b8cc2ae2-b124-4d8c-808b-b0ad30cd543a req-442d7db4-8220-4d3c-82ec-76e0c6bdff0f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.070233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b8cc2ae2-b124-4d8c-808b-b0ad30cd543a req-442d7db4-8220-4d3c-82ec-76e0c6bdff0f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.101254 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b8cc2ae2-b124-4d8c-808b-b0ad30cd543a req-442d7db4-8220-4d3c-82ec-76e0c6bdff0f service nova] Creating event network-vif-unplugged:8ec5090a-4fb8-4b2b-b9cc-58d3443773c7 for instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 on n-h2-841089-2 May 10 02:12:25.106847 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b8cc2ae2-b124-4d8c-808b-b0ad30cd543a req-442d7db4-8220-4d3c-82ec-76e0c6bdff0f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075156 May 10 02:12:25.107820 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 247/429] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:25.116292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:25.117417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:25.124047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.124633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.125545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.126087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.674898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:25.687386 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0bb64f88-5eb2-4abc-83b3-22d134279813 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.578036 May 10 02:12:25.690208 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 248/430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:25 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:25.700173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:25.700787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:25.716776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.717422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.718278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.718728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.786497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:25.787030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:25.787401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:25.787812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:25.788216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:25.793663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.794323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.794966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lazy-loading 'fault' on Instance uuid ff33c6c6-557b-4f01-bfff-80e8a6cb9356 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:25.809283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.809994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.811184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:25.811824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:25.832714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:25.837763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for user b31e1f4aa1eb4cceb37e10f1b8f7b3f2 and project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:25.851751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:25.854238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:25.932934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc3c6e99-e16c-49ee-8442-b5b7efbe5e09 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.426785 May 10 02:12:25.940392 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 183/431] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:12:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2435 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:12:25.941735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee51d8b18db4c649c37b04cbd9f9842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572edeebc3c46f1aba4159acf54e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:25.956035 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b8ca25bb-6ae4-4179-a3d8-35dafeb91717 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 200 len: 1310 microversion: 2.1 time: 0.262516 May 10 02:12:25.957362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 249/432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:25 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 1310 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:25.973937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-903f738e-a5ca-4485-bd33-338eb47068f8 req-7c2d8735-809b-4026-af1c-ee0b4442b71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff33c6c6-557b-4f01-bfff-80e8a6cb9356", "name": "network-vif-deleted", "tag": "cc265bf7-b898-4047-8fdd-22ee6f896cbc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:25.997651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-903f738e-a5ca-4485-bd33-338eb47068f8 req-7c2d8735-809b-4026-af1c-ee0b4442b71f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.000250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-903f738e-a5ca-4485-bd33-338eb47068f8 req-7c2d8735-809b-4026-af1c-ee0b4442b71f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.028347 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-903f738e-a5ca-4485-bd33-338eb47068f8 req-7c2d8735-809b-4026-af1c-ee0b4442b71f service nova] Creating event network-vif-deleted:cc265bf7-b898-4047-8fdd-22ee6f896cbc for instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 on n-h1-841089-2 May 10 02:12:26.042508 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-903f738e-a5ca-4485-bd33-338eb47068f8 req-7c2d8735-809b-4026-af1c-ee0b4442b71f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081763 May 10 02:12:26.048429 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 250/433] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:26.058572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6964353-0695-44c2-9fd2-df4bab03a51d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.059649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6964353-0695-44c2-9fd2-df4bab03a51d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:26.170418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6964353-0695-44c2-9fd2-df4bab03a51d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:26.182397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6964353-0695-44c2-9fd2-df4bab03a51d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:26.196245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6964353-0695-44c2-9fd2-df4bab03a51d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:26.197728 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6964353-0695-44c2-9fd2-df4bab03a51d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1262 microversion: 2.25 time: 0.147705 May 10 02:12:26.207591 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 251/434] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:26.231252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.231724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:26.244691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.247331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.248153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.248605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.323557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Calling method '.version_select at 0x7f3d37797790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.324401 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.324401 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.325824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.326287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.350567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.351090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.372509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.373195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.380968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c4189e5-e553-4399-b2b2-60610346ff73 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.439070 May 10 02:12:26.381783 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 184/435] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:26.465203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Calling method '.version_select at 0x7f3d37878940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.466194 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.466194 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.467638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.468282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.490970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.492480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.500239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:26.512953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.513740 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aaeca6ca-6563-4b51-822b-991de524325e tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1317 microversion: 2.1 time: 0.302897 May 10 02:12:26.514349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.514815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 252/436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:26.537683 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb5805c5-380a-4a13-8714-5bef34396aa7 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.154645 May 10 02:12:26.539055 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 185/437] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:26.556242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Calling method '.version_select at 0x7f3d37878790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.558236 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.558236 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.561324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.561969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.589989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.590586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.623420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.624173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.655645 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-500f3625-c92a-4583-bcf6-8794b2cc90c2 tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-841089-2/servers" status: 200 len: 275 microversion: 2.1 time: 0.108788 May 10 02:12:26.656633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 186/438] 10.222.0.52 () {58 vars in 1211 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors/n-h1-841089-2/servers => generated 275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:26.671506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Calling method '.version_select at 0x7f3d377b6310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.672273 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.672273 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.673435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.673886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.718639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.719481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.745779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f26cc8d-f0d0-40d6-8124-f3ab86b3713f tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Calling method '.version_select at 0x7f3d37997550>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.747713 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.747713 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:26.751391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f26cc8d-f0d0-40d6-8124-f3ab86b3713f tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '834f6f242f254546ab428c441f6237a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed3f2cea0b640e9ba0123e8f4b3807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f26cc8d-f0d0-40d6-8124-f3ab86b3713f tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Request method failure captured: May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hypervisors/n-h1-841089-2/search HTTP/1.1 May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoHynJuTBUB6VhPW3tDPR9uuePQFlFqLwzHhSkOSRKGaBRtBW52U2RHYCD6nxCReFhJ15qT2yHf6yqdctO8T7dOdWrF9njB5fkk2kbZhZsno2MTDvBdBikr2RSDn9492NRfGq2QOZ8INsh2EHn3phNmnn2Zds2z6-6uIG5Lm_JCe0Q May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: fed3f2cea0b640e9ba0123e8f4b3807e May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1091540340 May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:26.754470 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fed3f2cea0b640e9ba0123e8f4b3807e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fed3f2cea0b640e9ba0123e8f4b3807e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fed3f2cea0b640e9ba0123e8f4b3807e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fed3f2cea0b640e9ba0123e8f4b3807e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1091540340 May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: fed3f2cea0b640e9ba0123e8f4b3807e May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1091540340 May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 834f6f242f254546ab428c441f6237a9 May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 10 02:12:26.756021 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-h1-841089-2'} May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:26.756765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 10 02:12:26.757921 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:26.763972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f26cc8d-f0d0-40d6-8124-f3ab86b3713f tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:26.764628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.765344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.767000 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f26cc8d-f0d0-40d6-8124-f3ab86b3713f tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-841089-2/search" status: 403 len: 117 microversion: 2.1 time: 0.248812 May 10 02:12:26.767662 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 253/439] 10.222.0.52 () {58 vars in 1208 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors/n-h1-841089-2/search => generated 117 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:26.775449 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51d9d5ec-9338-47ce-aff8-f1430bc8ad4a tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.107783 May 10 02:12:26.776513 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 187/440] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:26.787146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Calling method '.version_select at 0x7f3d377b6700>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.788710 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.788710 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.789897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.790399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.790517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:26.791212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.798811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Request method failure captured: May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoI3yzWy-dtNA35C28P-Af4_0SJw0apEgqww8Wl0vbPujwDlt9GllJ9V_1iKVGDm8uh7Oc4hWZoYHOYGROIwJVJfnXMc6bUxiboMwI2ayooTCypEnMB0tx1ojHeIkGlnSIbLY8F8OfLxHhowBYGa5P68pN1DZt2xFDa3JRJu5PVl9k May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7b395f0af3f04dc2b4b6412ba9362aea May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1207892094 May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:12:26.801715 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b395f0af3f04dc2b4b6412ba9362aea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b395f0af3f04dc2b4b6412ba9362aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b395f0af3f04dc2b4b6412ba9362aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b395f0af3f04dc2b4b6412ba9362aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1207892094 May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7b395f0af3f04dc2b4b6412ba9362aea May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1207892094 May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b04668c25c6a41728f555b96d489a3b6 May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 10 02:12:26.802922 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'nonexistent_hypervisor_name'} May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.803639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.804695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.804695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:26.804695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:26.804695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 10 02:12:26.804695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.805076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.805076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.805871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.806318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.807090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:26.808170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-edb68ec9-a8c6-4f0a-b870-4ba4691ed5f2 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024775 May 10 02:12:26.809315 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 188/441] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:26.817180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37c1a0cc-e0e9-415c-b211-9a722da4d94d tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Calling method '.version_select at 0x7f3d377688b0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.819562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1a0cc-e0e9-415c-b211-9a722da4d94d tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.820240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1a0cc-e0e9-415c-b211-9a722da4d94d tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.841425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1a0cc-e0e9-415c-b211-9a722da4d94d tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.842477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1a0cc-e0e9-415c-b211-9a722da4d94d tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.850505 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37c1a0cc-e0e9-415c-b211-9a722da4d94d tempest-HypervisorAdminUnderV252Test-1741922669 tempest-HypervisorAdminUnderV252Test-1741922669-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-841089-2/search" status: 200 len: 104 microversion: 2.1 time: 0.039955 May 10 02:12:26.854171 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 189/442] 10.222.0.52 () {58 vars in 1208 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors/n-h1-841089-2/search => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:26.877144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Calling method '.version_select at 0x7f3d377681f0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.879902 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.879902 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.885345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.886121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.916642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.917095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.930428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.931762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.939090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19396853-3206-478f-884a-d76d0eead4cb tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078556 May 10 02:12:26.939810 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 190/443] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:26.950483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7855b21c-f402-44ba-b014-565ae8d00c96 tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Calling method '.version_select at 0x7f3d377b6430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.951557 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:26.951557 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:26.952971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7855b21c-f402-44ba-b014-565ae8d00c96 tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '834f6f242f254546ab428c441f6237a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed3f2cea0b640e9ba0123e8f4b3807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7855b21c-f402-44ba-b014-565ae8d00c96 tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Request method failure captured: May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoHynJuTBUB6VhPW3tDPR9uuePQFlFqLwzHhSkOSRKGaBRtBW52U2RHYCD6nxCReFhJ15qT2yHf6yqdctO8T7dOdWrF9njB5fkk2kbZhZsno2MTDvBdBikr2RSDn9492NRfGq2QOZ8INsh2EHn3phNmnn2Zds2z6-6uIG5Lm_JCe0Q May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: fed3f2cea0b640e9ba0123e8f4b3807e May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1091540340 May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:26.954848 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fed3f2cea0b640e9ba0123e8f4b3807e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fed3f2cea0b640e9ba0123e8f4b3807e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fed3f2cea0b640e9ba0123e8f4b3807e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fed3f2cea0b640e9ba0123e8f4b3807e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1091540340 May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: fed3f2cea0b640e9ba0123e8f4b3807e May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1091540340 May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 834f6f242f254546ab428c441f6237a9 May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 10 02:12:26.956630 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1'} May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:26.957861 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 10 02:12:26.958857 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.961358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7855b21c-f402-44ba-b014-565ae8d00c96 tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:26.961358 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7855b21c-f402-44ba-b014-565ae8d00c96 tempest-HypervisorAdminNegativeUnderV252Test-1091540340 tempest-HypervisorAdminNegativeUnderV252Test-1091540340-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009769 May 10 02:12:26.961358 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 191/444] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 10 02:12:26.967437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Calling method '.version_select at 0x7f3d37775430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.969477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:26.970090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:26.980049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] HTTP exception thrown: No hypervisor matching 'f1351030-2c9c-4464-8def-89b8cd318764' could be found. May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Request method failure captured: May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/f1351030-2c9c-4464-8def-89b8cd318764/servers HTTP/1.1 May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoI3yzWy-dtNA35C28P-Af4_0SJw0apEgqww8Wl0vbPujwDlt9GllJ9V_1iKVGDm8uh7Oc4hWZoYHOYGROIwJVJfnXMc6bUxiboMwI2ayooTCypEnMB0tx1ojHeIkGlnSIbLY8F8OfLxHhowBYGa5P68pN1DZt2xFDa3JRJu5PVl9k May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7b395f0af3f04dc2b4b6412ba9362aea May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1207892094 May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:12:26.981797 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b395f0af3f04dc2b4b6412ba9362aea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b395f0af3f04dc2b4b6412ba9362aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b395f0af3f04dc2b4b6412ba9362aea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b395f0af3f04dc2b4b6412ba9362aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1207892094 May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7b395f0af3f04dc2b4b6412ba9362aea May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1207892094 May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b04668c25c6a41728f555b96d489a3b6 May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: exception: No hypervisor matching 'f1351030-2c9c-4464-8def-89b8cd318764' could be found. May 10 02:12:26.982979 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f1351030-2c9c-4464-8def-89b8cd318764'} May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f1351030-2c9c-4464-8def-89b8cd318764' could be found. May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.983688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f1351030-2c9c-4464-8def-89b8cd318764' could be found. May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] Returning 404 to user: No hypervisor matching 'f1351030-2c9c-4464-8def-89b8cd318764' could be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:26.984686 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5b66bfed-6fa7-4e2a-b39d-94700e21d990 tempest-HypervisorAdminNegativeUnderV252Test-1207892094 tempest-HypervisorAdminNegativeUnderV252Test-1207892094-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/f1351030-2c9c-4464-8def-89b8cd318764/servers" status: 404 len: 123 microversion: 2.1 time: 0.021121 May 10 02:12:26.991605 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 192/445] 10.222.0.52 () {58 vars in 1280 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/os-hypervisors/f1351030-2c9c-4464-8def-89b8cd318764/servers => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:12:26.996553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:26.997180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.025113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.025573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.032025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.032489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.064229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] HTTP exception thrown: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Request method failure captured: May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 HTTP/1.1 May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnKZhvlE2C-1KufR1t5YnnURjQZ1po_002GyndpdCGLzgDnM7HaoSDTLdRGGYv6DryPn5SeXfaneeJe_KqTHuk_WBb-3Z-6bGsqyoLmCA9X1N8U_fol9sa_TodNCrmexYt6lwyW5A-0pR4_nn3nc3s7lf_gb-X_GGvskfIq2qEBVzI May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:27.066086 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7572edeebc3c46f1aba4159acf54e224", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: cee51d8b18db4c649c37b04cbd9f9842 May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.067425 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ff33c6c6-557b-4f01-bfff-80e8a6cb9356'} May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:27.068138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.069191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.070172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Returning 404 to user: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:27.070172 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-756cc8fe-5ac1-48e8-91ee-28a200c70e61 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 404 len: 111 microversion: 2.1 time: 0.080317 May 10 02:12:27.070172 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 193/446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:27.081711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:27.082244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.100547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.101003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.101923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.102366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.142235 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] HTTP exception thrown: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Request method failure captured: May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 HTTP/1.1 May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnKZhvlE2C-1KufR1t5YnnURjQZ1po_002GyndpdCGLzgDnM7HaoSDTLdRGGYv6DryPn5SeXfaneeJe_KqTHuk_WBb-3Z-6bGsqyoLmCA9X1N8U_fol9sa_TodNCrmexYt6lwyW5A-0pR4_nn3nc3s7lf_gb-X_GGvskfIq2qEBVzI May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:27.144046 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7572edeebc3c46f1aba4159acf54e224", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: cee51d8b18db4c649c37b04cbd9f9842 May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.146113 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ff33c6c6-557b-4f01-bfff-80e8a6cb9356'} May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:27.146812 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.148060 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.151922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Returning 404 to user: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:27.154266 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb265999-be0a-4b8d-bcc3-d6e304615cbe tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 404 len: 111 microversion: 2.1 time: 0.076477 May 10 02:12:27.157889 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 194/447] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:27 2022] DELETE /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:27.169965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c83e0401-81c4-40ac-9b06-955b906259c3 req-f2d658ae-86fa-4b2e-9778-90caf9287b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97ad790-f1eb-49d6-b1c9-249fa0d34af8", "tag": "8ec5090a-4fb8-4b2b-b9cc-58d3443773c7"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:27.192910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c83e0401-81c4-40ac-9b06-955b906259c3 req-f2d658ae-86fa-4b2e-9778-90caf9287b9b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.193488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c83e0401-81c4-40ac-9b06-955b906259c3 req-f2d658ae-86fa-4b2e-9778-90caf9287b9b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.214429 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c83e0401-81c4-40ac-9b06-955b906259c3 req-f2d658ae-86fa-4b2e-9778-90caf9287b9b service nova] Creating event network-changed:8ec5090a-4fb8-4b2b-b9cc-58d3443773c7 for instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 on n-h2-841089-2 May 10 02:12:27.231084 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c83e0401-81c4-40ac-9b06-955b906259c3 req-f2d658ae-86fa-4b2e-9778-90caf9287b9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067191 May 10 02:12:27.233772 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 195/448] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:27.259877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:27.260993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: ff33c6c6-557b-4f01-bfff-80e8a6cb9356] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.283619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.284603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.285997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.287012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.322196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] HTTP exception thrown: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Request method failure captured: May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 HTTP/1.1 May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnKZhvlE2C-1KufR1t5YnnURjQZ1po_002GyndpdCGLzgDnM7HaoSDTLdRGGYv6DryPn5SeXfaneeJe_KqTHuk_WBb-3Z-6bGsqyoLmCA9X1N8U_fol9sa_TodNCrmexYt6lwyW5A-0pR4_nn3nc3s7lf_gb-X_GGvskfIq2qEBVzI May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:27.327053 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7572edeebc3c46f1aba4159acf54e224", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: cee51d8b18db4c649c37b04cbd9f9842 May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.328278 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ff33c6c6-557b-4f01-bfff-80e8a6cb9356'} May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:27.328931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. May 10 02:12:27.329977 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.335337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Returning 404 to user: Instance ff33c6c6-557b-4f01-bfff-80e8a6cb9356 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:27.336277 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7810ffc2-ec22-4e0d-b1dd-48008a1bd2c4 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356" status: 404 len: 111 microversion: 2.1 time: 0.101319 May 10 02:12:27.339915 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 196/449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:27 2022] GET /compute/v2.1/servers/ff33c6c6-557b-4f01-bfff-80e8a6cb9356 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:27.341715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:27.343292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.349716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.350293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.351602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.352096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.617037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:27.626769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:27.628417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:27.630888 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2908962a-49dc-46ba-b789-aa4a8f241914 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1314 microversion: 2.25 time: 0.292442 May 10 02:12:27.631412 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 197/450] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:27 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:27.636104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:27.636852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.643476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.644114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.644894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.645332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.661486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] HTTP exception thrown: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Request method failure captured: May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a HTTP/1.1 May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnKZhvlE2C-1KufR1t5YnnURjQZ1po_002GyndpdCGLzgDnM7HaoSDTLdRGGYv6DryPn5SeXfaneeJe_KqTHuk_WBb-3Z-6bGsqyoLmCA9X1N8U_fol9sa_TodNCrmexYt6lwyW5A-0pR4_nn3nc3s7lf_gb-X_GGvskfIq2qEBVzI May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:27.663971 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7572edeebc3c46f1aba4159acf54e224", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: cee51d8b18db4c649c37b04cbd9f9842 May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.665374 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '9db1f99b-607f-4121-b793-8cd35916a89a'} May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:27.666043 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.667270 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:27.670584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Returning 404 to user: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:27.671470 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5ea88697-899a-45d7-b47d-5f0fd8d848fb tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 404 len: 111 microversion: 2.1 time: 0.038888 May 10 02:12:27.672354 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 198/451] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:27 2022] DELETE /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:27.677708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:27.678329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.680610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:27.684681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.685325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.686105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.686542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.688150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9be99b2f-301e-4a81-9aa7-8eb19edb5c2a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.917702 May 10 02:12:27.688733 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 254/452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:26 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:27.703276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:27.704065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] [instance: 9db1f99b-607f-4121-b793-8cd35916a89a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:27.715766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.716237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.717062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:27.717497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:27.743447 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] HTTP exception thrown: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Request method failure captured: May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a HTTP/1.1 May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnKZhvlE2C-1KufR1t5YnnURjQZ1po_002GyndpdCGLzgDnM7HaoSDTLdRGGYv6DryPn5SeXfaneeJe_KqTHuk_WBb-3Z-6bGsqyoLmCA9X1N8U_fol9sa_TodNCrmexYt6lwyW5A-0pR4_nn3nc3s7lf_gb-X_GGvskfIq2qEBVzI May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:27.744905 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7572edeebc3c46f1aba4159acf54e224", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7572edeebc3c46f1aba4159acf54e224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7572edeebc3c46f1aba4159acf54e224 May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1067201960 May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: cee51d8b18db4c649c37b04cbd9f9842 May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersAdminTestJSON-1067201960-project May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.746390 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '9db1f99b-607f-4121-b793-8cd35916a89a'} May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:27.747235 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. May 10 02:12:27.748468 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:27.749630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] Returning 404 to user: Instance 9db1f99b-607f-4121-b793-8cd35916a89a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:27.749630 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5823c0c-1811-4da1-b4fa-e25f3a42d460 tempest-DeleteServersAdminTestJSON-1067201960 tempest-DeleteServersAdminTestJSON-1067201960-project] 10.222.0.52 "GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a" status: 404 len: 111 microversion: 2.1 time: 0.056648 May 10 02:12:27.749630 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 255/453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:27 2022] GET /compute/v2.1/servers/9db1f99b-607f-4121-b793-8cd35916a89a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:28.173117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:28.183359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0241e91-9705-475b-9926-044948e32591 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1317 microversion: 2.1 time: 0.509708 May 10 02:12:28.183937 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 199/454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:27 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:28.492787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e4c2eb2a-85c1-4f2f-b515-a4e99f7fd9f2 req-b1067c49-9f1d-45df-b0ca-a2dafb2a3644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "name": "network-vif-plugged", "status": "completed", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:28.508820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e4c2eb2a-85c1-4f2f-b515-a4e99f7fd9f2 req-b1067c49-9f1d-45df-b0ca-a2dafb2a3644 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:28.510882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e4c2eb2a-85c1-4f2f-b515-a4e99f7fd9f2 req-b1067c49-9f1d-45df-b0ca-a2dafb2a3644 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:28.532742 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e4c2eb2a-85c1-4f2f-b515-a4e99f7fd9f2 req-b1067c49-9f1d-45df-b0ca-a2dafb2a3644 service nova] Creating event network-vif-plugged:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:12:28.546490 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e4c2eb2a-85c1-4f2f-b515-a4e99f7fd9f2 req-b1067c49-9f1d-45df-b0ca-a2dafb2a3644 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057623 May 10 02:12:28.553282 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 256/455] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:28.651677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:28.652620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:28.669377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:28.671326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:28.672768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:28.674320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:28.708489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:28.709904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:28.729468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:28.730182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:28.730975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:28.731444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:28.862661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:28.872914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:28.875476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:28.876944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a253bfa0-76d2-46c6-8495-120d3f8713b7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1320 microversion: 2.25 time: 0.231294 May 10 02:12:28.877892 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 200/456] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:28 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:29.201023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:29.201678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:29.212886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:29.213518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:29.214365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:29.217239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:29.353904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:29.362213 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e339c575-b2f9-482f-93e9-d83882c93165 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.659951 May 10 02:12:29.366173 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 257/457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:28 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:29.614819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:29.626367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc7de81e-55fb-4099-bc9d-a5778b40f5bd tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1317 microversion: 2.1 time: 0.429106 May 10 02:12:29.627293 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 201/458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:29 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:29.903026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:29.904916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:29.915801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:29.919763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:29.921944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:29.924389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:30.336977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:30.346255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:30.350976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:30.354905 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07637c5f-1203-486e-8791-470c761c78eb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 0.458428 May 10 02:12:30.358711 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 258/459] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:29 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:30.384673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:30.385395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:30.394958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:30.395655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:30.397094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:30.397691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:30.643242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:30.646711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:30.656816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:30.665055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:30.665997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:30.666452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:30.839894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:30.858051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00af1a20-e15c-4702-bbe4-d22944c8a4ec tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.481084 May 10 02:12:30.859176 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 202/460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:30 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:31.093172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:31.103598 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ff1d1b0-52c8-48a4-82c4-9a65b870651f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1466 microversion: 2.1 time: 0.463918 May 10 02:12:31.108275 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 259/461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:30 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1466 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:31.122686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-748960484", "metadata": {"image_type": "test"}}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:31.123929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:31.134665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:31.135156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:31.135960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:31.138525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:31.217584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Getting quotas for project 26a35846a10642e48703cf9597c3e810. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:31.231091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Getting quotas for user c0819595c84d497194721e063f9c3170 and project 26a35846a10642e48703cf9597c3e810. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:31.376831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:31.377443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:31.387855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:31.388526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:31.389487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:31.391119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:31.655138 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2ed5f07-017b-48e8-b7aa-81bcd61b1677 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "POST /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac/action" status: 202 len: 0 microversion: 2.1 time: 0.536709 May 10 02:12:31.662202 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 203/462] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:12:31 2022] POST /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:12:32.110769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acc256f8-446d-44c8-8b76-eab4cac1a14a tempest-InstanceUsageAuditLogTestJSON-961014211 tempest-InstanceUsageAuditLogTestJSON-961014211-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:32.111664 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:32.111664 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:32.134020 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acc256f8-446d-44c8-8b76-eab4cac1a14a tempest-InstanceUsageAuditLogTestJSON-961014211 tempest-InstanceUsageAuditLogTestJSON-961014211-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-10 02:12:31" status: 200 len: 318 microversion: 2.1 time: 0.470291 May 10 02:12:32.143928 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 204/463] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:12:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-10%2002%3A12%3A31 => generated 318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:32.151804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-471f292c-d06a-4887-99ea-cd9479a1d3f2 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37768550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:32.175634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:32.207126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:32.209101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:32.210855 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3550557-8741-4007-a281-edace7345f41 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 0.838407 May 10 02:12:32.212319 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 260/464] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:31 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:12:32.218123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:32.218905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:32.234163 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-471f292c-d06a-4887-99ea-cd9479a1d3f2 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.088370 May 10 02:12:32.234923 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 205/465] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:32 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:32.245792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:32.246505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-483519f5-4eb1-4777-a095-d3f63f5696d7 tempest-InstanceUsageAuditLogTestJSON-961014211 tempest-InstanceUsageAuditLogTestJSON-961014211-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:32.247597 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:32.247597 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:32.248652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:32.250015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:32.251445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:32.263220 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-483519f5-4eb1-4777-a095-d3f63f5696d7 tempest-InstanceUsageAuditLogTestJSON-961014211 tempest-InstanceUsageAuditLogTestJSON-961014211-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.020846 May 10 02:12:32.264033 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 206/466] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 02:12:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:32.426022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-64350783-fa24-4553-a184-cee99fc82053 req-84ee9871-688c-42d9-bdcc-5250bba6fbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41eee814-bd80-402e-b5a7-fe4f529f7070", "tag": "66c5b609-ea59-45fc-bd4c-971f08a42a91"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:32.442269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-64350783-fa24-4553-a184-cee99fc82053 req-84ee9871-688c-42d9-bdcc-5250bba6fbf2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:32.443247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-64350783-fa24-4553-a184-cee99fc82053 req-84ee9871-688c-42d9-bdcc-5250bba6fbf2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:32.472592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-64350783-fa24-4553-a184-cee99fc82053 req-84ee9871-688c-42d9-bdcc-5250bba6fbf2 service nova] Creating event network-changed:66c5b609-ea59-45fc-bd4c-971f08a42a91 for instance 41eee814-bd80-402e-b5a7-fe4f529f7070 on n-h1-841089-2 May 10 02:12:32.479365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-64350783-fa24-4553-a184-cee99fc82053 req-84ee9871-688c-42d9-bdcc-5250bba6fbf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059073 May 10 02:12:32.480692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 207/467] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:32.771441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:32.797907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8eaa48b-5883-4026-9160-9ae1032d2422 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.581342 May 10 02:12:32.801629 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 261/468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:32 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:32.960631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2094858813", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:33.026365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:33.162481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eefec001-b7f4-4c7b-ba4b-b0d3c46137da tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1826995580", "id": 1946073887, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:33.164377 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:33.164377 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:33.181746 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eefec001-b7f4-4c7b-ba4b-b0d3c46137da tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.086304 May 10 02:12:33.188034 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 262/469] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:33 2022] POST /compute/v2.1/flavors => generated 430 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:33.192730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-640292a5-7f38-47e7-9d8c-b4ba763a4648 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:33.193521 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:33.193521 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:33.214987 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-640292a5-7f38-47e7-9d8c-b4ba763a4648 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1946073887" status: 202 len: 0 microversion: 2.1 time: 0.025791 May 10 02:12:33.216072 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 263/470] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:33 2022] DELETE /compute/v2.1/flavors/1946073887 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:33.224463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1bdd2e3-c516-47c5-90b9-81456213d34e tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:33.250779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1bdd2e3-c516-47c5-90b9-81456213d34e tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.030497 May 10 02:12:33.252917 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 264/471] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:33 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:33.259032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:33.259947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:33.268263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:33.269031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:33.270027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:33.270470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:33.793251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:33.794679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:33.795547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:33.796570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:33.797474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:33.831824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:33.832572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:33.833799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:33.834933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:33.835850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:33.850616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:33.852154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:33.853277 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c5ad964f-b936-48ff-bb66-2ef994265044 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 0.598667 May 10 02:12:33.853842 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 265/472] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:33 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:33.858234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0dbab665-f986-4170-96f8-2090a1e954eb tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3798d430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:33.861845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Getting quotas for project 85beabe7271b4dcdb7ea8a4b65e0eb00. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:33.867575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Getting quotas for user fbaf584a0f104d4c9568ac686efd1b1c and project 85beabe7271b4dcdb7ea8a4b65e0eb00. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:33.894029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:33.898247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:33.927346 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0dbab665-f986-4170-96f8-2090a1e954eb tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.072421 May 10 02:12:33.928905 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 266/473] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:33 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:33.944943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cecac9ef-cd44-42a0-a79e-d32be15f6dbc tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-170373722", "id": 1622761421, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:33.950435 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:33.950435 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:33.981364 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cecac9ef-cd44-42a0-a79e-d32be15f6dbc tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.050372 May 10 02:12:33.981977 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 267/474] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:33 2022] POST /compute/v2.1/flavors => generated 416 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:33.992999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:33.993647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:34.011516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:34.012244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:34.013181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:34.014972 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9a840c78-a084-4127-a79e-78db29ba5df0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393448 May 10 02:12:34.015987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:34.028145 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 208/475] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:12:34.033123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f05e5bbf-7cc3-470b-bb63-0afd632b31d5 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.090173 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f05e5bbf-7cc3-470b-bb63-0afd632b31d5 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.060826 May 10 02:12:34.103105 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 209/476] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:34.113714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2cf1a00-d5bc-48cd-8872-582b963ac001 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.114387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2cf1a00-d5bc-48cd-8872-582b963ac001 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:34.282870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2cf1a00-d5bc-48cd-8872-582b963ac001 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:34.291290 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2cf1a00-d5bc-48cd-8872-582b963ac001 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1223 microversion: 2.1 time: 0.194887 May 10 02:12:34.292603 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 210/477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:34.299684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b338b324-d110-4ff1-8a48-e6b0dadeef63 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.301321 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:34.301321 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:34.335249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b338b324-d110-4ff1-8a48-e6b0dadeef63 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1622761421" status: 202 len: 0 microversion: 2.1 time: 0.037266 May 10 02:12:34.339915 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 211/478] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:34 2022] DELETE /compute/v2.1/flavors/1622761421 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:34.350333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f98ea0bd-2983-4d80-a749-d803d247987d tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.375385 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f98ea0bd-2983-4d80-a749-d803d247987d tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.030634 May 10 02:12:34.376714 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 212/479] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:34.395397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0f28b86-4f4e-44f8-8b36-6dc9a9db51b1 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1231203452", "id": 1586837350, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:34.400256 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:34.400256 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:34.436295 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0f28b86-4f4e-44f8-8b36-6dc9a9db51b1 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.044090 May 10 02:12:34.436947 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 213/480] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:34 2022] POST /compute/v2.1/flavors => generated 429 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:34.448840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7516a10-f9fc-43d6-8d59-dd9694d39572 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.489509 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7516a10-f9fc-43d6-8d59-dd9694d39572 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1586837350" status: 202 len: 0 microversion: 2.1 time: 0.044977 May 10 02:12:34.490971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 214/481] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:34 2022] DELETE /compute/v2.1/flavors/1586837350 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:12:34.498844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fcb96c10-ef1a-43e4-8374-dd48956b1312 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.550378 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fcb96c10-ef1a-43e4-8374-dd48956b1312 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.055223 May 10 02:12:34.550989 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 215/482] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:34.570071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e212f35-fe5f-4efd-a6ac-e6725840232f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1375159116", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:34.598191 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e212f35-fe5f-4efd-a6ac-e6725840232f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032156 May 10 02:12:34.602013 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 216/483] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:34 2022] POST /compute/v2.1/flavors => generated 507 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:34.609438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6541ffd-05ba-487c-9a30-8e80a3ab07e4 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.661938 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6541ffd-05ba-487c-9a30-8e80a3ab07e4 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/5717dda6-9704-4c1a-8fb5-05d2323a9fce" status: 202 len: 0 microversion: 2.1 time: 0.056130 May 10 02:12:34.662693 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 217/484] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:34 2022] DELETE /compute/v2.1/flavors/5717dda6-9704-4c1a-8fb5-05d2323a9fce => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:34.671303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7382e5a3-9d3b-4a04-9983-30a0d3557dc0 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.719095 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7382e5a3-9d3b-4a04-9983-30a0d3557dc0 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.050943 May 10 02:12:34.721738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 218/485] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:34.737324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:34.741621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cbf15da-9614-429d-b230-ee2454e62e5f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-730766024", "id": "aa291965-32b8-4820-a7a4-0177b3754205", "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:34.750081 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52ad6132-77b3-498a-862b-6bddcbc0168e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.767023 May 10 02:12:34.753639 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 268/486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:33 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:34.790811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4cbf15da-9614-429d-b230-ee2454e62e5f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.054269 May 10 02:12:34.797126 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 219/487] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:34 2022] POST /compute/v2.1/flavors => generated 506 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:34.804160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa1fe6b7-e031-47ec-916a-c4778714eee2 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.804935 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:34.804935 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:34.843010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa1fe6b7-e031-47ec-916a-c4778714eee2 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/aa291965-32b8-4820-a7a4-0177b3754205" status: 202 len: 0 microversion: 2.1 time: 0.044234 May 10 02:12:34.844431 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 269/488] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:34 2022] DELETE /compute/v2.1/flavors/aa291965-32b8-4820-a7a4-0177b3754205 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:34.854225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb024ca6-5761-49a2-a64f-cd638948c375 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.872211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:34.873344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:34.888106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:34.888327 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb024ca6-5761-49a2-a64f-cd638948c375 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.039598 May 10 02:12:34.889380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:34.891012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:34.892662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:34.899563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 220/489] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:34.909563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46d5a1cb-fdd8-4e51-b999-ac4d08889216 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-134562184", "id": 852515041, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:34.944443 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46d5a1cb-fdd8-4e51-b999-ac4d08889216 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.043557 May 10 02:12:34.947006 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 221/490] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:34 2022] POST /compute/v2.1/flavors => generated 410 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:34.953357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19e5dc2c-f4cc-4d0e-890f-eb7befe57b52 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37691310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.039603 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19e5dc2c-f4cc-4d0e-890f-eb7befe57b52 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.091446 May 10 02:12:35.040789 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 222/491] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:35.067350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da6a46d5-187c-4411-bdc9-1749893b6536 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.092387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da6a46d5-187c-4411-bdc9-1749893b6536 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/852515041" status: 200 len: 410 microversion: 2.1 time: 0.043133 May 10 02:12:35.093207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 223/492] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:12:35 2022] GET /compute/v2.1/flavors/852515041 => generated 410 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:35.449044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8971cb03-db77-4f52-bb47-72ecad85a228 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.488265 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8971cb03-db77-4f52-bb47-72ecad85a228 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6213 microversion: 2.1 time: 0.388071 May 10 02:12:35.490845 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 224/493] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:35 2022] GET /compute/v2.1/flavors/detail => generated 6213 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:35.504934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.505572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:35.512484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:35.512941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:35.513727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:35.514166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:35.537112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:35.549625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:35.556958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:35.558412 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-134466db-a625-4334-8553-e69954b9bc1a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 0.691269 May 10 02:12:35.558977 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 270/494] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:34 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:35.582559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b75120d0-e35d-4eb0-9cf0-fc46a95e55ef tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.583832 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:35.583832 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:35.641447 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b75120d0-e35d-4eb0-9cf0-fc46a95e55ef tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/852515041" status: 202 len: 0 microversion: 2.1 time: 0.081045 May 10 02:12:35.647246 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 271/495] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:35 2022] DELETE /compute/v2.1/flavors/852515041 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:35.653277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2dd0ab40-ca6e-4031-b32f-c6a38e5a5d7f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.755421 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2dd0ab40-ca6e-4031-b32f-c6a38e5a5d7f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.106541 May 10 02:12:35.767829 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 272/496] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:35 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:35.797063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:35.799083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:35.817579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:35.825826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:35.832504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:35.833367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:35.904282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:35.914959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e20bb6d6-1072-4907-8db0-e62a29662321 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1275 microversion: 2.1 time: 0.419174 May 10 02:12:35.918581 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 225/497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:35 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1275 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:35.924247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e453ab0-0ac0-400d-914f-29dd6f4839d5 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-47950321", "id": 1156516123, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:35.941320 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:35.941320 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:35.991744 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e453ab0-0ac0-400d-914f-29dd6f4839d5 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.070916 May 10 02:12:35.992688 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 226/498] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:35 2022] POST /compute/v2.1/flavors => generated 428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.004389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66271914-aee2-4438-9c7b-231eb35e6be2 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "1156516123"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:36.026148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-66271914-aee2-4438-9c7b-231eb35e6be2 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] HTTP exception thrown: Flavor 1156516123 could not be found. May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66271914-aee2-4438-9c7b-231eb35e6be2 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] Request method failure captured: May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 107 May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoPx4_dVp2MIoQkURAm_Ca5fDGr35ieY4kTSRB3xqPhr5gIP_qT-D5X5dkXfAyrQj-arwV-LRMWgZS2f1C28GYtc95RvqEDO2ZU_XH42ZbMrbiakpQN3NJh_kHogPiz-R_2ap2MpdCIxzyzGwfkjmaJOw_7ejohRofUEfZXcImxwOo May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b14b9d0335ec46658a42b30d7ce112b9 May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FlavorsAdminTestJSON-143079247 May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:36.029383 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b14b9d0335ec46658a42b30d7ce112b9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b14b9d0335ec46658a42b30d7ce112b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b14b9d0335ec46658a42b30d7ce112b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b14b9d0335ec46658a42b30d7ce112b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FlavorsAdminTestJSON-143079247 May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b14b9d0335ec46658a42b30d7ce112b9 May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-143079247 May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FlavorsAdminTestJSON-143079247-project May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f6525f0b39c3440b888a8ec0c5ac3a54 May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FlavorsAdminTestJSON-143079247-project May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "test", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "1156516123"}} May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:12:36.030955 n-d-841089-2 devstack@n-api.service[118717]: exception: Flavor 1156516123 could not be found. May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '1156516123'}}} May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1156516123 could not be found. May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:36.031801 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1156516123 could not be found. May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:36.033036 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:36.034223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:36.034223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:36.034223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:36.034223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1156516123 could not be found. May 10 02:12:36.034223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:36.040118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66271914-aee2-4438-9c7b-231eb35e6be2 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] Returning 400 to user: Flavor 1156516123 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:36.042171 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-66271914-aee2-4438-9c7b-231eb35e6be2 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.042999 May 10 02:12:36.048298 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 227/499] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:35 2022] POST /compute/v2.1/servers => generated 81 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:12:36.068150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8cc96be-38bd-4b62-a820-14aa1e2a10fc tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3765f670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.164332 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8cc96be-38bd-4b62-a820-14aa1e2a10fc tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.114552 May 10 02:12:36.165357 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 228/500] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:36.169883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-39abe7fa-c651-4882-8c2a-6f4a794dc2f4 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.184221 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:36.184221 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:36.216637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-39abe7fa-c651-4882-8c2a-6f4a794dc2f4 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1156516123" status: 202 len: 0 microversion: 2.1 time: 0.050055 May 10 02:12:36.217453 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 229/501] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:36 2022] DELETE /compute/v2.1/flavors/1156516123 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:36.225823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-003381ea-c196-4721-a9c9-887a62b2bc22 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.262108 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-003381ea-c196-4721-a9c9-887a62b2bc22 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.040312 May 10 02:12:36.273740 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 230/502] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:36.289217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dd561a6-3f48-4885-8030-e7bc7d09b77b tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-828475858", "id": 317397804, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:36.317279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dd561a6-3f48-4885-8030-e7bc7d09b77b tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.042303 May 10 02:12:36.322950 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 231/503] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:36 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.328947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf78f3b9-d6b0-42a4-b612-b8c2aed3389f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-454614727", "id": 1248322172, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:36.365052 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf78f3b9-d6b0-42a4-b612-b8c2aed3389f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.040061 May 10 02:12:36.371125 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 232/504] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:36 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.391214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a32e02fd-69e3-48a0-b16e-6098bb7d5aef tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.450853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a32e02fd-69e3-48a0-b16e-6098bb7d5aef tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.068908 May 10 02:12:36.462737 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 233/505] 10.222.0.52 () {58 vars in 1168 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.476661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dec5577b-ff72-46c1-bf51-a83a5f965711 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.500036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dec5577b-ff72-46c1-bf51-a83a5f965711 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.035429 May 10 02:12:36.511403 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 234/506] 10.222.0.52 () {58 vars in 1176 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.523651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:36.524008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22231a6a-9496-4970-8842-e01fd130631a tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.543974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4343e3b-0c68-47b7-b6bb-ffd0549c8b64 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1502 microversion: 2.1 time: 0.753990 May 10 02:12:36.545700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 273/507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:35 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1502 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:36.552811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-22231a6a-9496-4970-8842-e01fd130631a tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.037648 May 10 02:12:36.566967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b29a3ac2-43bb-4a95-838a-cd4e1795f598 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.571353 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 235/508] 10.222.0.52 () {58 vars in 1170 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.582967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.586283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:36.602922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:36.604108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:36.606056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:36.607645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:36.665385 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b29a3ac2-43bb-4a95-838a-cd4e1795f598 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.103835 May 10 02:12:36.665990 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 274/509] 10.222.0.52 () {58 vars in 1168 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.686272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-492e4c8b-c228-4bdd-8e71-490c788f5481 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.776301 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-492e4c8b-c228-4bdd-8e71-490c788f5481 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6216 microversion: 2.1 time: 0.102516 May 10 02:12:36.783325 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 275/510] 10.222.0.52 () {58 vars in 1168 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:36.794296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02f83e47-9232-4dd4-b575-e08a44796e84 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:36.854315 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02f83e47-9232-4dd4-b575-e08a44796e84 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6216 microversion: 2.1 time: 0.065974 May 10 02:12:36.855607 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 276/511] 10.222.0.52 () {58 vars in 1174 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:36.870711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-13bda882-541e-4448-8628-81ee86e8f6be req-9e0a022b-abf6-4eeb-b2cc-05d6477cd310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "name": "network-vif-plugged", "status": "completed", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:36.913813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-13bda882-541e-4448-8628-81ee86e8f6be req-9e0a022b-abf6-4eeb-b2cc-05d6477cd310 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:36.920774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-13bda882-541e-4448-8628-81ee86e8f6be req-9e0a022b-abf6-4eeb-b2cc-05d6477cd310 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:36.962120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-13bda882-541e-4448-8628-81ee86e8f6be req-9e0a022b-abf6-4eeb-b2cc-05d6477cd310 service nova] Creating event network-vif-plugged:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:12:36.971060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-13bda882-541e-4448-8628-81ee86e8f6be req-9e0a022b-abf6-4eeb-b2cc-05d6477cd310 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104047 May 10 02:12:36.976720 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 277/512] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:36.982412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53c5c702-24ea-4ea6-80e9-185e929f7c57 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.040181 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53c5c702-24ea-4ea6-80e9-185e929f7c57 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6216 microversion: 2.1 time: 0.061890 May 10 02:12:37.059184 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 278/513] 10.222.0.52 () {58 vars in 1172 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.059184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.059184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:37.073748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:37.074207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:37.075000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:37.075481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:37.197676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:37.213752 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db52233d-16c4-43a2-8936-fcf6dc8081a0 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1281 microversion: 2.1 time: 0.162231 May 10 02:12:37.216755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 279/514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.226349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43d5e182-47c6-4218-8f53-9a93fafc0536 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.351685 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43d5e182-47c6-4218-8f53-9a93fafc0536 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6216 microversion: 2.1 time: 0.133630 May 10 02:12:37.356056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 280/515] 10.222.0.52 () {58 vars in 1168 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.368019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1d6d0e93-09dd-4cd6-806d-d59a634d2c17 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37997700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.460903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1d6d0e93-09dd-4cd6-806d-d59a634d2c17 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.103718 May 10 02:12:37.467214 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 281/516] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.470831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29f563fd-92d5-477d-b4ee-b142cb470461 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.472163 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:37.472163 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:37.504466 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29f563fd-92d5-477d-b4ee-b142cb470461 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1248322172" status: 202 len: 0 microversion: 2.1 time: 0.041555 May 10 02:12:37.505278 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 282/517] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:12:37 2022] DELETE /compute/v2.1/flavors/1248322172 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:37.515987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a16e361-1225-4e09-b133-f5a3b5bec6c6 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.551248 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9a16e361-1225-4e09-b133-f5a3b5bec6c6 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.039670 May 10 02:12:37.552337 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 283/518] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.561322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.562676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:37.572680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:37.573495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:37.574537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:37.575263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:37.614521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:37.623034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:37.629523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:37.630717 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2756f071-c4c2-4ea3-b049-9f606f3a4590 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 1.057345 May 10 02:12:37.631275 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 236/519] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:36 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:37.650919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b881007b-1274-4835-b265-5ae15ce8301f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.651725 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:37.651725 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:37.681816 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b881007b-1274-4835-b265-5ae15ce8301f tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/317397804" status: 202 len: 0 microversion: 2.1 time: 0.049396 May 10 02:12:37.685944 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 237/520] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:37 2022] DELETE /compute/v2.1/flavors/317397804 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:37.722852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0653ebe2-c309-4089-951d-c2b1ed22474c tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.754465 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0653ebe2-c309-4089-951d-c2b1ed22474c tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.062840 May 10 02:12:37.756978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 238/521] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:12:37.775700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-596e3a45-8fbd-4b3a-a52c-c57b7404e504 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-108037565", "id": 839535505, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:37.777592 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:37.777592 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:37.821567 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-596e3a45-8fbd-4b3a-a52c-c57b7404e504 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.050480 May 10 02:12:37.828905 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 239/522] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:12:37.835741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1be501df-0fd0-4022-9467-33941524ae13 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.857970 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1be501df-0fd0-4022-9467-33941524ae13 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.027906 May 10 02:12:37.870709 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 240/523] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.880876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13350a17-4846-4670-baaa-a3cb51fea998 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.909798 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13350a17-4846-4670-baaa-a3cb51fea998 tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.037586 May 10 02:12:37.922904 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 241/524] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:37.931055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2aa9672e-a559-4ce4-af12-52648bf01fc1 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:37.958416 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2aa9672e-a559-4ce4-af12-52648bf01fc1 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/839535505" status: 202 len: 0 microversion: 2.1 time: 0.031641 May 10 02:12:37.962952 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 242/525] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:37 2022] DELETE /compute/v2.1/flavors/839535505 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:37.978438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-211455f3-0093-4081-bd20-e4e186430741 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:38.004671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-211455f3-0093-4081-bd20-e4e186430741 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.039020 May 10 02:12:38.019131 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 243/526] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:38.235987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:38.250903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69eaec75-a1b4-410d-93c9-999ce0c524d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1492 microversion: 2.1 time: 0.688009 May 10 02:12:38.270806 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 284/527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:37 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1492 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:38.281197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8debdecb-b0ff-4190-9010-fed4bb6f2430 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1119680707", "id": 666527584, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:38.283525 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:38.283525 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:38.317724 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8debdecb-b0ff-4190-9010-fed4bb6f2430 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043889 May 10 02:12:38.319557 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 285/528] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:38 2022] POST /compute/v2.1/flavors => generated 411 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:38.331851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:38.332788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:38.346396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.349886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:38.353088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.354075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:38.476425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:38.483738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bcb9ae7e-e7a9-4b8b-b7c1-8f0bb875a5e7 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1281 microversion: 2.1 time: 0.161005 May 10 02:12:38.492678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ba540b1-703e-4b41-9da1-81ca8dd9bd4e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Action: 'create', calling method: .version_select at 0x7f3d3765f9d0>, body: {"pool": null} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:38.494050 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 286/529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:38 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:38.499097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-519a075a-e2c0-4483-a3f2-e56862d9ec60 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '.version_select at 0x7f3d3796d3a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:38.501663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-519a075a-e2c0-4483-a3f2-e56862d9ec60 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.502124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-519a075a-e2c0-4483-a3f2-e56862d9ec60 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:38.510204 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-519a075a-e2c0-4483-a3f2-e56862d9ec60 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.015045 May 10 02:12:38.516908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 287/530] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:12:38 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:38.605465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1650524963", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": "none"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:38.674029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:38.674792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:38.676068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:38.676706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:38.677384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:38.687279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.688076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:38.689115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.689807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:38.716504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Getting quotas for project 854f6b356f3141509a3b05f8b2e1d006. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:38.730046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Getting quotas for user b722dd005e334220877adb60b3cab8e8 and project 854f6b356f3141509a3b05f8b2e1d006. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:38.752367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:38.755548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:38.828725 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-70120f88-ddc5-4b8a-81a5-6d6590fe4063 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.316238 May 10 02:12:38.829764 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 288/531] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:12:38.836135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3ce179d-9c61-4d15-bb0d-c3e9d837b23d tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:38.865804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3ce179d-9c61-4d15-bb0d-c3e9d837b23d tempest-FlavorsAdminTestJSON-143079247 tempest-FlavorsAdminTestJSON-143079247-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6214 microversion: 2.1 time: 0.033247 May 10 02:12:38.875752 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 289/532] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:38 2022] GET /compute/v2.1/flavors/detail => generated 6214 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:38.882044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-694ff966-bd1b-4644-8f33-eb4b8bfef924 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3796d670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:38.929964 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-694ff966-bd1b-4644-8f33-eb4b8bfef924 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.053005 May 10 02:12:38.930810 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 290/533] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:38 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:38.936074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:38.937044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:38.943766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.944423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:38.945392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:38.945985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:39.885061 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2e2a93c-5c8a-42d1-bf23-4e88f9f7382c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1643 microversion: 2.1 time: 0.952692 May 10 02:12:39.886861 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 291/534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:38 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1643 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:39.898247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:39.901170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:39.929284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:39.930338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:39.931872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:39.933613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:40.396059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:40.415468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:40.417475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:40.418838 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99325934-d5ed-48dc-8077-1b9a32955a74 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 0.529581 May 10 02:12:40.422341 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 292/535] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:39 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:40.428791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:40.430159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:40.439890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:40.442265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:40.444979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:40.445615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:40.888288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:40.900953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:40.910826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:40.922817 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b012cbfe-9383-4fc9-b4cc-008f49ca42ad tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "PUT /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1411 microversion: 2.75 time: 0.499037 May 10 02:12:40.927528 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 293/536] 10.222.0.52 () {62 vars in 1296 bytes} [Tue May 10 02:12:40 2022] PUT /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1411 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:40.932460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48f897f0-f129-4ad4-8deb-043c7332ebe2 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:40.936986 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:40.936986 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:40.968467 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-48f897f0-f129-4ad4-8deb-043c7332ebe2 tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/666527584" status: 202 len: 0 microversion: 2.1 time: 0.038726 May 10 02:12:40.970267 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 294/537] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:12:40 2022] DELETE /compute/v2.1/flavors/666527584 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:40.977997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-305c761b-9d5b-4782-90a2-6c9edd9703d6 req-a41cfaf2-4fe2-4f00-a289-bdff26c867cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41eee814-bd80-402e-b5a7-fe4f529f7070", "name": "network-vif-plugged", "status": "completed", "tag": "66c5b609-ea59-45fc-bd4c-971f08a42a91"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:40.997080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-305c761b-9d5b-4782-90a2-6c9edd9703d6 req-a41cfaf2-4fe2-4f00-a289-bdff26c867cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:40.997736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-305c761b-9d5b-4782-90a2-6c9edd9703d6 req-a41cfaf2-4fe2-4f00-a289-bdff26c867cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:41.016293 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-305c761b-9d5b-4782-90a2-6c9edd9703d6 req-a41cfaf2-4fe2-4f00-a289-bdff26c867cc service nova] Creating event network-vif-plugged:66c5b609-ea59-45fc-bd4c-971f08a42a91 for instance 41eee814-bd80-402e-b5a7-fe4f529f7070 on n-h1-841089-2 May 10 02:12:41.026363 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-305c761b-9d5b-4782-90a2-6c9edd9703d6 req-a41cfaf2-4fe2-4f00-a289-bdff26c867cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054424 May 10 02:12:41.027250 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 295/538] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:41.070688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:41.074498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:41.083239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:41.084039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:41.085017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:41.085623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:41.539622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:41.548054 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1186f6a-3ccf-473a-b20c-0dcb030e2db3 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1323 microversion: 2.1 time: 0.519396 May 10 02:12:41.558445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 296/539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:41 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1323 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:41.566005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32cd69e1-5715-4476-b3fa-2de587f18dbf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3793d1f0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:41.635038 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32cd69e1-5715-4476-b3fa-2de587f18dbf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.070636 May 10 02:12:41.635038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 297/540] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:41 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:41.643987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:41.644539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:41.651173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:41.655596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:41.656632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:41.657234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:41.699975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:12:41.822811 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-044d0ed2-8120-4aa8-87c3-93c713d4dd13 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 204 len: 0 microversion: 2.1 time: 0.197853 May 10 02:12:41.823850 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 298/541] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:41 2022] DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:41.844666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-908495194", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "2f8708f8-b1bb-4099-8385-4858a3f8bcfb"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:41.955632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] validate_networks() for [('2f8708f8-b1bb-4099-8385-4858a3f8bcfb', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:42.593580 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ba540b1-703e-4b41-9da1-81ca8dd9bd4e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.574978 May 10 02:12:42.594172 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 244/542] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:12:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:42.598984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:42.599626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:42.608793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:42.609429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:42.610395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:42.610845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:42.755402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:42.766527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:42.768478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:42.782668 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2bdf9490-6a7a-4d16-b132-7228c08339b8 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1417 microversion: 2.75 time: 0.187158 May 10 02:12:42.783368 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 245/543] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:42 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1417 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:42.788777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5a60ccb-47ca-468d-bd2c-96a3f9caccdd tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:42.811967 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c5a60ccb-47ca-468d-bd2c-96a3f9caccdd tempest-FlavorsAdminTestJSON-1049547786 tempest-FlavorsAdminTestJSON-1049547786-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.027246 May 10 02:12:42.812945 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 246/544] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:12:42 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:42.829131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:42.830008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:42.837897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:42.838871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:42.839770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:42.840282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:43.170495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:43.179916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:43.182042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:43.183389 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d900ce8b-f306-41ec-863a-5e3e3cb3af15 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1362 microversion: 2.25 time: 0.369268 May 10 02:12:43.197606 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 247/545] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:42 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:43.203450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-769e8e15-27e9-48f5-84ab-2a76b87994f9 req-1e4f8b8c-232d-42f1-83fc-e52e420bdc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f701cb9-4fb8-4fd3-b64d-8969633f9817", "tag": "61b148de-755c-4109-8157-9510b1f5bb51"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:43.212959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:43.213808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:43.214068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:43.214844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:43.215313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:43.223206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-769e8e15-27e9-48f5-84ab-2a76b87994f9 req-1e4f8b8c-232d-42f1-83fc-e52e420bdc4b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:43.223658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-769e8e15-27e9-48f5-84ab-2a76b87994f9 req-1e4f8b8c-232d-42f1-83fc-e52e420bdc4b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:43.236770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:43.236994 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-769e8e15-27e9-48f5-84ab-2a76b87994f9 req-1e4f8b8c-232d-42f1-83fc-e52e420bdc4b service nova] Creating event network-changed:61b148de-755c-4109-8157-9510b1f5bb51 for instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 on n-h2-841089-2 May 10 02:12:43.237218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:43.238236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:43.238846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:43.243522 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-769e8e15-27e9-48f5-84ab-2a76b87994f9 req-1e4f8b8c-232d-42f1-83fc-e52e420bdc4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044317 May 10 02:12:43.245018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 248/546] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:43.255822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-241251133", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "85330213", "adminPass": "***", "networks": [{"uuid": "c89d42e3-f9fc-43d7-8c45-97defa9745eb"}], "security_groups": [{"name": "tempest-securitygroup--323684939"}], "key_name": "tempest-keypair-1108535060", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:43.280001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:43.292959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for user f3afba6df0eb454cbfa342f196e6727f and project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:43.318197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:43.320780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:43.407953 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-975d6634-f53e-43f6-9d1d-f079f425cc65 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581690 May 10 02:12:43.414623 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 299/547] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:12:43.416685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] validate_networks() for [('c89d42e3-f9fc-43d7-8c45-97defa9745eb', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:12:43.422724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:43.424141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:43.434474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:43.435432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:43.436836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:43.437522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:44.308957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:44.319754 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-983563e0-38ee-4045-9fcc-f78ecccb83a6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1323 microversion: 2.1 time: 0.902505 May 10 02:12:44.320336 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 300/548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:43 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1323 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:44.337514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ebf14d09-6fe9-4a9f-8fbd-784cc5709f0c tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Calling method '.version_select at 0x7f3d37908040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:44.954404 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ebf14d09-6fe9-4a9f-8fbd-784cc5709f0c tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/e78d74a3-7bd4-4282-b1b2-f622c5570e0f" status: 200 len: 141 microversion: 2.1 time: 0.621309 May 10 02:12:44.955326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 301/549] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:44 2022] GET /compute/v2.1/os-floating-ips/e78d74a3-7bd4-4282-b1b2-f622c5570e0f => generated 141 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:44.960652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a7ca5b7-b08d-45a2-8be2-9993ed55203d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d378e8160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:45.037098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a7ca5b7-b08d-45a2-8be2-9993ed55203d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.076483 May 10 02:12:45.037974 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 302/550] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:44 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:45.054727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:45.057358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:45.078248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.078985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.080803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.084548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.344755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:45.355180 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2351d8f6-6855-479e-8bc6-54690fef5288 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1270 microversion: 2.1 time: 0.314121 May 10 02:12:45.356161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 303/551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:45 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1270 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:45.366893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:45.369864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:45.389140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.391552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.397139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.397682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.573017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:45.575962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:45.582335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:45.583623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:45.584599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:45.585575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:45.590305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:45.592724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:45.607056 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b6cfe471-80cc-46a5-9853-4cd55ac66d53 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1438 microversion: 2.75 time: 0.246831 May 10 02:12:45.607899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.611619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.612815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 304/552] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:45 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1438 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:45.613744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.614464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.631856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:45.635596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:45.649970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Getting quotas for project 28a9f22674ee4e27ad7c42db55473a93. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:12:45.657611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Getting quotas for user 6587868068d641b88a68acaeff886cd9 and project 28a9f22674ee4e27ad7c42db55473a93. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:12:45.658516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.658960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.668744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:45.669694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:45.693158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:12:45.698974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:12:45.849083 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bbdc1e94-36cf-4177-834a-63f96a5514e8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.592091 May 10 02:12:45.850809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 249/553] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:12:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:12:45.855744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e1abe7f9-1966-4128-b2dc-950703e773d7 tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Calling method '.version_select at 0x7f3d3758e940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:46.789820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:46.810212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:46.817933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:46.822552 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9246b2e9-b11a-42b9-889e-ec6e4745d6b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1559 microversion: 2.25 time: 1.208691 May 10 02:12:46.835126 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 305/554] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:45 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1559 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:46.844486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:46.845144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:46.868394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:46.872217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:46.875517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:46.881801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.455004 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e1abe7f9-1966-4128-b2dc-950703e773d7 tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.602861 May 10 02:12:47.456437 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 250/555] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:12:45 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:47.461865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:47.470320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:47.486226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:47.495373 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7b78027-8748-4196-bc35-3331bcc6bd5d tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1323 microversion: 2.1 time: 0.666381 May 10 02:12:47.498337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.498831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.499299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 306/556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:46 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1323 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:47.499712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.500140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.505409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:47.506333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:47.531256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.534722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.540334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.541197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.677858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:12:47.678311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:12:47.678812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:12:47.679265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:12:47.682939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:12:47.687612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:47.711701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6da64b1d-9442-44fd-a577-e62a7cae11c7 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1312 microversion: 2.1 time: 0.210186 May 10 02:12:47.723047 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 307/557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:47 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:47.729775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c59062c-7c0d-44ea-96a9-f10e07ebb185 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3780f160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:47.841588 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c59062c-7c0d-44ea-96a9-f10e07ebb185 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.124306 May 10 02:12:47.847859 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 308/558] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:47 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:47.866393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:47.872375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:47.886597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:47.890881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.891896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.898746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.902097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.911346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.912063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:47.924411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:47.930848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:48.288786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:48.306280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:48.316200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:48.326934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-011df54c-8f3a-410f-9eab-996c2101ecb2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "POST /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a/action" status: 202 len: 1495 microversion: 2.75 time: 0.869219 May 10 02:12:48.340024 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 251/559] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:12:47 2022] POST /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a/action => generated 1495 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 10 02:12:48.357385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:48.358406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:48.372974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:48.373818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:48.379386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:48.380177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:48.818181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:48.832032 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28a31dc4-172a-4586-9a81-48658cdb152e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1310 microversion: 2.1 time: 0.988242 May 10 02:12:48.833680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 309/560] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:47 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1310 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:48.860752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3fead1b8-7f84-40af-a3ed-1d931e5cfe71 tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Calling method '.version_select at 0x7f3d379ed4c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:49.104258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:49.127315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ccb983fa-ac79-4ed3-a55e-b05b04659427 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 2052 microversion: 2.25 time: 0.785686 May 10 02:12:49.139546 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 252/561] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:48 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 2052 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:49.354920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba520b26-d283-450e-8ee2-2773813db390 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Calling method '.version_select at 0x7f3d37768430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:49.356726 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:49.356726 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:49.358235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba520b26-d283-450e-8ee2-2773813db390 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.358910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba520b26-d283-450e-8ee2-2773813db390 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:49.359941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba520b26-d283-450e-8ee2-2773813db390 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.360572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba520b26-d283-450e-8ee2-2773813db390 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:49.422739 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba520b26-d283-450e-8ee2-2773813db390 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.281641 May 10 02:12:49.427475 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 253/562] 10.222.0.52 () {58 vars in 1127 bytes} [Tue May 10 02:12:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:49.437489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:49.440277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:49.456810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.457642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:49.458709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.466227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:49.678431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:49.689578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:49.696166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:49.717581 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cdf9bf7b-6f0f-44d8-9dba-0cb10a7f372f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.276239 May 10 02:12:49.718244 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 254/563] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:49 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:49.729897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a979165f-7b88-42d9-a13d-1b5301b2e019 req-fa139e08-6c7c-4433-88f4-fad8e5bb8861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766bfcd2-c5c1-4a25-a548-6c3481c683de", "tag": "46d63a95-70a5-4cc0-b972-ba14f2023740"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:49.761925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a979165f-7b88-42d9-a13d-1b5301b2e019 req-fa139e08-6c7c-4433-88f4-fad8e5bb8861 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.762515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a979165f-7b88-42d9-a13d-1b5301b2e019 req-fa139e08-6c7c-4433-88f4-fad8e5bb8861 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:49.784924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a979165f-7b88-42d9-a13d-1b5301b2e019 req-fa139e08-6c7c-4433-88f4-fad8e5bb8861 service nova] Creating event network-changed:46d63a95-70a5-4cc0-b972-ba14f2023740 for instance 766bfcd2-c5c1-4a25-a548-6c3481c683de on n-h1-841089-2 May 10 02:12:49.798578 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a979165f-7b88-42d9-a13d-1b5301b2e019 req-fa139e08-6c7c-4433-88f4-fad8e5bb8861 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075548 May 10 02:12:49.799245 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 255/564] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:49.822819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:49.823472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:49.830131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.830595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:49.831496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:49.831958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:50.548047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:50.589591 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6af6e525-5740-4ec5-b15e-be124907cf15 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1323 microversion: 2.1 time: 0.788104 May 10 02:12:50.592841 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 256/565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:49 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1323 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:50.607954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-38913432-1806-4661-bec5-18d3d63e8abd req-b2a15a86-e143-4d4c-8e65-fb97f3880373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f701cb9-4fb8-4fd3-b64d-8969633f9817", "name": "network-vif-plugged", "status": "completed", "tag": "61b148de-755c-4109-8157-9510b1f5bb51"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:50.652581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-38913432-1806-4661-bec5-18d3d63e8abd req-b2a15a86-e143-4d4c-8e65-fb97f3880373 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:50.653798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-38913432-1806-4661-bec5-18d3d63e8abd req-b2a15a86-e143-4d4c-8e65-fb97f3880373 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:50.709204 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-38913432-1806-4661-bec5-18d3d63e8abd req-b2a15a86-e143-4d4c-8e65-fb97f3880373 service nova] Creating event network-vif-plugged:61b148de-755c-4109-8157-9510b1f5bb51 for instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 on n-h2-841089-2 May 10 02:12:50.730634 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-38913432-1806-4661-bec5-18d3d63e8abd req-b2a15a86-e143-4d4c-8e65-fb97f3880373 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126143 May 10 02:12:50.731800 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 257/566] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:50.759983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:50.760723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:50.769718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:50.770185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:50.770989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:50.771472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.102539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:51.110693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74fcd517-30cb-426a-95c9-cc8df49dd366 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1318 microversion: 2.1 time: 0.376962 May 10 02:12:51.132256 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 258/567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:50 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:51.136934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1810332c-cfb7-416c-a1ae-c6769ac58b37 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37691550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:51.219617 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1810332c-cfb7-416c-a1ae-c6769ac58b37 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.086473 May 10 02:12:51.220344 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 259/568] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:51 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:51.230716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f75a16f6-b1e4-4d78-9a1d-d4868e55de40 req-2f31ca63-1282-470b-9e26-4a07ddc5e28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb619058-700d-4b0a-8b3e-9c3c845c4538", "name": "network-vif-deleted", "tag": "9a877a3d-b01e-4608-9e40-1aa136c12444"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:51.240127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f75a16f6-b1e4-4d78-9a1d-d4868e55de40 req-2f31ca63-1282-470b-9e26-4a07ddc5e28c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.240589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f75a16f6-b1e4-4d78-9a1d-d4868e55de40 req-2f31ca63-1282-470b-9e26-4a07ddc5e28c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.257591 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f75a16f6-b1e4-4d78-9a1d-d4868e55de40 req-2f31ca63-1282-470b-9e26-4a07ddc5e28c service nova] Creating event network-vif-deleted:9a877a3d-b01e-4608-9e40-1aa136c12444 for instance eb619058-700d-4b0a-8b3e-9c3c845c4538 on n-h1-841089-2 May 10 02:12:51.264158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f75a16f6-b1e4-4d78-9a1d-d4868e55de40 req-2f31ca63-1282-470b-9e26-4a07ddc5e28c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036456 May 10 02:12:51.265055 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 260/569] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:51.271327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:51.271908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:51.278770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.279595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.280368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.280998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.474944 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3fead1b8-7f84-40af-a3ed-1d931e5cfe71 tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/e78d74a3-7bd4-4282-b1b2-f622c5570e0f" status: 202 len: 0 microversion: 2.1 time: 2.617936 May 10 02:12:51.476146 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 310/570] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:12:48 2022] DELETE /compute/v2.1/os-floating-ips/e78d74a3-7bd4-4282-b1b2-f622c5570e0f => generated 0 bytes in 2642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:51.661081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da14a28a-961a-4e0e-906b-f1ec4dce0027 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Calling method '.version_select at 0x7f3d37997790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:51.662633 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:51.662633 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:51.664061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-da14a28a-961a-4e0e-906b-f1ec4dce0027 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '002882f5621a47218da97f0b2a188e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916287a49bfa4d189d597b0cabb7a05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da14a28a-961a-4e0e-906b-f1ec4dce0027 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Request method failure captured: May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoeUgQXVFh8vLW1KKH5G8Xh3vopLMRfqpYFNVUBaZGCKbAdZnt_bzTD0afmlKVJO8VFJq_vwYcKkw2Bo0IZHnqccF5TjgBQkhn1yhbB3gny6IS1OcvIjHS3V3_s1o1OB6v3ZXxLsIn_hqk1e1kwHNIU_o39VsbxnEzg1rWI7a-k62w May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:51.666221 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_916287a49bfa4d189d597b0cabb7a05a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 002882f5621a47218da97f0b2a188e5a May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:12:51.667876 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:51.668948 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 10 02:12:51.670883 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:51.672418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da14a28a-961a-4e0e-906b-f1ec4dce0027 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:51.672418 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-da14a28a-961a-4e0e-906b-f1ec4dce0027 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.185349 May 10 02:12:51.673875 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 311/571] 10.222.0.52 () {58 vars in 1127 bytes} [Tue May 10 02:12:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 192 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:51.679841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:51.680468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:51.686648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.687134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.687937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.688373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.731849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:51.755792 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-95069ba9-297e-4071-a746-f199b1aa4999 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 2052 microversion: 2.25 time: 0.488863 May 10 02:12:51.757018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 261/572] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:51 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 2052 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:51.762406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:51.763312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:51.770451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.771732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.772704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:51.773296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:51.907635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:51.921250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:51.927353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:51.937774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37d14b9e-64f2-480e-9ab8-310387774936 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.179486 May 10 02:12:51.939216 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 262/573] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:51 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:51.946735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d532c19-0d9d-4e56-bf24-d8eef26b279b tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Action: 'create', calling method: .version_select at 0x7f3d37531160>, body: {"pool": null} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:52.057706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:52.064520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-87e61fc1-bb2d-4abd-ab1c-467cbb96e619 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1310 microversion: 2.1 time: 0.389492 May 10 02:12:52.065095 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 312/574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:51 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1310 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:52.078319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:52.079733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:52.087784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.088241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.093759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.094952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.315578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:52.324073 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a0fac8be-48d5-4ca9-b8c0-521e7bf5a2d9 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1323 microversion: 2.1 time: 0.256965 May 10 02:12:52.332209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 313/575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:52 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:52.344883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba4653f7-bfd3-4ab7-80d0-8151edaa1b89 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Calling method '.version_select at 0x7f3d37908940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:52.345943 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:52.345943 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:52.347397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ba4653f7-bfd3-4ab7-80d0-8151edaa1b89 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '002882f5621a47218da97f0b2a188e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916287a49bfa4d189d597b0cabb7a05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba4653f7-bfd3-4ab7-80d0-8151edaa1b89 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Request method failure captured: May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts/n-d-841089-2/reboot HTTP/1.1 May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoeUgQXVFh8vLW1KKH5G8Xh3vopLMRfqpYFNVUBaZGCKbAdZnt_bzTD0afmlKVJO8VFJq_vwYcKkw2Bo0IZHnqccF5TjgBQkhn1yhbB3gny6IS1OcvIjHS3V3_s1o1OB6v3ZXxLsIn_hqk1e1kwHNIU_o39VsbxnEzg1rWI7a-k62w May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:52.349220 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_916287a49bfa4d189d597b0cabb7a05a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 002882f5621a47218da97f0b2a188e5a May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2'} May 10 02:12:52.350731 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:52.351733 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 10 02:12:52.352858 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.355181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba4653f7-bfd3-4ab7-80d0-8151edaa1b89 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:52.356325 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ba4653f7-bfd3-4ab7-80d0-8151edaa1b89 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-841089-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.022876 May 10 02:12:52.357364 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 314/576] 10.222.0.52 () {58 vars in 1187 bytes} [Tue May 10 02:12:52 2022] GET /compute/v2.1/os-hosts/n-d-841089-2/reboot => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:52.366251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bee44122-6d67-43db-8b98-c9dd3a8979cc tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:52.367828 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:52.367828 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:52.369390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bee44122-6d67-43db-8b98-c9dd3a8979cc tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.370026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bee44122-6d67-43db-8b98-c9dd3a8979cc tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.372055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bee44122-6d67-43db-8b98-c9dd3a8979cc tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.372734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bee44122-6d67-43db-8b98-c9dd3a8979cc tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.402590 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bee44122-6d67-43db-8b98-c9dd3a8979cc tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043815 May 10 02:12:52.403833 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 315/577] 10.222.0.52 () {60 vars in 1216 bytes} [Tue May 10 02:12:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:12:52.409243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:52.410108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:52.418453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.419271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.420262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.420877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.731776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:52.772221 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71c25928-4ba8-4e98-818f-19a64b8a676c tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.366204 May 10 02:12:52.773222 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 316/578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:52 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:52.797762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80737756-7507-41a0-93fe-1f9ac4133562 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37908940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:52.864560 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80737756-7507-41a0-93fe-1f9ac4133562 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1421 microversion: 2.1 time: 0.088065 May 10 02:12:52.871041 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 317/579] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:52 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:52.876143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06cdcf6c-77af-4cc6-a619-7d35c57d82cd tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Calling method '.version_select at 0x7f3d3780f940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:52.876934 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:52.876934 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:52.888908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-06cdcf6c-77af-4cc6-a619-7d35c57d82cd tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06cdcf6c-77af-4cc6-a619-7d35c57d82cd tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:52.890952 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'nonexistent_hostname'} May 10 02:12:52.892307 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5861, in targeted May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:52.893136 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 10 02:12:52.894374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06cdcf6c-77af-4cc6-a619-7d35c57d82cd tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06cdcf6c-77af-4cc6-a619-7d35c57d82cd tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.019898 May 10 02:12:52.895497 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 318/580] 10.222.0.52 () {58 vars in 1211 bytes} [Tue May 10 02:12:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:52.898338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:52.898884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:52.905833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.906295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:52.907399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:52.908014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:53.012536 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7d6969ae-1294-4fe6-9452-50b236724fb5 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070/action" status: 202 len: 0 microversion: 2.25 time: 0.117905 May 10 02:12:53.017688 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 319/581] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:12:52 2022] POST /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:53.026086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-722a86ef-2f90-479a-bdfa-a3a57d8396cf tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Calling method '.version_select at 0x7f3d3780f670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:53.029098 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:53.029098 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:53.030858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-722a86ef-2f90-479a-bdfa-a3a57d8396cf tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '002882f5621a47218da97f0b2a188e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916287a49bfa4d189d597b0cabb7a05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-722a86ef-2f90-479a-bdfa-a3a57d8396cf tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Request method failure captured: May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts/n-d-841089-2 HTTP/1.1 May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoeUgQXVFh8vLW1KKH5G8Xh3vopLMRfqpYFNVUBaZGCKbAdZnt_bzTD0afmlKVJO8VFJq_vwYcKkw2Bo0IZHnqccF5TjgBQkhn1yhbB3gny6IS1OcvIjHS3V3_s1o1OB6v3ZXxLsIn_hqk1e1kwHNIU_o39VsbxnEzg1rWI7a-k62w May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:53.035193 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_916287a49bfa4d189d597b0cabb7a05a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 002882f5621a47218da97f0b2a188e5a May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2'} May 10 02:12:53.036478 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:53.037218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 10 02:12:53.038285 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.040151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-722a86ef-2f90-479a-bdfa-a3a57d8396cf tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:53.040151 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-722a86ef-2f90-479a-bdfa-a3a57d8396cf tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-841089-2" status: 403 len: 109 microversion: 2.1 time: 0.017779 May 10 02:12:53.040151 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 320/582] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:12:53 2022] GET /compute/v2.1/os-hosts/n-d-841089-2 => generated 109 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:53.047111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:53.048321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:53.060917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:53.061383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:53.062482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:53.062992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:53.219680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:53.230830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:53.232921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:53.251955 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24e009ba-74c5-41a5-a5b3-4291def7bcaf tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.211742 May 10 02:12:53.265073 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 321/583] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:53 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:53.266619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:53.268678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:53.291224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:53.291224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:53.292401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:53.292849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:53.749945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:53.764923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec8832b7-16f9-4210-9eaa-96ded353c591 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 2057 microversion: 2.25 time: 0.507593 May 10 02:12:53.766453 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 322/584] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:53 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 2057 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:53.772054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e26340b7-7e71-4f88-aa8b-bcf304176d1d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Calling method '.version_select at 0x7f3d378e8670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:53.773072 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:53.773072 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:53.779254 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e26340b7-7e71-4f88-aa8b-bcf304176d1d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e26340b7-7e71-4f88-aa8b-bcf304176d1d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:53.781912 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'nonexistent_hostname'} May 10 02:12:53.783497 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:53.784483 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:53.785678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:53.786888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e26340b7-7e71-4f88-aa8b-bcf304176d1d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:53.786888 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e26340b7-7e71-4f88-aa8b-bcf304176d1d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015768 May 10 02:12:53.789239 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 323/585] 10.222.0.52 () {58 vars in 1190 bytes} [Tue May 10 02:12:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:53.794142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:53.794694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:53.802074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:53.802556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:53.803363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:53.803799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.342938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.350945 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-deb015da-05d3-45ee-80ec-a539e31a2b41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1310 microversion: 2.1 time: 0.560450 May 10 02:12:54.360699 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 324/586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:53 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1310 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:54.367080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:54.367940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:54.374292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.375006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.375991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.376913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.735206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.743770 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-232661ef-c63c-407b-a3ed-f63e5ff4dab4 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1473 microversion: 2.1 time: 0.380440 May 10 02:12:54.744495 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 325/587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:54 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:54.750146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-880c1b25-d707-4da4-929e-9a65ce3f9f73 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Calling method '.version_select at 0x7f3d378e8820>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:54.751571 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:54.751571 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:54.752876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-880c1b25-d707-4da4-929e-9a65ce3f9f73 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '002882f5621a47218da97f0b2a188e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916287a49bfa4d189d597b0cabb7a05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-880c1b25-d707-4da4-929e-9a65ce3f9f73 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Request method failure captured: May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts/n-d-841089-2/shutdown HTTP/1.1 May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoeUgQXVFh8vLW1KKH5G8Xh3vopLMRfqpYFNVUBaZGCKbAdZnt_bzTD0afmlKVJO8VFJq_vwYcKkw2Bo0IZHnqccF5TjgBQkhn1yhbB3gny6IS1OcvIjHS3V3_s1o1OB6v3ZXxLsIn_hqk1e1kwHNIU_o39VsbxnEzg1rWI7a-k62w May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:54.754583 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_916287a49bfa4d189d597b0cabb7a05a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 002882f5621a47218da97f0b2a188e5a May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2'} May 10 02:12:54.756290 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:54.757175 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 10 02:12:54.758464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:54.760428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-880c1b25-d707-4da4-929e-9a65ce3f9f73 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:54.761259 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-880c1b25-d707-4da4-929e-9a65ce3f9f73 tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-841089-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015528 May 10 02:12:54.761792 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 326/588] 10.222.0.52 () {58 vars in 1193 bytes} [Tue May 10 02:12:54 2022] GET /compute/v2.1/os-hosts/n-d-841089-2/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:54.766412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:54.767026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:54.773972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.774441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.775239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.775680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.792607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d532c19-0d9d-4e56-bf24-d8eef26b279b tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.851769 May 10 02:12:54.793346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 263/589] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:12:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:54.798405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96a5e83a-fa01-46bb-b588-dd17f97a475c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37531700>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:54.843298 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96a5e83a-fa01-46bb-b588-dd17f97a475c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1430 microversion: 2.1 time: 0.048304 May 10 02:12:54.844011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 264/590] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:54 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1430 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:54.848696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-13a21b61-56d3-4b95-bf5c-f555b3b61e63 req-0357ffe7-9f43-4e92-88ae-41fc974c78a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e0f3f6-cf67-49e7-9ed5-916920dda8f3", "tag": "1bda6730-ac4d-4198-84c4-d63deba87d3c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:54.856717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-13a21b61-56d3-4b95-bf5c-f555b3b61e63 req-0357ffe7-9f43-4e92-88ae-41fc974c78a0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.857163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-13a21b61-56d3-4b95-bf5c-f555b3b61e63 req-0357ffe7-9f43-4e92-88ae-41fc974c78a0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.867923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-13a21b61-56d3-4b95-bf5c-f555b3b61e63 req-0357ffe7-9f43-4e92-88ae-41fc974c78a0 service nova] Creating event network-changed:1bda6730-ac4d-4198-84c4-d63deba87d3c for instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 on n-h2-841089-2 May 10 02:12:54.872606 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-13a21b61-56d3-4b95-bf5c-f555b3b61e63 req-0357ffe7-9f43-4e92-88ae-41fc974c78a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027660 May 10 02:12:54.873188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 265/591] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:54.878071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:54.878764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:54.885277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.885728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.886500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:54.886934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:54.973895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.982768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.985153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.990680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:54.991458 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d695fcd4-bef1-47f7-899e-c060f9632440 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.117108 May 10 02:12:54.992038 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 266/592] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:54 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:54.996462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c36e7d51-e666-4b04-ab93-b434f9aa388a req-04b66255-bf5b-4e04-9e53-b82f82140bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766bfcd2-c5c1-4a25-a548-6c3481c683de", "name": "network-vif-plugged", "status": "completed", "tag": "46d63a95-70a5-4cc0-b972-ba14f2023740"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:55.003998 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57a77ef2-0b33-4741-891e-11bf7066a626 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.241223 May 10 02:12:55.004159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c36e7d51-e666-4b04-ab93-b434f9aa388a req-04b66255-bf5b-4e04-9e53-b82f82140bec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.004466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c36e7d51-e666-4b04-ab93-b434f9aa388a req-04b66255-bf5b-4e04-9e53-b82f82140bec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.007111 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 327/593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:54 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:55.009422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.009913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:55.015332 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c36e7d51-e666-4b04-ab93-b434f9aa388a req-04b66255-bf5b-4e04-9e53-b82f82140bec service nova] Creating event network-vif-plugged:46d63a95-70a5-4cc0-b972-ba14f2023740 for instance 766bfcd2-c5c1-4a25-a548-6c3481c683de on n-h1-841089-2 May 10 02:12:55.015490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.016153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.016960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.017403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.020275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c36e7d51-e666-4b04-ab93-b434f9aa388a req-04b66255-bf5b-4e04-9e53-b82f82140bec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027102 May 10 02:12:55.020872 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 267/594] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:55.025875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4f5e982c-b2bf-44f1-a2aa-fa5f8dd72368 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Calling method '.version_select at 0x7f3d3765f430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.026741 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:55.026741 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:55.035481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4f5e982c-b2bf-44f1-a2aa-fa5f8dd72368 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4f5e982c-b2bf-44f1-a2aa-fa5f8dd72368 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:12:55.037529 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'nonexistent_hostname'} May 10 02:12:55.039284 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5861, in targeted May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:55.040402 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 10 02:12:55.041806 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4f5e982c-b2bf-44f1-a2aa-fa5f8dd72368 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4f5e982c-b2bf-44f1-a2aa-fa5f8dd72368 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.016985 May 10 02:12:55.043005 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 268/595] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:55.047701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Request method failure captured: May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817/diagnostics HTTP/1.1 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoPwWQbdWXfMMwtwsSACGwQOzedR3huHr01R880Ptz3s5JYLIq6DTuR2xILp-Ik8cfC6w2mnmhi83JiyUiK0udpXf7t9iu_EW-T21JYjS_rrkilFNdLDtqn7Y4Pr_HuVsGOEs9R0xI-oM780Y5UV_rLNDCP9LhJnpF2QrPtsUsl_P0 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 85beabe7271b4dcdb7ea8a4b65e0eb00 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-403178408 May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:55.049594 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85beabe7271b4dcdb7ea8a4b65e0eb00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85beabe7271b4dcdb7ea8a4b65e0eb00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85beabe7271b4dcdb7ea8a4b65e0eb00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85beabe7271b4dcdb7ea8a4b65e0eb00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-403178408 May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 85beabe7271b4dcdb7ea8a4b65e0eb00 May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-403178408 May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerDiagnosticsNegativeTest-403178408-project May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fbaf584a0f104d4c9568ac686efd1b1c May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-403178408-project May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:12:55.052192 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'server_id': '3f701cb9-4fb8-4fd3-b64d-8969633f9817'} May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:55.053157 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:55.054325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:55.055439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7b8fb7d1-edc9-4190-b6a3-70e1abe6979b tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.045837 May 10 02:12:55.055439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 328/596] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817/diagnostics => generated 117 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:55.056860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.057142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5fc42c4d-3ccd-4a4c-8262-3aba424a5e0b tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Calling method '.version_select at 0x7f3d37997790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.058147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:55.065159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.065616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.066397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.067143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.286774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:55.300946 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac055552-f318-4f8b-a16a-a19dc839fff0 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 2037 microversion: 2.25 time: 0.260405 May 10 02:12:55.301715 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 269/597] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 2037 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:55.316653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa1d3971-3a02-44ce-b92c-d8d842a87466 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d375314c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.361099 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa1d3971-3a02-44ce-b92c-d8d842a87466 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 200 len: 1430 microversion: 2.1 time: 0.058526 May 10 02:12:55.367276 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 270/598] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 1430 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:55.367276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f7fef7a-676a-48be-8231-191b488c161f tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Calling method '.version_select at 0x7f3d3761c790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.367863 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:55.367863 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:12:55.369105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6f7fef7a-676a-48be-8231-191b488c161f tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '002882f5621a47218da97f0b2a188e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916287a49bfa4d189d597b0cabb7a05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f7fef7a-676a-48be-8231-191b488c161f tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Request method failure captured: May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hosts/n-d-841089-2/startup HTTP/1.1 May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoeUgQXVFh8vLW1KKH5G8Xh3vopLMRfqpYFNVUBaZGCKbAdZnt_bzTD0afmlKVJO8VFJq_vwYcKkw2Bo0IZHnqccF5TjgBQkhn1yhbB3gny6IS1OcvIjHS3V3_s1o1OB6v3ZXxLsIn_hqk1e1kwHNIU_o39VsbxnEzg1rWI7a-k62w May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:12:55.370706 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_916287a49bfa4d189d597b0cabb7a05a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 002882f5621a47218da97f0b2a188e5a May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'n-d-841089-2'} May 10 02:12:55.372145 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:55.373033 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 10 02:12:55.374410 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:12:55.375526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f7fef7a-676a-48be-8231-191b488c161f tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:55.375526 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f7fef7a-676a-48be-8231-191b488c161f tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-841089-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.008823 May 10 02:12:55.376375 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 271/599] 10.222.0.52 () {58 vars in 1190 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/os-hosts/n-d-841089-2/startup => generated 110 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:55.381576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.382074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:55.388894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.389349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.390120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.390554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.414818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:12:55.493310 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90ab7340-821b-412c-94d6-fd0820671163 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 204 len: 0 microversion: 2.1 time: 0.115600 May 10 02:12:55.493921 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 272/600] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:12:55 2022] DELETE /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:55.498859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-841089-2", "block_migration": "auto"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:55.500135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:55.507320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.507782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.508581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.509016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.533366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'flavor' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:12:55.546204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Going to try to live migrate instance to n-h2-841089-2 {{(pid=118717) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:12:55.813151 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5fc42c4d-3ccd-4a4c-8262-3aba424a5e0b tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7" status: 202 len: 0 microversion: 2.1 time: 0.759662 May 10 02:12:55.813867 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 329/601] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:12:55 2022] DELETE /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7 => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:12:55.818567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.819216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:55.825162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.825620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.826401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.826846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.963897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:55.976637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2240dcd5-1630-48a4-99b8-832c022fb09f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1310 microversion: 2.1 time: 0.161662 May 10 02:12:55.977502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 330/602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:55.982038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:55.982651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:55.988500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.988953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:55.989724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:55.990161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.122197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:56.130435 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d7769826-0ae0-466e-8167-d37a6199bdad tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1466 microversion: 2.1 time: 0.151943 May 10 02:12:56.131008 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 331/603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:55 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:56.145237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff476c1c-5f62-45d5-8ecf-93c9274ede1a tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Calling method '.version_select at 0x7f3d378e8280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.146018 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:56.146018 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:56.154837 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ff476c1c-5f62-45d5-8ecf-93c9274ede1a tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff476c1c-5f62-45d5-8ecf-93c9274ede1a tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:56.157177 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'nonexistent_hostname'} May 10 02:12:56.158737 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5861, in targeted May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:56.164152 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 10 02:12:56.165281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff476c1c-5f62-45d5-8ecf-93c9274ede1a tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff476c1c-5f62-45d5-8ecf-93c9274ede1a tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017737 May 10 02:12:56.166642 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 332/604] 10.222.0.52 () {58 vars in 1214 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:56.167643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.167643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:56.173597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:56.174094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.175013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:56.175480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.309211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:56.318379 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-508cf286-c118-4854-857d-3bbd1da52da6 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1479 microversion: 2.1 time: 0.157648 May 10 02:12:56.318955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 333/605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1479 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:56.324162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86bb06e1-6abc-4130-94da-2709c370f96e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Calling method '.version_select at 0x7f3d3780f040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.379357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-86bb06e1-6abc-4130-94da-2709c370f96e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8ade1662-86af-4577-abdd-c879a3b383b7 could not be found", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:12:56.380071 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-86bb06e1-6abc-4130-94da-2709c370f96e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] HTTP exception thrown: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86bb06e1-6abc-4130-94da-2709c370f96e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Request method failure captured: May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7 HTTP/1.1 May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoVqb6TqYLN8VHKEP5RtpjnNhqQqJrrD3MLEFDdfMReVav-7sy0kC_P9Ww7VOm4ViO8bX0B2je2Um1nfc13W98vmggf40yVmqzUQroaSWodqZ4Y47nbgS5m3Mr2iHw6GtQLt3aunEewOn5chkGuj8p7JTK3AiK_BfLgu--dmpbNC5k May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 0b39b24e1d954250b4f84d4870cdcbbc May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsTestJSON-94609382 May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:56.392069 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0b39b24e1d954250b4f84d4870cdcbbc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0b39b24e1d954250b4f84d4870cdcbbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0b39b24e1d954250b4f84d4870cdcbbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0b39b24e1d954250b4f84d4870cdcbbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsTestJSON-94609382 May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 0b39b24e1d954250b4f84d4870cdcbbc May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsTestJSON-94609382 May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsTestJSON-94609382-project May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b787266970f5422cbd978cf3574a9d1b May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsTestJSON-94609382-project May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: exception: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '8ade1662-86af-4577-abdd-c879a3b383b7'} May 10 02:12:56.394151 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:12:56.395264 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8ade1662-86af-4577-abdd-c879a3b383b7 could not be found May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71bbe2f8-9285-4bb5-a2a5-fa80b49cdf5d'] May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7. May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.396917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:56.398358 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:56.399777 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.399777 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.399777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86bb06e1-6abc-4130-94da-2709c370f96e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Returning 404 to user: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:56.399777 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86bb06e1-6abc-4130-94da-2709c370f96e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7" status: 404 len: 111 microversion: 2.1 time: 0.073689 May 10 02:12:56.399777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 334/606] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:56.399777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.400242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:56.407463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:56.407927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.408723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:56.409157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.476574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:56.484547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:56.486075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:56.491324 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1e87c119-d20a-476e-bf87-0f553f871fdd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.095389 May 10 02:12:56.491897 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 335/607] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:56.496226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.496836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:56.502642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:56.503123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.503904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:56.504351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:56.629372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:56.637056 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e94ec2a-97d1-4c0a-8726-dcc6c49a3cc6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.144210 May 10 02:12:56.637635 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 336/608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:56.642963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7ffaef3-1626-41e1-846f-b396f5fc9db6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d378329d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.685249 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7ffaef3-1626-41e1-846f-b396f5fc9db6 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/193324a5-9e6a-4320-a184-bbef949b550f" status: 200 len: 784 microversion: 2.1 time: 0.045879 May 10 02:12:56.685815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 337/609] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/images/193324a5-9e6a-4320-a184-bbef949b550f => generated 784 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:56.690077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38cf4764-54cc-4a34-94dc-7caaf291f15d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37777700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38cf4764-54cc-4a34-94dc-7caaf291f15d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-hosts/n-d-841089-2 HTTP/1.1 May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 51 May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:56.692685 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: {"status": "enable", "maintenance_mode": "invalid"} May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:56.694142 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'disable', May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'Enable', May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'Disable', May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'ENABLE', May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance: May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'invalid' May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.694983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.696575 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38cf4764-54cc-4a34-94dc-7caaf291f15d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38cf4764-54cc-4a34-94dc-7caaf291f15d tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-841089-2" status: 400 len: 199 microversion: 2.1 time: 0.007310 May 10 02:12:56.697874 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 338/610] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:12:56 2022] PUT /compute/v2.1/os-hosts/n-d-841089-2 => generated 199 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:12:56.698614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e721267b-972a-4dc9-bf37-e33245796d1e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Calling method '.version_select at 0x7f3d3774b940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.741727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-e721267b-972a-4dc9-bf37-e33245796d1e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8ade1662-86af-4577-abdd-c879a3b383b7 could not be found", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:12:56.742430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e721267b-972a-4dc9-bf37-e33245796d1e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] HTTP exception thrown: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e721267b-972a-4dc9-bf37-e33245796d1e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Request method failure captured: May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7 HTTP/1.1 May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoVqb6TqYLN8VHKEP5RtpjnNhqQqJrrD3MLEFDdfMReVav-7sy0kC_P9Ww7VOm4ViO8bX0B2je2Um1nfc13W98vmggf40yVmqzUQroaSWodqZ4Y47nbgS5m3Mr2iHw6GtQLt3aunEewOn5chkGuj8p7JTK3AiK_BfLgu--dmpbNC5k May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 0b39b24e1d954250b4f84d4870cdcbbc May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsTestJSON-94609382 May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:56.744273 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0b39b24e1d954250b4f84d4870cdcbbc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0b39b24e1d954250b4f84d4870cdcbbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0b39b24e1d954250b4f84d4870cdcbbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0b39b24e1d954250b4f84d4870cdcbbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsTestJSON-94609382 May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 0b39b24e1d954250b4f84d4870cdcbbc May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsTestJSON-94609382 May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsTestJSON-94609382-project May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b787266970f5422cbd978cf3574a9d1b May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsTestJSON-94609382-project May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: exception: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '8ade1662-86af-4577-abdd-c879a3b383b7'} May 10 02:12:56.745749 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:12:56.746643 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8ade1662-86af-4577-abdd-c879a3b383b7 could not be found May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6e0ea32-3e78-4a4b-bce3-4922825f71c2'] May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7. May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.748034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:56.749460 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:56.750781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 May 10 02:12:56.750781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.750781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e721267b-972a-4dc9-bf37-e33245796d1e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] Returning 404 to user: Floating IP not found for ID 8ade1662-86af-4577-abdd-c879a3b383b7 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:56.750781 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e721267b-972a-4dc9-bf37-e33245796d1e tempest-FloatingIPsTestJSON-94609382 tempest-FloatingIPsTestJSON-94609382-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7" status: 404 len: 111 microversion: 2.1 time: 0.050295 May 10 02:12:56.750781 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 339/611] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:12:56 2022] DELETE /compute/v2.1/os-floating-ips/8ade1662-86af-4577-abdd-c879a3b383b7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:56.752794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3ebe2fe-0068-4df6-b88d-f151d1196f9d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:56.760722 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3ebe2fe-0068-4df6-b88d-f151d1196f9d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013626 May 10 02:12:56.761269 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 340/612] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:12:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:56.766575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6619ada3-de50-4856-8749-ae6eb9d6bdcf tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Action: 'update', calling method: .version_select at 0x7f3d3780fc10>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6619ada3-de50-4856-8749-ae6eb9d6bdcf tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-hosts/n-d-841089-2 HTTP/1.1 May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 51 May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:56.767753 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: {"status": "invalid", "maintenance_mode": "enable"} May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:56.769751 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'disable', May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'Enable', May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'Disable', May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'ENABLE', May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance: May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'invalid' May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.770789 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:56.772283 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6619ada3-de50-4856-8749-ae6eb9d6bdcf tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6619ada3-de50-4856-8749-ae6eb9d6bdcf tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-841089-2" status: 400 len: 189 microversion: 2.1 time: 0.007396 May 10 02:12:56.773345 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 341/613] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:12:56 2022] PUT /compute/v2.1/os-hosts/n-d-841089-2 => generated 189 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:12:56.778051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58a97908-b42e-4203-9a5d-1ddf1a2c3390 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37832c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:57.277209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58a97908-b42e-4203-9a5d-1ddf1a2c3390 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "DELETE /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 204 len: 0 microversion: 2.1 time: 0.506119 May 10 02:12:57.277861 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 342/614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:56 2022] DELETE /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:57.283519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-359565d4-051d-4493-b016-27069981b7cc tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Action: 'update', calling method: .version_select at 0x7f3d378409d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:57.285236 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:57.285236 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:57.286330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-359565d4-051d-4493-b016-27069981b7cc tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '002882f5621a47218da97f0b2a188e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916287a49bfa4d189d597b0cabb7a05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-359565d4-051d-4493-b016-27069981b7cc tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Request method failure captured: May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-hosts/n-d-841089-2 HTTP/1.1 May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 50 May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecoeUgQXVFh8vLW1KKH5G8Xh3vopLMRfqpYFNVUBaZGCKbAdZnt_bzTD0afmlKVJO8VFJq_vwYcKkw2Bo0IZHnqccF5TjgBQkhn1yhbB3gny6IS1OcvIjHS3V3_s1o1OB6v3ZXxLsIn_hqk1e1kwHNIU_o39VsbxnEzg1rWI7a-k62w May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:57.287945 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_916287a49bfa4d189d597b0cabb7a05a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/916287a49bfa4d189d597b0cabb7a05a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 916287a49bfa4d189d597b0cabb7a05a May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1649683506 May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 002882f5621a47218da97f0b2a188e5a May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1649683506-project May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: {"status": "enable", "maintenance_mode": "enable"} May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 10 02:12:57.289393 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:57.290495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 10 02:12:57.292057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.293345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-359565d4-051d-4493-b016-27069981b7cc tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:57.293345 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-359565d4-051d-4493-b016-27069981b7cc tempest-HostsAdminNegativeTestJSON-1649683506 tempest-HostsAdminNegativeTestJSON-1649683506-project] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-841089-2" status: 403 len: 111 microversion: 2.1 time: 0.010308 May 10 02:12:57.295363 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 343/615] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:12:57 2022] PUT /compute/v2.1/os-hosts/n-d-841089-2 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:12:57.300498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:57.301136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:57.307690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:57.308143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:57.308911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:57.309352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:57.807701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:57.815726 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36e3a67d-d7a0-4195-b9cf-ffdd57008455 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1493 microversion: 2.1 time: 0.518637 May 10 02:12:57.816301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 344/616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:57 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1493 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:57.820719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-713efda0-d820-421b-817e-0990f1786142 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37777b80>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:57.842249 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-713efda0-d820-421b-817e-0990f1786142 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] HTTP exception thrown: Image not found. May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-713efda0-d820-421b-817e-0990f1786142 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Request method failure captured: May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 HTTP/1.1 May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecn_9pBdUsH3Xkt80BOVcApXNcHXkm8-KUGiU-7kKSXJp51cevx2sXaUT2NGaHDATg-Eccvsq41G7ksq7EJpwnfwKaZpmTdkEmoJNpfnUXT_twfe5UC3rJ3icSrvmsEEY_af_XAN-cWfdr9gcFPpMb9KspBluUbS4lzz97bsUUQZbXE May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 26a35846a10642e48703cf9597c3e810 May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerTestJSON-838103336 May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:12:57.851490 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_26a35846a10642e48703cf9597c3e810", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26a35846a10642e48703cf9597c3e810"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/26a35846a10642e48703cf9597c3e810"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26a35846a10642e48703cf9597c3e810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerTestJSON-838103336 May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 26a35846a10642e48703cf9597c3e810 May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-838103336 May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerTestJSON-838103336-project May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c0819595c84d497194721e063f9c3170 May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerTestJSON-838103336-project May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'c0038409-9972-4257-8df1-37d08aaaf844'} May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:57.852770 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c0038409-9972-4257-8df1-37d08aaaf844 May 10 02:12:57.853641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:12:57.859887 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0038409-9972-4257-8df1-37d08aaaf844 could not be found. May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:57.861823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-713efda0-d820-421b-817e-0990f1786142 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:57.863352 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-713efda0-d820-421b-817e-0990f1786142 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 404 len: 62 microversion: 2.1 time: 0.036085 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 345/617] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:12:57 2022] GET /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1a2a2de-617c-43f3-bde3-f9463ff4bc09 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37840160>, body: {"status": null, "maintenance_mode": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1a2a2de-617c-43f3-bde3-f9463ff4bc09 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-hosts/n-d-841089-2 HTTP/1.1 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 42 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:57.864937 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: {"status": null, "maintenance_mode": null} May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 10 02:12:57.866793 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'n-d-841089-2', 'body': {'status': None, 'maintenance_mode': None}} May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'disable', May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'Enable', May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'Disable', May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'ENABLE', May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance: May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi None May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:57.868137 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:57.869820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1a2a2de-617c-43f3-bde3-f9463ff4bc09 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f1a2a2de-617c-43f3-bde3-f9463ff4bc09 tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-841089-2" status: 400 len: 127 microversion: 2.1 time: 0.008613 May 10 02:12:57.871153 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 346/618] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:12:57 2022] PUT /compute/v2.1/os-hosts/n-d-841089-2 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:12:57.875668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:57.876285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:57.882658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:57.883140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:57.884246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:57.884691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.192229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:58.199459 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbc77a1f-a054-4253-aae2-bbf639d35b32 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1479 microversion: 2.1 time: 0.328021 May 10 02:12:58.200153 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 347/619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:57 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1479 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:58.214112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:58.214992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:58.221767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.222227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.223134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.223586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.319997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:58.330579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:58.333256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:58.341074 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b45dda49-0f5c-412c-aa51-54af0f5645cb tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.139865 May 10 02:12:58.342392 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 348/620] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:58 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:12:58.347058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:58.348309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:58.354423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.354993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.355906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.356441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.723505 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e56aceb3-1b6d-4dbb-822d-268003ef5d53 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070/action" status: 202 len: 0 microversion: 2.25 time: 3.228258 May 10 02:12:58.724620 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 273/621] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:12:55 2022] POST /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070/action => generated 0 bytes in 3230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:12:58.729752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:58.731115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:58.754051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.754707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.755944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.756698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.896285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:12:58.905489 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17a88776-fd22-4230-a3e4-8b2f5cb2aed3 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.561895 May 10 02:12:58.911785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 349/622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:58 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:58.922215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1600051435"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:58.923368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:58.932358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.932742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:58.933688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:58.934136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:59.268310 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41a03649-4b19-4261-b54c-02edd6da4c2f tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "POST /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac/action" status: 202 len: 0 microversion: 2.1 time: 0.345054 May 10 02:12:59.269056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 350/623] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:12:58 2022] POST /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:12:59.278261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0235c41b-0dff-452f-bb05-97713a70378e tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37777940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:59.280050 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:12:59.280050 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:12:59.284251 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.hosts [None req-0235c41b-0dff-452f-bb05-97713a70378e tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Enabling host nonexistent_hostname. May 10 02:12:59.292685 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0235c41b-0dff-452f-bb05-97713a70378e tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0235c41b-0dff-452f-bb05-97713a70378e tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Request method failure captured: May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 50 May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecofGcaCCXBvAXi9C8L8XIJ_ANIe7hI_IPF9i_9Nuzglba_bZGtaMOpI0UB-VBGcuicH5oQ7BVGtpoJytVfNZ02_rbQDNpTKAlQa2tFsOPyKTCRMlRXlfbOIYDkUvt8SAhPDZ7tCaPBs7dLbekNZBxxvJKmV6nfsOWtNjpKNWfRCLeQ May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:12:59.294684 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d306ded32ce467b9d5f41d0a1622432", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d306ded32ce467b9d5f41d0a1622432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7d306ded32ce467b9d5f41d0a1622432 May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2058069342 May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 434582d2eba74c3aa3096790e2fa9d37 May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2058069342-project-admin May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: {"status": "enable", "maintenance_mode": "enable"} May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:59.296261 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5861, in targeted May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 10 02:12:59.297325 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:12:59.298702 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:12:59.301275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0235c41b-0dff-452f-bb05-97713a70378e tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:12:59.302502 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0235c41b-0dff-452f-bb05-97713a70378e tempest-HostsAdminNegativeTestJSON-2058069342 tempest-HostsAdminNegativeTestJSON-2058069342-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025078 May 10 02:12:59.304209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 351/624] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:12:59 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:12:59.309040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-12d24e8e-a8b7-4bd6-b113-0a75039f46d6 req-d9e9e50c-aef3-4dc2-941d-63f650603d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "name": "network-vif-unplugged", "status": "completed", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:12:59.319393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-12d24e8e-a8b7-4bd6-b113-0a75039f46d6 req-d9e9e50c-aef3-4dc2-941d-63f650603d86 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:59.320073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-12d24e8e-a8b7-4bd6-b113-0a75039f46d6 req-d9e9e50c-aef3-4dc2-941d-63f650603d86 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:59.333100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-12d24e8e-a8b7-4bd6-b113-0a75039f46d6 req-d9e9e50c-aef3-4dc2-941d-63f650603d86 service nova] Creating event network-vif-unplugged:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:12:59.340796 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-12d24e8e-a8b7-4bd6-b113-0a75039f46d6 req-d9e9e50c-aef3-4dc2-941d-63f650603d86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035273 May 10 02:12:59.341666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 352/625] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:12:59.349775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:59.350705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:59.361560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:59.362856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:59.363841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:59.364575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:59.375572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-908d9181-9820-49cd-a178-6c66c892a8d2 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1644 microversion: 2.1 time: 0.648332 May 10 02:12:59.389284 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 274/626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:58 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1644 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:12:59.396148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:12:59.396990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:12:59.405577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:59.406044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:12:59.407035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:12:59.407677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.087837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.096698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.098353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.099635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d77346e3-dbf7-440e-8df7-64f07e6f700d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.756688 May 10 02:13:00.100192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 353/627] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:12:59 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:00.107635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f54c5a9-9192-4329-8812-a94066744576 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37777ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:00.151450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaf584a0f104d4c9568ac686efd1b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beabe7271b4dcdb7ea8a4b65e0eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.166444 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40622107-1877-49a0-bc4a-5a3a62dc1c36 tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 200 len: 1479 microversion: 2.1 time: 0.775906 May 10 02:13:00.177158 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 275/628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:12:59 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 1479 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:00.177344 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f54c5a9-9192-4329-8812-a94066744576 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.068817 May 10 02:13:00.178305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 354/629] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:00 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:00.179909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:00.180819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:00.187421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:00.187663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.188299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.188882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:00.189450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.190524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.203431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.204660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.207419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.208092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.321051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.337637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.341583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.352424 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-17fa2549-3357-4a38-bbe7-5c7ea5e272ae tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.182908 May 10 02:13:00.353365 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 276/630] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:00 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:00.370546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:00.371277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:00.379482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.379938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.384641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.385223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.728152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:00.739318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-652e99b5-cd90-4c71-a08a-60368356955f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.384499 May 10 02:13:00.741085 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 277/631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:00 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:00.750218 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ec3892e-891b-46a4-bd78-5574fee47cdc tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1644 microversion: 2.1 time: 0.564770 May 10 02:13:00.750218 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 355/632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:00 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1644 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:00.755656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-49c56e02-2e79-4e33-b7f9-b348df116396 req-ed02e9d6-b251-4263-a1cf-25c3c9c1d9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f701cb9-4fb8-4fd3-b64d-8969633f9817", "name": "network-vif-deleted", "tag": "61b148de-755c-4109-8157-9510b1f5bb51"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:00.764989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e421bc41-4e67-4bb7-a100-149e7c3f3e0e tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:00.766683 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:00.766683 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:00.767986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e421bc41-4e67-4bb7-a100-149e7c3f3e0e tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.768437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e421bc41-4e67-4bb7-a100-149e7c3f3e0e tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.769520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e421bc41-4e67-4bb7-a100-149e7c3f3e0e tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.770744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e421bc41-4e67-4bb7-a100-149e7c3f3e0e tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.771867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-49c56e02-2e79-4e33-b7f9-b348df116396 req-ed02e9d6-b251-4263-a1cf-25c3c9c1d9ab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.772331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-49c56e02-2e79-4e33-b7f9-b348df116396 req-ed02e9d6-b251-4263-a1cf-25c3c9c1d9ab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.787399 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-49c56e02-2e79-4e33-b7f9-b348df116396 req-ed02e9d6-b251-4263-a1cf-25c3c9c1d9ab service nova] Creating event network-vif-deleted:61b148de-755c-4109-8157-9510b1f5bb51 for instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 on n-h2-841089-2 May 10 02:13:00.792750 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-49c56e02-2e79-4e33-b7f9-b348df116396 req-ed02e9d6-b251-4263-a1cf-25c3c9c1d9ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045254 May 10 02:13:00.793362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 356/633] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:00.809139 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e421bc41-4e67-4bb7-a100-149e7c3f3e0e tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048955 May 10 02:13:00.810106 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 278/634] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:13:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:00.833932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:00.835323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:00.842151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.842728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.843682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.844235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.929732 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9b49750-a9f4-4357-bfed-4c980937e030 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de/action" status: 202 len: 0 microversion: 2.1 time: 0.100798 May 10 02:13:00.931029 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 357/635] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:00 2022] POST /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:00.940887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:00.941887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:00.955723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.956606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:00.959031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:00.960003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.120828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:01.121896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:01.133425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.134306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.135501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.145115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.271473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24204233-a44b-4969-81dc-9b9b12335d24 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1649 microversion: 2.1 time: 0.335978 May 10 02:13:01.284366 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 279/636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:00 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1649 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:01.292277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c3f35a7-3eb9-4c10-bbb4-41b8ed858706 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37486ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:01.378587 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c3f35a7-3eb9-4c10-bbb4-41b8ed858706 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.101939 May 10 02:13:01.387726 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 280/637] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:01 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:01.392769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:01.393940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] [instance: 3f701cb9-4fb8-4fd3-b64d-8969633f9817] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:01.400478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.401185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.402166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.402804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.424437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] HTTP exception thrown: Instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 could not be found. May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Request method failure captured: May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 HTTP/1.1 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoPwWQbdWXfMMwtwsSACGwQOzedR3huHr01R880Ptz3s5JYLIq6DTuR2xILp-Ik8cfC6w2mnmhi83JiyUiK0udpXf7t9iu_EW-T21JYjS_rrkilFNdLDtqn7Y4Pr_HuVsGOEs9R0xI-oM780Y5UV_rLNDCP9LhJnpF2QrPtsUsl_P0 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 85beabe7271b4dcdb7ea8a4b65e0eb00 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-403178408 May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:01.426736 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85beabe7271b4dcdb7ea8a4b65e0eb00", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85beabe7271b4dcdb7ea8a4b65e0eb00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85beabe7271b4dcdb7ea8a4b65e0eb00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85beabe7271b4dcdb7ea8a4b65e0eb00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-403178408 May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 85beabe7271b4dcdb7ea8a4b65e0eb00 May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-403178408 May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiagnosticsNegativeTest-403178408-project May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fbaf584a0f104d4c9568ac686efd1b1c May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-403178408-project May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 could not be found. May 10 02:13:01.428438 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3f701cb9-4fb8-4fd3-b64d-8969633f9817'} May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 could not be found. May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:01.429325 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 could not be found. May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 could not be found. May 10 02:13:01.430723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:01.432182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] Returning 404 to user: Instance 3f701cb9-4fb8-4fd3-b64d-8969633f9817 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:01.432182 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d00d437-bd3c-48aa-aa87-f27f58d0ad1a tempest-ServerDiagnosticsNegativeTest-403178408 tempest-ServerDiagnosticsNegativeTest-403178408-project] 10.222.0.52 "GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817" status: 404 len: 111 microversion: 2.1 time: 0.039921 May 10 02:13:01.432182 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 281/638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:01 2022] GET /compute/v2.1/servers/3f701cb9-4fb8-4fd3-b64d-8969633f9817 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:01.454519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0c03572f-845d-4eca-a693-bbf58a6e898a req-6db1ef04-4e16-49a1-8ff8-b5455e604e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e0f3f6-cf67-49e7-9ed5-916920dda8f3", "name": "network-vif-plugged", "status": "completed", "tag": "1bda6730-ac4d-4198-84c4-d63deba87d3c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:01.475527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0c03572f-845d-4eca-a693-bbf58a6e898a req-6db1ef04-4e16-49a1-8ff8-b5455e604e66 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.475973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0c03572f-845d-4eca-a693-bbf58a6e898a req-6db1ef04-4e16-49a1-8ff8-b5455e604e66 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.506281 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0c03572f-845d-4eca-a693-bbf58a6e898a req-6db1ef04-4e16-49a1-8ff8-b5455e604e66 service nova] Creating event network-vif-plugged:1bda6730-ac4d-4198-84c4-d63deba87d3c for instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 on n-h2-841089-2 May 10 02:13:01.519258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0c03572f-845d-4eca-a693-bbf58a6e898a req-6db1ef04-4e16-49a1-8ff8-b5455e604e66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085562 May 10 02:13:01.524153 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 282/639] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:01.532132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:01.545697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:01.547452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:01.559608 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cf446b52-0bfc-4500-87b4-1d935f9fd8c8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.434248 May 10 02:13:01.560460 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 358/640] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:01 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:13:01.570704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:01.579330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:01.601845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.602306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.603256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.604075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.713253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:01.736711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:01.744620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:01.757429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:01.758829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:01.760812 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d807011-4674-46e2-a560-c1e90da79959 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.234585 May 10 02:13:01.766576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.770445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.771085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:01.771774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:01.771899 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 283/641] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:01 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:02.288320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:02.288923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:02.301842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:02.302310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:02.303137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:02.303583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:02.608391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:02.617835 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1dd06e78-a491-42b7-8525-49ad1db3bd86 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.864182 May 10 02:13:02.639401 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 359/642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:01 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:02.645030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3faf7cad-7eb1-4260-a72e-b362a3980c17 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d376ddc10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:02.712063 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3faf7cad-7eb1-4260-a72e-b362a3980c17 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.071326 May 10 02:13:02.717851 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 360/643] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:02 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:02.722810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:02.734392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:02.752613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:02.755805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:02.759827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:02.762351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:03.028367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-479544f3-9639-4ccd-a760-2e2b71912a42 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1629 microversion: 2.1 time: 0.743675 May 10 02:13:03.044670 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 284/644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:02 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1629 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:03.053636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:03.054321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:03.078315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:03.081487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:03.082586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:03.083054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:03.253435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.261843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.263793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.270149 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-084c0e2c-ea5c-438f-857d-c324c4cf9e34 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.223590 May 10 02:13:03.271116 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 285/645] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:03 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:03.275737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-41d6abff-1db7-482c-bad5-75203a8d906c req-71e3a59e-ea0d-4ce0-a490-36669d59da5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41eee814-bd80-402e-b5a7-fe4f529f7070", "name": "network-vif-unplugged", "status": "completed", "tag": "66c5b609-ea59-45fc-bd4c-971f08a42a91"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:03.285431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-41d6abff-1db7-482c-bad5-75203a8d906c req-71e3a59e-ea0d-4ce0-a490-36669d59da5d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:03.286165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-41d6abff-1db7-482c-bad5-75203a8d906c req-71e3a59e-ea0d-4ce0-a490-36669d59da5d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:03.302546 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-41d6abff-1db7-482c-bad5-75203a8d906c req-71e3a59e-ea0d-4ce0-a490-36669d59da5d service nova] Creating event network-vif-unplugged:66c5b609-ea59-45fc-bd4c-971f08a42a91 for instance 41eee814-bd80-402e-b5a7-fe4f529f7070 on n-h1-841089-2 May 10 02:13:03.311414 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-41d6abff-1db7-482c-bad5-75203a8d906c req-71e3a59e-ea0d-4ce0-a490-36669d59da5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038849 May 10 02:13:03.312800 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 286/646] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:03.354052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.364540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.366542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.368479 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e6bdd2a-3c7f-41d5-b728-b5d2f744c0a1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.649363 May 10 02:13:03.369604 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 361/647] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:02 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:03.389809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-841089-2", "block_migration": true, "disk_over_commit": false}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:03.394776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:03.402210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:03.402739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:03.403483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:03.403901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:03.534748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lazy-loading 'flavor' on Instance uuid 766bfcd2-c5c1-4a25-a548-6c3481c683de {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:03.702746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Going to try to live migrate instance to n-h2-841089-2 {{(pid=118716) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:13:03.902720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78defb7a-22b6-4657-8639-9636eb5dc293 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Calling method '.version_select at 0x7f3d3765f1f0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:03.904995 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:03.904995 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:03.908377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-78defb7a-22b6-4657-8639-9636eb5dc293 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ce5f8f314220497cad138d06762dd691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cb118e18974f73a14ef41704341ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78defb7a-22b6-4657-8639-9636eb5dc293 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Request method failure captured: May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecotQ8mOi21J2_Y-hLhTtCbNLKbCjtPKwX1YOHZ0s___1ds_OY7LPx3f0-3Wk16cssZ0R7M00GGHVPMRo6oBltAuj40hK2HUC-Z2ePXYbHznxspnfx-qrsFeLmACCcNJ67dkUX2waUnGaF8K0da2fHyRy2zujlQqU3xp4P39Hgs_GFk May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:03.914175 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9cb118e18974f73a14ef41704341ee2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ce5f8f314220497cad138d06762dd691 May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: action_args: {} May 10 02:13:03.925482 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._detail(req) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:13:03.926897 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 10 02:13:03.928267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:03.931511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78defb7a-22b6-4657-8639-9636eb5dc293 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:03.936322 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-78defb7a-22b6-4657-8639-9636eb5dc293 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.621691 May 10 02:13:03.943194 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 287/648] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:13:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 629 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:03.959034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:03.969988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:04.000827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:04.005557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:04.009960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:04.016314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:04.291966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:04.302181 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a7abb90b-263b-4977-af52-f58444df5fde tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1385 microversion: 2.1 time: 0.356857 May 10 02:13:04.302769 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 288/649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:03 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1385 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:04.322367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6801174-98d8-4f81-85f3-31d65fa5c44a tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3765f430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:04.409451 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6801174-98d8-4f81-85f3-31d65fa5c44a tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.101593 May 10 02:13:04.410664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 289/650] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:04 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:04.427565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5db41a05-bce4-4e23-8519-26349a0181b1 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Calling method '.version_select at 0x7f3d37531820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:04.430230 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:04.430230 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:04.433067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5db41a05-bce4-4e23-8519-26349a0181b1 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ce5f8f314220497cad138d06762dd691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cb118e18974f73a14ef41704341ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5db41a05-bce4-4e23-8519-26349a0181b1 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Request method failure captured: May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecotQ8mOi21J2_Y-hLhTtCbNLKbCjtPKwX1YOHZ0s___1ds_OY7LPx3f0-3Wk16cssZ0R7M00GGHVPMRo6oBltAuj40hK2HUC-Z2ePXYbHznxspnfx-qrsFeLmACCcNJ67dkUX2waUnGaF8K0da2fHyRy2zujlQqU3xp4P39Hgs_GFk May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:04.443754 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9cb118e18974f73a14ef41704341ee2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ce5f8f314220497cad138d06762dd691 May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: action_args: {} May 10 02:13:04.445334 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._index(req) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:13:04.446256 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 10 02:13:04.447447 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:04.451876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5db41a05-bce4-4e23-8519-26349a0181b1 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:04.453864 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5db41a05-bce4-4e23-8519-26349a0181b1 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.041378 May 10 02:13:04.455857 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 290/651] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:13:04 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:04.468603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:04.469819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:04.490217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:04.491850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:04.492828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:04.495562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:04.631416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:04.642616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:04.650755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:04.667486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-755319dc-4c85-48f0-a78d-6ee120afc16b tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.208117 May 10 02:13:04.681324 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 291/652] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:04 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:04.686473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:04.697481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:04.711883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:04.713317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:04.716552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:04.730495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:05.029488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:05.046143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:05.050599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:05.054799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b364fe30-4780-4348-abb1-5f7de3bd2c87 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.370749 May 10 02:13:05.057367 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 292/653] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:04 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:05.072369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eefa61db-b970-454b-88e8-16618d518d49 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Calling method '.version_select at 0x7f3d37afd430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:05.076172 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:05.076172 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:05.083646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eefa61db-b970-454b-88e8-16618d518d49 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ce5f8f314220497cad138d06762dd691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cb118e18974f73a14ef41704341ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eefa61db-b970-454b-88e8-16618d518d49 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Request method failure captured: May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecotQ8mOi21J2_Y-hLhTtCbNLKbCjtPKwX1YOHZ0s___1ds_OY7LPx3f0-3Wk16cssZ0R7M00GGHVPMRo6oBltAuj40hK2HUC-Z2ePXYbHznxspnfx-qrsFeLmACCcNJ67dkUX2waUnGaF8K0da2fHyRy2zujlQqU3xp4P39Hgs_GFk May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:05.087692 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9cb118e18974f73a14ef41704341ee2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ce5f8f314220497cad138d06762dd691 May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: action_args: {} May 10 02:13:05.089468 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:13:05.090405 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 10 02:13:05.091756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:05.095130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eefa61db-b970-454b-88e8-16618d518d49 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:05.096207 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eefa61db-b970-454b-88e8-16618d518d49 tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.037692 May 10 02:13:05.097631 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 293/654] 10.222.0.52 () {58 vars in 1178 bytes} [Tue May 10 02:13:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:05.112334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b72eda76-0881-4787-a6bc-aa2c239dad90 req-239d6c62-c5e1-48cf-a3b0-e2919b11a041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "name": "network-vif-plugged", "status": "completed", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:05.135888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b72eda76-0881-4787-a6bc-aa2c239dad90 req-239d6c62-c5e1-48cf-a3b0-e2919b11a041 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:05.136622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b72eda76-0881-4787-a6bc-aa2c239dad90 req-239d6c62-c5e1-48cf-a3b0-e2919b11a041 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:05.168017 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b72eda76-0881-4787-a6bc-aa2c239dad90 req-239d6c62-c5e1-48cf-a3b0-e2919b11a041 service nova] Creating event network-vif-plugged:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:13:05.192509 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b72eda76-0881-4787-a6bc-aa2c239dad90 req-239d6c62-c5e1-48cf-a3b0-e2919b11a041 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085205 May 10 02:13:05.193174 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 294/655] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:05.696534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Calling method '.version_select at 0x7f3d37500c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:05.698684 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:05.698684 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:05.700233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:05.701184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:05.738834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:05.741600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:05.785685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:05.787497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:05.806677 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-203f04d0-ba8e-4bf9-bfe5-b11cb2d2479e tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.608846 May 10 02:13:05.810302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 295/656] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:13:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:05.827519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:05.828434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:05.887558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:05.890459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:05.894013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:05.895952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.193459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.212659 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9bd35265-9a22-4220-a697-db39e8cf7ca6 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1584 microversion: 2.1 time: 0.401189 May 10 02:13:06.223657 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 296/657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:05 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1584 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:06.235934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1fbb0b3e-afc0-4b2e-953a-655f7e5ce3ce req-ed46ffe8-7526-4f63-aa4e-1d550779d533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41eee814-bd80-402e-b5a7-fe4f529f7070", "tag": "66c5b609-ea59-45fc-bd4c-971f08a42a91"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:06.259767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1fbb0b3e-afc0-4b2e-953a-655f7e5ce3ce req-ed46ffe8-7526-4f63-aa4e-1d550779d533 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.259767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1fbb0b3e-afc0-4b2e-953a-655f7e5ce3ce req-ed46ffe8-7526-4f63-aa4e-1d550779d533 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.289851 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1fbb0b3e-afc0-4b2e-953a-655f7e5ce3ce req-ed46ffe8-7526-4f63-aa4e-1d550779d533 service nova] Creating event network-changed:66c5b609-ea59-45fc-bd4c-971f08a42a91 for instance 41eee814-bd80-402e-b5a7-fe4f529f7070 on n-h1-841089-2 May 10 02:13:06.306448 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1fbb0b3e-afc0-4b2e-953a-655f7e5ce3ce req-ed46ffe8-7526-4f63-aa4e-1d550779d533 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078472 May 10 02:13:06.307404 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 297/658] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:06.314352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9602b68b-9a62-4a4f-8b3d-1789e8fe3315 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37492b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:06.368619 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9602b68b-9a62-4a4f-8b3d-1789e8fe3315 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.059814 May 10 02:13:06.373070 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 298/659] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:06 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:06.385715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:06.386771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:06.394820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.395359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.396334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.396942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.561541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.577831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.581262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.617785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-805a8b86-0ab2-4ea9-ae6b-47456b5b588f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.238466 May 10 02:13:06.621781 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 299/660] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:06 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:06.634456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28a0434a-be66-4d35-8916-79cb7d0922dd tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Calling method '.version_select at 0x7f3d37492e50>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:06.645474 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:06.645474 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:06.647026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28a0434a-be66-4d35-8916-79cb7d0922dd tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ce5f8f314220497cad138d06762dd691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cb118e18974f73a14ef41704341ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28a0434a-be66-4d35-8916-79cb7d0922dd tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Request method failure captured: May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecotQ8mOi21J2_Y-hLhTtCbNLKbCjtPKwX1YOHZ0s___1ds_OY7LPx3f0-3Wk16cssZ0R7M00GGHVPMRo6oBltAuj40hK2HUC-Z2ePXYbHznxspnfx-qrsFeLmACCcNJ67dkUX2waUnGaF8K0da2fHyRy2zujlQqU3xp4P39Hgs_GFk May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:06.648997 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9cb118e18974f73a14ef41704341ee2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ce5f8f314220497cad138d06762dd691 May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1'} May 10 02:13:06.650341 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:13:06.651159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 10 02:13:06.652254 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:06.655101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28a0434a-be66-4d35-8916-79cb7d0922dd tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:06.656565 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28a0434a-be66-4d35-8916-79cb7d0922dd tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.033475 May 10 02:13:06.658010 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 300/661] 10.222.0.52 () {58 vars in 1172 bytes} [Tue May 10 02:13:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:06.670243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:06.671585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:06.680610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.681455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.682499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.683207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.686997 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-323203bb-6852-484f-a66d-905f005aac9f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de/action" status: 202 len: 0 microversion: 2.1 time: 3.315909 May 10 02:13:06.687671 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 362/662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:03 2022] POST /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de/action => generated 0 bytes in 3317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:06.924671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.941600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.943998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:06.945186 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e98f4518-4d01-4921-a946-d11457f484ac tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.285325 May 10 02:13:06.948435 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 301/663] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:06 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:06.957213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:06.963218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:06.976612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.976954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:06.977685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:06.978483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.118492 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-69d48d36-a585-40df-9b97-46d2dda7a5b4 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168739 May 10 02:13:07.119450 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 302/664] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:13:06 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:07.124794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-667d1896-9258-4a9e-a3b5-9b0b531b72d6 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Calling method '.version_select at 0x7f3d37642160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.126134 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:07.126134 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:07.130198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-667d1896-9258-4a9e-a3b5-9b0b531b72d6 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] HTTP exception thrown: Hypervisor with ID '1ae4f6bb-bca0-438d-817b-fea60adf272c' could not be found. May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-667d1896-9258-4a9e-a3b5-9b0b531b72d6 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Request method failure captured: May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/1ae4f6bb-bca0-438d-817b-fea60adf272c/uptime HTTP/1.1 May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecouuGzLK1DU8hgpxJ6Ub3S_J61ftl1bGSbpEZnVFKAiMMlOVa1CUbV28qdmSCZD8WpIQmwG9OxkZajOBx1nKP_pVJ-ymjwVvL-FQX0BKnlio2gvIg4oq_HlvqYL5NzPIWxF6ztt9eHCN_T1BiFjRnU0aznOJ6wVEb1JAu7M2GbfhKQ May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 756cbb74a6df48fc9629f2a2689f26ea May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2007228188 May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:13:07.145416 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_756cbb74a6df48fc9629f2a2689f26ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/756cbb74a6df48fc9629f2a2689f26ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/756cbb74a6df48fc9629f2a2689f26ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/756cbb74a6df48fc9629f2a2689f26ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2007228188 May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 756cbb74a6df48fc9629f2a2689f26ea May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2007228188 May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fd6d73425f364950afe605af7c12688d May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: exception: Hypervisor with ID '1ae4f6bb-bca0-438d-817b-fea60adf272c' could not be found. May 10 02:13:07.147397 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1ae4f6bb-bca0-438d-817b-fea60adf272c'} May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1ae4f6bb-bca0-438d-817b-fea60adf272c' May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 10 02:13:07.148380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1ae4f6bb-bca0-438d-817b-fea60adf272c' could not be found. May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.149683 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1ae4f6bb-bca0-438d-817b-fea60adf272c' could not be found. May 10 02:13:07.151236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.153416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-667d1896-9258-4a9e-a3b5-9b0b531b72d6 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Returning 404 to user: Hypervisor with ID '1ae4f6bb-bca0-438d-817b-fea60adf272c' could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:07.155842 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-667d1896-9258-4a9e-a3b5-9b0b531b72d6 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1ae4f6bb-bca0-438d-817b-fea60adf272c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.034858 May 10 02:13:07.156621 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 303/665] 10.222.0.52 () {58 vars in 1277 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/os-hypervisors/1ae4f6bb-bca0-438d-817b-fea60adf272c/uptime => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:07.169359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.170434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:07.183687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-645139235", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:07.196056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.196886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.197894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.198641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.273216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:07.397930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:07.406319 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6e46636-24cb-42da-a51b-6feed5df9e8e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.248363 May 10 02:13:07.411986 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 304/666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:07.416942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Calling method '.version_select at 0x7f3d375d6160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.421549 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:07.421549 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:07.424595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.426451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.463274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.463996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.494791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.495590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.512039 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2bcd2dfa-bb1c-4d22-9f2c-ba5b55872aad tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.098433 May 10 02:13:07.513965 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 305/667] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:07.523086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8cca433c-7d66-49f3-982a-cf73a852684c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d375d6a60>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.599814 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8cca433c-7d66-49f3-982a-cf73a852684c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.084574 May 10 02:13:07.606555 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 306/668] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:07.612399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da0e5a7b-50d3-4d83-a052-5da4812a18eb tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Calling method '.version_select at 0x7f3d37768790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.613538 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:07.613538 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:07.615060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da0e5a7b-50d3-4d83-a052-5da4812a18eb tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ce5f8f314220497cad138d06762dd691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cb118e18974f73a14ef41704341ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da0e5a7b-50d3-4d83-a052-5da4812a18eb tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Request method failure captured: May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecotQ8mOi21J2_Y-hLhTtCbNLKbCjtPKwX1YOHZ0s___1ds_OY7LPx3f0-3Wk16cssZ0R7M00GGHVPMRo6oBltAuj40hK2HUC-Z2ePXYbHznxspnfx-qrsFeLmACCcNJ67dkUX2waUnGaF8K0da2fHyRy2zujlQqU3xp4P39Hgs_GFk May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:07.616988 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d9cb118e18974f73a14ef41704341ee2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d9cb118e18974f73a14ef41704341ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d9cb118e18974f73a14ef41704341ee2 May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954 May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ce5f8f314220497cad138d06762dd691 May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2021177954-project May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1'} May 10 02:13:07.618257 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:13:07.619000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 10 02:13:07.620132 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.622843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da0e5a7b-50d3-4d83-a052-5da4812a18eb tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:07.623956 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da0e5a7b-50d3-4d83-a052-5da4812a18eb tempest-HypervisorAdminNegativeTestJSON-2021177954 tempest-HypervisorAdminNegativeTestJSON-2021177954-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016095 May 10 02:13:07.625080 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 307/669] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:07.635855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ab8d95b-5cc5-4a34-9146-46428a0b3797 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Calling method '.version_select at 0x7f3d379b65e0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.637932 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9ab8d95b-5cc5-4a34-9146-46428a0b3797 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] HTTP exception thrown: Hypervisor with ID '98ae886d-e9a6-4781-839c-28bbbdf45b18' could not be found. May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ab8d95b-5cc5-4a34-9146-46428a0b3797 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Request method failure captured: May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-hypervisors/98ae886d-e9a6-4781-839c-28bbbdf45b18 HTTP/1.1 May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecouuGzLK1DU8hgpxJ6Ub3S_J61ftl1bGSbpEZnVFKAiMMlOVa1CUbV28qdmSCZD8WpIQmwG9OxkZajOBx1nKP_pVJ-ymjwVvL-FQX0BKnlio2gvIg4oq_HlvqYL5NzPIWxF6ztt9eHCN_T1BiFjRnU0aznOJ6wVEb1JAu7M2GbfhKQ May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 756cbb74a6df48fc9629f2a2689f26ea May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2007228188 May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:13:07.640125 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_756cbb74a6df48fc9629f2a2689f26ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/756cbb74a6df48fc9629f2a2689f26ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/756cbb74a6df48fc9629f2a2689f26ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/756cbb74a6df48fc9629f2a2689f26ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2007228188 May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 756cbb74a6df48fc9629f2a2689f26ea May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2007228188 May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fd6d73425f364950afe605af7c12688d May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: exception: Hypervisor with ID '98ae886d-e9a6-4781-839c-28bbbdf45b18' could not be found. May 10 02:13:07.641363 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '98ae886d-e9a6-4781-839c-28bbbdf45b18'} May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '98ae886d-e9a6-4781-839c-28bbbdf45b18' May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 10 02:13:07.642077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:13:07.643922 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '98ae886d-e9a6-4781-839c-28bbbdf45b18' could not be found. May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '98ae886d-e9a6-4781-839c-28bbbdf45b18' could not be found. May 10 02:13:07.645541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:07.650649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ab8d95b-5cc5-4a34-9146-46428a0b3797 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] Returning 404 to user: Hypervisor with ID '98ae886d-e9a6-4781-839c-28bbbdf45b18' could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:07.651738 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ab8d95b-5cc5-4a34-9146-46428a0b3797 tempest-HypervisorAdminNegativeTestJSON-2007228188 tempest-HypervisorAdminNegativeTestJSON-2007228188-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/98ae886d-e9a6-4781-839c-28bbbdf45b18" status: 404 len: 123 microversion: 2.1 time: 0.021123 May 10 02:13:07.652806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 308/670] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/os-hypervisors/98ae886d-e9a6-4781-839c-28bbbdf45b18 => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:07.661040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.662000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:07.671687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.672376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.673774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.674467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.789211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:07.789841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:07.790784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:07.791778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:07.792465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:07.811008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.812234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.815464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.819477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.882902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Getting quotas for project 107552c6b0a94d33b3a7b66af44f9740. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:07.891404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:07.893619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Getting quotas for user 3425cd583e7d46e7aef80bc35e859b15 and project 107552c6b0a94d33b3a7b66af44f9740. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:07.909254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:07.910306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:07.912419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:07.915060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:07.934092 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92cd1603-6f93-4a1a-b51e-e6ecfb6a5e11 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.274287 May 10 02:13:07.946686 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 309/671] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:07.972559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:07.973605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:07.987612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.991894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:07.995402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:07.996471 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4bf1380-394a-4ca6-aa92-d767524742b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302102 May 10 02:13:08.006972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:08.007962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 363/672] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:13:08.202101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:08.221569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:08.226437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:08.229321 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f153e726-1068-40f4-89e8-39e7de3758c2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.263930 May 10 02:13:08.230226 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 310/673] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:07 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:08.249245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1486466507", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:08.387694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:08.429824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:08.430445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:08.449412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:08.449869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:08.460115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:08.460593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.006275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.025822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:09.026344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:09.026766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:09.027443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:09.028087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:09.038147 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8920d988-d96f-426c-bb57-c03f3e99b772 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.594068 May 10 02:13:09.039360 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 311/674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:08 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:09.044858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12d39b81-29e2-4203-b1a4-20e5657ac1e0 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d374faee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:09.065324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.066721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.070761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.072445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.115814 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12d39b81-29e2-4203-b1a4-20e5657ac1e0 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.075145 May 10 02:13:09.116817 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 312/675] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:09 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:09.134575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:09.136472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:09.158641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Getting quotas for project 107552c6b0a94d33b3a7b66af44f9740. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:09.162977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.164037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.170358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.174938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.182774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Getting quotas for user 3425cd583e7d46e7aef80bc35e859b15 and project 107552c6b0a94d33b3a7b66af44f9740. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:09.227953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:09.230347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:09.324293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.327764 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e6bb7dca-2ba5-4f44-9053-b5b0079e375c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082401 May 10 02:13:09.334060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 364/676] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:13:09.338703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.339581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:09.340405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:09.340870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.347687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.348426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.349442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.350818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.363973 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12fc7cab-a5d3-43e7-83f8-efe5141920e4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.246459 May 10 02:13:09.369734 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 313/677] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:09 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:09.378316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7131946f-e32f-4c38-9b3b-393ec3ec0927 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:09.379431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7131946f-e32f-4c38-9b3b-393ec3ec0927 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:09.531295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7131946f-e32f-4c38-9b3b-393ec3ec0927 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.542421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7131946f-e32f-4c38-9b3b-393ec3ec0927 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1214 microversion: 2.1 time: 0.169256 May 10 02:13:09.545521 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 314/678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:09 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:09.825788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.843430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.845287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:09.846923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cd2f9226-35b8-460e-81df-4898f5f63159 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 0.511662 May 10 02:13:09.859572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 365/679] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:09 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:09.901411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:09.902807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:09.917978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.920304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.925145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.925983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.935921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6b4a9868-f939-4c23-89c1-4ef03c39ff7b req-610e9f4f-4027-4e08-901d-23c46bda2893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e0f3f6-cf67-49e7-9ed5-916920dda8f3", "tag": "1bda6730-ac4d-4198-84c4-d63deba87d3c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:09.957776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6b4a9868-f939-4c23-89c1-4ef03c39ff7b req-610e9f4f-4027-4e08-901d-23c46bda2893 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:09.958664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6b4a9868-f939-4c23-89c1-4ef03c39ff7b req-610e9f4f-4027-4e08-901d-23c46bda2893 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:09.990253 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6b4a9868-f939-4c23-89c1-4ef03c39ff7b req-610e9f4f-4027-4e08-901d-23c46bda2893 service nova] Creating event network-changed:1bda6730-ac4d-4198-84c4-d63deba87d3c for instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 on n-h2-841089-2 May 10 02:13:10.000967 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6b4a9868-f939-4c23-89c1-4ef03c39ff7b req-610e9f4f-4027-4e08-901d-23c46bda2893 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069502 May 10 02:13:10.005044 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 366/680] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:13:10.057132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:10.058242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:10.073710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.074612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.080746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.083782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.566275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:10.584689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a7393b7c-d1aa-4f56-93fa-84ee788f166f tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1584 microversion: 2.1 time: 0.688269 May 10 02:13:10.585920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 315/681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:09 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1584 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:10.592210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a3834c52-cb51-4946-ae7b-270cd95da423 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37534af0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:10.684694 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a3834c52-cb51-4946-ae7b-270cd95da423 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.097377 May 10 02:13:10.685969 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 316/682] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:10 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:10.693044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:10.696882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:10.710730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.713339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.714441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.717064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.872051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:10.895108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:10.897117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:10.906242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c314e69-6671-475e-928e-7b9825c6768f tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.218982 May 10 02:13:10.907497 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 317/683] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:10 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:10.913189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:10.914016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:10.921619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.922363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.923388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.924083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.937920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:10.951631 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9167fcbf-ba17-4a1d-bad9-261adad020bb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.899473 May 10 02:13:10.952987 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 367/684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:10 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:10.961176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:10.962412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:10.970446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.989957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:10.995214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:10.996852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:11.175144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:11.187594 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab2a7919-d04e-4047-bb55-b6610c0bfb48 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1266 microversion: 2.1 time: 0.278169 May 10 02:13:11.194167 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 318/685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:10 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:11.701663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7669d916-50a0-40e6-b33f-2955de1f0bb7 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3761caf0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:11.791363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7669d916-50a0-40e6-b33f-2955de1f0bb7 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.095866 May 10 02:13:11.792092 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 319/686] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:11 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:11.929360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:11.930006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:11.948986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:11.949452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:11.964456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:11.965443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:12.224332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.233649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.239182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.243116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.244639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.257770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.260915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-432ea34d-ae31-4ae8-bfb1-c64effcac975 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.335924 May 10 02:13:12.262726 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 320/687] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:11 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:13:12.264255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b181f2d8-803d-49cf-91eb-6f8a5428384c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 1.309874 May 10 02:13:12.269714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:12.270806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:12.273208 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 368/688] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:10 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:12.289502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:12.291245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:12.293753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:12.294889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:12.295201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:12.295882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:12.312391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:12.315777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:12.316627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:12.317256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:12.682904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.697897 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2b103a5d-730c-48fe-b99f-a4962768dc84 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.432955 May 10 02:13:12.701193 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 321/689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:12 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:12.706403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:12.717512 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f9369b1-f4df-435b-84da-2c027d7c2c94 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1272 microversion: 2.1 time: 0.440149 May 10 02:13:12.719665 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 369/690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:12 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1272 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:12.808903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-95abe913-e301-4af2-a9da-f16eac4bb6a7 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37500b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:12.895456 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-95abe913-e301-4af2-a9da-f16eac4bb6a7 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.094188 May 10 02:13:12.897493 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 322/691] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:12 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:13.284928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:13.285594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:13.293656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:13.294218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:13.320055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:13.325077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:13.330421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:13.332029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:13.342854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:13.343491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:13.344444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:13.359590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:14.028679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:14.038278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:14.051398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:14.072594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3540b5d4-cb32-4769-a64d-4949236a1a70 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.789955 May 10 02:13:14.073248 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 370/692] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:13 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:14.093201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:14.093850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:14.117023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:14.119650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:14.120496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:14.120969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:15.014250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.036860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb6f61a3-154b-4790-8a64-532bbd802519 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.956128 May 10 02:13:15.038477 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 371/693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:14 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:15.045573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:15.046460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:15.064175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:15.065031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:15.066173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:15.069373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:15.084745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.103336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.105291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.109217 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1367a7ca-8965-46c2-a30e-b7d8af56aad3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1569 microversion: 2.25 time: 1.821429 May 10 02:13:15.116189 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 323/694] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:13 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1569 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:15.126305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aa37baca-1104-46d5-8810-8fb32933383a tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37461280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:15.209044 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aa37baca-1104-46d5-8810-8fb32933383a tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.091331 May 10 02:13:15.226522 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 324/695] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:15 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:15.273784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:15.274417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:15.296550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:15.297152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:15.298256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:15.299486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:15.579404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.589122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.602794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.620719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-225cb796-0e52-45ec-98c3-dd9b130702f2 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.389761 May 10 02:13:15.628723 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 325/696] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:15 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:15.887792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:15.899676 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6164cc76-a0a8-4de5-91ef-fcfe50e1791c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 0.858774 May 10 02:13:15.900282 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 372/697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:15 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:15.928034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-304300271", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:16.054364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:16.055238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:16.079390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:16.080824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:16.085192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:16.085665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:16.099644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:16.623910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:16.661540 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-377760bc-8be9-4320-8bec-e962b31ba47c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.611400 May 10 02:13:16.664756 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 373/698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:16 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:16.681536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:16.682661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:16.689794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:16.691213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:16.692291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:16.693166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:16.895953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:16.896565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:16.897060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:16.897479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:16.897906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:16.913965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:16.914430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:16.915275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:16.921114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:16.975520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:16.984419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for user ea129546ff474fd0aa9c93c1bfaac5fd and project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:16.999974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:17.003339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:17.097735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42028b59-fc95-4189-809b-f6e1af1f0e51 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467160 May 10 02:13:17.099133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 326/699] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:13:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:13:17.106140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9b20bf8-de87-402c-9859-9ca018003ccf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37461670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:17.182309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9b20bf8-de87-402c-9859-9ca018003ccf tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.081788 May 10 02:13:17.187810 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 327/700] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:17 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:17.204125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f2eb2deb-7ab5-4ca8-8ff0-ad4f23a6a28b req-c78b1950-9bf0-4f4d-b091-928f128a763d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f14d520-8ca8-49ee-af8e-5c0b6a52b570", "tag": "3f95e3d9-24f4-4658-86c3-0e9a1abaf85d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:17.233485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f2eb2deb-7ab5-4ca8-8ff0-ad4f23a6a28b req-c78b1950-9bf0-4f4d-b091-928f128a763d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.233862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f2eb2deb-7ab5-4ca8-8ff0-ad4f23a6a28b req-c78b1950-9bf0-4f4d-b091-928f128a763d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.253810 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f2eb2deb-7ab5-4ca8-8ff0-ad4f23a6a28b req-c78b1950-9bf0-4f4d-b091-928f128a763d service nova] Creating event network-changed:3f95e3d9-24f4-4658-86c3-0e9a1abaf85d for instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 on n-h1-841089-2 May 10 02:13:17.274285 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f2eb2deb-7ab5-4ca8-8ff0-ad4f23a6a28b req-c78b1950-9bf0-4f4d-b091-928f128a763d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086469 May 10 02:13:17.274901 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 328/701] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:17.286385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:17.295554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:17.302929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.303485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.304465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.305661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.353209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.362556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.364125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.383658 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a457efd-85c5-4ec0-85bc-4bfdc27e7b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1544 microversion: 2.25 time: 0.690273 May 10 02:13:17.384986 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 374/702] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:16 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1544 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:17.391422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:17.399693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:17.422929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.424281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.426777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.427999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.439742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.447839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.454760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.482943 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8fb7f0d-ad28-4a36-9384-86d3989088a4 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.206804 May 10 02:13:17.495214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 329/703] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:17 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:17.510722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-279e0607-3e07-43be-b3f0-6d7c566b0d3d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:17.511710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-279e0607-3e07-43be-b3f0-6d7c566b0d3d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:17.664888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-279e0607-3e07-43be-b3f0-6d7c566b0d3d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:17.677975 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-279e0607-3e07-43be-b3f0-6d7c566b0d3d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1212 microversion: 2.1 time: 0.180007 May 10 02:13:17.679271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 330/704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:17 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:17.693131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40bc6d98-0902-4198-9b83-e916ae145d30 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '.version_select at 0x7f3d37458c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:17.701777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40bc6d98-0902-4198-9b83-e916ae145d30 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.703702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40bc6d98-0902-4198-9b83-e916ae145d30 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.745540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40bc6d98-0902-4198-9b83-e916ae145d30 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1942 microversion: 2.25 time: 0.064766 May 10 02:13:17.746536 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 331/705] 10.222.0.52 () {60 vars in 1183 bytes} [Tue May 10 02:13:17 2022] GET /compute/v2.1/os-migrations => generated 1942 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:17.756407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:17.764106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:17.776482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.780997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:17.786690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:17.787488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.129417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:18.140882 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1da17f3-84ce-41b2-b3af-54fbee66bb82 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 0.751643 May 10 02:13:18.143191 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 375/706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:17 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:18.156154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:18.157161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:18.170545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:18.171563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.175662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:18.176421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.179871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:18.201923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8ff5c36c-5f81-4b29-b492-0b46d5530586 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.450627 May 10 02:13:18.204546 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 332/707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:17 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:18.211687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f4a2a41-40a5-4fcf-830c-bfeb1296d09c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d374fab80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:18.297995 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f4a2a41-40a5-4fcf-830c-bfeb1296d09c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.089415 May 10 02:13:18.299455 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 333/708] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:18 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:18.378447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:18.409173 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db61d948-e2e8-4347-8a61-4cffbfcd4c4b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 2037 microversion: 2.25 time: 0.262489 May 10 02:13:18.424846 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 376/709] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:18 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 2037 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:18.505141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:18.505907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:18.519610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:18.523700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.532294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:18.535412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.600600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1510051824", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "7fe840c0-65b0-4d12-94df-84e1e8a62759"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:18.706931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:18.709094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] validate_networks() for [('7fe840c0-65b0-4d12-94df-84e1e8a62759', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:18.724317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:18.726236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:18.732724 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a9435e9-a8ba-441d-9d46-a92d3e930594 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.232803 May 10 02:13:18.734096 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 334/710] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:18 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:18.740008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:18.740891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:18.747900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:18.749291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.750485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:18.751204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:18.860674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:18.904528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec64bc96-ee5e-4d09-8de9-76b6eb8ba040 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1264 microversion: 2.1 time: 0.168717 May 10 02:13:18.918647 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 335/711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:18 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:19.162909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:19.164915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:19.183479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.190477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.191884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.192503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.630561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:19.633853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:19.634571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:19.635182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:19.635780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:19.657826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.658604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.659646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.660266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.679246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:19.688036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d05fbf72-17ff-47b9-9f5d-6659ff1294a1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 0.532086 May 10 02:13:19.690905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:19.692614 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 336/712] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:19 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:19.702297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for user b31e1f4aa1eb4cceb37e10f1b8f7b3f2 and project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:19.704230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:19.706753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:19.730260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:19.733179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:19.740778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.741826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.743338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.744007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.832600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-578c0e23-b76d-4149-968e-e6a3874164dc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.236862 May 10 02:13:19.838984 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 377/713] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 02:13:19.859119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47e59c1e-4857-4c44-b236-969aadd51298 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37671040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:19.910414 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-47e59c1e-4857-4c44-b236-969aadd51298 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.058717 May 10 02:13:19.911653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 378/714] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:19 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:19.916741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-07d3e226-877e-4ffd-ab21-6025d306fb2b req-b842b0e7-6306-475a-acb0-3fbb3b211889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77517283-8636-44f0-8c0a-a9df64000a56", "tag": "c80677e4-247c-4eca-9d7b-a5f69cc0ce3f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:19.928131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-07d3e226-877e-4ffd-ab21-6025d306fb2b req-b842b0e7-6306-475a-acb0-3fbb3b211889 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.928797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-07d3e226-877e-4ffd-ab21-6025d306fb2b req-b842b0e7-6306-475a-acb0-3fbb3b211889 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.941535 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-07d3e226-877e-4ffd-ab21-6025d306fb2b req-b842b0e7-6306-475a-acb0-3fbb3b211889 service nova] Creating event network-changed:c80677e4-247c-4eca-9d7b-a5f69cc0ce3f for instance 77517283-8636-44f0-8c0a-a9df64000a56 on n-h2-841089-2 May 10 02:13:19.946912 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-07d3e226-877e-4ffd-ab21-6025d306fb2b req-b842b0e7-6306-475a-acb0-3fbb3b211889 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 May 10 02:13:19.947727 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 379/715] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:19.954286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:19.955180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:19.962540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.963276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:19.964257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:19.964863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:20.684817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:20.701255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:20.702803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:20.725423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c40ccbf6-c7c3-44a7-940b-de7b422bd7d1 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1447 microversion: 2.75 time: 0.764793 May 10 02:13:20.726496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 380/716] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:19 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1447 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:20.731574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:20.732212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:20.751348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:20.751843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:20.753360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:20.754810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:20.949653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:20.966243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:20.982224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:20.983453 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-84a9d564-4384-402c-a82e-9f10b05b3427 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1266 microversion: 2.25 time: 0.255817 May 10 02:13:20.994132 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 381/717] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:20 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:20.995950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:20.996581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:21.002686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:21.011819 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46f28c14-fb9f-40a9-a06a-b602d70dee5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 1.317804 May 10 02:13:21.012416 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 337/718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:19 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:21.038361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:21.038994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:21.058161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:21.058838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:21.059753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:21.060214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:21.079369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:21.080409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:21.081306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:21.081756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:21.243964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:21.263401 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee192485-bbf2-4f31-9cf4-4a47621e204f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1270 microversion: 2.1 time: 0.271274 May 10 02:13:21.264585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 382/719] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:20 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:21.269632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82a24d1d-3a52-48dd-a9a1-97617ee4ae47 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37624ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:21.362119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82a24d1d-3a52-48dd-a9a1-97617ee4ae47 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.096246 May 10 02:13:21.373002 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 383/720] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:21 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:21.555337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:21.564988 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb4f5fe0-2460-4946-b2e8-f146539ef059 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 0.542398 May 10 02:13:21.571668 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 338/721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:21 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:21.746840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:21.747501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:21.765636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:21.766088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:21.767153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:21.767636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:22.004145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:22.004784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:22.029920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:22.052167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:22.053352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:22.053974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:22.089345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:22.100348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:22.109454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:22.119659 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1fb91e8-4e88-479c-ad5a-4e36ef0fe9f0 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1453 microversion: 2.75 time: 0.376709 May 10 02:13:22.123109 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 384/722] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:21 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1453 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:22.138993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:22.139908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:22.157229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:22.157725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:22.158533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:22.158976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:22.311971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:22.324609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:22.326542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:22.328772 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c1929ea-1ddd-4672-9894-7fe5a4d9bc96 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1320 microversion: 2.25 time: 0.330867 May 10 02:13:22.330132 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 339/723] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:21 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:13:22.373320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:22.374252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:22.403370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:22.407236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:22.408748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:22.417690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:23.091113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:23.114652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a65ca754-92da-471b-9b9f-bfe87eec03f4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.985917 May 10 02:13:23.117616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 385/724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:22 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:23.125749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4593c4ea-f2ea-48b7-a68b-62c487c7da3d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37840700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:23.171606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:23.188412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e50cdeab-6c17-455a-89f7-7123e4d441c0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.830994 May 10 02:13:23.189563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 340/725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:22 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:23.197294 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4593c4ea-f2ea-48b7-a68b-62c487c7da3d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.077808 May 10 02:13:23.198497 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 386/726] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:23 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:23.203205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:23.208917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:23.211156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:23.212510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:23.223802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:23.224372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:23.225518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:23.227177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:23.227788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:23.228489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:23.230120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:23.230582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:23.898115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:23.913804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:23.918336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:23.930389 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ad90994-82a4-467d-b53c-0f156ffb763d tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1453 microversion: 2.75 time: 0.730634 May 10 02:13:23.935161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 387/727] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:23 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1453 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:23.947005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:23.948748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:23.960945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:23.961635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:23.963813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:23.965827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:24.302588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:24.316539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:24.322143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:24.324478 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c704a36-a987-4119-a225-8ac645d8e98d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.388081 May 10 02:13:24.335816 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 388/728] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:23 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:24.380633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:24.389397 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c1d8c2c-6ac8-436f-9bad-4ae59aa5f242 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 1.189922 May 10 02:13:24.394774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 341/729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:23 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:24.404666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c5b3fbce-abbc-4d34-95a8-88612d6fe0b3 req-9d886863-a867-4f65-9b02-6ee3158d5cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766bfcd2-c5c1-4a25-a548-6c3481c683de", "name": "network-vif-unplugged", "status": "completed", "tag": "46d63a95-70a5-4cc0-b972-ba14f2023740"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:24.434432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c5b3fbce-abbc-4d34-95a8-88612d6fe0b3 req-9d886863-a867-4f65-9b02-6ee3158d5cb9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:24.434886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c5b3fbce-abbc-4d34-95a8-88612d6fe0b3 req-9d886863-a867-4f65-9b02-6ee3158d5cb9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:24.465295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1f9cea0-2de1-4079-af14-f07f845ddc4d tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Action: 'create', calling method: .version_select at 0x7f3d3774bca0>, body: {"pool": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:24.477031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c5b3fbce-abbc-4d34-95a8-88612d6fe0b3 req-9d886863-a867-4f65-9b02-6ee3158d5cb9 service nova] Creating event network-vif-unplugged:46d63a95-70a5-4cc0-b972-ba14f2023740 for instance 766bfcd2-c5c1-4a25-a548-6c3481c683de on n-h1-841089-2 May 10 02:13:24.485162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c5b3fbce-abbc-4d34-95a8-88612d6fe0b3 req-9d886863-a867-4f65-9b02-6ee3158d5cb9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086256 May 10 02:13:24.487298 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 342/730] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:24.493020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:24.494482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:24.538126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:24.539003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:24.541853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:24.543013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:25.453072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:25.463590 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9a1f550-05d7-4bb7-b674-f21d3ddff2d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.974459 May 10 02:13:25.474144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 343/731] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:24 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:25.479566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:25.480415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:25.496135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:25.496906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:25.498123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:25.498726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:26.419859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:26.434221 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9acdd34-6282-4409-a6ea-8f91fde40c92 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.958512 May 10 02:13:26.450338 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 344/732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:25 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:26.464700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-626ce70f-26ef-4a72-9907-70b6273c2e37 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37458940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:26.554412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-626ce70f-26ef-4a72-9907-70b6273c2e37 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1427 microversion: 2.1 time: 0.102830 May 10 02:13:26.555001 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 345/733] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:26 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:26.565975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:26.578660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:26.597258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:26.597719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:26.609250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:26.609983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.078022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.089144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.093884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.105071 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bfe3675c-9fbd-4594-bb52-c8b14fdbdb6a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1438 microversion: 2.75 time: 0.546845 May 10 02:13:27.119534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 346/734] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:26 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1438 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:27.135302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:27.136175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:27.144548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.145303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.146310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.146929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.339332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.357489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.359152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.360484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7daa8ad2-e3b8-4302-8fbd-ce8e5fb3e9d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.239623 May 10 02:13:27.361773 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 347/735] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:27 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:27.366704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:27.367354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:27.377500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.377956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.378746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.379212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.592426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:27.601496 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-73621b53-bd2e-4ca6-a2c0-e9d987ffbee1 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 0.238561 May 10 02:13:27.610711 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 348/736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:27 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:27.615425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2f8c1f26-da9d-4207-b256-5ebcda21660d req-8c4fea7f-9b92-4634-bfb8-cf90842045a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77517283-8636-44f0-8c0a-a9df64000a56", "name": "network-vif-plugged", "status": "completed", "tag": "c80677e4-247c-4eca-9d7b-a5f69cc0ce3f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:27.623052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2f8c1f26-da9d-4207-b256-5ebcda21660d req-8c4fea7f-9b92-4634-bfb8-cf90842045a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.623539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2f8c1f26-da9d-4207-b256-5ebcda21660d req-8c4fea7f-9b92-4634-bfb8-cf90842045a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.634446 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2f8c1f26-da9d-4207-b256-5ebcda21660d req-8c4fea7f-9b92-4634-bfb8-cf90842045a3 service nova] Creating event network-vif-plugged:c80677e4-247c-4eca-9d7b-a5f69cc0ce3f for instance 77517283-8636-44f0-8c0a-a9df64000a56 on n-h2-841089-2 May 10 02:13:27.639392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2f8c1f26-da9d-4207-b256-5ebcda21660d req-8c4fea7f-9b92-4634-bfb8-cf90842045a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027285 May 10 02:13:27.639994 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 349/737] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:27.645921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7ef29514-202a-4b0b-a1dc-b3be85d92d61 req-4c74ae26-a085-43f6-a44a-61de279f0223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2caaf280-a323-44ef-a538-116e02a6af60", "tag": "ecb8fe6b-b852-4405-bdd4-46a18d504493"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:27.654295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7ef29514-202a-4b0b-a1dc-b3be85d92d61 req-4c74ae26-a085-43f6-a44a-61de279f0223 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.654754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7ef29514-202a-4b0b-a1dc-b3be85d92d61 req-4c74ae26-a085-43f6-a44a-61de279f0223 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.666214 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7ef29514-202a-4b0b-a1dc-b3be85d92d61 req-4c74ae26-a085-43f6-a44a-61de279f0223 service nova] Creating event network-changed:ecb8fe6b-b852-4405-bdd4-46a18d504493 for instance 2caaf280-a323-44ef-a538-116e02a6af60 on n-h1-841089-2 May 10 02:13:27.670945 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7ef29514-202a-4b0b-a1dc-b3be85d92d61 req-4c74ae26-a085-43f6-a44a-61de279f0223 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029542 May 10 02:13:27.671752 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 350/738] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:27.676881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:27.677580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:27.684177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.684638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:27.685423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:27.685879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.042116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:28.049666 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8174acf5-8913-45bf-a483-65fd9ff89975 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.376628 May 10 02:13:28.050363 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 351/739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:27 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:28.054890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7bb63522-3569-4ac1-a795-199ff4d47a26 req-1e583f33-0204-4bcc-b8dc-3e7f94bfa11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374", "tag": "18ef4267-996b-41de-90f2-8e5bb5fa4902"}, {"name": "network-changed", "server_uuid": "766bfcd2-c5c1-4a25-a548-6c3481c683de", "tag": "46d63a95-70a5-4cc0-b972-ba14f2023740"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:28.064978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7bb63522-3569-4ac1-a795-199ff4d47a26 req-1e583f33-0204-4bcc-b8dc-3e7f94bfa11e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.065430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7bb63522-3569-4ac1-a795-199ff4d47a26 req-1e583f33-0204-4bcc-b8dc-3e7f94bfa11e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.078940 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7bb63522-3569-4ac1-a795-199ff4d47a26 req-1e583f33-0204-4bcc-b8dc-3e7f94bfa11e service nova] Creating event network-changed:18ef4267-996b-41de-90f2-8e5bb5fa4902 for instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 on n-h1-841089-2 May 10 02:13:28.079546 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7bb63522-3569-4ac1-a795-199ff4d47a26 req-1e583f33-0204-4bcc-b8dc-3e7f94bfa11e service nova] Creating event network-changed:46d63a95-70a5-4cc0-b972-ba14f2023740 for instance 766bfcd2-c5c1-4a25-a548-6c3481c683de on n-h1-841089-2 May 10 02:13:28.086340 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7bb63522-3569-4ac1-a795-199ff4d47a26 req-1e583f33-0204-4bcc-b8dc-3e7f94bfa11e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034818 May 10 02:13:28.087136 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 352/740] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:28.194790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:28.196524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:28.202622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.203092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.203861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.204299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.248043 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1f9cea0-2de1-4079-af14-f07f845ddc4d tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.911048 May 10 02:13:28.248712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 389/741] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:13:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:28.253209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:28.253947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:28.261225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.261760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.262617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.263160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.285965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:28.286387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:28.286855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:28.287288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:28.287696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:28.347414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:28.356091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.356602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.357487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.357929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.402252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:28.410565 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-927d633a-093d-40e5-8a08-0615dc6ceb63 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.160876 May 10 02:13:28.419517 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 390/742] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:28 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:28.424708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb4bfc65-8fda-4c57-926b-505cba28b9e7 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37777310>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:28.471754 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb4bfc65-8fda-4c57-926b-505cba28b9e7 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1436 microversion: 2.1 time: 0.050822 May 10 02:13:28.472413 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 391/743] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:28 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1436 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:28.477327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d9dbe0ee-382e-4a4f-bb3a-b09cc786f37a tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Action: 'create', calling method: .version_select at 0x7f3d376f6940>, body: {"pool": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:28.483675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:28.500847 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28d1ab82-1cc5-4654-bdb0-4227859e1c71 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a/action" status: 202 len: 1942 microversion: 2.75 time: 0.412404 May 10 02:13:28.502130 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 353/744] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:13:28 2022] POST /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a/action => generated 1942 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 10 02:13:28.506782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:28.507494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:28.513160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.514218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.515327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.515955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.736713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:28.744530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:28.746051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:28.747189 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c04d3958-5d22-4f5a-b704-de208383d1e5 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.244109 May 10 02:13:28.747943 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 354/745] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:28 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:28.752072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1cc756c8-6a62-40ca-9c59-ee762b71a76c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3741c820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:28.795595 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1cc756c8-6a62-40ca-9c59-ee762b71a76c tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 200 len: 1436 microversion: 2.1 time: 0.046776 May 10 02:13:28.796178 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 355/746] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:13:28 2022] GET /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 1436 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:28.801847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:28.803239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:28.810026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.810578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.811483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.811924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.909711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:28.927911 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59122d08-1af7-48b9-8bb4-d2bb579c53d3 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.129822 May 10 02:13:28.928602 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 356/747] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:28 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:28.933477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:28.934333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:28.948443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.948992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:28.950658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:28.951237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:29.218479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:29.226459 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5153f350-8dbe-4590-b3e0-5599a88f161a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1314 microversion: 2.1 time: 0.296466 May 10 02:13:29.227041 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 357/748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:28 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:29.231502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:29.232115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:29.237897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:29.238355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:29.239161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:29.239606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:29.705230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:29.713652 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d95381b-a744-4158-bbc8-1cf77f89a398 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1466 microversion: 2.1 time: 0.485581 May 10 02:13:29.714223 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 358/749] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:29 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1466 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:29.726861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:29.726861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:29.726861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:29.726861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:29.727273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:29.727609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:29.979047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:29.987776 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77b254d2-f6e4-4e52-9f92-c990b5ac5806 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.272560 May 10 02:13:29.988347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 359/750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:29 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:29.993974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:29.994619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:30.002280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.002736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:30.003538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.003978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:30.355826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:30.363230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3dfefbde-1953-48d2-ae79-087703be5d24 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.373877 May 10 02:13:30.371658 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 360/751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:29 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:30.371658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-543067cd-da6e-4a9e-865b-223551e63136 req-286be2fc-a1e8-4044-a3dd-577f47b76950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f14d520-8ca8-49ee-af8e-5c0b6a52b570", "name": "network-vif-plugged", "status": "completed", "tag": "3f95e3d9-24f4-4658-86c3-0e9a1abaf85d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:30.378708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-543067cd-da6e-4a9e-865b-223551e63136 req-286be2fc-a1e8-4044-a3dd-577f47b76950 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.379188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-543067cd-da6e-4a9e-865b-223551e63136 req-286be2fc-a1e8-4044-a3dd-577f47b76950 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:30.390079 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-543067cd-da6e-4a9e-865b-223551e63136 req-286be2fc-a1e8-4044-a3dd-577f47b76950 service nova] Creating event network-vif-plugged:3f95e3d9-24f4-4658-86c3-0e9a1abaf85d for instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 on n-h1-841089-2 May 10 02:13:30.395609 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-543067cd-da6e-4a9e-865b-223551e63136 req-286be2fc-a1e8-4044-a3dd-577f47b76950 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030382 May 10 02:13:30.396411 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 361/752] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:30.404517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd6319a8-d1e3-49d3-bc15-61b1ab142095 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d3746d9d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:30.433612 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d9dbe0ee-382e-4a4f-bb3a-b09cc786f37a tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.959754 May 10 02:13:30.434915 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 392/753] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:13:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:30.441743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:30.442660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:30.464551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.471200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:30.472913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.474726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:30.909263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:30.929590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:30.933028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:30.940673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7cfffd16-99a1-4fd2-9cb2-0f931c8563ca tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.503933 May 10 02:13:30.941328 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 393/754] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:30 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:30.956009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:30.956467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:30.962510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.963173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:30.964422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:30.965182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:31.101021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:31.125416 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c02b265f-81c4-4870-9999-e0bc80928e18 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.173022 May 10 02:13:31.127592 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 394/755] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:30 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:31.132632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:31.133468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:31.139591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:31.140071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:31.140829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:31.141445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:31.158707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd6319a8-d1e3-49d3-bc15-61b1ab142095 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "DELETE /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42" status: 204 len: 0 microversion: 2.1 time: 0.757499 May 10 02:13:31.160034 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 362/756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:30 2022] DELETE /compute/v2.1/images/4d2dbb8c-1734-4054-bfbb-92a95f3ade42 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:13:31.170551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aed05da2-699d-4769-b72f-58ad5a1fab40 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Action: 'create', calling method: .version_select at 0x7f3d37407790>, body: {"pool": null} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:31.693577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:31.700883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dcc939ec-0e04-43ed-b0be-3af753c45dc2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1463 microversion: 2.1 time: 0.572056 May 10 02:13:31.701812 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 395/757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:31 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1463 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:31.707207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:31.707833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:31.714066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:31.714740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:31.715568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:31.716035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:32.045976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:32.053520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b57dde0b-1b9e-455d-a836-498827bc0dcf tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1503 microversion: 2.1 time: 0.350717 May 10 02:13:32.054097 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 396/758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:31 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:32.059082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4912996-9404-4e1e-88ae-1aa510075a89 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '.version_select at 0x7f3d37777d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:32.104769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b4912996-9404-4e1e-88ae-1aa510075a89 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] HTTP exception thrown: Image not found. May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4912996-9404-4e1e-88ae-1aa510075a89 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Request method failure captured: May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 HTTP/1.1 May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecn_9pBdUsH3Xkt80BOVcApXNcHXkm8-KUGiU-7kKSXJp51cevx2sXaUT2NGaHDATg-Eccvsq41G7ksq7EJpwnfwKaZpmTdkEmoJNpfnUXT_twfe5UC3rJ3icSrvmsEEY_af_XAN-cWfdr9gcFPpMb9KspBluUbS4lzz97bsUUQZbXE May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 26a35846a10642e48703cf9597c3e810 May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerTestJSON-838103336 May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:13:32.106726 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_26a35846a10642e48703cf9597c3e810", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26a35846a10642e48703cf9597c3e810"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/26a35846a10642e48703cf9597c3e810"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26a35846a10642e48703cf9597c3e810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerTestJSON-838103336 May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 26a35846a10642e48703cf9597c3e810 May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-838103336 May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerTestJSON-838103336-project May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c0819595c84d497194721e063f9c3170 May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerTestJSON-838103336-project May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'c0038409-9972-4257-8df1-37d08aaaf844'} May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:32.108953 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c0038409-9972-4257-8df1-37d08aaaf844 to delete May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.110052 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0038409-9972-4257-8df1-37d08aaaf844 could not be found. May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:32.111462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4912996-9404-4e1e-88ae-1aa510075a89 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4912996-9404-4e1e-88ae-1aa510075a89 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "DELETE /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844" status: 404 len: 62 microversion: 2.1 time: 0.053305 May 10 02:13:32.112908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 397/759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:32 2022] DELETE /compute/v2.1/images/c0038409-9972-4257-8df1-37d08aaaf844 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:13:32.117513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:32.117863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:32.124779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:32.125261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:32.126038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:32.126489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:32.419149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:32.427227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3cf324a0-ef71-4126-b867-8c67cc781c6f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.313528 May 10 02:13:32.427801 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 398/760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:32 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:32.432298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:32.432902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:32.439345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:32.439803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:32.440583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:32.441027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:32.669456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:32.677205 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-893983fc-3740-43e5-8ea8-bfa4e6ab07df tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1463 microversion: 2.1 time: 0.248430 May 10 02:13:32.677782 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 399/761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:32 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:32.682487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:32.683371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:32.689349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:32.690007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:32.690806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:32.691297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.013421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:33.022603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:33.025274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:33.026873 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-962e85a0-9080-46f4-ad55-e297531621d2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.348007 May 10 02:13:33.027702 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 400/762] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:32 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:33.033467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:33.034038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:33.042395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.043094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.044083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.044689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.072138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:13:33.159855 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-becdf6a2-f8ee-4bff-93ad-3ff7bbcbafae tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "DELETE /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 204 len: 0 microversion: 2.1 time: 0.130352 May 10 02:13:33.163144 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 401/763] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:13:33 2022] DELETE /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:13:33.181609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:33.182468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:33.195557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.208989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.209893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.210356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.304666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:33.325029 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb055b05-67b9-429d-a69a-bcb5204c2b75 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.158089 May 10 02:13:33.327186 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 402/764] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:33 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:33.336441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2e212052-0b4d-478b-8965-6574f9691379 req-9758458a-4438-4e45-81ee-9e4249257510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "name": "network-vif-unplugged", "status": "completed", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:33.345463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2e212052-0b4d-478b-8965-6574f9691379 req-9758458a-4438-4e45-81ee-9e4249257510 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.346188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2e212052-0b4d-478b-8965-6574f9691379 req-9758458a-4438-4e45-81ee-9e4249257510 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.359472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2e212052-0b4d-478b-8965-6574f9691379 req-9758458a-4438-4e45-81ee-9e4249257510 service nova] Creating event network-vif-unplugged:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:13:33.365690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2e212052-0b4d-478b-8965-6574f9691379 req-9758458a-4438-4e45-81ee-9e4249257510 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037022 May 10 02:13:33.366923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 403/765] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:33.372696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-868269451", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9f14d520-8ca8-49ee-af8e-5c0b6a52b570"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:33.411675 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aed05da2-699d-4769-b72f-58ad5a1fab40 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.246511 May 10 02:13:33.413191 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 363/766] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:13:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:33.420757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:33.422155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:33.428375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:33.429863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.430309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.431131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.431750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.648459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:33.656104 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af13d743-80af-4fdb-a62f-529c66897cc9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1478 microversion: 2.1 time: 0.241286 May 10 02:13:33.656751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 364/767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:33 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1478 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:33.661829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:33.662473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:33.668587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.669039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.669815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.670251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.702358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:33.702859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:33.703357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:33.703767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:33.704203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:33.713027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.713479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.714280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.714722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.731858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Getting quotas for project 107552c6b0a94d33b3a7b66af44f9740. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:33.736927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Getting quotas for user 3425cd583e7d46e7aef80bc35e859b15 and project 107552c6b0a94d33b3a7b66af44f9740. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:33.749885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:33.752442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:33.797819 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e063a36b-023e-4f1d-8f47-672468b4566f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.429283 May 10 02:13:33.799120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:33.799486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 404/768] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:13:33.804202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b813eff-f2d7-4e08-b151-65eacc70b5e8 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Action: 'create', calling method: .version_select at 0x7f3d376f6160>, body: {"pool": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:33.807257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bccec948-01b3-46da-a7df-5ec40f896766 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1472 microversion: 2.1 time: 0.149341 May 10 02:13:33.807824 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 365/769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:33 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:33.812477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:33.813084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:33.819347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.819986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:33.820956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:33.821546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.016857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:34.024991 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ebd2f3c-49cd-438b-868e-d939c56d9fe9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.215881 May 10 02:13:34.037827 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 366/770] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:33 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:34.043302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c04918af-715f-4446-bf67-e0a4dadb1c9c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '.version_select at 0x7f3d37450940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:34.046094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c04918af-715f-4446-bf67-e0a4dadb1c9c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.046625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c04918af-715f-4446-bf67-e0a4dadb1c9c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.057456 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c04918af-715f-4446-bf67-e0a4dadb1c9c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.017695 May 10 02:13:34.058372 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 367/771] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:13:34 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:34.062867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4f68f4b-264e-41bd-bcd8-3fa97fcda6f7 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:34.063729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b4f68f4b-264e-41bd-bcd8-3fa97fcda6f7 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:34.130192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b4f68f4b-264e-41bd-bcd8-3fa97fcda6f7 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:34.138185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b4f68f4b-264e-41bd-bcd8-3fa97fcda6f7 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1213 microversion: 2.1 time: 0.078640 May 10 02:13:34.148464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 368/772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:34 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:34.148464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:34.148464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:34.151723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.152181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.152992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.154158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.342961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:34.352477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:34.354100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:34.355451 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-723db2a1-6e77-40a1-bdd0-81cc64914f66 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.215543 May 10 02:13:34.356396 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 369/773] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:34 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:34.361651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:34.362512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:34.369037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.369481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.370264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.370706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.539268 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e608ed1-0c6e-43d4-9dbf-9eade418baea tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1629 microversion: 2.1 time: 0.181492 May 10 02:13:34.539906 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 370/774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:34 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1629 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:34.544172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:34.544773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:34.551011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.551694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.552628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:34.553836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:34.656211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:34.676836 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a34811f-2d99-4da1-8e2a-c43b6a9d3f08 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.135937 May 10 02:13:34.677429 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 371/775] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:34 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:34.693637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1655392033", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "2f8708f8-b1bb-4099-8385-4858a3f8bcfb"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:34.754284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] validate_networks() for [('2f8708f8-b1bb-4099-8385-4858a3f8bcfb', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:36.041063 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b813eff-f2d7-4e08-b151-65eacc70b5e8 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.240415 May 10 02:13:36.041739 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 405/776] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:13:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:36.047413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:36.048115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:36.054264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.054713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.055513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.055951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.144695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:36.145184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:36.145597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:36.146013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:36.146435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:36.155406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.155871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.156700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.157165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.176544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:36.181298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for user f3afba6df0eb454cbfa342f196e6727f and project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:36.193413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:36.195747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:36.240193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-820daafc-3ff8-4c28-8bc7-e1b300cf00a6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550220 May 10 02:13:36.246322 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 372/777] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:13:36.246520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:36.247477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:36.254533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.254807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.255804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.256787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.379293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:36.387837 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f1d1231a-6a31-40a0-a1c6-01654107eb4d tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1472 microversion: 2.1 time: 0.344731 May 10 02:13:36.388972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 406/778] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:36 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:36.406498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:36.407815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:36.415398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.416387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.417911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.419044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.549080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:36.554258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:36.557457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a48588b-00fb-48f6-b186-f6b242a2ba0b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1271 microversion: 2.1 time: 0.155174 May 10 02:13:36.558224 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 407/779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:36 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:36.561515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1c2eb6a-e82f-4ace-be7e-6adac8866aca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.318978 May 10 02:13:36.562093 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 373/780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:36 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:36.572560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:36.573196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:36.578725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-aec41130-b6af-47f4-8865-a7e862f70f3c req-9954d14f-8131-4724-8124-f9e4c536ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374", "name": "network-vif-plugged", "status": "completed", "tag": "18ef4267-996b-41de-90f2-8e5bb5fa4902"}, {"server_uuid": "2caaf280-a323-44ef-a538-116e02a6af60", "name": "network-vif-plugged", "status": "completed", "tag": "ecb8fe6b-b852-4405-bdd4-46a18d504493"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:36.581008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.581803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.582770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.583402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.588517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-aec41130-b6af-47f4-8865-a7e862f70f3c req-9954d14f-8131-4724-8124-f9e4c536ab9f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.589267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-aec41130-b6af-47f4-8865-a7e862f70f3c req-9954d14f-8131-4724-8124-f9e4c536ab9f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.604237 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-aec41130-b6af-47f4-8865-a7e862f70f3c req-9954d14f-8131-4724-8124-f9e4c536ab9f service nova] Creating event network-vif-plugged:18ef4267-996b-41de-90f2-8e5bb5fa4902 for instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 on n-h1-841089-2 May 10 02:13:36.605209 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-aec41130-b6af-47f4-8865-a7e862f70f3c req-9954d14f-8131-4724-8124-f9e4c536ab9f service nova] Creating event network-vif-plugged:ecb8fe6b-b852-4405-bdd4-46a18d504493 for instance 2caaf280-a323-44ef-a538-116e02a6af60 on n-h1-841089-2 May 10 02:13:36.619217 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-aec41130-b6af-47f4-8865-a7e862f70f3c req-9954d14f-8131-4724-8124-f9e4c536ab9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055886 May 10 02:13:36.628683 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 374/781] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:36.634451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:36.635639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:36.644835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.645611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.647331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:36.648086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:36.841138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:36.865825 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a752041d-bbaf-4760-bd12-9baa55d03c89 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.235351 May 10 02:13:36.880671 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 375/782] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:36 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:36.885701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c2fe421d-8582-411d-85c5-8e1f2b7183a9 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d37461940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:37.100976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:37.110949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:37.112610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:37.114225 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2f670fd-8a0f-4770-915f-d26bb5b9e940 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1362 microversion: 2.25 time: 0.554771 May 10 02:13:37.115017 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 408/783] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:36 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1362 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:37.120043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:37.121412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:37.129319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.129319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.129932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.130380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.253280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:37.262899 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-48dccbd5-1dd0-4546-b9fc-003bb32a02c7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1263 microversion: 2.1 time: 0.146723 May 10 02:13:37.264244 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 409/784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:37 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:37.270879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c1f20e0d-948d-4b9b-804c-2b12096d3541 req-1314d120-80da-494a-896d-ccb75df573f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71568d69-958a-4c3f-a614-2e9f1b76c6ac", "name": "network-vif-deleted", "tag": "f04ed4f8-7b8e-4d77-aa22-d1463f258ec7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:37.291203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c2fe421d-8582-411d-85c5-8e1f2b7183a9 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/ccde5eb4-8bb8-49fb-9b57-72814cdbbda8" status: 200 len: 141 microversion: 2.1 time: 0.409300 May 10 02:13:37.298036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 376/785] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:13:36 2022] GET /compute/v2.1/os-floating-ips/ccde5eb4-8bb8-49fb-9b57-72814cdbbda8 => generated 141 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:37.298231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c1f20e0d-948d-4b9b-804c-2b12096d3541 req-1314d120-80da-494a-896d-ccb75df573f1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.298231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c1f20e0d-948d-4b9b-804c-2b12096d3541 req-1314d120-80da-494a-896d-ccb75df573f1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.305043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ecb9e470-fcd4-43b0-8f5a-0b8f2ba10d4c tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d3746d670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:37.308267 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c1f20e0d-948d-4b9b-804c-2b12096d3541 req-1314d120-80da-494a-896d-ccb75df573f1 service nova] Creating event network-vif-deleted:f04ed4f8-7b8e-4d77-aa22-d1463f258ec7 for instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac on n-h2-841089-2 May 10 02:13:37.317504 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c1f20e0d-948d-4b9b-804c-2b12096d3541 req-1314d120-80da-494a-896d-ccb75df573f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051513 May 10 02:13:37.318492 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 410/786] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:37.408930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:37.410105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:37.417800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.420410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.423410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.426050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.461383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.461842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.462308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lazy-loading 'fault' on Instance uuid 71568d69-958a-4c3f-a614-2e9f1b76c6ac {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:37.800282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0819595c84d497194721e063f9c3170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a35846a10642e48703cf9597c3e810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:37.806970 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05d245f5-5763-4a71-9e52-e4f967cc1996 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 200 len: 1307 microversion: 2.1 time: 0.403517 May 10 02:13:37.816168 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 411/787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:37 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:37.820308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:37.820937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:37.826863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.827348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:37.828124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:37.828563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:38.295190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:38.302852 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dd7c85c0-7ff6-4d59-9c8c-de01bb02d9d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.494319 May 10 02:13:38.303486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 412/788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:37 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:38.307973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:38.308595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:38.316980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:38.317846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:38.318898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:38.319382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:38.718984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:38.727701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-079d574c-02c2-4515-a7f1-7988ffac7f1d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1312 microversion: 2.1 time: 0.423189 May 10 02:13:38.728287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 413/789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:38 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:38.733132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:38.733745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:38.740101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:38.740555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:38.741336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:38.741776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:38.883288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:38.900378 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb7cf1c0-42ba-4237-b51a-195a10c6f8e6 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.170867 May 10 02:13:38.901057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 414/790] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:38 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:38.906100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:38.906557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:38.912959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:38.913299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:38.914080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:38.914538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.264388 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ecb9e470-fcd4-43b0-8f5a-0b8f2ba10d4c tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/ccde5eb4-8bb8-49fb-9b57-72814cdbbda8" status: 202 len: 0 microversion: 2.1 time: 1.963515 May 10 02:13:39.265163 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 377/791] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:13:37 2022] DELETE /compute/v2.1/os-floating-ips/ccde5eb4-8bb8-49fb-9b57-72814cdbbda8 => generated 0 bytes in 1966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:39.270593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:39.271252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:39.277458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.277944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.278701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.279492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.294266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:39.304003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:39.306205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:39.307972 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52014f2f-1493-41c6-887e-349a9ed16016 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1558 microversion: 2.25 time: 0.405797 May 10 02:13:39.308548 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 415/792] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:38 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1558 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:39.319470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:39.320141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] [instance: 71568d69-958a-4c3f-a614-2e9f1b76c6ac] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:39.332396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.332871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.333836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.334492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.349785 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] HTTP exception thrown: Instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac could not be found. May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Request method failure captured: May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac HTTP/1.1 May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecn_9pBdUsH3Xkt80BOVcApXNcHXkm8-KUGiU-7kKSXJp51cevx2sXaUT2NGaHDATg-Eccvsq41G7ksq7EJpwnfwKaZpmTdkEmoJNpfnUXT_twfe5UC3rJ3icSrvmsEEY_af_XAN-cWfdr9gcFPpMb9KspBluUbS4lzz97bsUUQZbXE May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 26a35846a10642e48703cf9597c3e810 May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerTestJSON-838103336 May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:13:39.354153 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_26a35846a10642e48703cf9597c3e810", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26a35846a10642e48703cf9597c3e810"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/26a35846a10642e48703cf9597c3e810"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/26a35846a10642e48703cf9597c3e810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerTestJSON-838103336 May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 26a35846a10642e48703cf9597c3e810 May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-838103336 May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerTestJSON-838103336-project May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c0819595c84d497194721e063f9c3170 May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerTestJSON-838103336-project May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac could not be found. May 10 02:13:39.355952 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '71568d69-958a-4c3f-a614-2e9f1b76c6ac'} May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac could not be found. May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:39.356848 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac could not be found. May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac could not be found. May 10 02:13:39.360878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:39.362128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] Returning 404 to user: Instance 71568d69-958a-4c3f-a614-2e9f1b76c6ac could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:39.362128 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bda1dacf-7a53-4a3f-80bb-aaba4106fdd9 tempest-ImagesOneServerTestJSON-838103336 tempest-ImagesOneServerTestJSON-838103336-project] 10.222.0.52 "GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac" status: 404 len: 111 microversion: 2.1 time: 0.047849 May 10 02:13:39.362128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 416/793] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:39 2022] GET /compute/v2.1/servers/71568d69-958a-4c3f-a614-2e9f1b76c6ac => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:39.367749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4aaf5de-9339-41d4-8078-ac79142f2db8 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d37840700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:39.384940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:39.395835 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38c271e3-d96a-4f76-8736-07df258b7e99 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1269 microversion: 2.1 time: 0.129286 May 10 02:13:39.397488 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 378/794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:39 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1269 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:39.404115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:39.405736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:39.414305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.414769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.415592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.416372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.735791 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4aaf5de-9339-41d4-8078-ac79142f2db8 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.375763 May 10 02:13:39.736582 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 417/795] 10.222.0.52 () {58 vars in 1163 bytes} [Tue May 10 02:13:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:13:39.751997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:39.754675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:39.767519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.771398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.772666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.773405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.812234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:39.821119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba6c1ccd-4064-4e57-b5e2-d83c87465bcc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.422399 May 10 02:13:39.823534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 379/796] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:39 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:39.828751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:39.830271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:39.837077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.837628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:39.838494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:39.839010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.433671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 2caaf280-a323-44ef-a538-116e02a6af60 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:40.447635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5c0455f-e58e-4a57-96ab-60844238ee71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 2051 microversion: 2.25 time: 0.709634 May 10 02:13:40.456892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:40.463391 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 418/797] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:39 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 2051 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:40.465665 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3631b7d5-ce45-4a0d-875c-d7aea0fc11ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1461 microversion: 2.1 time: 0.640642 May 10 02:13:40.478764 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 380/798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:39 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1461 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:40.479565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d785d56-ffb2-44c0-a347-3473ed5599a0 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d375ad430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:40.484236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:40.485040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:40.492116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.492577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.493371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.493820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.662694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:40.683528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2da53279-c6ba-411b-96ad-cef272ab0b32 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.203115 May 10 02:13:40.684190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 381/799] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:40 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:40.689362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ef3f8fff-4bc3-4e94-b2c4-ae1e57eea36c req-9bfd97a8-ebaf-44da-b876-e27e84e1ee17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54eee163-ad8b-421c-be94-e5a973f28745", "tag": "303dbe9d-d2f7-43d3-a59d-7e86baf9d76b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:40.697630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ef3f8fff-4bc3-4e94-b2c4-ae1e57eea36c req-9bfd97a8-ebaf-44da-b876-e27e84e1ee17 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.698297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ef3f8fff-4bc3-4e94-b2c4-ae1e57eea36c req-9bfd97a8-ebaf-44da-b876-e27e84e1ee17 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.709844 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ef3f8fff-4bc3-4e94-b2c4-ae1e57eea36c req-9bfd97a8-ebaf-44da-b876-e27e84e1ee17 service nova] Creating event network-changed:303dbe9d-d2f7-43d3-a59d-7e86baf9d76b for instance 54eee163-ad8b-421c-be94-e5a973f28745 on n-h1-841089-2 May 10 02:13:40.714824 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ef3f8fff-4bc3-4e94-b2c4-ae1e57eea36c req-9bfd97a8-ebaf-44da-b876-e27e84e1ee17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029324 May 10 02:13:40.715814 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 382/800] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:40.721381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:40.722144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:40.730273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.730945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.731787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.732394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.980291 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d785d56-ffb2-44c0-a347-3473ed5599a0 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.515437 May 10 02:13:40.981350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 419/801] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:13:40 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:40.991194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9dda135-feda-497f-8c17-afe4c9c4b142 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:40.993184 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:40.993184 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:13:40.995716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9dda135-feda-497f-8c17-afe4c9c4b142 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.996659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9dda135-feda-497f-8c17-afe4c9c4b142 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:40.997957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9dda135-feda-497f-8c17-afe4c9c4b142 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:40.999447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9dda135-feda-497f-8c17-afe4c9c4b142 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:41.032953 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9dda135-feda-497f-8c17-afe4c9c4b142 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049924 May 10 02:13:41.033818 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 420/802] 10.222.0.52 () {60 vars in 1216 bytes} [Tue May 10 02:13:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:13:41.079975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:41.088678 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc597619-3074-4ae1-888b-aa25f405226d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.370924 May 10 02:13:41.089922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 383/803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:40 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:41.099296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:41.100517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:41.107444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:41.108202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:41.120454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:41.121236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:41.281608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:41.283842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:41.292076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:41.292916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:41.294401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:41.295581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:41.457311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:41.483972 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f55630d6-96b5-41cc-a393-054e8cad1b65 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.385530 May 10 02:13:41.485924 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 384/804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:41 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:41.494621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c6a4c3a-7278-4e1b-99b0-5dbc9927921c tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d37531ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:42.010516 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c2e3dd0-30ee-4dd3-bc7f-7d7b0b114057 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1612 microversion: 2.1 time: 0.975353 May 10 02:13:42.012076 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 421/805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:41 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1612 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:42.017860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:42.018779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:42.026031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:42.027514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:42.028424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:42.029251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:42.174123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:42.191596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2bd82a15-be90-4337-ad1b-2098b146f61a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.178147 May 10 02:13:42.192185 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 422/806] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:42 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:42.256639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1132431069", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "0d719d6b-b89f-4847-9aaf-10a99b24bfcf"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:42.317390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] validate_networks() for [('0d719d6b-b89f-4847-9aaf-10a99b24bfcf', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:13:43.505158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c6a4c3a-7278-4e1b-99b0-5dbc9927921c tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/9de8f7fa-d2c8-4b16-b946-4b42951e1264" status: 202 len: 0 microversion: 2.1 time: 2.017069 May 10 02:13:43.505758 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 385/807] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:13:41 2022] DELETE /compute/v2.1/os-floating-ips/9de8f7fa-d2c8-4b16-b946-4b42951e1264 => generated 0 bytes in 2019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:43.510417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:43.511312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:43.519025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.519520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.520305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.520749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.596922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fd929eec704e4295be1a82ed7f54deae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc78bfaf22d48cda331932f097f8b85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:43.597435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] flavor_id is None. Assuming migration. {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4142}} May 10 02:13:43.598092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 02:13:43.612195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:43.613486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:43.614937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:43.616583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:43.617651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:43.633755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.635372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.636763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.637458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.660844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:13:43.665348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for user fa657ea59867462a91093cea627895f8 and project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:13:43.678941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:13:43.682235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:13:43.761472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2188b21c-b58c-440c-ab39-752359ff3e03 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568008 May 10 02:13:43.768731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 423/808] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:13:43.774024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:43.774768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:43.782452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.783005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.783908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.784565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.970624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:43.978629 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-baaa844a-5308-4f1a-8269-45165d8c3c35 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.208738 May 10 02:13:43.983337 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 424/809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:43 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:43.990655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:43.991310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:43.997665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.998128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:43.998953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:43.999694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:44.041173 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-073de133-441a-4793-80da-779286049c3f tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374/action" status: 202 len: 0 microversion: 2.1 time: 0.533937 May 10 02:13:44.055326 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 386/810] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:43 2022] POST /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:44.062056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f18a11c0-8496-439e-9b73-d4d86777894c req-05cf0e66-fed6-40e3-a61c-eca5ce7cc768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ba2859-735c-49d1-94e0-48d745fcad0e", "tag": "a8ec29aa-bdf9-420a-b041-1bcced8ee65f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:44.080911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f18a11c0-8496-439e-9b73-d4d86777894c req-05cf0e66-fed6-40e3-a61c-eca5ce7cc768 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:44.081449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f18a11c0-8496-439e-9b73-d4d86777894c req-05cf0e66-fed6-40e3-a61c-eca5ce7cc768 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:44.096110 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f18a11c0-8496-439e-9b73-d4d86777894c req-05cf0e66-fed6-40e3-a61c-eca5ce7cc768 service nova] Creating event network-changed:a8ec29aa-bdf9-420a-b041-1bcced8ee65f for instance 39ba2859-735c-49d1-94e0-48d745fcad0e on n-h2-841089-2 May 10 02:13:44.103583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f18a11c0-8496-439e-9b73-d4d86777894c req-05cf0e66-fed6-40e3-a61c-eca5ce7cc768 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046228 May 10 02:13:44.105059 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 387/811] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:44.111623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:44.112673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:44.129741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:44.130325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:44.131100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:44.131678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:44.247500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:44.279260 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1773a6d6-14a0-4bb3-aa6b-7298af012896 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.172152 May 10 02:13:44.287453 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 388/812] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:44 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:44.302468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-458b4d7f-dd9e-48b7-94c2-b3a6593b102d tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d37500700>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:44.316208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:44.324798 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7d687c9-b932-44da-9808-6791c185094d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.343307 May 10 02:13:44.332348 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 425/813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:43 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:44.346329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82802b61-f0ff-4f25-9ed5-495127b13d99 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:44.348293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-82802b61-f0ff-4f25-9ed5-495127b13d99 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:44.493751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-82802b61-f0ff-4f25-9ed5-495127b13d99 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:44.501264 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82802b61-f0ff-4f25-9ed5-495127b13d99 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1225 microversion: 2.1 time: 0.164452 May 10 02:13:44.504949 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 426/814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:44 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:44.520974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:44.521617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:44.537717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:44.538339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:44.539743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:44.540405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:44.944410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:44.955401 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec3bdd9b-5c63-4217-94d9-10651dc156a5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1470 microversion: 2.1 time: 0.448882 May 10 02:13:44.956287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 427/815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:44 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:44.996879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:44.997974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:45.004806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.005332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.006221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.006814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.314442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:45.332149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-449b5cb1-1091-4dbb-b57c-79bb05530848 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.340140 May 10 02:13:45.333071 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 428/816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:44 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:45.337840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63e46c85-b4f4-428e-96d8-6e4c7aa10a43", "device": "/dev/xvdb"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:45.339519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:45.359219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.360473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.361426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.361917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.887094 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-458b4d7f-dd9e-48b7-94c2-b3a6593b102d tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/60f9d063-a9e3-49ec-a0a1-6524b552919d" status: 202 len: 0 microversion: 2.1 time: 1.598182 May 10 02:13:45.888019 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 389/817] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:13:44 2022] DELETE /compute/v2.1/os-floating-ips/60f9d063-a9e3-49ec-a0a1-6524b552919d => generated 0 bytes in 1600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:45.894349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:45.895239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:45.901803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.902584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.903710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.904425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.970488 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2089a7fb-0723-4d6a-9834-83f69813ff6b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "POST /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.636135 May 10 02:13:45.971479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 429/818] 10.222.0.52 () {62 vars in 1363 bytes} [Tue May 10 02:13:45 2022] POST /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:13:45.976862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:45.977703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:45.979260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:45.986189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.987259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:45.989514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:45.990105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:46.002799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38374868-487c-450d-be57-3518343f57fd tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.113719 May 10 02:13:46.006785 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 390/819] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:45 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:46.015079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:46.015717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:46.029437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:46.029905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:46.030695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:46.031343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:46.123094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:46.131731 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e1e8f06-e9a1-4640-80de-abc05b482ca7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1283 microversion: 2.1 time: 0.123722 May 10 02:13:46.132832 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 391/820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:46 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1283 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:46.138164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ce0c377e-e652-459a-b1c7-2d90d73dcda8 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] Calling method '.version_select at 0x7f3d3746d700>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:46.231138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:46.240182 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-22bd14a5-18e5-4308-bc5b-c9a47d97e7d8 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.267472 May 10 02:13:46.250672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 430/821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:45 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:46.256077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:46.256707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:46.263235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:46.263703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:46.264495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:46.264960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:46.966597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:46.979748 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35f11eab-7826-4c17-b3f5-50dc86a76651 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1470 microversion: 2.1 time: 0.725241 May 10 02:13:46.985350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 431/822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:46 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1470 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:46.995922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:46.996669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:47.009309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.010771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.012506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.014656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.457294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:47.468068 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-441e3f92-c484-4416-8bd6-03ca47569eb5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.481291 May 10 02:13:47.469184 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 432/823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:46 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:47.485485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:47.486102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:47.494017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.494475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.495352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.495798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.601206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:47.621750 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e25bc7b8-3ab1-4b77-8457-c7375247abad tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.140304 May 10 02:13:47.622941 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 433/824] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:47 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:47.630192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:47.631052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:47.637529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.638954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.639963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.640564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.880555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:47.891312 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2efc78b-178f-4ea0-bf08-b193d2ad43b2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1325 microversion: 2.1 time: 0.267045 May 10 02:13:47.892650 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 434/825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:47 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:47.899648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:47.900645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:47.908400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.909699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:47.910722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:47.911153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.055473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ce0c377e-e652-459a-b1c7-2d90d73dcda8 tempest-FloatingIPDetailsTestJSON-1088742245 tempest-FloatingIPDetailsTestJSON-1088742245-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/6fa30d79-53a2-45f6-a9c9-9a34dc4b211d" status: 202 len: 0 microversion: 2.1 time: 1.921333 May 10 02:13:48.056125 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 392/826] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:13:46 2022] DELETE /compute/v2.1/os-floating-ips/6fa30d79-53a2-45f6-a9c9-9a34dc4b211d => generated 0 bytes in 1923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:48.062318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0913da4b-ffc4-43b8-9883-c99f028def7b req-070661e7-b1b9-4b0c-83bc-2314f3fcbfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eee163-ad8b-421c-be94-e5a973f28745", "name": "network-vif-plugged", "status": "completed", "tag": "303dbe9d-d2f7-43d3-a59d-7e86baf9d76b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:48.072257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0913da4b-ffc4-43b8-9883-c99f028def7b req-070661e7-b1b9-4b0c-83bc-2314f3fcbfe8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.072715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0913da4b-ffc4-43b8-9883-c99f028def7b req-070661e7-b1b9-4b0c-83bc-2314f3fcbfe8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.087182 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0913da4b-ffc4-43b8-9883-c99f028def7b req-070661e7-b1b9-4b0c-83bc-2314f3fcbfe8 service nova] Creating event network-vif-plugged:303dbe9d-d2f7-43d3-a59d-7e86baf9d76b for instance 54eee163-ad8b-421c-be94-e5a973f28745 on n-h1-841089-2 May 10 02:13:48.094063 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0913da4b-ffc4-43b8-9883-c99f028def7b req-070661e7-b1b9-4b0c-83bc-2314f3fcbfe8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036086 May 10 02:13:48.095415 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 393/827] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:48.102229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-beefdbf6-20d0-4efe-b0f4-eb23c0f4afa6 req-211a4397-5c56-4b90-a867-878c7c24639b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70be7911-c078-4bad-91e9-b38423508afa", "tag": "0933a744-bdb6-4579-9074-890b7a0087b0"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:48.113775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-beefdbf6-20d0-4efe-b0f4-eb23c0f4afa6 req-211a4397-5c56-4b90-a867-878c7c24639b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.116059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-beefdbf6-20d0-4efe-b0f4-eb23c0f4afa6 req-211a4397-5c56-4b90-a867-878c7c24639b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.121129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:48.135446 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-beefdbf6-20d0-4efe-b0f4-eb23c0f4afa6 req-211a4397-5c56-4b90-a867-878c7c24639b service nova] Creating event network-changed:0933a744-bdb6-4579-9074-890b7a0087b0 for instance 70be7911-c078-4bad-91e9-b38423508afa on n-h2-841089-2 May 10 02:13:48.141759 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-beefdbf6-20d0-4efe-b0f4-eb23c0f4afa6 req-211a4397-5c56-4b90-a867-878c7c24639b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044705 May 10 02:13:48.142524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 394/828] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:48.148229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:48.149109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:48.156049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.157277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.158279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.159041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.162575 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b91b796b-d51f-4386-b929-f70fa59bc4a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.268689 May 10 02:13:48.176522 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 435/829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:47 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:48.381234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:48.389489 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23f54099-af9f-4b90-a59e-08eeb12ea432 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.245644 May 10 02:13:48.390179 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 395/830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:48 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:48.464032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:48.464869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:48.471751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.472440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.473437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.474072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.485693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:48.486686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:48.493047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.493804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.495199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.495701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.503008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:13:48.596765 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c5d6db4f-b6f6-4aca-912e-f85c8ab88d8b tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 204 len: 0 microversion: 2.1 time: 0.136258 May 10 02:13:48.597362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 436/831] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:13:48 2022] DELETE /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:13:48.608906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:48.610440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:48.617647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.618338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.619368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.619960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.659989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:48.674296 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-97b06d83-0df9-4eb9-a58b-777b9faf7dba tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.192335 May 10 02:13:48.674970 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 396/832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:48 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:48.680262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:48.680939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:48.702678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.706256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.707187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.707935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.833871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:48.842382 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cdaed699-4d87-40e0-b8c0-6a16236d26ec tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1709 microversion: 2.1 time: 0.237994 May 10 02:13:48.846019 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 437/833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:48 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1709 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:48.862808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:48.885679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c9910404-31c7-49ac-8c93-3f6058971ac2 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.209439 May 10 02:13:48.887756 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 397/834] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:48 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:48.909435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:48.910069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:48.917422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.917889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:48.918682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:48.919600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.089109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:49.096411 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-96d446c9-19a7-4f94-93da-9ef094239ac9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1325 microversion: 2.1 time: 0.191820 May 10 02:13:49.096938 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 438/835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:48 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:49.184267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:49.185114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:49.192561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.193212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.194050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.195307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.350812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:49.359100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20b06dff-7609-48cb-9d65-927b967469a6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1313 microversion: 2.1 time: 0.179474 May 10 02:13:49.360533 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 398/836] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:49 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:49.408457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:49.409096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:49.415867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.416667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.417690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.418330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.604616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:49.613394 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36d949c3-75fc-4dd1-9d1e-99fbb304ebe8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.209651 May 10 02:13:49.623810 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 439/837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:49 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:49.691375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:49.692313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:49.699229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.699969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.700918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.701508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.845850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:49.854090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80d3aec1-0146-4ce3-a83f-ce96509081c2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.166508 May 10 02:13:49.864692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 399/838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:49 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:49.869778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:49.870407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:49.876994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.877466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.878350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.878692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.907783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:49.908423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:49.921180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.921650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:49.922490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:49.922942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.038960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:50.060286 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0e5073b-cc38-46ab-b984-6e544c5a615d tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.157183 May 10 02:13:50.061630 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 400/839] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:49 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:13:50.112834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:50.114396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:50.121007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.121738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.122728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.123403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.140264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:50.151886 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1cf6a13a-53b5-473a-8745-2b55d399af1e tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1709 microversion: 2.1 time: 0.285895 May 10 02:13:50.166663 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 440/840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:49 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1709 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:50.182193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ea67fcdc-202f-4d71-8dbf-03918c784d50 req-8b5e3b93-98b2-409e-96c4-3c9b6bc5cb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ba2859-735c-49d1-94e0-48d745fcad0e", "name": "network-vif-plugged", "status": "completed", "tag": "a8ec29aa-bdf9-420a-b041-1bcced8ee65f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:50.197851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ea67fcdc-202f-4d71-8dbf-03918c784d50 req-8b5e3b93-98b2-409e-96c4-3c9b6bc5cb81 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.198678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ea67fcdc-202f-4d71-8dbf-03918c784d50 req-8b5e3b93-98b2-409e-96c4-3c9b6bc5cb81 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.210748 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ea67fcdc-202f-4d71-8dbf-03918c784d50 req-8b5e3b93-98b2-409e-96c4-3c9b6bc5cb81 service nova] Creating event network-vif-plugged:a8ec29aa-bdf9-420a-b041-1bcced8ee65f for instance 39ba2859-735c-49d1-94e0-48d745fcad0e on n-h2-841089-2 May 10 02:13:50.216000 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ea67fcdc-202f-4d71-8dbf-03918c784d50 req-8b5e3b93-98b2-409e-96c4-3c9b6bc5cb81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037433 May 10 02:13:50.217032 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 441/841] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:13:50.357923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:50.366833 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1d2c4d6-2093-4882-9870-32341ba983d2 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1325 microversion: 2.1 time: 0.257982 May 10 02:13:50.377108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:50.377960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:50.378356 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 401/842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:50 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:50.384248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.384902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.385979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.386572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.633839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:50.634387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:50.655012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.655507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.656295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.656774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.665955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:50.675005 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02b938ad-f3c7-4753-81be-6741a5950d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1462 microversion: 2.1 time: 0.302744 May 10 02:13:50.676133 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 442/843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:50 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1462 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:50.904817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:50.909112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'deleted': False, 'project_id': '244d019e2c304960a228f12a63506c30'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:50.926182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.926729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:50.927644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:50.928179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.133870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-11ecd7df-bb3e-47ad-af68-40d0c8b11cc0 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.443803 May 10 02:13:51.139188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 443/844] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:13:50 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:13:51.147134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:51.148112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:51.155921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.157208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.158812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.159547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.173283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:51.185437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c53d6f99-7dec-4e3e-b688-349a672ce25d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.555392 May 10 02:13:51.197956 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 402/845] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:50 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:51.204361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:51.205953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:51.212652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.213114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.213907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.214350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.399040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:51.430626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-080cef3d-6437-4314-bf44-a7e9cdd8eb8e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.231265 May 10 02:13:51.431257 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 403/846] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:51 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:51.443045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:51.450640 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f51957f9-3592-41fa-84f0-8471eecd5e85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1311 microversion: 2.1 time: 0.310039 May 10 02:13:51.454618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:51.455902 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 444/847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:51 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:51.460496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:51.461119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:51.467969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'deleted': False} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:51.485427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.485922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.486743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.492076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.492533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.493354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.493797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.499345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:51.755499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:13:51.917356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:51.917826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:52.500474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:52.520375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4608cbbd-5e2d-4c2c-8790-89c613d5cbd8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1709 microversion: 2.1 time: 1.061457 May 10 02:13:52.521068 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 445/848] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:51 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1709 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:52.554819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:52.562256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:52.574888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:52.575861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:52.577096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:52.579527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.054501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8367db12-b596-46f4-afd7-47c06c02c7ac tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20917 microversion: 2.1 time: 1.622163 May 10 02:13:53.055744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 404/849] 10.222.0.52 () {58 vars in 1170 bytes} [Tue May 10 02:13:51 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20917 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:13:53.061690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.062511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:53.071121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:53.083197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.089653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c1fb3f5-3de5-44bd-805a-552b954c9af8 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1325 microversion: 2.1 time: 0.564906 May 10 02:13:53.090742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.090865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 446/850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:52 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:53.091949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.092549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.097958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.108769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:53.125139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.125644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.131129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.135057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.295743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:53.335826 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d89c0972-a183-40cc-af39-f5884651810f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.243665 May 10 02:13:53.336801 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 447/851] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:53.342153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.343176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:53.349730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.350410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.351429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.352027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.404617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:53.412871 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-912dc1e7-0835-499a-bf0a-3e87f497d773 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.355908 May 10 02:13:53.413466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 405/852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:53.426021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f140742c-f54e-4e3f-b7b7-7d7f5f8e26f5 req-07012170-acf0-4397-b48d-42926b5ffeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70be7911-c078-4bad-91e9-b38423508afa", "name": "network-vif-plugged", "status": "completed", "tag": "0933a744-bdb6-4579-9074-890b7a0087b0"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:53.442676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f140742c-f54e-4e3f-b7b7-7d7f5f8e26f5 req-07012170-acf0-4397-b48d-42926b5ffeb3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.443148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f140742c-f54e-4e3f-b7b7-7d7f5f8e26f5 req-07012170-acf0-4397-b48d-42926b5ffeb3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.464069 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f140742c-f54e-4e3f-b7b7-7d7f5f8e26f5 req-07012170-acf0-4397-b48d-42926b5ffeb3 service nova] Creating event network-vif-plugged:0933a744-bdb6-4579-9074-890b7a0087b0 for instance 70be7911-c078-4bad-91e9-b38423508afa on n-h2-841089-2 May 10 02:13:53.494329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f140742c-f54e-4e3f-b7b7-7d7f5f8e26f5 req-07012170-acf0-4397-b48d-42926b5ffeb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075470 May 10 02:13:53.495875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 406/853] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:53.502787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.517500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'deleted': False, 'project_id': '244d019e2c304960a228f12a63506c30'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:53.531044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.534169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.536459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.539942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.678668 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59138cae-3c21-42a0-9fdc-23ddd4808049 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?tenant_id=107552c6b0a94d33b3a7b66af44f9740" status: 200 len: 15 microversion: 2.1 time: 0.181472 May 10 02:13:53.680349 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 407/854] 10.222.0.52 () {58 vars in 1230 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/detail?tenant_id=107552c6b0a94d33b3a7b66af44f9740 => generated 15 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:13:53.685980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.686907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:53.694864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.695567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.697187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.697896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.833966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:53.837573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:53.845685 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75885e90-4e49-4f69-924b-c7bda67ee7e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1494 microversion: 2.1 time: 0.507768 May 10 02:13:53.846413 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7b9c224-45ba-40ba-839b-f03398c7a970 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1642 microversion: 2.1 time: 0.164466 May 10 02:13:53.854841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 448/855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1494 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:53.865406 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 408/856] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1642 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:53.869863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.880743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:53.883657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:53.890333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'tenant_id': '107552c6b0a94d33b3a7b66af44f9740', 'deleted': False} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:53.906729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.915637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.916810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.919831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.923517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.924116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.926972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:53.927531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:53.981398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:13:54.243178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0c89828-86cc-420c-a7c1-7f846185a233 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1645 microversion: 2.1 time: 0.373160 May 10 02:13:54.243787 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 409/857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1645 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:54.259814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:54.260445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:54.269188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.269655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.270456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.270907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.294991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.295840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.534520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6956d20-88b6-4e52-b3c6-ba9b84f7c965 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=107552c6b0a94d33b3a7b66af44f9740" status: 200 len: 4824 microversion: 2.1 time: 0.675704 May 10 02:13:54.548527 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 449/858] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 02:13:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=107552c6b0a94d33b3a7b66af44f9740 => generated 4824 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:54.551415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:54.556343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0a86bc8f-8ff8-4f4c-a9ae-ec895ae225f3 req-9e93b8df-56d8-4d76-8ce2-f8b55b2a507b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e0f3f6-cf67-49e7-9ed5-916920dda8f3", "name": "network-vif-deleted", "tag": "1bda6730-ac4d-4198-84c4-d63deba87d3c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:54.559763 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf08ec6d-3f2f-402a-8f87-5b49c188ac8c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1325 microversion: 2.1 time: 0.314912 May 10 02:13:54.570134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 410/859] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:54 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:54.570134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2be71092-9339-4e5f-b2de-9c4a4599906c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:54.570134 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:54.570134 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:54.570838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2be71092-9339-4e5f-b2de-9c4a4599906c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.571326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2be71092-9339-4e5f-b2de-9c4a4599906c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.572164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2be71092-9339-4e5f-b2de-9c4a4599906c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.572740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2be71092-9339-4e5f-b2de-9c4a4599906c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.577218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0a86bc8f-8ff8-4f4c-a9ae-ec895ae225f3 req-9e93b8df-56d8-4d76-8ce2-f8b55b2a507b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.577883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0a86bc8f-8ff8-4f4c-a9ae-ec895ae225f3 req-9e93b8df-56d8-4d76-8ce2-f8b55b2a507b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.588958 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0a86bc8f-8ff8-4f4c-a9ae-ec895ae225f3 req-9e93b8df-56d8-4d76-8ce2-f8b55b2a507b service nova] Creating event network-vif-deleted:1bda6730-ac4d-4198-84c4-d63deba87d3c for instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 on n-h2-841089-2 May 10 02:13:54.594634 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0a86bc8f-8ff8-4f4c-a9ae-ec895ae225f3 req-9e93b8df-56d8-4d76-8ce2-f8b55b2a507b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044494 May 10 02:13:54.595786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 450/860] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:54.602163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:54.603321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:54.613388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.614405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.615782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.616756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.621117 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2be71092-9339-4e5f-b2de-9c4a4599906c tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056198 May 10 02:13:54.622309 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 411/861] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:13:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:54.643442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:54.644143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:54.652156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.652834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.654097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.654756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.832095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:54.867976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:54.883390 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74958832-81b4-4ec5-ae0e-20eb0ebd722a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.251772 May 10 02:13:54.884046 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 412/862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:54 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:54.884560 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3cc9c91-0b44-4315-97ea-f432c4cf676f tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.287162 May 10 02:13:54.887705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 451/863] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:54 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:54.899019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:54.904868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:54.905049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:54.919047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.921185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.922854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.924860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'tenant_id': '244d019e2c304960a228f12a63506c30', 'deleted': False} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:54.925542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.945374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.946061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:54.948296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:54.951049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.006831 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc5a5b1f-98cd-4bcc-93f2-59709006a102 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=244d019e2c304960a228f12a63506c30" status: 200 len: 15 microversion: 2.1 time: 0.121708 May 10 02:13:55.008412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.010981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.011971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lazy-loading 'fault' on Instance uuid 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:55.019735 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 413/864] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 02:13:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=244d019e2c304960a228f12a63506c30 => generated 15 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:13:55.024737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-720785fa-580d-4028-924d-99dad9160568 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:55.029142 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-720785fa-580d-4028-924d-99dad9160568 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008037 May 10 02:13:55.053659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 414/865] 10.222.0.52 () {58 vars in 1188 bytes} [Tue May 10 02:13:55 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:13:55.072799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:55.073767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:55.095292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.095749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.096550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.096995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.134638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6587868068d641b88a68acaeff886cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a9f22674ee4e27ad7c42db55473a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:55.144751 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5897c6c0-4216-4a6d-ac94-67774b4adc64 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 200 len: 1350 microversion: 2.1 time: 0.254982 May 10 02:13:55.145902 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 452/866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:54 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 1350 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:55.317190 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-189cc2d3-3eaf-4d73-bb4c-65d03c453b2e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 0 microversion: 2.1 time: 0.262305 May 10 02:13:55.325530 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 415/867] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:55 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:55.331127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:55.336478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:55.337330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '107552c6b0a94d33b3a7b66af44f9740'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:55.348721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.349182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.350047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.350503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.539652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:13:55.577952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:55.579181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:55.590229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.598918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.600978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.604088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.691170 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c837a8f-9867-48e5-a86b-49b08ef816f6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.363970 May 10 02:13:55.692139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 453/868] 10.222.0.52 () {58 vars in 1149 bytes} [Tue May 10 02:13:55 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:55.708099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:55.708863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:55.726689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.727244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.728012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.728460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.864189 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0fe23aa9-0f84-448b-987e-6c5acfbd61e4 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 0 microversion: 2.1 time: 0.164003 May 10 02:13:55.869478 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 454/869] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:55 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:55.876093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:55.877080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:55.877616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:55.885006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.886133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.887196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.887865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.890455 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2438fa7b-9b3c-4ae3-b7ec-9548b108afc9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.314721 May 10 02:13:55.899119 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 416/870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:55 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:55.910187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:55.913490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:55.930240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.931748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:55.932792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:55.935682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.139660 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9fa053e2-7cea-4dea-a446-5761acdf237c tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1614 microversion: 2.1 time: 0.267737 May 10 02:13:56.140179 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 455/871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:55 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1614 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:56.150037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.157172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.170440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.171011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.171729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.172219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.185337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:56.192787 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3be02487-d83f-4403-82f6-4d2aa0c2cbc0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.289071 May 10 02:13:56.193367 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 417/872] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:55 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:13:56.198425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.199356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.205744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.206226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.207097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.207470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.332874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:56.369368 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e9f4693d-e5e3-4427-b750-c3ac56862a69 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.227594 May 10 02:13:56.370688 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 456/873] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:56.374344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.375617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.398662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.399138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.400046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.400370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.461421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:56.474420 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-09495a8e-3680-45b3-b600-00450a09d317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.279997 May 10 02:13:56.477146 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 418/874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:56.487316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.488294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.494510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.495294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.496608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.497270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.515282 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 HTTP/1.1 May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:56.517690 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:56.519116 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '41e0f3f6-cf67-49e7-9ed5-916920dda8f3'} May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:56.519858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:56.521000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.523460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:56.524548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dc2ebb3-ea85-4bb1-a724-a7477875aab0 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 404 len: 111 microversion: 2.1 time: 0.044553 May 10 02:13:56.525374 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 419/875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:56.531985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b559a88e-090f-4f90-86a6-588f334e765d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1024966035", "metadata": {"": ""}}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b559a88e-090f-4f90-86a6-588f334e765d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action HTTP/1.1 May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 107 May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:56.534860 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1024966035", "metadata": {"": ""}}} May 10 02:13:56.536269 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1024966035', 'metadata': {'': ''}}}} May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'': ''} May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.537125 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.538384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.539627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.539627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.539627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:13:56.539627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:13:56.539627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:56.539627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.541620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b559a88e-090f-4f90-86a6-588f334e765d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:56.542879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b559a88e-090f-4f90-86a6-588f334e765d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action" status: 400 len: 170 microversion: 2.1 time: 0.016389 May 10 02:13:56.546852 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 420/876] 10.222.0.52 () {60 vars in 1278 bytes} [Tue May 10 02:13:56 2022] POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action => generated 170 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:13:56.554923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.555735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.563557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.564305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.565399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.567475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.583648 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 HTTP/1.1 May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:56.585527 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.586806 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'eb619058-700d-4b0a-8b3e-9c3c845c4538'} May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:56.587567 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.588719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:56.591201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:56.592579 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1f2906b-cbc5-4b9d-aa5e-5f1f17586887 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 404 len: 111 microversion: 2.1 time: 0.042186 May 10 02:13:56.593669 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 421/877] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:13:56 2022] DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:56.599276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.600214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.606976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.607840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.608854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.609590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.662537 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5eda184a-c02d-4d4c-8428-16e79f3ff8cc tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1614 microversion: 2.1 time: 0.290387 May 10 02:13:56.664524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 457/878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1614 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:56.674990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.676085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:56.697977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.701333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.702383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.702983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.734474 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 HTTP/1.1 May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:13:56.736414 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.738059 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'eb619058-700d-4b0a-8b3e-9c3c845c4538'} May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:56.738928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:56.740449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:56.746858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:56.746858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d11e49e4-7834-4051-9611-70cd307236d8 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 404 len: 111 microversion: 2.1 time: 0.077310 May 10 02:13:56.746858 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 458/879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:56.751937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.756762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'host': 'n-h1-841089-2', 'deleted': False} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:56.763752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.764449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.765408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:56.766598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:56.868604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:13:56.950730 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1a0f182-7e4d-4fdf-b605-09d9bdb4f43b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=n-h1-841089-2&all_tenants=1" status: 200 len: 1981 microversion: 2.1 time: 0.202277 May 10 02:13:56.952640 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 459/880] 10.222.0.52 () {58 vars in 1189 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers?host=n-h1-841089-2&all_tenants=1 => generated 1981 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:56.959453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76f81214-8d99-4de9-a152-0f01b45ed115 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '.version_select at 0x7f3d37679700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:56.985385 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76f81214-8d99-4de9-a152-0f01b45ed115 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108535060" status: 202 len: 0 microversion: 2.1 time: 0.030617 May 10 02:13:56.990385 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 460/881] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108535060 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:56.995634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:57.003678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:13:57.010549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.011659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.013914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.014533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.038568 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-74281171-08df-430d-9fa8-326385e56094 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.046798 May 10 02:13:57.039826 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 461/882] 10.222.0.52 () {58 vars in 1195 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:13:57.056767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:57.059784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:57.075317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.079988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.081025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.081607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.177226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc631477-b1e7-48bf-8a4b-eaf7bb589930 tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 0 microversion: 2.1 time: 0.129079 May 10 02:13:57.178918 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 462/883] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:57 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:57.210077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:57.214414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:57.241443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.241998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.242858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.247178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.338943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:57.358132 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afe882ef-aae1-4fc9-acc9-b48a7f21fdc5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.762547 May 10 02:13:57.372010 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 422/884] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:56 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:57.391956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:57.394307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:57.406912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.423797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.425203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.426291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.449508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:13:57.449937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:13:57.450421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:13:57.450823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:13:57.451275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:13:57.565121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:57.573479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.574347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.587305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.588303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.634292 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4589a171-9f91-4091-bcbb-2ed520500235 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 1067 microversion: 2.1 time: 0.450923 May 10 02:13:57.652928 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 463/885] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:13:57 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 1067 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 10 02:13:57.658571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:57.659248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:57.667342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.667803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.668597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.669040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.916361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:57.951314 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-96918e50-7550-4704-8e04-6f2faecbc1c9 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.296417 May 10 02:13:57.965645 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 464/886] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:57 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:57.980993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:57.981639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:57.990910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.991597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:57.992634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:57.993217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.115464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:58.126106 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6750406c-a387-4273-88df-bb7461c43436 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.752590 May 10 02:13:58.126606 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 423/887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:57 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:58.144580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:58.145522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:58.154924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:58.156075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.159461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:58.188298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.423709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:58.437392 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51f0909d-e038-4323-8ae8-1c40369bc656 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.470512 May 10 02:13:58.448473 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 465/888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:57 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:58.448473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a102ccf9-e8ba-4081-91e8-3afef36a0140", "device": "/dev/xvdb"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:58.457412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:58.470503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:58.471124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.472073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:58.473101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.637318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:58.649360 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74ad2283-01e7-40d8-81bb-7607efef822d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.521369 May 10 02:13:58.651133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 424/889] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:58 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:58.656368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d8fcc09-e466-4c80-8aab-58b836f8733e tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:58.656983 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:58.656983 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:13:58.682904 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d8fcc09-e466-4c80-8aab-58b836f8733e tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1296505445" status: 202 len: 0 microversion: 2.1 time: 0.030185 May 10 02:13:58.683567 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 425/890] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:13:58 2022] DELETE /compute/v2.1/flavors/1296505445 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:58.688836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c47321c1-b454-4917-b3ac-a3a21f6953f7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1062211439", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c47321c1-b454-4917-b3ac-a3a21f6953f7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action HTTP/1.1 May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 619 May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:58.691621 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:13:58.693166 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:13:58.693963 n-d-841089-2 devstack@n-api.service[118717]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1062211439", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 10 02:13:58.693963 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:58.693963 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1062211439', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 10 02:13:58.694467 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:58.695415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.697184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:58.698085 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:58.698085 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:58.698085 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:13:58.698085 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:13:58.698085 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:13:58.698085 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:58.698611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c47321c1-b454-4917-b3ac-a3a21f6953f7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:58.698611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c47321c1-b454-4917-b3ac-a3a21f6953f7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action" status: 400 len: 938 microversion: 2.1 time: 0.008490 May 10 02:13:58.698611 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 426/891] 10.222.0.52 () {60 vars in 1278 bytes} [Tue May 10 02:13:58 2022] POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action => generated 938 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:13:58.773054 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3da2c23f-3120-4663-83ba-ac9f2c929778 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "POST /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331466 May 10 02:13:58.773774 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 466/892] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:13:58 2022] POST /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:58.779293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25bdbb06-67c5-4fd8-a795-83292148614b tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:58.800586 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25bdbb06-67c5-4fd8-a795-83292148614b tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5399 microversion: 2.1 time: 0.025454 May 10 02:13:58.813508 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 467/893] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:13:58 2022] GET /compute/v2.1/flavors/detail => generated 5399 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:58.818579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:58.820009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:58.826223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:58.826752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.836481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:58.837105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:58.849552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6802d66a-bff5-4d24-9098-57ad6fbe06e1 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d37796ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-712887606", "description": "tempest-description-1611157524"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:59.021613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:59.034702 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-60de3bb7-2ff4-4f44-adfb-91e739f43207 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.220061 May 10 02:13:59.055043 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 468/894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:58 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:59.055043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c233f1f8-a837-4420-a05f-ff713fe28e7d tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.057610 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:13:59.057610 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:13:59.094824 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6802d66a-bff5-4d24-9098-57ad6fbe06e1 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.397151 May 10 02:13:59.096217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 427/895] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:13:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:59.107967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.108542 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c233f1f8-a837-4420-a05f-ff713fe28e7d tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/85330213" status: 202 len: 0 microversion: 2.1 time: 0.062906 May 10 02:13:59.110312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 469/896] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:13:59 2022] DELETE /compute/v2.1/flavors/85330213 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:59.110760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.116027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.116696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.123632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.124166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.124876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.125052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.125890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.126020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.126709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.127256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.207746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:13:59.229000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aff14c5e-cc3e-4a75-bef5-304cf247034e tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.131338 May 10 02:13:59.241751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 428/897] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:13:59.245981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-116e2644-9bd0-49df-ad2c-cb56e4244edc tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d37e02ee0>, body: {"security_group_rule": {"parent_group_id": "3a1772c3-718d-451d-a643-7b43d1ea6cf3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:59.314546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:59.322484 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59067dfd-90d5-46bf-bd74-a94277c0d924 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.210791 May 10 02:13:59.323497 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 470/898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:59.327771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b42098dd-6695-4b0b-9d84-c3b25ef08b4e tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.348086 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b42098dd-6695-4b0b-9d84-c3b25ef08b4e tempest-ServersWithSpecificFlavorTestJSON-818928391 tempest-ServersWithSpecificFlavorTestJSON-818928391-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023594 May 10 02:13:59.348998 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 471/899] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:59.353632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.354255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.367059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.367581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.368381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.368839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.544198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-116e2644-9bd0-49df-ad2c-cb56e4244edc tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.313459 May 10 02:13:59.545749 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 429/900] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:13:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:13:59.553266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f5f726b-89fb-4677-891e-520787df2f2f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:59.555526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f5f726b-89fb-4677-891e-520787df2f2f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action HTTP/1.1 May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 285 May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:59.556221 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:13:59.558121 n-d-841089-2 devstack@n-api.service[118717]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:13:59.558905 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:13:59.559811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:13:59.561219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:13:59.562219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:13:59.562219 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.562219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f5f726b-89fb-4677-891e-520787df2f2f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:59.562219 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f5f726b-89fb-4677-891e-520787df2f2f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action" status: 400 len: 619 microversion: 2.1 time: 0.013762 May 10 02:13:59.563131 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 430/901] 10.222.0.52 () {60 vars in 1278 bytes} [Tue May 10 02:13:59 2022] POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:13:59.567439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-883ac9f0-88ab-4a0a-9101-cf9c2e5cddc1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.217279 May 10 02:13:59.568019 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 472/902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:59.572521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fee1b2a2-3e4a-4481-9440-e0e39d39e9e0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d374ec820>, body: {"security_group_rule": {"parent_group_id": "3a1772c3-718d-451d-a643-7b43d1ea6cf3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:13:59.572913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.573432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.583172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.584029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.585072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.585748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.600766 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 HTTP/1.1 May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:13:59.602402 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.603824 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '41e0f3f6-cf67-49e7-9ed5-916920dda8f3'} May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:59.604695 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.609081 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:13:59.611060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:59.611060 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee480b9a-113b-4d51-85af-71c9aa401f3a tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 404 len: 111 microversion: 2.1 time: 0.041620 May 10 02:13:59.611060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 431/903] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:13:59 2022] DELETE /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:59.613802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.614543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.620454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.621116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.621906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.622355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.630130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-fee1b2a2-3e4a-4481-9440-e0e39d39e9e0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: This rule already exists in group 3a1772c3-718d-451d-a643-7b43d1ea6cf3 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fee1b2a2-3e4a-4481-9440-e0e39d39e9e0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 138 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:13:59.632881 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: {"security_group_rule": {"parent_group_id": "3a1772c3-718d-451d-a643-7b43d1ea6cf3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 10 02:13:59.634270 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: exception: This rule already exists in group 3a1772c3-718d-451d-a643-7b43d1ea6cf3 May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3a1772c3-718d-451d-a643-7b43d1ea6cf3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3a1772c3-718d-451d-a643-7b43d1ea6cf3 May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:13:59.635007 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3a1772c3-718d-451d-a643-7b43d1ea6cf3 May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3a1772c3-718d-451d-a643-7b43d1ea6cf3 May 10 02:13:59.636297 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.638975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fee1b2a2-3e4a-4481-9440-e0e39d39e9e0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 400 to user: This rule already exists in group 3a1772c3-718d-451d-a643-7b43d1ea6cf3 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:59.640166 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fee1b2a2-3e4a-4481-9440-e0e39d39e9e0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.071233 May 10 02:13:59.644066 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 473/904] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:13:59 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:13:59.649117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.650587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: 41e0f3f6-cf67-49e7-9ed5-916920dda8f3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.657894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.658361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.659188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.659642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.674871 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 HTTP/1.1 May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:13:59.675822 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.677094 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '41e0f3f6-cf67-49e7-9ed5-916920dda8f3'} May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:59.681500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. May 10 02:13:59.682820 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.683871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance 41e0f3f6-cf67-49e7-9ed5-916920dda8f3 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:59.683871 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e73d373-ccd3-4230-9dce-a2b2cfe181ad tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3" status: 404 len: 111 microversion: 2.1 time: 0.032040 May 10 02:13:59.683871 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 474/905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/41e0f3f6-cf67-49e7-9ed5-916920dda8f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:59.683871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a38c4180-d0c4-4a23-a180-26df8804648f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d37a09ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.806339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:13:59.814471 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6d428af1-b3fe-4a15-832e-0f0dec08d4f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.207228 May 10 02:13:59.815047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 432/906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:13:59.819523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.820131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.828111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.828568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.829347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.829783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.900120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a38c4180-d0c4-4a23-a180-26df8804648f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/b2e4f2a5-844a-4c50-a26f-25add65b0ff6" status: 202 len: 0 microversion: 2.1 time: 0.220966 May 10 02:13:59.900883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 475/907] 10.222.0.52 () {58 vars in 1286 bytes} [Tue May 10 02:13:59 2022] DELETE /compute/v2.1/os-security-group-rules/b2e4f2a5-844a-4c50-a26f-25add65b0ff6 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:13:59.906314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.907033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.913457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.914117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.914901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.915542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.930158 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 HTTP/1.1 May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:13:59.932109 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:59.933620 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'eb619058-700d-4b0a-8b3e-9c3c845c4538'} May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:13:59.934467 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:13:59.935803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:13:59.937140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:13:59.937140 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc495f65-0a73-40d4-8f3b-bd0a1248e5bd tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 404 len: 111 microversion: 2.1 time: 0.031767 May 10 02:13:59.937282 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 476/908] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:13:59 2022] DELETE /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:13:59.942607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:13:59.943397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:13:59.949687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.950156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:13:59.950946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:13:59.951498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.007642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:00.014960 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e10d76b-7783-4fc8-92d0-c3d77b5071eb tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.198965 May 10 02:14:00.015591 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 433/909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:00.022490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1184e072-8587-412b-a39f-71dedde21c32 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d377971f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1710670878", "description": "tempest-description-345228804"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:00.125684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:00.133166 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1847d693-d191-4e07-b04a-c5e0ca400fe7 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.194345 May 10 02:14:00.133852 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 477/910] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:13:59 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:00.138332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:00.139059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] [instance: eb619058-700d-4b0a-8b3e-9c3c845c4538] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:00.145647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.146251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.147160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.147610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.161435 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] HTTP exception thrown: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Request method failure captured: May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 HTTP/1.1 May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnDSre8Q1vTd0b8i3a5nRMCJPuDTBStF5b4IzjLIfqRERlfVqCgpWu9rr3csbXS-d_YhJycRi6LV_PK9VKtMiPd98JaoqjhiILf5tXzo2QAjKxTUPyo9PO4VFnd6kmO8W8Rzf_eM5gQXGYZaj6XibWutFliNW9O_KrNfZMyWcXcPCc May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:00.163156 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28a9f22674ee4e27ad7c42db55473a93", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28a9f22674ee4e27ad7c42db55473a93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 28a9f22674ee4e27ad7c42db55473a93 May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300 May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 6587868068d641b88a68acaeff886cd9 May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-165287300-project May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:14:00.164681 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'eb619058-700d-4b0a-8b3e-9c3c845c4538'} May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:00.165602 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. May 10 02:14:00.167118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.168489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] Returning 404 to user: Instance eb619058-700d-4b0a-8b3e-9c3c845c4538 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:00.168489 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e6f9803-0486-4bef-9a7a-5d52372fb5f1 tempest-ServersWithSpecificFlavorTestJSON-165287300 tempest-ServersWithSpecificFlavorTestJSON-165287300-project] 10.222.0.52 "GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538" status: 404 len: 111 microversion: 2.1 time: 0.029707 May 10 02:14:00.168489 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 478/911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:00 2022] GET /compute/v2.1/servers/eb619058-700d-4b0a-8b3e-9c3c845c4538 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:00.173056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1093320480"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:00.174188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:00.180689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.181149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.181943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.182390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.213560 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1184e072-8587-412b-a39f-71dedde21c32 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.195036 May 10 02:14:00.216733 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 434/912] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:00.230964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2b05e8d-0f50-473a-95e9-9734fd364bc0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d37629040>, body: {"security_group_rule": {"parent_group_id": "33d924ba-8b94-4cae-9f69-1a61e3d6bc12", "ip_protocol": "tcp", "from_port": 1198350267, "to_port": 22}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:00.307482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a2b05e8d-0f50-473a-95e9-9734fd364bc0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Invalid port range 1198350267:22. Former value cannot be greater than the later May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2b05e8d-0f50-473a-95e9-9734fd364bc0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 146 May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:14:00.309874 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: {"security_group_rule": {"parent_group_id": "33d924ba-8b94-4cae-9f69-1a61e3d6bc12", "ip_protocol": "tcp", "from_port": 1198350267, "to_port": 22}} May 10 02:14:00.311486 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid port range 1198350267:22. Former value cannot be greater than the later May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'security_group_rule': {'parent_group_id': '33d924ba-8b94-4cae-9f69-1a61e3d6bc12', 'ip_protocol': 'tcp', 'from_port': 1198350267, 'to_port': 22}}} May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1198350267:22. Former value cannot be greater than the later May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.312925 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1198350267:22. Former value cannot be greater than the later May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1198350267:22. Former value cannot be greater than the later May 10 02:14:00.314317 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:00.315710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2b05e8d-0f50-473a-95e9-9734fd364bc0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 400 to user: Invalid port range 1198350267:22. Former value cannot be greater than the later {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:00.315710 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a2b05e8d-0f50-473a-95e9-9734fd364bc0 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.089830 May 10 02:14:00.321630 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 435/913] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:14:00 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:14:00.323663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:00.327394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:00.342437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.344738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.345618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.348838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.487299 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bb12cfc2-6238-4207-8fea-373e6c263bb9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action" status: 202 len: 0 microversion: 2.1 time: 0.317558 May 10 02:14:00.488559 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 479/914] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:00 2022] POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:14:00.501108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-216ba18a-390b-421d-9ccd-78f90a81cf42 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d374c58b0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-535500784", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:00.507008 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-216ba18a-390b-421d-9ccd-78f90a81cf42 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Security group id should be uuid May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-216ba18a-390b-421d-9ccd-78f90a81cf42 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 130 May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:00.517362 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-535500784", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:14:00.519104 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group id should be uuid May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-535500784', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:00.520041 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 10 02:14:00.521562 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.523866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-216ba18a-390b-421d-9ccd-78f90a81cf42 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 400 to user: Security group id should be uuid {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:00.526552 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-216ba18a-390b-421d-9ccd-78f90a81cf42 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.036661 May 10 02:14:00.531013 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 480/915] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:14:00 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:14:00.544399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1543230466"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:00.545814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:00.557112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.558165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.559399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.560171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.612802 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Cannot 'createImage' instance 70be7911-c078-4bad-91e9-b38423508afa while it is in task_state image_snapshot_pending May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action HTTP/1.1 May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 85 May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:00.614782 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1543230466"}} May 10 02:14:00.616106 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: exception: Cannot 'createImage' instance 70be7911-c078-4bad-91e9-b38423508afa while it is in task_state image_snapshot_pending May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1543230466'}}} May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 70be7911-c078-4bad-91e9-b38423508afa in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:00.616888 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 70be7911-c078-4bad-91e9-b38423508afa while it is in task_state image_snapshot_pending May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 70be7911-c078-4bad-91e9-b38423508afa while it is in task_state image_snapshot_pending May 10 02:14:00.617998 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:00.620906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 409 to user: Cannot 'createImage' instance 70be7911-c078-4bad-91e9-b38423508afa while it is in task_state image_snapshot_pending {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:00.622042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a61b1e7-8b69-46f4-be78-0b30cf2699f3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action" status: 409 len: 167 microversion: 2.1 time: 0.089718 May 10 02:14:00.626737 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 481/916] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:00 2022] POST /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa/action => generated 167 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:14:00.631961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fef4f502-3d74-4aee-ae2f-b8c6d6616b66 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d376f6af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-759461191", "description": "tempest-description-2137803292"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:00.867528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:00.890880 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8625e96d-44ae-428d-b522-a43770981584 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1929 microversion: 2.75 time: 0.573467 May 10 02:14:00.892581 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 436/917] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:00 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1929 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:00.910222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:00.910927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:00.925036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.925651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:00.929599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:00.930335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:01.155387 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fef4f502-3d74-4aee-ae2f-b8c6d6616b66 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.527072 May 10 02:14:01.157172 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 482/918] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:01.170277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-08c1bcb9-751c-4f46-9c4d-b5f63080e13e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '.version_select at 0x7f3d3798d940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:01.182379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:01.191415 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dad35978-ff24-4de1-9fd2-70093f6f6dc3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.297485 May 10 02:14:01.200622 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 437/919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:00 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:01.200622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:01.200622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:01.204247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:01.204825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:01.205904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:01.206510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:01.347129 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-08c1bcb9-751c-4f46-9c4d-b5f63080e13e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/images/41220bf0-5575-4683-9d28-15bd64fee6ba" status: 204 len: 0 microversion: 2.1 time: 0.187740 May 10 02:14:01.350587 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 483/920] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:01 2022] DELETE /compute/v2.1/images/41220bf0-5575-4683-9d28-15bd64fee6ba => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:01.356003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b92cba9-8ca6-4be5-bbe6-51fc02d80d04 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d374d6700>, body: {"security_group_rule": {"parent_group_id": "4308e0de-62df-4cf7-afd1-407f466e9d41", "ip_protocol": "tempest-999-91217971", "from_port": 22, "to_port": 22}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:01.414538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:01.425682 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-3b92cba9-8ca6-4be5-bbe6-51fc02d80d04 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Invalid IP protocol tempest-999-91217971. May 10 02:14:01.427003 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b3f7d72d-463b-4d43-9488-699d0c56996f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.233269 May 10 02:14:01.428205 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 438/921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:01 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b92cba9-8ca6-4be5-bbe6-51fc02d80d04 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 155 May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:01.434344 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: {"security_group_rule": {"parent_group_id": "4308e0de-62df-4cf7-afd1-407f466e9d41", "ip_protocol": "tempest-999-91217971", "from_port": 22, "to_port": 22}} May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:14:01.435859 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid IP protocol tempest-999-91217971. May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4308e0de-62df-4cf7-afd1-407f466e9d41', 'ip_protocol': 'tempest-999-91217971', 'from_port': 22, 'to_port': 22}}} May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-91217971. May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:01.436813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-91217971. May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-91217971. May 10 02:14:01.438282 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:01.439393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b92cba9-8ca6-4be5-bbe6-51fc02d80d04 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 400 to user: Invalid IP protocol tempest-999-91217971. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:01.439393 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b92cba9-8ca6-4be5-bbe6-51fc02d80d04 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.087416 May 10 02:14:01.439393 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 484/922] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:14:01 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:14:01.441807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:01.444630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:01.454396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c468f02b-6774-4c4a-8fba-60c611dc767b tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d37da3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-171257549", "description": "tempest-description-1956822115"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:01.460036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:01.462328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:01.463168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:01.463705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:01.697787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:01.709981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eee4ae4c-4e42-446c-a0df-07bfff34d538 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1532 microversion: 2.1 time: 0.280279 May 10 02:14:01.712579 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 439/923] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:01 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1532 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:01.741514 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c468f02b-6774-4c4a-8fba-60c611dc767b tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.298512 May 10 02:14:01.742480 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 485/924] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:01.759957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0203ee7f-2733-482b-be11-16f110319f85 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d378f5d30>, body: {"security_group_rule": {"parent_group_id": "3a349f04-9f82-4d4a-996d-2abbb37f2eaa", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:01.820550 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0203ee7f-2733-482b-be11-16f110319f85 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0203ee7f-2733-482b-be11-16f110319f85 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 138 May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:14:01.822113 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: {"security_group_rule": {"parent_group_id": "3a349f04-9f82-4d4a-996d-2abbb37f2eaa", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 10 02:14:01.823432 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3a349f04-9f82-4d4a-996d-2abbb37f2eaa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:01.824155 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 10 02:14:01.830249 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:01.831353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0203ee7f-2733-482b-be11-16f110319f85 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:01.831353 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0203ee7f-2733-482b-be11-16f110319f85 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.071679 May 10 02:14:01.831353 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 440/925] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:14:01 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:14:01.834294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2f1e8a8-837a-47e3-926b-fa6e40bb0bc7 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d3780fa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1198496433", "description": "tempest-description-1723170236"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:01.911925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:01.912837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:01.927527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:01.928434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:01.929421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:01.942397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:02.183946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2f1e8a8-837a-47e3-926b-fa6e40bb0bc7 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.353863 May 10 02:14:02.190830 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 486/926] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:01 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:02.200025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56b2776e-192f-47a1-bd15-effdcdfb0e6e tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d376dd3a0>, body: {"security_group_rule": {"parent_group_id": "649c69c4-9f40-4459-bf03-c3828ad04b80", "ip_protocol": "tcp", "from_port": 22, "to_port": 1841933040}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:02.211984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:02.267622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e351d463-5e0f-4300-855b-e967032a5e7a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1935 microversion: 2.75 time: 0.360630 May 10 02:14:02.268211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 441/927] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:01 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1935 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:02.279320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:02.279946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:02.295703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:02.296308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:02.297176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:02.297621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:02.363707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-56b2776e-192f-47a1-bd15-effdcdfb0e6e tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Invalid port range 22:1841933040. Valid TCP ports should be between 1-65535 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56b2776e-192f-47a1-bd15-effdcdfb0e6e tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 146 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:02.365237 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: {"security_group_rule": {"parent_group_id": "649c69c4-9f40-4459-bf03-c3828ad04b80", "ip_protocol": "tcp", "from_port": 22, "to_port": 1841933040}} May 10 02:14:02.366848 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid port range 22:1841933040. Valid TCP ports should be between 1-65535 May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'security_group_rule': {'parent_group_id': '649c69c4-9f40-4459-bf03-c3828ad04b80', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1841933040}}} May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1841933040. Valid TCP ports should be between 1-65535 May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:02.367749 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1841933040. Valid TCP ports should be between 1-65535 May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1841933040. Valid TCP ports should be between 1-65535 May 10 02:14:02.369020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.371913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56b2776e-192f-47a1-bd15-effdcdfb0e6e tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 400 to user: Invalid port range 22:1841933040. Valid TCP ports should be between 1-65535 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:02.371913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56b2776e-192f-47a1-bd15-effdcdfb0e6e tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.171422 May 10 02:14:02.371913 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 487/928] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:14:02 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:14:02.376827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Action: 'create', calling method: .version_select at 0x7f3d37840670>, body: {"security_group_rule": {"parent_group_id": "ce2ead57-fe66-4a95-b1cb-2f28ff36f788", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:02.412529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:14:02.413146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Neutron security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:14:02.413681 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.413681 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 138 May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:02.415583 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: {"security_group_rule": {"parent_group_id": "ce2ead57-fe66-4a95-b1cb-2f28ff36f788", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 10 02:14:02.417111 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ce2ead57-fe66-4a95-b1cb-2f28ff36f788', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:14:02.417965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 10 02:14:02.419278 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] May 10 02:14:02.422193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 404 to user: Security group ce2ead57-fe66-4a95-b1cb-2f28ff36f788 does not exist May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-92120d8a-58a8-49f2-a1b3-78579d704bea'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:02.423813 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2b48c4ab-930a-49da-b0e3-1dc12f4d6307 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.044380 May 10 02:14:02.424769 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 488/929] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:14:02 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:02.426258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d374c5c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:02.467762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:14:02.468358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Neutron security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 not found {{(pid=118716) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 10 02:14:02.469434 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] HTTP exception thrown: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.469434 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Request method failure captured: May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-security-group-rules/a6848a81-ea47-4e82-9fd0-091ede4f8622 HTTP/1.1 May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpmcl65SSUG9nTTPOiJdFT8Qge-47YgKGokh4J3BMEZXghPwzaX-Z0nhSsXsyZly_8NYjMZJIKpYtSDFSHsY_UrqxmPz08ERdI1sHsG3yZowlIr6EsRaUsGStXhcVY0BNIvTv3faqxhN8n-YTUysWCaUHF3-e-5PTvEQgjSy0mbCLQ May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:02.471737 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_56040ddcde464ed48baccc194f8ee7f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/56040ddcde464ed48baccc194f8ee7f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 56040ddcde464ed48baccc194f8ee7f1 May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415 May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3c5427d6837b466187462d3981db0b12 May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.473246 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'a6848a81-ea47-4e82-9fd0-091ede4f8622'} May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.474131 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 10 02:14:02.475572 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.477927 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Returning 404 to user: Security group rule a6848a81-ea47-4e82-9fd0-091ede4f8622 does not exist May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-c1b1b7ff-6501-46b3-825e-d4db87799b5f'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:02.479471 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7b792c81-9939-432b-840e-c99c4beef38f tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/a6848a81-ea47-4e82-9fd0-091ede4f8622" status: 404 len: 199 microversion: 2.1 time: 0.051094 May 10 02:14:02.480566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 489/930] 10.222.0.52 () {58 vars in 1286 bytes} [Tue May 10 02:14:02 2022] DELETE /compute/v2.1/os-security-group-rules/a6848a81-ea47-4e82-9fd0-091ede4f8622 => generated 199 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:02.485726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:02.487009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:02.503750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:02.504211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:02.505019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:02.505466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:02.802676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:02.817120 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-390d0d7a-86ab-475d-b491-503372e41852 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.547830 May 10 02:14:02.818429 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 442/931] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:02 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:02.827560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0bfb7c17-dca0-4ee9-8440-2626e4ceca18 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d37796ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:02.937473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:02.945982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46b52279-5138-4dc3-9e3f-fa6323579d8b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.466296 May 10 02:14:02.958762 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 490/932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:02 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:02.973695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:02.974615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:02.989825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:02.990311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:02.991195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:02.991641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:03.406519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:03.413437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0bfb7c17-dca0-4ee9-8440-2626e4ceca18 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/649c69c4-9f40-4459-bf03-c3828ad04b80" status: 202 len: 0 microversion: 2.1 time: 0.593511 May 10 02:14:03.414375 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 443/933] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:02 2022] DELETE /compute/v2.1/os-security-groups/649c69c4-9f40-4459-bf03-c3828ad04b80 => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:03.419978 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3d239ff1-4d7a-4db3-85d4-24028e59886d tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1538 microversion: 2.1 time: 0.459729 May 10 02:14:03.420570 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 491/934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:02 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1538 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:03.422423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:03.423405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:03.436421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:03.439428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:03.441005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:03.443698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:03.448546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c718b81-6f33-4146-b369-efbbd275abd8 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d376f6af0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:03.664494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:03.692821 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6d58eb92-be29-427f-af44-dfad94aaac02 tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1935 microversion: 2.75 time: 0.272313 May 10 02:14:03.705311 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 444/935] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:03 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1935 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:03.834367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:03.836326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:03.849292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:03.850102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:03.851209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:03.851881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:03.938530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c718b81-6f33-4146-b369-efbbd275abd8 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3a349f04-9f82-4d4a-996d-2abbb37f2eaa" status: 202 len: 0 microversion: 2.1 time: 0.512557 May 10 02:14:03.939147 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 492/936] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:03 2022] DELETE /compute/v2.1/os-security-groups/3a349f04-9f82-4d4a-996d-2abbb37f2eaa => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:03.948191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6cf1ecb-24ed-466d-8370-9889eadd58cd tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d372a5670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:04.186432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:04.212891 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f26fc7b-4528-46cf-8278-e859fd6f9a01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.378087 May 10 02:14:04.214025 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 445/937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:03 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:04.237498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:04.238972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:04.263913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:04.264933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:04.267487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:04.268296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:04.565000 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f6cf1ecb-24ed-466d-8370-9889eadd58cd tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/4308e0de-62df-4cf7-afd1-407f466e9d41" status: 202 len: 0 microversion: 2.1 time: 0.619219 May 10 02:14:04.566524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 493/938] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:03 2022] DELETE /compute/v2.1/os-security-groups/4308e0de-62df-4cf7-afd1-407f466e9d41 => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:04.571855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:04.572880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:04.595556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:04.610174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:04.611437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:04.612066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:04.679635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:04.688046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2faa4ca6-1863-458e-863a-b4af25eb59a2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.470957 May 10 02:14:04.697818 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 446/939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:04 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:04.704678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72b21df6-f817-49a6-ac98-14968c126c5b tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d37108310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.150878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:05.167530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fec0bb9c-2d1e-4999-914b-b7db081774e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1520 microversion: 2.1 time: 0.599728 May 10 02:14:05.168356 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 494/940] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:04 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1520 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:05.173000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.173796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:05.184587 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72b21df6-f817-49a6-ac98-14968c126c5b tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/33d924ba-8b94-4cae-9f69-1a61e3d6bc12" status: 202 len: 0 microversion: 2.1 time: 0.488976 May 10 02:14:05.185183 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 447/941] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:04 2022] DELETE /compute/v2.1/os-security-groups/33d924ba-8b94-4cae-9f69-1a61e3d6bc12 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:05.190168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.190677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:05.196457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.197264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.199661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.201141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.208779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.208779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.209476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.210143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.268169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:14:05.344353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] Lazy-loading 'services' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:05.380432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0cbcf48-6811-4a44-bb5d-be2b689c608a tempest-ServersAdmin275Test-1184010635 tempest-ServersAdmin275Test-1184010635-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1920 microversion: 2.75 time: 0.210787 May 10 02:14:05.382053 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 495/942] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:05 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1920 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:05.410745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-424486b4-427f-4210-a362-d42c4a817884 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] Calling method '.version_select at 0x7f3d372b3b80>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.429031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07ce76ea-8e33-4fcc-a223-224f72efd957 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 204 len: 0 microversion: 2.1 time: 0.242144 May 10 02:14:05.429815 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 448/943] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:14:05 2022] DELETE /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:05.459913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fe2bb2d3-1637-466e-8606-5f0ee20bb75c req-a277aa4e-a276-4f2b-9d7e-737726bcc1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70be7911-c078-4bad-91e9-b38423508afa", "name": "network-vif-plugged", "status": "completed", "tag": "0933a744-bdb6-4579-9074-890b7a0087b0"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:05.468195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fe2bb2d3-1637-466e-8606-5f0ee20bb75c req-a277aa4e-a276-4f2b-9d7e-737726bcc1e0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.468681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fe2bb2d3-1637-466e-8606-5f0ee20bb75c req-a277aa4e-a276-4f2b-9d7e-737726bcc1e0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.502007 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fe2bb2d3-1637-466e-8606-5f0ee20bb75c req-a277aa4e-a276-4f2b-9d7e-737726bcc1e0 service nova] Creating event network-vif-plugged:0933a744-bdb6-4579-9074-890b7a0087b0 for instance 70be7911-c078-4bad-91e9-b38423508afa on n-h2-841089-2 May 10 02:14:05.508263 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fe2bb2d3-1637-466e-8606-5f0ee20bb75c req-a277aa4e-a276-4f2b-9d7e-737726bcc1e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077127 May 10 02:14:05.511830 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 449/944] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:05.517900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.518806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:05.525558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.526190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.526958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.527424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.805361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:05.816840 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e4e58027-6104-4924-a5ff-725b3633aff4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.303589 May 10 02:14:05.818134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 450/945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:05 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:05.824904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.825697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:05.832849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.833609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.835133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.835820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.865035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:14:05.937169 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-424486b4-427f-4210-a362-d42c4a817884 tempest-SecurityGroupRulesNegativeTestJSON-1673560415 tempest-SecurityGroupRulesNegativeTestJSON-1673560415-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3a1772c3-718d-451d-a643-7b43d1ea6cf3" status: 202 len: 0 microversion: 2.1 time: 0.536258 May 10 02:14:05.939428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 496/946] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:05 2022] DELETE /compute/v2.1/os-security-groups/3a1772c3-718d-451d-a643-7b43d1ea6cf3 => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:05.945761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:05.946685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:05.955547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.956314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:05.957372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:05.958041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:06.020846 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f34369ba-143c-495f-b0b6-2fd2b142603a tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 204 len: 0 microversion: 2.75 time: 0.200771 May 10 02:14:06.021867 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 451/947] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:14:05 2022] DELETE /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:14:06.026996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:06.027762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:06.034677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:06.034677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:06.035499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:06.035942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:06.312526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:06.321286 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a38931ee-6f33-46d0-81da-ade8bd264686 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.298421 May 10 02:14:06.323642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:06.333353 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 452/948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:06 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:06.334222 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb717a8f-2a29-41c1-aaae-1f084744b337 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1526 microversion: 2.1 time: 0.393462 May 10 02:14:06.338899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:06.339858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:06.345464 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 497/949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:05 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1526 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:06.350348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:06.350807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:06.351639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:06.352197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:06.442466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:06.451727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:06.453794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:06.472843 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7face31-dbef-425b-9a78-b6cc984b199c tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1444 microversion: 2.75 time: 0.137714 May 10 02:14:06.473406 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 453/950] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:06 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:06.836341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:06.837014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:06.849553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:06.850263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:06.856727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:06.858182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.269918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:07.277451 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-110ec927-3235-45f9-aeea-415ba432ed21 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.447476 May 10 02:14:07.278421 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 498/951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:06 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:07.342217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:07.344035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:07.351849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:07.352573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:07.354936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.355574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.356506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.357169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.361610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.362085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.365575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.366216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.670169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:07.682417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-11ab2d22-51de-47f1-b563-0c30d05cb77e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.346064 May 10 02:14:07.690429 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 454/952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:07 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:07.696039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:07.696649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:07.716328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.716715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.717493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.718106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.851355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:07.856699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:07.874591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:07.877130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2bc55e1b-5807-40dc-bee1-84ab3f30a3e5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1526 microversion: 2.1 time: 0.529730 May 10 02:14:07.881722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:07.882684 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 499/953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:07 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1526 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:07.898842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:07.899530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:07.906249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aeebe1da-e81d-4b0d-a98e-e34b6d8af455 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1444 microversion: 2.75 time: 0.211908 May 10 02:14:07.910388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 455/954] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:07 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1444 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:07.916201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.916872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:07.917865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:07.918642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.101404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-817968d3-9cf1-4fdf-b894-e142ecce51db req-a503363c-0a7b-4cda-b9b8-f230eb7e02ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70be7911-c078-4bad-91e9-b38423508afa", "name": "network-vif-deleted", "tag": "0933a744-bdb6-4579-9074-890b7a0087b0"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:08.113760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-817968d3-9cf1-4fdf-b894-e142ecce51db req-a503363c-0a7b-4cda-b9b8-f230eb7e02ff service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.114450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-817968d3-9cf1-4fdf-b894-e142ecce51db req-a503363c-0a7b-4cda-b9b8-f230eb7e02ff service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.128636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-817968d3-9cf1-4fdf-b894-e142ecce51db req-a503363c-0a7b-4cda-b9b8-f230eb7e02ff service nova] Creating event network-vif-deleted:0933a744-bdb6-4579-9074-890b7a0087b0 for instance 70be7911-c078-4bad-91e9-b38423508afa on n-h2-841089-2 May 10 02:14:08.137295 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-817968d3-9cf1-4fdf-b894-e142ecce51db req-a503363c-0a7b-4cda-b9b8-f230eb7e02ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038024 May 10 02:14:08.139164 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 456/955] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:14:08.319009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:08.321869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:08.348149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.350104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.352638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.361663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.417408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 2caaf280-a323-44ef-a538-116e02a6af60 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:08.434697 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a24de620-0e7a-49f1-b564-398fbf1bd2ba tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 2129 microversion: 2.25 time: 0.549874 May 10 02:14:08.435800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 500/956] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:07 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 2129 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:08.453409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-841089-2", "block_migration": "auto"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:08.454589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:08.482304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.482772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.483738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.484084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.534726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'flavor' on Instance uuid 2caaf280-a323-44ef-a538-116e02a6af60 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:08.572338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Going to try to live migrate instance to n-h2-841089-2 {{(pid=118716) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:14:08.698197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:08.708299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd3bc45a-0e61-4d3c-bf67-fbd4f6a39702 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.416519 May 10 02:14:08.721875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 457/957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:08 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:08.741047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:08.743245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:08.760401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.764379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:08.766131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:08.767649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.053140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:09.060412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b6fe99a9-b975-461a-a944-5025aa354166 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1471 microversion: 2.1 time: 0.337119 May 10 02:14:09.063515 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 458/958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:08 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:09.071155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:09.071778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:09.105689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.107744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.111172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.111876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.240180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.241518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.241998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lazy-loading 'fault' on Instance uuid 70be7911-c078-4bad-91e9-b38423508afa {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:09.310246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:09.322501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d96aece-a2bc-408b-969e-176d64adf84b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 200 len: 1315 microversion: 2.1 time: 0.254453 May 10 02:14:09.323190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 459/959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:09 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:09.337129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:09.337744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:09.355647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.358197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.360129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.362747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.440796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.441542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.442190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lazy-loading 'fault' on Instance uuid 1385e126-5412-4324-8bbc-02bba9711d3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:09.499925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:09.512643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:09.516440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b722dd005e334220877adb60b3cab8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '854f6b356f3141509a3b05f8b2e1d006', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:09.527797 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e1e29c4-efe5-4b3d-8e2a-9cf31094d1cd tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 200 len: 1449 microversion: 2.75 time: 0.203512 May 10 02:14:09.541000 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 460/960] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:09 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 1449 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:09.727813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:09.728663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:09.739779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.741656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:09.746326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:09.747220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.106537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:10.115616 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5617e967-8e3c-4085-931b-97381c2ee037 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.392310 May 10 02:14:10.129992 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 461/961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:09 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:10.140506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:10.142054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:10.151943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:10.154065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.156649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:10.160256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.468195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:10.476916 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-48821135-a0bb-4024-8399-1dc74bf88649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1477 microversion: 2.1 time: 0.345543 May 10 02:14:10.488717 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 462/962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:10 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1477 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:10.496792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:10.498336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:10.505733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:10.507654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.508864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:10.509479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.536758 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa HTTP/1.1 May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:14:10.538691 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:14:10.540325 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa'} May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:10.541054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:14:10.542211 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.549507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:10.550402 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50a3bc49-7a11-41f1-948b-b4ee391c195e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 404 len: 111 microversion: 2.1 time: 0.060461 May 10 02:14:10.559339 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 463/963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:10 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:10.564887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:10.565735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] [instance: 1385e126-5412-4324-8bbc-02bba9711d3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:10.572351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:10.573299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.574839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:10.575482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:10.603917 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] HTTP exception thrown: Instance 1385e126-5412-4324-8bbc-02bba9711d3a could not be found. May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Request method failure captured: May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a HTTP/1.1 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecoUJpLPDyJvd5VcfoeLUxxyzLaDm7NJ7Jmgcv9uEhdC6ANeQJgmv0Z7vCUcH8MrVW7Jd3GjSzbWMk0MwLNccnjkT1EckfvjSsysEjxNGSK2MiA1q2EvzXeNkT2uZTKdk2IAXcQYSC-aPpOqS9IWf_JRVfTg0RW_9C3m5HnWyv_QJME May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.75 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 854f6b356f3141509a3b05f8b2e1d006 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersAdmin275Test-1507283127 May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:14:10.608938 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_854f6b356f3141509a3b05f8b2e1d006", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/854f6b356f3141509a3b05f8b2e1d006"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/854f6b356f3141509a3b05f8b2e1d006"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/854f6b356f3141509a3b05f8b2e1d006"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersAdmin275Test-1507283127 May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 854f6b356f3141509a3b05f8b2e1d006 May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersAdmin275Test-1507283127 May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersAdmin275Test-1507283127-project May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b722dd005e334220877adb60b3cab8e8 May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersAdmin275Test-1507283127-project May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1385e126-5412-4324-8bbc-02bba9711d3a could not be found. May 10 02:14:10.610614 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1385e126-5412-4324-8bbc-02bba9711d3a'} May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1385e126-5412-4324-8bbc-02bba9711d3a could not be found. May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:10.611476 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1385e126-5412-4324-8bbc-02bba9711d3a could not be found. May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1385e126-5412-4324-8bbc-02bba9711d3a could not be found. May 10 02:14:10.612610 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:10.613648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] Returning 404 to user: Instance 1385e126-5412-4324-8bbc-02bba9711d3a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:10.617547 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2acad94d-e7d1-4cd0-9536-ce6ba231fd59 tempest-ServersAdmin275Test-1507283127 tempest-ServersAdmin275Test-1507283127-project] 10.222.0.52 "GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a" status: 404 len: 111 microversion: 2.75 time: 0.054020 May 10 02:14:10.618501 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 464/964] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:10 2022] GET /compute/v2.1/servers/1385e126-5412-4324-8bbc-02bba9711d3a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:14:10.649598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfc062ce-6879-4541-a4c3-31536dc0f54a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'create', calling method: .version_select at 0x7f3d371399d0>, body: {"keypair": {"name": "tempest-keypair-1820328996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLSrAd01xXZ2PmVyFBmh0siQzt1EjYIvdy/9thKzbNtrzNyK9jUB+jLrD/IYwzcJViDz7vmME5RnwDqg/aozKU8AHkezeL+ieCdmzQX59VvUHdIuJcTc5Qs6KCMIN9S0g=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:10.678927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cfc062ce-6879-4541-a4c3-31536dc0f54a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:10.685102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cfc062ce-6879-4541-a4c3-31536dc0f54a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for user fa657ea59867462a91093cea627895f8 and project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:10.724965 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfc062ce-6879-4541-a4c3-31536dc0f54a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104236 May 10 02:14:10.727805 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 465/965] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:14:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:11.254152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-998840469", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:11.330535 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5418572-7cec-4506-830f-6ca17c06746a tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/action" status: 202 len: 0 microversion: 2.25 time: 2.881366 May 10 02:14:11.334546 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 501/966] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:14:08 2022] POST /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/action => generated 0 bytes in 2883 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:11.337421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:11.339579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:11.369467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:11.369946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:11.380274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:11.380811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:11.399185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:11.834259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:11.845008 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54d13e6f-d907-41c5-b292-7fa386120c81 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.512177 May 10 02:14:11.845711 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 502/967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:11 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:11.859770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:11.860654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:11.875632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:11.876097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:11.876903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:11.883269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.408416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:12.408894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:12.409344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:12.409766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:12.410193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:12.418598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:12.444026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:12.446568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:12.453210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:12.453820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.455809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:12.457866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.458093 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-825b07a2-ef68-41d5-816d-d57982b92b85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.604905 May 10 02:14:12.459350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 503/968] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:11 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:12.474660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:12.476387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:12.492598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:12.494805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.497893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:12.500243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.512717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:12.524523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:12.571091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:12.574349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:12.647203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-948abfbb-b007-4c6c-b9f5-3730339e293c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604748 May 10 02:14:12.648375 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 466/969] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:14:12.662393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33f73451-27c9-4c94-a3ac-600f79d37bd4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:12.663026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33f73451-27c9-4c94-a3ac-600f79d37bd4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:12.783330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33f73451-27c9-4c94-a3ac-600f79d37bd4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:12.790028 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33f73451-27c9-4c94-a3ac-600f79d37bd4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1214 microversion: 2.1 time: 0.134814 May 10 02:14:12.791662 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 467/970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:12 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:12.861632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:12.862249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:12.869507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:12.869972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.870814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:12.875236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:12.921957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:12.944464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-834c7828-a976-4545-8d2a-7118a343dce9 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1477 microversion: 2.1 time: 0.483637 May 10 02:14:12.955660 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 504/971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:12 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:13.427687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:13.438170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-91941354-0765-466a-bc16-3c0dd063d2b7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.580311 May 10 02:14:13.441799 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 468/972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:12 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:13.477496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:13.478763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:13.488522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:13.492088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:13.493178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:13.495626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:13.807502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:13.808227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:13.818499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:13.819231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:13.820289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:13.820939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:13.926044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:13.942549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:13.949010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:13.953163 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f215a31-3def-4ef8-9dd4-76656fa6d783 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.478754 May 10 02:14:13.953774 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 505/973] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:13 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:13.960267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:13.971536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c509714f-0b51-4fee-8649-b588e2a08d47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1266 microversion: 2.1 time: 0.168498 May 10 02:14:13.972707 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 469/974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:13 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:13.994329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:13.997763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:14.021572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:14.022038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:14.022842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:14.023318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:14.458861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:14.459490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:14.477510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:14.481499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:14.483216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:14.486597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:14.542145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:14.556308 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc9d9c31-6080-4105-b013-f2a68673505f tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1477 microversion: 2.1 time: 0.580209 May 10 02:14:14.570159 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 506/975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:13 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1477 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:14.715790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1635610937", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:14.792846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:14.801481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-983f283e-9c30-4cb0-bf13-8d6a95dcc21d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.348991 May 10 02:14:14.812934 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 470/976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:14 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:14.824414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] validate_networks() for [('0d719d6b-b89f-4847-9aaf-10a99b24bfcf', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:14.981015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:14.982300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:15.022167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.024479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.036385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.036630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.488148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:15.500670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:15.504236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:15.509175 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89ca942b-8033-469a-809c-adde7d915ea0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.541275 May 10 02:14:15.510529 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 471/977] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:14 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:14:15.515821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:15.520480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:15.532290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.534247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.538113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.538908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.813733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:15.825323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:15.825819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:15.826222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:15.826854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b733825a-5a9d-4805-9735-77a3b8a8da37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.315153 May 10 02:14:15.827085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:15.828081 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 472/978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:15 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:15.828607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:15.833574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1a51ca57-09ef-422b-a2cd-6a78dff5c3d3 req-50cac155-9036-43b9-87ca-e91d783cc924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f14d520-8ca8-49ee-af8e-5c0b6a52b570", "name": "network-vif-plugged", "status": "completed", "tag": "3f95e3d9-24f4-4658-86c3-0e9a1abaf85d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:15.842457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1a51ca57-09ef-422b-a2cd-6a78dff5c3d3 req-50cac155-9036-43b9-87ca-e91d783cc924 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.842911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1a51ca57-09ef-422b-a2cd-6a78dff5c3d3 req-50cac155-9036-43b9-87ca-e91d783cc924 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.845775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.846242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.854187 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1a51ca57-09ef-422b-a2cd-6a78dff5c3d3 req-50cac155-9036-43b9-87ca-e91d783cc924 service nova] Creating event network-vif-plugged:3f95e3d9-24f4-4658-86c3-0e9a1abaf85d for instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 on n-h1-841089-2 May 10 02:14:15.857438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.859927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1a51ca57-09ef-422b-a2cd-6a78dff5c3d3 req-50cac155-9036-43b9-87ca-e91d783cc924 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030695 May 10 02:14:15.860532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.860733 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 473/979] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:15.866699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:15.867791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:15.885025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.886312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.887935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:15.888867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:15.909356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:15.915243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for user fa657ea59867462a91093cea627895f8 and project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:15.929134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:15.932095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:15.989176 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-489d1881-7af8-478d-b0ae-676080fe13dd tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.279248 May 10 02:14:15.990850 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 507/980] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:14:16.010684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:16.012435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:16.029817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:16.034310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:16.035291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:16.035753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:16.256933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:16.266144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49cb97fe-7b17-45c2-b84a-3546680b5439 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1477 microversion: 2.1 time: 0.404067 May 10 02:14:16.271271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 474/981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:15 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1477 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:16.281743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2073bd16-4c5c-420f-8863-c7e183e6b812 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:16.285545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2073bd16-4c5c-420f-8863-c7e183e6b812 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:16.438431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2073bd16-4c5c-420f-8863-c7e183e6b812 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:16.448578 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2073bd16-4c5c-420f-8863-c7e183e6b812 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1225 microversion: 2.1 time: 0.174029 May 10 02:14:16.449523 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 475/982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:16 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:16.527564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:16.528406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:16.532422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:16.549045 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b113fae-19a0-4be7-807b-5828e152c420 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.556901 May 10 02:14:16.549650 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 508/983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:15 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:16.552786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:16.553455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:16.554602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:16.555614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:16.824821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:16.836932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:16.839897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:16.841492 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33bba93a-67e2-4bbe-a3cd-416a54719064 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.317940 May 10 02:14:16.842911 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 476/984] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:16 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:14:16.862215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:16.866511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:16.876502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:16.880094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:16.881120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:16.883877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.010283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1398605101", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:17.071661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:17.114792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:17.130047 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7043f22c-03ed-4013-9ec0-f4bff2bb54be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.284581 May 10 02:14:17.143162 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 477/985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:16 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:17.217824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f44dc22c-eebf-45b1-bc50-faf28c191d5f tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1691418732", "id": 229203830, "os-flavor-access:is_public": "False"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:17.220531 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:17.220531 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:14:17.241680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f44dc22c-eebf-45b1-bc50-faf28c191d5f tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.097080 May 10 02:14:17.243229 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 478/986] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:17 2022] POST /compute/v2.1/flavors => generated 428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:17.248439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8365e326-a22d-4a20-88f8-2d8ee5c5ed57 req-44ef0282-4d95-468b-8c93-d43d63b2c4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5790707-188a-437e-b169-112129b41399", "tag": "5df4c9fe-577d-4d35-9a86-ff99b78bcebc"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:17.259494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8365e326-a22d-4a20-88f8-2d8ee5c5ed57 req-44ef0282-4d95-468b-8c93-d43d63b2c4b0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.260378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8365e326-a22d-4a20-88f8-2d8ee5c5ed57 req-44ef0282-4d95-468b-8c93-d43d63b2c4b0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.274101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8365e326-a22d-4a20-88f8-2d8ee5c5ed57 req-44ef0282-4d95-468b-8c93-d43d63b2c4b0 service nova] Creating event network-changed:5df4c9fe-577d-4d35-9a86-ff99b78bcebc for instance f5790707-188a-437e-b169-112129b41399 on n-h2-841089-2 May 10 02:14:17.284853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8365e326-a22d-4a20-88f8-2d8ee5c5ed57 req-44ef0282-4d95-468b-8c93-d43d63b2c4b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040121 May 10 02:14:17.285641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 479/987] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:17.290789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e216c78-c98d-4cee-b019-d810851b5b6e tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5e589e980ea349fb8c28d4d19014ef4b"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:17.292122 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:17.292122 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:14:17.320828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:17.321266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:17.321765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:17.322188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:17.322615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:17.335161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.335596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.336545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.337033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.367428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Getting quotas for project d1b2066e0b794483b3d7cf8aca6ad655. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:17.374133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Getting quotas for user f0951d520ac94a8f80efa1986944a0fc and project d1b2066e0b794483b3d7cf8aca6ad655. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:17.385478 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e216c78-c98d-4cee-b019-d810851b5b6e tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/229203830/action" status: 200 len: 96 microversion: 2.1 time: 0.098682 May 10 02:14:17.386102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 480/988] 10.222.0.52 () {60 vars in 1196 bytes} [Tue May 10 02:14:17 2022] POST /compute/v2.1/flavors/229203830/action => generated 96 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:14:17.392661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:17.395535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:17.398087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:17.401281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:17.428356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.432232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.433407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.436426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.478386 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4bf2888-6d00-46e6-9d8b-469865d036bf tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821534 May 10 02:14:17.481014 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 509/989] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:14:17.744156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bd4cfcf1-6c9d-468a-9bee-68748119106a tempest-FlavorsAccessTestJSON-1632109554 tempest-FlavorsAccessTestJSON-1632109554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:17.775229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:17.787444 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9d6b30b-56f6-43c9-a100-b5a8b36d822c tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1477 microversion: 2.1 time: 0.399920 May 10 02:14:17.793208 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bd4cfcf1-6c9d-468a-9bee-68748119106a tempest-FlavorsAccessTestJSON-1632109554 tempest-FlavorsAccessTestJSON-1632109554-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.305447 May 10 02:14:17.793711 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 481/990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:17 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:17.805819 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 510/991] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:14:17 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:17.809370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:17.814429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:17.820401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-647243d5-7f0f-4bb1-ac61-f332811559e4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:17.821131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-647243d5-7f0f-4bb1-ac61-f332811559e4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:17.830795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.832335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.833821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.835370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.948919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-647243d5-7f0f-4bb1-ac61-f332811559e4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:17.966603 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-647243d5-7f0f-4bb1-ac61-f332811559e4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1222 microversion: 2.1 time: 0.157655 May 10 02:14:17.967725 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 511/992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:17 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:17.972981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:17.973824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:17.981375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.982097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:17.983197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:17.984457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.008659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:18.031246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-471faef4-4223-44d3-97c0-663295874dbe tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1295 microversion: 2.1 time: 0.236051 May 10 02:14:18.034492 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 482/993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:17 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1295 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:18.052344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67d9f236-135b-46e1-95a1-9d4404748847 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5e589e980ea349fb8c28d4d19014ef4b"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:18.058612 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:18.058612 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:14:18.174774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67d9f236-135b-46e1-95a1-9d4404748847 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/229203830/action" status: 200 len: 21 microversion: 2.1 time: 0.128651 May 10 02:14:18.179243 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 483/994] 10.222.0.52 () {60 vars in 1196 bytes} [Tue May 10 02:14:18 2022] POST /compute/v2.1/flavors/229203830/action => generated 21 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:14:18.194121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.196136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:18.210859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:18.223153 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59a64f47-3c51-4ec6-b272-2573d88f8277 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.249994 May 10 02:14:18.225968 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 512/995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:17 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:18.226124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.226464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.227303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.227743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.233326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.234669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:18.251592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.253916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.256742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.257324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.838718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:18.849844 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c2c7f20-04c9-49f0-841a-923e72ca5893 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.623920 May 10 02:14:18.859278 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 513/996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:18 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:18.865243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b15e516a-4ebc-4b3d-889a-aa72a328ab68 tempest-FlavorsAccessTestJSON-1632109554 tempest-FlavorsAccessTestJSON-1632109554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.867855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:18.878229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:18.880644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:18.882421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-264723ce-31ee-414d-9d65-6a248076c8c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.701575 May 10 02:14:18.883155 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 484/997] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:18 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:18.888295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.889377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:18.896517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.897371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.898365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.899319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.905114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b15e516a-4ebc-4b3d-889a-aa72a328ab68 tempest-FlavorsAccessTestJSON-1632109554 tempest-FlavorsAccessTestJSON-1632109554-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044544 May 10 02:14:18.906257 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 514/998] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:14:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:18.919884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57c8c825-e94f-44c0-928c-5a86734c0158 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.920972 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:18.920972 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:14:18.940092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57c8c825-e94f-44c0-928c-5a86734c0158 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/229203830" status: 202 len: 0 microversion: 2.1 time: 0.023679 May 10 02:14:18.943194 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 515/999] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:14:18 2022] DELETE /compute/v2.1/flavors/229203830 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:18.949638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72023f9b-c828-4c2b-943a-f73bf79401ab tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.969645 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72023f9b-c828-4c2b-943a-f73bf79401ab tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023926 May 10 02:14:18.970641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 516/1000] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:14:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:18.986018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:18.986826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:18.993026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.993717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:18.994529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:18.994966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.118964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:19.128155 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a9843934-d5b2-44f1-80b4-c68c5983a7fb tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1274 microversion: 2.1 time: 0.146034 May 10 02:14:19.129019 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 517/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:18 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1274 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:19.133347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b6efb56-0f22-4f78-a50b-e5cc7265cfb3 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1050317782", "id": 765197568, "os-flavor-access:is_public": "False"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:19.134989 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:19.134989 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:14:19.159813 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b6efb56-0f22-4f78-a50b-e5cc7265cfb3 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.029722 May 10 02:14:19.166160 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 518/1002] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:19 2022] POST /compute/v2.1/flavors => generated 428 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:19.170790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.172353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.182035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.183096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.184138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.184800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.190990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:19.198684 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5d6d4d32-d8d5-4d84-8663-2fc5bc2fd59d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1463 microversion: 2.1 time: 0.314152 May 10 02:14:19.202011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 485/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:18 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1463 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:19.208012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ca27a65-4aad-4edc-8e0c-ece3af9be655 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.213174 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:19.213174 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:14:19.238246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ca27a65-4aad-4edc-8e0c-ece3af9be655 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/765197568/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.035109 May 10 02:14:19.240047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 486/1004] 10.222.0.52 () {58 vars in 1205 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/flavors/765197568/os-flavor-access => generated 21 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:14:19.251404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.252107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.258248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.258939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.259612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.262394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.290038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:19.299606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b4e40cf-c3b6-4aee-9ba0-59378696902f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1283 microversion: 2.1 time: 0.137634 May 10 02:14:19.300292 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 519/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:19.307278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.308311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.315176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.315642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.316431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.316879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.519036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:19.527520 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82d90d15-c76c-494b-bb39-8b212812f12d tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1463 microversion: 2.1 time: 0.285634 May 10 02:14:19.533617 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 487/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:19.540064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-216e59c1-7704-4048-8ea0-d42f4e6d1267 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.540898 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:19.540898 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:14:19.546770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:19.554530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed91a6a4-35d4-45d9-bfbb-c22eaaf82be8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1475 microversion: 2.1 time: 0.252574 May 10 02:14:19.555605 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 520/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:19.560051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-216e59c1-7704-4048-8ea0-d42f4e6d1267 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/765197568" status: 202 len: 0 microversion: 2.1 time: 0.025132 May 10 02:14:19.560845 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 488/1008] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:14:19 2022] DELETE /compute/v2.1/flavors/765197568 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:19.568593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0697cb5c-ab9c-4091-846f-7aec9bd0c331 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.571037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:19.572535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.578864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.579422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.580641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.581582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.588321 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0697cb5c-ab9c-4091-846f-7aec9bd0c331 tempest-FlavorsAccessTestJSON-361709207 tempest-FlavorsAccessTestJSON-361709207-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023279 May 10 02:14:19.589100 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 489/1009] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:19.664975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:19.665403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:19.665877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:19.666289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:19.666816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:19.736255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.742043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.742576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.743475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.743989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.769779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a16a80ab-23ef-485b-a247-47261d880fbe tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 1067 microversion: 2.1 time: 0.202660 May 10 02:14:19.770455 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 521/1010] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:19 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 1067 bytes in 214 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 10 02:14:19.786331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.787190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.794122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.794627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.795368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.795907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.867096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:19.868148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:19.875474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.876788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:19.878141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:19.878836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.162387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:20.170112 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24a61194-6dda-4036-a1b6-cfd0e6b5d7fa tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.387944 May 10 02:14:20.180451 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 490/1011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:20.185435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:20.186062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:20.194759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.195246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.196054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.196497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.261251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:20.269481 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19df8c8f-e90c-4cb5-837c-428bd1d3dff4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.407551 May 10 02:14:20.279868 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 522/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:19 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:20.284978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:20.285157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:20.299096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.299694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.300407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.300994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.466280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:20.474575 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab64f8a5-2d17-482a-b4b7-d68a016412c2 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1274 microversion: 2.1 time: 0.193807 May 10 02:14:20.475951 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 523/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:20 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:20.481665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:20.482520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:20.490173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.490824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.491794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.492233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.769699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:20.786463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:20.788749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:20.790749 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1544799e-e834-46c9-bdf5-b28830d6c141 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.608709 May 10 02:14:20.792018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 491/1014] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:20 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:20.798810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:20.799753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:20.808069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.808790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:20.809975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:20.811179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.043613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:21.051475 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c10b162d-2a33-40a3-92ed-415b8ae51304 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.574247 May 10 02:14:21.055693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 524/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:20 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:21.193865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:21.194908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:21.206985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.208783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.209782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.211402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.271693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:21.283727 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-27b73b62-18ae-4b50-b79e-2566f3e6644a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1474 microversion: 2.1 time: 0.490202 May 10 02:14:21.285175 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 492/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:20 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1474 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:21.298209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:21.302207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:21.310432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.310898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.312286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.312741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.597377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:21.606900 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b07bf740-d589-4a50-a289-a021c732ddc6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.421751 May 10 02:14:21.607988 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 525/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:21 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:21.613627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:21.614441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:21.621961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.622765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.623957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.624626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.659205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:21.666582 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fd56ec0-d8f7-438f-a924-9c5ca3315701 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.374350 May 10 02:14:21.667182 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 493/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:21 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:21.726915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:21.735750 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-23fa1688-25d9-4179-bb0f-31e7c9931d0a tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1280 microversion: 2.1 time: 0.125866 May 10 02:14:21.736346 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 526/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:21 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:21.810805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:21.812103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:21.828710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.830336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.833383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.835285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.867880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-84840318-9d58-4234-ab37-75a1fa511384 req-cd239074-1fdc-4991-b871-94eb9cec2abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb10aa49-ee3f-42e5-9761-83bdf2d0299b", "tag": "12ad8c9f-0bcb-460c-b95d-b477061d65b2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:21.878585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-84840318-9d58-4234-ab37-75a1fa511384 req-cd239074-1fdc-4991-b871-94eb9cec2abd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:21.879695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-84840318-9d58-4234-ab37-75a1fa511384 req-cd239074-1fdc-4991-b871-94eb9cec2abd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:21.896654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-84840318-9d58-4234-ab37-75a1fa511384 req-cd239074-1fdc-4991-b871-94eb9cec2abd service nova] Creating event network-changed:12ad8c9f-0bcb-460c-b95d-b477061d65b2 for instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b on n-h2-841089-2 May 10 02:14:21.905473 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-84840318-9d58-4234-ab37-75a1fa511384 req-cd239074-1fdc-4991-b871-94eb9cec2abd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041600 May 10 02:14:21.906986 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 527/1020] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:14:22.072935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:22.073656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:22.080890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.081351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.082139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.082586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.257135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:22.270798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:22.275421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:22.276925 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a926cedb-c3e2-4c9a-8c3f-77bf7060e8af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.471148 May 10 02:14:22.289325 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 494/1021] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:21 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:22.303029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:22.304696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:22.311339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.312132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.314323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.315282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.322961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:22.334605 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-026f0a27-a6c7-4b93-872c-92252b77960f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.263484 May 10 02:14:22.335397 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 528/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:22 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:22.627319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:22.628910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:22.645007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.646780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.648134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.652671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.756121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:22.763914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd3010d2-b574-4c58-ad64-b3b58d77b213 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1474 microversion: 2.1 time: 0.465313 May 10 02:14:22.764771 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 495/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:22 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1474 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:22.770074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:22.771029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:22.781506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.781980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:22.782770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:22.783643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:23.242185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:23.259031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64375295-091e-4241-b583-6c54a41804d0 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.492474 May 10 02:14:23.259759 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 496/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:22 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:23.264638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:23.270715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:23.295713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:23.296327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:23.297152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:23.297597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:23.332227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:23.339836 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a315003c-a630-41dc-a4a4-a56673138f36 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.718909 May 10 02:14:23.340428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 529/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:22 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:23.359403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d0dadcac-6109-48d0-a4e3-adabd8a72f11 req-b81585c9-d25a-41ee-bcb6-86971e9deb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5790707-188a-437e-b169-112129b41399", "name": "network-vif-plugged", "status": "completed", "tag": "5df4c9fe-577d-4d35-9a86-ff99b78bcebc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:23.392098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d0dadcac-6109-48d0-a4e3-adabd8a72f11 req-b81585c9-d25a-41ee-bcb6-86971e9deb6b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:23.392349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d0dadcac-6109-48d0-a4e3-adabd8a72f11 req-b81585c9-d25a-41ee-bcb6-86971e9deb6b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:23.434245 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d0dadcac-6109-48d0-a4e3-adabd8a72f11 req-b81585c9-d25a-41ee-bcb6-86971e9deb6b service nova] Creating event network-vif-plugged:5df4c9fe-577d-4d35-9a86-ff99b78bcebc for instance f5790707-188a-437e-b169-112129b41399 on n-h2-841089-2 May 10 02:14:23.453662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d0dadcac-6109-48d0-a4e3-adabd8a72f11 req-b81585c9-d25a-41ee-bcb6-86971e9deb6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110535 May 10 02:14:23.457921 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 530/1026] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:23.470689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:23.471703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:23.481599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:23.482404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:23.483484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:23.484090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.175534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:24.187872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7fb733ed-b6af-4013-98a2-51608d4f47be tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.926785 May 10 02:14:24.201614 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 497/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:23 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:24.208127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:24.209724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:24.217231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.218840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.219949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.220399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.488575 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-565e3d21-d31e-4a1e-8d74-3871c84a06bb tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1691 microversion: 2.1 time: 1.029050 May 10 02:14:24.490809 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 531/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:23 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1691 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:24.499909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5106c531-a236-4556-b9a1-2e5aa3d44d21 req-2ba9fd68-ebe4-4a30-a05b-5265db064dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374", "name": "network-vif-unplugged", "status": "completed", "tag": "18ef4267-996b-41de-90f2-8e5bb5fa4902"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:24.511360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5106c531-a236-4556-b9a1-2e5aa3d44d21 req-2ba9fd68-ebe4-4a30-a05b-5265db064dee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.512321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5106c531-a236-4556-b9a1-2e5aa3d44d21 req-2ba9fd68-ebe4-4a30-a05b-5265db064dee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.527535 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5106c531-a236-4556-b9a1-2e5aa3d44d21 req-2ba9fd68-ebe4-4a30-a05b-5265db064dee service nova] Creating event network-vif-unplugged:18ef4267-996b-41de-90f2-8e5bb5fa4902 for instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 on n-h2-841089-2 May 10 02:14:24.536125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-5106c531-a236-4556-b9a1-2e5aa3d44d21 req-2ba9fd68-ebe4-4a30-a05b-5265db064dee service nova] Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:14:24.547683 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5106c531-a236-4556-b9a1-2e5aa3d44d21 req-2ba9fd68-ebe4-4a30-a05b-5265db064dee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055311 May 10 02:14:24.548289 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 532/1029] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:24.554407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:24.555144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:24.562116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.562578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.563974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.564424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.643189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:24.652326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:24.654372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:24.655784 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-538c9e94-3a18-4277-96cf-9015bad9d97a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.452606 May 10 02:14:24.665102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 498/1030] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:24 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:24.670738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:24.673065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:24.679562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.680372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.681333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:24.682006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:24.899746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:24.908457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-370eb822-e19e-47fa-8d2a-a8bd6570a05a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.358799 May 10 02:14:24.919278 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 533/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:24 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:25.028191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:25.044813 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6633c2b7-f04f-446e-93e6-c9955af7b634 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1474 microversion: 2.1 time: 0.387359 May 10 02:14:25.045888 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 499/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:24 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:25.065026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:25.066119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:25.070521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bb43ddd-4bc1-4593-95e7-43c34f4d071e tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:25.071613 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:25.071613 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:14:25.074422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.076438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.078379 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-3bb43ddd-4bc1-4593-95e7-43c34f4d071e tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 10 02:14:25.079186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.080799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bb43ddd-4bc1-4593-95e7-43c34f4d071e tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin] Request method failure captured: May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp_9euY2W1efzBemq9xA2yM6gVrVnGEtJAVExZvdf0o5br8CX_nKNsEe0gAeH0--6tjmJgtz820oB4MBkfTxAUus3wQtNdRxgynFFn7F7m1MlDwpcqv-j5qpwb4Is3aKwMMnrSlKy7Q-hxHstBbyuyvC_XVnmUSJyw93ohTRAjZrl0 May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b3a9484fb286409db9d64c1cd94ab5cb May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:14:25.092704 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b3a9484fb286409db9d64c1cd94ab5cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3a9484fb286409db9d64c1cd94ab5cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b3a9484fb286409db9d64c1cd94ab5cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b3a9484fb286409db9d64c1cd94ab5cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b3a9484fb286409db9d64c1cd94ab5cb May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2fca613ef0cb400ca7498d187f45bd40 May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:14:25.094786 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid timestamp for date invalid_time May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'invalid_time'} May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:25.095637 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.097151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bb43ddd-4bc1-4593-95e7-43c34f4d071e tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:25.098119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3bb43ddd-4bc1-4593-95e7-43c34f4d071e tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935 tempest-InstanceUsageAuditLogNegativeTestJSON-1911846935-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.175254 May 10 02:14:25.098920 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 534/1033] 10.222.0.52 () {58 vars in 1223 bytes} [Tue May 10 02:14:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:14:25.107391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:25.108191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:25.134007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.134635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.135580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.136150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.521375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:25.535845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:25.540696 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3aca2668-e0d8-4797-820f-7ec833692a56 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.492770 May 10 02:14:25.542089 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 500/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:25 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:25.543779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-efed5d51-5a3f-4145-916d-cfcb4428b7d0 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.444033 May 10 02:14:25.544350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 535/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:25 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:25.559554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-841089-2", "block_migration": true, "disk_over_commit": false}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:25.561055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:25.569419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.570266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.571325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.571973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.606259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lazy-loading 'flavor' on Instance uuid 39ba2859-735c-49d1-94e0-48d745fcad0e {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:25.619433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Going to try to live migrate instance to n-h1-841089-2 {{(pid=118717) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:14:25.739690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15c39378-6bd9-430e-b001-147e29d87321 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:25.740703 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:25.740703 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:14:25.741861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15c39378-6bd9-430e-b001-147e29d87321 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '2917192aa413493d8adfae0f177eda9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cacc1f374742d396740c813c4d7aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15c39378-6bd9-430e-b001-147e29d87321 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Request method failure captured: May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp-VlTiCx6N0MC4fCguoeWjXrtLUZd7N2m73cf9LC2oXuzd1eQ6ygI6APAe37GDqw-U47jhbO6j4RUOuBmS66bsQyV0w1lw8fa7n7emfKUaP5x8ICCJfCZmehKzk-7WxBmNixExDMlqYJ-6Opjl4l_PAV7DlENHZL4Q9zdPw99Atys May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 08cacc1f374742d396740c813c4d7aed May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:25.744070 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08cacc1f374742d396740c813c4d7aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08cacc1f374742d396740c813c4d7aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08cacc1f374742d396740c813c4d7aed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08cacc1f374742d396740c813c4d7aed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 08cacc1f374742d396740c813c4d7aed May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2917192aa413493d8adfae0f177eda9a May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:14:25.745612 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:14:25.746536 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:25.752508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15c39378-6bd9-430e-b001-147e29d87321 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:25.754835 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-15c39378-6bd9-430e-b001-147e29d87321 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.196825 May 10 02:14:25.754835 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 536/1036] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 02:14:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:25.754835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:25.754835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:25.766199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.767171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:25.773412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:25.779676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.038335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.046892 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef71bb85-d6b7-48a5-8386-a780efc048af tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.298440 May 10 02:14:26.057726 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 537/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:25 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:26.063875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4c530f3a-4773-4627-b754-d3050a22c958 req-8e349780-e031-4d20-b89e-48231dcfb5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c68ee3-4ef4-429a-b82f-ebaf1db59665", "tag": "504f6793-d980-40d9-8613-eab5f925ba97"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:26.081161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4c530f3a-4773-4627-b754-d3050a22c958 req-8e349780-e031-4d20-b89e-48231dcfb5a9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.081765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4c530f3a-4773-4627-b754-d3050a22c958 req-8e349780-e031-4d20-b89e-48231dcfb5a9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.093794 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4c530f3a-4773-4627-b754-d3050a22c958 req-8e349780-e031-4d20-b89e-48231dcfb5a9 service nova] Creating event network-changed:504f6793-d980-40d9-8613-eab5f925ba97 for instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 on n-h1-841089-2 May 10 02:14:26.098656 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4c530f3a-4773-4627-b754-d3050a22c958 req-8e349780-e031-4d20-b89e-48231dcfb5a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039477 May 10 02:14:26.099788 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 538/1038] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:26.106122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:26.106829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:26.113843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.114306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.115337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.115790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.256862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.265696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.267250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.268422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c63761f-f2eb-4eea-9382-202652614387 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.167379 May 10 02:14:26.275829 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 539/1039] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:26 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:26.284801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3aca362-1a8a-4061-bbcf-59a585f33fba tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:26.285708 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:14:26.285708 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:14:26.286911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3aca362-1a8a-4061-bbcf-59a585f33fba tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '2917192aa413493d8adfae0f177eda9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cacc1f374742d396740c813c4d7aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3aca362-1a8a-4061-bbcf-59a585f33fba tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Request method failure captured: May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-10%2002:14:25 HTTP/1.1 May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp-VlTiCx6N0MC4fCguoeWjXrtLUZd7N2m73cf9LC2oXuzd1eQ6ygI6APAe37GDqw-U47jhbO6j4RUOuBmS66bsQyV0w1lw8fa7n7emfKUaP5x8ICCJfCZmehKzk-7WxBmNixExDMlqYJ-6Opjl4l_PAV7DlENHZL4Q9zdPw99Atys May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 08cacc1f374742d396740c813c4d7aed May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:26.289119 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08cacc1f374742d396740c813c4d7aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08cacc1f374742d396740c813c4d7aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08cacc1f374742d396740c813c4d7aed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08cacc1f374742d396740c813c4d7aed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 08cacc1f374742d396740c813c4d7aed May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2917192aa413493d8adfae0f177eda9a May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:14:26.290390 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '2022-05-10 02:14:25'} May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:14:26.295134 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:26.296978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3aca362-1a8a-4061-bbcf-59a585f33fba tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:26.299030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e3aca362-1a8a-4061-bbcf-59a585f33fba tempest-InstanceUsageAuditLogNegativeTestJSON-607649063 tempest-InstanceUsageAuditLogNegativeTestJSON-607649063-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-10 02:14:25" status: 403 len: 128 microversion: 2.1 time: 0.013258 May 10 02:14:26.299030 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 540/1040] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:14:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-10%2002%3A14%3A25 => generated 128 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:26.301918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:26.302626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:26.309489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.309957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.310812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.311377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.456068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.464903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e9eabaf-d868-4724-9db1-d52ff9bf2c0c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.172690 May 10 02:14:26.466183 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 541/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:26 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:26.481820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:26.482555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:26.490493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.491170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.492080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.492641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.649065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.658548 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6f2d44f-de62-498d-8bd9-9953c3b93fb8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1472 microversion: 2.1 time: 0.181453 May 10 02:14:26.659603 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 542/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:26 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:26.664484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:26.665200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:26.671753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.672527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.673573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.674234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.830705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:26.841316 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce151f44-33be-445e-bd4c-ab5d2f48625b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1314 microversion: 2.1 time: 0.180513 May 10 02:14:26.851481 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 543/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:26 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:26.856569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:26.857422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:26.863606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.864271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:26.865222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:26.865827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.078182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:27.086755 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19976774-51f4-4c8c-96d3-775e9e2bd0b4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.233983 May 10 02:14:27.097815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 544/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:26 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:27.103438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-292512fd-0bd8-45e4-afcb-106c20ec314c req-62b3a000-5966-44e0-bf89-21a62af9d117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374", "tag": "18ef4267-996b-41de-90f2-8e5bb5fa4902"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:27.113488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-292512fd-0bd8-45e4-afcb-106c20ec314c req-62b3a000-5966-44e0-bf89-21a62af9d117 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.114139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-292512fd-0bd8-45e4-afcb-106c20ec314c req-62b3a000-5966-44e0-bf89-21a62af9d117 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.139171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-292512fd-0bd8-45e4-afcb-106c20ec314c req-62b3a000-5966-44e0-bf89-21a62af9d117 service nova] Creating event network-changed:18ef4267-996b-41de-90f2-8e5bb5fa4902 for instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 on n-h2-841089-2 May 10 02:14:27.145727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-292512fd-0bd8-45e4-afcb-106c20ec314c req-62b3a000-5966-44e0-bf89-21a62af9d117 service nova] Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:14:27.157582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-292512fd-0bd8-45e4-afcb-106c20ec314c req-62b3a000-5966-44e0-bf89-21a62af9d117 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058315 May 10 02:14:27.158524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 545/1045] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:27.163518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:27.164222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:27.170299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.170808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.172128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.172582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.483978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:27.496785 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-755d7e45-267f-4b69-93ad-c6e62ba2357c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.336299 May 10 02:14:27.497641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 546/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:27 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:27.506374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:27.506374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:27.516216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.517691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.518628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.519727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.858558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:27.867762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:27.869521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:27.870769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-744584d5-f6e5-406d-924e-9a4baa25855d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.372185 May 10 02:14:27.871453 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 547/1047] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:27 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:27.876496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:27.877360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:27.883526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.883992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:27.884856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:27.885370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:28.433292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:28.441021 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c00dbc2-17c1-4b64-a255-da7b2e444e71 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.568325 May 10 02:14:28.441971 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 548/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:27 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:28.447456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:28.448237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:28.457217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:28.458217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:28.459396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:28.460072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:28.790198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:28.800039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-068600b4-11da-4abd-b2e1-023f934a43ae tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1469 microversion: 2.1 time: 0.356892 May 10 02:14:28.801229 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 549/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:28 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:28.805830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:28.806430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:28.812802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:28.813598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:28.814614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:28.815304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:28.916310 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-323e59fa-6eeb-48a2-94b7-66113ac6c672 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/action" status: 202 len: 0 microversion: 2.1 time: 3.372798 May 10 02:14:28.917549 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 501/1050] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:25 2022] POST /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/action => generated 0 bytes in 3375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:28.927432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:28.931038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:28.942402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:28.943270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:28.956973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:28.958178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.268155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:29.282160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d788c0fd-d8a2-453d-a4d9-9f05bc815a8e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1500 microversion: 2.1 time: 0.479615 May 10 02:14:29.298303 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 550/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:28 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1500 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:29.305539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:29.306786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:29.314949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.315742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.317557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.318192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.401425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:29.412058 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42862f1b-b106-4dcc-a876-853b39a485e4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.492730 May 10 02:14:29.413056 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 502/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:28 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:29.418261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:29.419054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:29.427038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.427861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.428950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.429558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.529708 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8283e437-c325-4173-acd1-bc015b49085f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374/action" status: 204 len: 0 microversion: 2.1 time: 0.113194 May 10 02:14:29.531052 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 503/1053] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:29 2022] POST /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374/action => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:29.556022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:29.556925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:29.588485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.599334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.603822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.606943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.688849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:29.697978 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c831101c-3c0c-401a-ae96-e4e598ab449f tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.397949 May 10 02:14:29.709473 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 551/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:29 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:29.717122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:29.718197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:29.726771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.727916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:29.729946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:29.730791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.203428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:30.210360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:30.224249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:30.228007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acb39989-434c-4d6d-9d5d-7776a601cc38 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.515011 May 10 02:14:30.229564 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 552/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:29 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:30.231789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:30.233712 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-06621b93-2d64-4acc-a754-519083f8c935 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.700359 May 10 02:14:30.235833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 504/1056] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:29 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:30.238702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:30.240537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:30.244785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:30.248392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.248820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:30.249419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.251388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.252761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.262420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.268005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.269306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.270184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.328559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:14:30.424528 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-059fdba4-1905-4226-a40e-0ced2412b164 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 204 len: 0 microversion: 2.1 time: 0.192930 May 10 02:14:30.427905 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 553/1057] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:14:30 2022] DELETE /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:30.435002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:30.435757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:30.455809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.458175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.459000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.459472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.608417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:30.621398 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-256fb8ab-8f90-4d47-af74-b14817b9bebf tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.383476 May 10 02:14:30.622001 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 505/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:30 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:30.637225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-35f48c39-c585-4fcd-aa0d-e244553fb209 req-bbc2c0df-927c-4e3d-88ab-5b03ecba8427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374", "name": "network-vif-plugged", "status": "completed", "tag": "18ef4267-996b-41de-90f2-8e5bb5fa4902"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:30.653912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-35f48c39-c585-4fcd-aa0d-e244553fb209 req-bbc2c0df-927c-4e3d-88ab-5b03ecba8427 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.657910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-35f48c39-c585-4fcd-aa0d-e244553fb209 req-bbc2c0df-927c-4e3d-88ab-5b03ecba8427 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.685126 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-35f48c39-c585-4fcd-aa0d-e244553fb209 req-bbc2c0df-927c-4e3d-88ab-5b03ecba8427 service nova] Creating event network-vif-plugged:18ef4267-996b-41de-90f2-8e5bb5fa4902 for instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 on n-h2-841089-2 May 10 02:14:30.693206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-35f48c39-c585-4fcd-aa0d-e244553fb209 req-bbc2c0df-927c-4e3d-88ab-5b03ecba8427 service nova] Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:14:30.723172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:30.723985 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-35f48c39-c585-4fcd-aa0d-e244553fb209 req-bbc2c0df-927c-4e3d-88ab-5b03ecba8427 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099962 May 10 02:14:30.725099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 506/1059] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:30.730779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acfdf80d-cad0-4b12-8288-a2d024326b4d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1469 microversion: 2.1 time: 0.301597 May 10 02:14:30.731715 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 554/1060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:30 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:30.736497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:30.737517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:30.745267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:30.745784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.746007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:30.746674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.747751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.748418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.757485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.757950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:30.758745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:30.759210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.050763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:31.058285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-03c323ab-4ec6-4518-a87c-2ee1e56e801c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1506 microversion: 2.1 time: 0.325254 May 10 02:14:31.071379 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 555/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:30 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:31.094029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:31.096422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:31.098241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:31.105875 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d97d40ea-cafd-4b1e-a401-20931ea37340 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.379355 May 10 02:14:31.106463 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 507/1062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:30 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:31.117400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.117875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.118689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.119167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.246285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:31.247117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:31.259832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.260434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.261391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.261941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.781785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:31.790429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41cdf4f5-6248-4b43-842c-0f27491e6343 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.715857 May 10 02:14:31.809581 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 556/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:31 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:31.815596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:31.816649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:31.824674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.825522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.826576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.827841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.843838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:31.853525 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b47b4435-b85a-4009-a02e-ba3eaa316c41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.611560 May 10 02:14:31.863748 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 508/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:31 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:31.863748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:31.863748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:31.870973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.871476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:31.872282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:31.872751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.151647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.167385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.169017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.170211 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f312063b-002c-4647-85ff-3f8afd18d7e9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.359265 May 10 02:14:32.171343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 557/1065] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:31 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:32.183608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:32.186259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:32.199672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.200164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.202813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.203601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.236698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.247475 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9e44b4e2-ade5-40af-8de1-96d5375e139f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.390990 May 10 02:14:32.249775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 509/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:31 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:32.263313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:32.264103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:32.276272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.277163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.278190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.279418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.548839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.559369 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0fe0c7f4-a0cc-4618-8dfc-bdb093090a26 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1469 microversion: 2.1 time: 0.383185 May 10 02:14:32.560312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 558/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:32 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:32.564836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:32.565635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:32.571815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.572509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.573475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.574174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.698174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.738354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d55eb71-e365-4a2c-bc0a-f9f17f9001b3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1506 microversion: 2.1 time: 0.482788 May 10 02:14:32.753843 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 510/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:32 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:32.773927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-67b1c30c-6ddb-4312-9802-7e9d9ff201ca req-150d5345-16b4-4402-af55-86c6bfd00f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10aa49-ee3f-42e5-9761-83bdf2d0299b", "name": "network-vif-plugged", "status": "completed", "tag": "12ad8c9f-0bcb-460c-b95d-b477061d65b2"}, {"server_uuid": "19c68ee3-4ef4-429a-b82f-ebaf1db59665", "name": "network-vif-plugged", "status": "completed", "tag": "504f6793-d980-40d9-8613-eab5f925ba97"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:32.787608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-67b1c30c-6ddb-4312-9802-7e9d9ff201ca req-150d5345-16b4-4402-af55-86c6bfd00f1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.788300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-67b1c30c-6ddb-4312-9802-7e9d9ff201ca req-150d5345-16b4-4402-af55-86c6bfd00f1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.803485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:32.814232 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ecfc8f40-8625-4d26-8ed0-c2e0d10549f5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.252887 May 10 02:14:32.815107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 559/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:32 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:32.819768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:32.823048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:32.835283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.836178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.837201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.840574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.846218 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-67b1c30c-6ddb-4312-9802-7e9d9ff201ca req-150d5345-16b4-4402-af55-86c6bfd00f1f service nova] Creating event network-vif-plugged:12ad8c9f-0bcb-460c-b95d-b477061d65b2 for instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b on n-h2-841089-2 May 10 02:14:32.848975 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-67b1c30c-6ddb-4312-9802-7e9d9ff201ca req-150d5345-16b4-4402-af55-86c6bfd00f1f service nova] Creating event network-vif-plugged:504f6793-d980-40d9-8613-eab5f925ba97 for instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 on n-h1-841089-2 May 10 02:14:32.867804 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-67b1c30c-6ddb-4312-9802-7e9d9ff201ca req-150d5345-16b4-4402-af55-86c6bfd00f1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101982 May 10 02:14:32.871881 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 511/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:14:32.882214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:32.887987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:32.900174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.903893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:32.910849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:32.913202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.214690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.222292 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98d3c0d8-1eb8-4756-b7ac-b298dc570632 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.405976 May 10 02:14:33.231809 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 560/1071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:32 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:33.237235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a8798689-7116-4460-9f59-5a3f59806ab8 req-0621fed3-2509-4789-af26-0cfcab25fc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5790707-188a-437e-b169-112129b41399", "name": "network-vif-deleted", "tag": "5df4c9fe-577d-4d35-9a86-ff99b78bcebc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:33.245977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a8798689-7116-4460-9f59-5a3f59806ab8 req-0621fed3-2509-4789-af26-0cfcab25fc8d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.246739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a8798689-7116-4460-9f59-5a3f59806ab8 req-0621fed3-2509-4789-af26-0cfcab25fc8d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.260151 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a8798689-7116-4460-9f59-5a3f59806ab8 req-0621fed3-2509-4789-af26-0cfcab25fc8d service nova] Creating event network-vif-deleted:5df4c9fe-577d-4d35-9a86-ff99b78bcebc for instance f5790707-188a-437e-b169-112129b41399 on n-h2-841089-2 May 10 02:14:33.266356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a8798689-7116-4460-9f59-5a3f59806ab8 req-0621fed3-2509-4789-af26-0cfcab25fc8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 May 10 02:14:33.268116 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 561/1072] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:33.273081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.274791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:33.276219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:33.281726 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c48841ee-a959-42ae-a23e-2f3322361420 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.408418 May 10 02:14:33.282498 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 512/1073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:32 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:33.291431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.291431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.291431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.291431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.297342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:33.297960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:33.304133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.304782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.305732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.306340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.516574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.529081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.538948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.541178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.542563 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-645b0218-b707-4c91-a8d8-9a7fc3714df9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.249469 May 10 02:14:33.542988 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f1f9f0e-6edf-4d8a-8db1-ff70dd68f57d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.273270 May 10 02:14:33.544193 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 562/1074] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:33 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:33.555486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 513/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:33 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:33.577382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:33.578136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:33.584418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.584997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.585891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.586502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.728396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.736013 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5df4f8df-ce8e-442a-b5e1-89f4eec37f02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1461 microversion: 2.1 time: 0.162833 May 10 02:14:33.736597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 563/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:33 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1461 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:33.753635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:33.755199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:33.759511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:33.760606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:33.763422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.764221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.765687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.766540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.767521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.768048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.769070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.769725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.816565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.817131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.817487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lazy-loading 'fault' on Instance uuid f5790707-188a-437e-b169-112129b41399 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:33.898557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:33.907139 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c6b87a9-3654-4f5e-a4de-e26db97c234d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 200 len: 1304 microversion: 2.1 time: 0.151561 May 10 02:14:33.907740 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 564/1077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:33 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:33.919640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:33.920267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:33.926794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.927301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:33.928308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:33.928911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.040909 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c806dadf-3da8-46d5-9a8d-5e1c17c87012 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1612 microversion: 2.1 time: 0.291906 May 10 02:14:34.041835 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 514/1078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:33 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1612 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:34.062382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05a2b137-a647-4e15-a820-c6e772e9c1c4 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '.version_select at 0x7f3d370fb040>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:34.065144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05a2b137-a647-4e15-a820-c6e772e9c1c4 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.065606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05a2b137-a647-4e15-a820-c6e772e9c1c4 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.076223 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-05a2b137-a647-4e15-a820-c6e772e9c1c4 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2713 microversion: 2.1 time: 0.017948 May 10 02:14:34.077401 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 515/1079] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:14:34 2022] GET /compute/v2.1/os-migrations => generated 2713 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:34.138203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:34.155005 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2de11d21-abe5-4513-b25e-2e79f66267b2 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.238977 May 10 02:14:34.155996 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 565/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:33 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:34.201632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-284698430", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:34.242771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:34.243911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:34.256249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.256900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.258934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.259579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.262487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:34.564063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:34.580000 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3aa96f17-ae37-4093-bb55-a00a6f148404 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1322 microversion: 2.1 time: 0.343436 May 10 02:14:34.581221 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 566/1081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:34 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:34.587441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:34.588193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:34.596596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.597320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.598226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.598950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.614826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:34.615946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:34.616551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:34.617082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:34.617610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:34.629671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.630341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.632529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.633036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.651264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:34.658257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for user ea129546ff474fd0aa9c93c1bfaac5fd and project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:34.672202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:34.676153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:34.744229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b5bd3bba-54f2-477f-a6b2-a67ca7939aa8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546204 May 10 02:14:34.745390 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 516/1082] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:14:34.753421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:34.754651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:34.762647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.763531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.765318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.765928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.776221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:34.793707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7cb1c77-f597-4e6c-ab6e-c833b572d7eb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.210646 May 10 02:14:34.794692 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 567/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:34 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:34.799379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:34.800004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:34.807963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.808100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.808906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:34.809359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:34.993183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.002573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.009281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.015254 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d76d9bdf-19d6-45fb-a732-6c0b92e6fcfa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.264689 May 10 02:14:35.016730 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 517/1084] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:34 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:35.018517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.032989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5990d5a-c1f4-4155-82af-ba5aa283e46e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:35.033834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5990d5a-c1f4-4155-82af-ba5aa283e46e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:35.036226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8711b7d9-bf54-4255-ba4c-f27447f20f06 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1325 microversion: 2.1 time: 0.240346 May 10 02:14:35.039477 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 568/1085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:34 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:35.055013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:35.058455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:35.081788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:35.085263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:35.088851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:35.090455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:35.134523 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 HTTP/1.1 May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:14:35.136993 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:14:35.138697 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f5790707-188a-437e-b169-112129b41399'} May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:35.139763 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:14:35.141291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:14:35.143941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance f5790707-188a-437e-b169-112129b41399 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:35.148104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5990d5a-c1f4-4155-82af-ba5aa283e46e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.156077 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5990d5a-c1f4-4155-82af-ba5aa283e46e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1212 microversion: 2.1 time: 0.137957 May 10 02:14:35.167203 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a0774c5-db13-484e-b7cf-50537b10bb61 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 404 len: 111 microversion: 2.1 time: 0.104145 May 10 02:14:35.167203 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 569/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:35 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:35.167499 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 518/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:35 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1212 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:35.175044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:35.176341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:35.182859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:35.183352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:35.184147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:35.184597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:35.317837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1540231609", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:35.401587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.416642 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bfe9bb31-f5c2-4c63-a24b-2778c315824e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.245874 May 10 02:14:35.417236 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 570/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:35 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:35.436277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:35.597811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:35.598521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:35.618890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:35.619646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:35.620457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:35.620905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:35.978818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:35.998977 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2fca3946-e109-4755-b3f0-f3b976b5a100 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1472 microversion: 2.1 time: 0.394632 May 10 02:14:35.999679 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 571/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:35 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:36.005429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:36.006435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:36.030918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.033537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.037481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.038323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.084643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:36.085203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:36.085779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:36.086261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:36.087285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:36.102172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.114696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.115822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.116277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.141780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:36.147270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:36.161182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:36.163607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:36.240420 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-308e314d-39df-407b-bcd0-6330cb6d3848 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923860 May 10 02:14:36.249136 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 519/1090] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:14:36.255998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-58150805-f67d-481d-8a05-50f9e4ce217a req-4a4bfa7b-f13c-494a-933c-db61d6f2c9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2caaf280-a323-44ef-a538-116e02a6af60", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb8fe6b-b852-4405-bdd4-46a18d504493"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:36.265612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-58150805-f67d-481d-8a05-50f9e4ce217a req-4a4bfa7b-f13c-494a-933c-db61d6f2c9ff service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.266171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-58150805-f67d-481d-8a05-50f9e4ce217a req-4a4bfa7b-f13c-494a-933c-db61d6f2c9ff service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.281641 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-58150805-f67d-481d-8a05-50f9e4ce217a req-4a4bfa7b-f13c-494a-933c-db61d6f2c9ff service nova] Creating event network-vif-unplugged:ecb8fe6b-b852-4405-bdd4-46a18d504493 for instance 2caaf280-a323-44ef-a538-116e02a6af60 on n-h1-841089-2 May 10 02:14:36.287674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-58150805-f67d-481d-8a05-50f9e4ce217a req-4a4bfa7b-f13c-494a-933c-db61d6f2c9ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041689 May 10 02:14:36.288286 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 520/1091] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:36.377023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:36.385043 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef90ec4a-dd7b-424e-8c1b-a0122e7b4695 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.384294 May 10 02:14:36.385637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 572/1092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:35 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:36.399252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:36.405525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:36.417217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.418062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.419146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.419709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.664955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55356d82-a95f-46a1-893f-8416ad422dab tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:36.665880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-55356d82-a95f-46a1-893f-8416ad422dab tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] [instance: 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:36.676523 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-55356d82-a95f-46a1-893f-8416ad422dab tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] HTTP exception thrown: Instance 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e could not be found. May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55356d82-a95f-46a1-893f-8416ad422dab tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Request method failure captured: May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/00243e1f-f2fc-4ee2-99fc-2fc4676aa55e/action HTTP/1.1 May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecp4GB4JXtDFAuzqrYVjJBmMBEDTVImVYZQj610Ket3faNAJr2XXtiQyoNS2vNISyw9ttflE1IVaAz4J_AY9kTvvVq4iMMLF17mKe7Ecl7lQaglLEfO6S6W4Zt1Y6a4OmJBa9zMg4U7ai7fLmPrAmc-sune40oiqwuxsTGmCtRXnkdQ May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:14:36.681557 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4029b18a5bd44ff383ff29746faa1ebc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: a9ebb70734704baaa43b0d46c0314e89 May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: {"migrate": {}} May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:14:36.683045 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e could not be found. May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '00243e1f-f2fc-4ee2-99fc-2fc4676aa55e', 'body': {'migrate': {}}} May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e could not be found. May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:36.684226 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e could not be found. May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e could not be found. May 10 02:14:36.685691 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:36.687006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55356d82-a95f-46a1-893f-8416ad422dab tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Returning 404 to user: Instance 00243e1f-f2fc-4ee2-99fc-2fc4676aa55e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:36.687006 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-55356d82-a95f-46a1-893f-8416ad422dab tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/00243e1f-f2fc-4ee2-99fc-2fc4676aa55e/action" status: 404 len: 111 microversion: 2.1 time: 0.393040 May 10 02:14:36.688912 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 521/1093] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:36 2022] POST /compute/v2.1/servers/00243e1f-f2fc-4ee2-99fc-2fc4676aa55e/action => generated 111 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:36.708976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:36.709874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:36.724414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.725116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.726252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.726945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.796858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:36.807822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:36.815608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:36.817767 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c528ad5b-ce2d-46c0-ba13-e08554db53ba tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.425775 May 10 02:14:36.820605 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 573/1094] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:36 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:36.828919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:36.835399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:36.855375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.856877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.858940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:36.860394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:36.978966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:36.988665 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd104dc3-e0b5-42d1-be4c-2f0ab7e68d01 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1270 microversion: 2.1 time: 0.165736 May 10 02:14:36.989673 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 574/1095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:36 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:36.995169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:36.995963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:37.003436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.003830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.004612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.005051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.120195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:37.122639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:37.130394 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c9e1952-7b1a-4ae3-9e25-911fc70383e4 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1521 microversion: 2.1 time: 0.439917 May 10 02:14:37.143207 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-20aba170-6959-414d-9efd-e0a5c429db46 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1219 microversion: 2.1 time: 0.150840 May 10 02:14:37.143333 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 522/1096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:36 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:37.144611 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 575/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:36 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:37.150608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:37.159655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:37.167752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.168504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.169521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.170185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.219100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a547c45f-e677-44ef-b114-9b9d833b77b7 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Action: 'update', calling method: .version_select at 0x7f3d3717f550>, body: {"quota_set": {"ram": "5120"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:37.305106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a547c45f-e677-44ef-b114-9b9d833b77b7 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.306291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a547c45f-e677-44ef-b114-9b9d833b77b7 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.307278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a547c45f-e677-44ef-b114-9b9d833b77b7 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.307972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a547c45f-e677-44ef-b114-9b9d833b77b7 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.361486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a547c45f-e677-44ef-b114-9b9d833b77b7 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89" status: 200 len: 240 microversion: 2.36 time: 0.217220 May 10 02:14:37.368542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 523/1098] 10.222.0.52 () {62 vars in 1302 bytes} [Tue May 10 02:14:37 2022] PUT /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89 => generated 240 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:14:37.374790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1482756925", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:37.425103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:37.434806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:37.442662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f09676f1-ac1c-41fd-9f0f-95e83a384dd3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.296862 May 10 02:14:37.443406 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 576/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:37 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:37.448065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:37.449101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:37.455744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.456323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.460580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.461266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.740730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:37.751507 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c751dad9-0c7d-44de-92ca-e89ec3ce48d6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1521 microversion: 2.1 time: 0.306788 May 10 02:14:37.752469 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 577/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:37 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:37.758160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a30ada8e-87d2-4c69-b686-aa4b09014e9f tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Calling method '.version_select at 0x7f3d371e5dc0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:37.869189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a30ada8e-87d2-4c69-b686-aa4b09014e9f tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.869758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a30ada8e-87d2-4c69-b686-aa4b09014e9f tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.870599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a30ada8e-87d2-4c69-b686-aa4b09014e9f tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.871050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a30ada8e-87d2-4c69-b686-aa4b09014e9f tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.896406 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a30ada8e-87d2-4c69-b686-aa4b09014e9f tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89/detail" status: 200 len: 672 microversion: 2.36 time: 0.142352 May 10 02:14:37.897490 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 578/1101] 10.222.0.52 () {60 vars in 1303 bytes} [Tue May 10 02:14:37 2022] GET /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89/detail => generated 672 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:14:37.908785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:37.909926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:37.916667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.917528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.919106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:37.920044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:37.994189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:37.995646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:37.996657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:37.997407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:37.998046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:38.011935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.012747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.013888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.014541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.040265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Getting quotas for project d1b2066e0b794483b3d7cf8aca6ad655. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:38.046735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Getting quotas for user f0951d520ac94a8f80efa1986944a0fc and project d1b2066e0b794483b3d7cf8aca6ad655. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:38.061769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:38.064905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:38.138311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cceeb458-4ec0-498b-b4b2-7ac59841352b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768262 May 10 02:14:38.140047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 524/1102] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:14:38.145233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-696367396"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:38.146714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:38.153738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.154389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.156943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.157579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.515376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a9e1b096-6b10-4e7d-8f3a-484f186f2767 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b/action" status: 202 len: 0 microversion: 2.1 time: 0.373782 May 10 02:14:38.517024 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 525/1103] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:38 2022] POST /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:14:38.525958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:38.526916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:38.536905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.538298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.539423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.540193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.739198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:38.750120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78ae4e7e-56e5-4be9-885a-5cd5f31892fb tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.851404 May 10 02:14:38.753763 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 579/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:37 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:38.760428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:38.761232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:38.776018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.776931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.777980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:38.778896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:38.898534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:38.910474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:38.912537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:38.913880 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e44ba5c-0ae8-4ad4-bfdb-8b73b83ee9c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.395798 May 10 02:14:38.922303 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 526/1105] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:38 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:38.927821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Action: 'update', calling method: .version_select at 0x7f3d370daf70>, body: {"quota_set": {"ram": "2048"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:39.010965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.011750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.012778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.013471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.049439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.050121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.051200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.051707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.116740 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b672c92-7ace-4138-ab23-bbbdf2641410 tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89?user_id=888f69b5e2ad419f964f26af79f164b7" status: 200 len: 240 microversion: 2.36 time: 0.193250 May 10 02:14:39.117633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 527/1106] 10.222.0.52 () {62 vars in 1383 bytes} [Tue May 10 02:14:38 2022] PUT /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89?user_id=888f69b5e2ad419f964f26af79f164b7 => generated 240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:14:39.122521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.123956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:39.130985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.131723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.132726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.133389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.282314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:39.290924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c087d13-5015-4e00-ade4-9f2c09774f15 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1218 microversion: 2.1 time: 0.171957 May 10 02:14:39.291484 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 528/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:39.292144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:39.296314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.297039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:39.303804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.304378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.305271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.305808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.309562 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f44d9a5-884d-4b6b-b3e5-46feb58dbdd2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.552805 May 10 02:14:39.312874 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 580/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:38 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:39.318234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-33b7bff6-051e-49ee-b60d-8d15c29620fb req-976a2649-78de-40a9-8b26-d3611eed531d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2caaf280-a323-44ef-a538-116e02a6af60", "tag": "ecb8fe6b-b852-4405-bdd4-46a18d504493"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:39.330577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-33b7bff6-051e-49ee-b60d-8d15c29620fb req-976a2649-78de-40a9-8b26-d3611eed531d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.331383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-33b7bff6-051e-49ee-b60d-8d15c29620fb req-976a2649-78de-40a9-8b26-d3611eed531d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.347332 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-33b7bff6-051e-49ee-b60d-8d15c29620fb req-976a2649-78de-40a9-8b26-d3611eed531d service nova] Creating event network-changed:ecb8fe6b-b852-4405-bdd4-46a18d504493 for instance 2caaf280-a323-44ef-a538-116e02a6af60 on n-h1-841089-2 May 10 02:14:39.354362 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-33b7bff6-051e-49ee-b60d-8d15c29620fb req-976a2649-78de-40a9-8b26-d3611eed531d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039939 May 10 02:14:39.355829 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 581/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:39.363240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.364097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:39.371037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.371537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.372323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.373286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.414004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:39.425620 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74da1c2a-0e15-48b1-9b61-9da1e69b02ee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1273 microversion: 2.1 time: 0.133039 May 10 02:14:39.435163 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 529/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:39.435163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-144a2366-342e-44cb-ad40-d9ea207910d3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '.version_select at 0x7f3d370d3040>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.566252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-144a2366-342e-44cb-ad40-d9ea207910d3 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b" status: 204 len: 0 microversion: 2.1 time: 0.138824 May 10 02:14:39.567042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 530/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:39 2022] DELETE /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:39.571675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c79fe099-dabe-4cca-b118-bf8a43343e2c tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] Calling method '.version_select at 0x7f3d370fb0d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.661210 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c79fe099-dabe-4cca-b118-bf8a43343e2c tempest-QuotasAdminTestV236-261593640 tempest-QuotasAdminTestV236-261593640-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89?user_id=888f69b5e2ad419f964f26af79f164b7" status: 200 len: 282 microversion: 2.36 time: 0.093164 May 10 02:14:39.661978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 531/1112] 10.222.0.52 () {60 vars in 1363 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/os-quota-sets/88c3376f7af2459aaa73a7633ebe6a89?user_id=888f69b5e2ad419f964f26af79f164b7 => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:14:39.671879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d92fab9-61e2-4168-b22f-b8bd853c8196 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '.version_select at 0x7f3d370e6ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.699318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9d92fab9-61e2-4168-b22f-b8bd853c8196 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Image not found. May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d92fab9-61e2-4168-b22f-b8bd853c8196 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b HTTP/1.1 May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:14:39.706459 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '85367d9d-d69b-422d-a05f-716174ce005b'} May 10 02:14:39.708036 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:14:39.708868 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 85367d9d-d69b-422d-a05f-716174ce005b May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:14:39.709948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85367d9d-d69b-422d-a05f-716174ce005b could not be found. May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:14:39.711119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:39.712224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d92fab9-61e2-4168-b22f-b8bd853c8196 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:39.713195 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d92fab9-61e2-4168-b22f-b8bd853c8196 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b" status: 404 len: 62 microversion: 2.1 time: 0.045823 May 10 02:14:39.713195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 532/1113] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:14:39.723165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.726310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:39.734485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.735051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.736092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.736725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.800857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:39.834581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28f76d04-27e4-4283-89f7-95b4989a2a95 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.476931 May 10 02:14:39.836510 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 582/1114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:39.862349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:39.871462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:39.884586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.887559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:39.892412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:39.894209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:40.471600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:40.484441 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55fa9c96-e80d-4928-afbd-06612653ba87 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.641358 May 10 02:14:40.485076 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 583/1115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:40.490415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:40.494755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:40.500094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:40.513910 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7edb4a01-5324-4580-b160-77b7fe5b1f02 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1533 microversion: 2.1 time: 0.797782 May 10 02:14:40.518007 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 533/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:39 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1533 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:40.525164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:40.534926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:40.536052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:40.538749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:40.539634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:40.540077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:40.548177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:40.548638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:40.549426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:40.549865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:40.763410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:40.770807 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-119df5b7-5079-4383-b883-d7ac0cca64fe tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1280 microversion: 2.1 time: 0.251355 May 10 02:14:40.771337 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 534/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:40 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:40.786093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:40.786973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:40.793684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:40.794486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:40.796107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:40.796778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:41.253955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:41.267317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:41.270322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:41.276326 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a1c5302-f30b-4f63-8908-230a0fe34989 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.789738 May 10 02:14:41.277146 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 584/1118] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:40 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:41.287453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:41.288378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:41.301400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:41.303914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:41.305060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:41.305183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:41.341229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:41.360044 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3eee9901-c83e-4113-87c7-fa072571abe2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.577785 May 10 02:14:41.365079 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 535/1119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:40 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:41.371806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:41.373963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:41.384771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:41.385536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:41.390298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:41.391095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.142002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:42.155769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9bc0cb7a-9009-4ffd-96d2-118d58825a5b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.875261 May 10 02:14:42.169089 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 585/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:41 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:42.174906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d0fc103c-8421-4a9b-a185-de22e707baf8 req-8d7003a4-1a73-48f6-9848-f2a5dc9fb1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8962c96e-b870-4700-bf38-f78601e5854e", "tag": "845550c8-69e5-4cd3-91b8-30fd8a345295"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:42.189026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d0fc103c-8421-4a9b-a185-de22e707baf8 req-8d7003a4-1a73-48f6-9848-f2a5dc9fb1e2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.189746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d0fc103c-8421-4a9b-a185-de22e707baf8 req-8d7003a4-1a73-48f6-9848-f2a5dc9fb1e2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.202982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:42.211215 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00a97c55-5f3a-4944-8a3e-c3b7d7980810 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.844734 May 10 02:14:42.211681 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 536/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:41 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:42.231928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:42.234589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:42.241133 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d0fc103c-8421-4a9b-a185-de22e707baf8 req-8d7003a4-1a73-48f6-9848-f2a5dc9fb1e2 service nova] Creating event network-changed:845550c8-69e5-4cd3-91b8-30fd8a345295 for instance 8962c96e-b870-4700-bf38-f78601e5854e on n-h2-841089-2 May 10 02:14:42.250116 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d0fc103c-8421-4a9b-a185-de22e707baf8 req-8d7003a4-1a73-48f6-9848-f2a5dc9fb1e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079138 May 10 02:14:42.251331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.251331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.252100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.252550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.253938 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 586/1122] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:42.262697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:42.266779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:42.279311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.280604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.281707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.282364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.705882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:42.721950 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4b19cb7-04ec-4d2f-868c-9121c94eba07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.502704 May 10 02:14:42.723046 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 537/1123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:42 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:42.730477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:42.732668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:42.743656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.744422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.748311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:42.759706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.760504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.762745 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dda8e5a9-091e-4d6f-8274-0792c9ac5782 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1534 microversion: 2.1 time: 0.504622 May 10 02:14:42.765918 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 587/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:42 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1534 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:42.785963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:42.789051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:42.806714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.809747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:42.812675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:42.813232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.270020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:43.275025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:43.278833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:43.280502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:43.281698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7699819-4474-4e4a-8fcb-47a5e4550ca8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.514572 May 10 02:14:43.282267 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 588/1125] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:42 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:43.287745 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1967a114-5004-4a87-9b20-5692c8d1f7ba tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.563227 May 10 02:14:43.288676 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 538/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:42 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:43.293732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4fadf15e-967c-422f-9120-3af287c0dc16 req-280ce4c9-f412-4903-947f-a905f217a87d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb", "tag": "37eeb610-2295-49f7-8a36-15f4b415874b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:43.298760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:43.299426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:43.306432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4fadf15e-967c-422f-9120-3af287c0dc16 req-280ce4c9-f412-4903-947f-a905f217a87d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.306894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4fadf15e-967c-422f-9120-3af287c0dc16 req-280ce4c9-f412-4903-947f-a905f217a87d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.316267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.316649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.317636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.318089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.325196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4fadf15e-967c-422f-9120-3af287c0dc16 req-280ce4c9-f412-4903-947f-a905f217a87d service nova] Creating event network-changed:37eeb610-2295-49f7-8a36-15f4b415874b for instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb on n-h2-841089-2 May 10 02:14:43.332737 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4fadf15e-967c-422f-9120-3af287c0dc16 req-280ce4c9-f412-4903-947f-a905f217a87d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042658 May 10 02:14:43.334357 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 539/1127] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:43.343570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:43.344521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:43.350949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.351704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.352707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.353354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.678578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:43.691264 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7237abf2-aab2-4c6d-8020-2f0413193c7a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.407905 May 10 02:14:43.692249 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 589/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:43 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:43.697688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:43.698714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:43.710487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.711061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.713488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.713957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.748243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:43.758974 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-970846f6-e936-4bd4-9602-2fb44fae185d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.420361 May 10 02:14:43.762703 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 540/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:43 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:43.775606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:43.777246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:43.792576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.793048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:43.793843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:43.796794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.209709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.223138 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-137d3357-04ff-4156-8bbc-b533c0bfa928 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.528153 May 10 02:14:44.232190 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 590/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:43 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:44.240263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:44.248340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.255971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:44.262777 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1cfdf85b-cea8-4f67-b517-331b84ab8cd4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.492988 May 10 02:14:44.265065 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 541/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:43 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:44.272210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.274024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.274743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.275219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.275683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-036d7193-cfdb-4711-9ef8-4be7bdda654e req-34c7367d-06ec-4e0c-919f-a877c651514e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10aa49-ee3f-42e5-9761-83bdf2d0299b", "name": "network-vif-plugged", "status": "completed", "tag": "12ad8c9f-0bcb-460c-b95d-b477061d65b2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:44.303634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-036d7193-cfdb-4711-9ef8-4be7bdda654e req-34c7367d-06ec-4e0c-919f-a877c651514e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.304099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-036d7193-cfdb-4711-9ef8-4be7bdda654e req-34c7367d-06ec-4e0c-919f-a877c651514e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.327406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-036d7193-cfdb-4711-9ef8-4be7bdda654e req-34c7367d-06ec-4e0c-919f-a877c651514e service nova] Creating event network-vif-plugged:12ad8c9f-0bcb-460c-b95d-b477061d65b2 for instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b on n-h2-841089-2 May 10 02:14:44.332293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-036d7193-cfdb-4711-9ef8-4be7bdda654e req-34c7367d-06ec-4e0c-919f-a877c651514e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066094 May 10 02:14:44.336888 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 542/1132] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:44.343733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:44.344809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:44.351698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.352424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.353427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.354077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.621186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.625221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.639444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33334a8a-6621-4247-9e8b-1999125ac8ee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1521 microversion: 2.1 time: 0.404564 May 10 02:14:44.641517 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 591/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:44 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:44.647668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.650184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.654298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:44.655777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:44.661827 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43b82db7-e305-44b5-9fa2-8b8ca4e05245 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.323505 May 10 02:14:44.662438 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 543/1134] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:44 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:44.662978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.663673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.664641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.665236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.677223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-339ca864-7adc-4eea-8ae6-976636038f50 req-ddd03f72-fcaf-4186-952f-2a507f329913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9509d8d2-b9af-4154-a5e7-e0a9815ea577", "tag": "6f4ae02f-7a5a-4484-9667-07d4192bd89c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:44.697674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-339ca864-7adc-4eea-8ae6-976636038f50 req-ddd03f72-fcaf-4186-952f-2a507f329913 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.701914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-339ca864-7adc-4eea-8ae6-976636038f50 req-ddd03f72-fcaf-4186-952f-2a507f329913 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.739038 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-339ca864-7adc-4eea-8ae6-976636038f50 req-ddd03f72-fcaf-4186-952f-2a507f329913 service nova] Creating event network-changed:6f4ae02f-7a5a-4484-9667-07d4192bd89c for instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 on n-h1-841089-2 May 10 02:14:44.755250 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-339ca864-7adc-4eea-8ae6-976636038f50 req-ddd03f72-fcaf-4186-952f-2a507f329913 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089408 May 10 02:14:44.758332 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 544/1135] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:44.771730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:44.785865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:44.798176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.800678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.802711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.803479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.846915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:14:44.947399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:44.955928 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2a68112-072a-434c-aa56-2c1e14e6d753 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.310752 May 10 02:14:44.956721 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 592/1136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:44 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:44.971286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:44.972106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:44.979464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.980233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.981572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74b88946-d119-4536-89a6-70c989e428a6 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 204 len: 0 microversion: 2.1 time: 0.221473 May 10 02:14:44.981707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:44.982342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:44.986464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 545/1137] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:14:44 2022] DELETE /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:44.994207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:44.995009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:45.002428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.003171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.004983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.005593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.220942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:45.229834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5362d089-e91c-46fe-bbfc-43ec8200929a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.263227 May 10 02:14:45.242430 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 593/1138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:44 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:45.249195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:45.259618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:45.267991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:45.275111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.276216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.277193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.278592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1245e2e0-cb8c-4492-afe6-671f707a7120 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.288680 May 10 02:14:45.279884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.280430 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 546/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:44 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:45.300896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:45.302016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:45.309923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.311334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.312410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.312956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.469598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:45.482040 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06c813f8-bd6f-4f1f-bf4a-fe19389610e1 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1527 microversion: 2.1 time: 0.238150 May 10 02:14:45.484277 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 594/1140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:45 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1527 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:45.499572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:45.501047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:45.509886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.510591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.511676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.512481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.527354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:45.540403 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00c871c7-2ae3-47a9-8b95-7825c33a2a7e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.258120 May 10 02:14:45.542722 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 547/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:45 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:45.682994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:45.684825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:45.700777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.701765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.702739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.703536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.810011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:45.828888 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddfd511d-85d5-40a5-ab67-fbcaeb0e1692 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.340967 May 10 02:14:45.829714 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 595/1142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:45 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:45.975134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:45.975976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:45.989711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:45.990860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:45.993080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.004920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.150456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.166002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.167737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.168937 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5ada82a-f6e2-4e95-aa74-2c19bdf34054 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.491838 May 10 02:14:46.181945 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 548/1143] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:45 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:46.262057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:46.263650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:46.272456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.273234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.274083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.274936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.354453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.363315 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-15bc77c2-66ef-46d9-b137-88873cbf56c3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.393598 May 10 02:14:46.374420 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 596/1144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:45 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:46.379567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:46.380442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:46.387906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.388626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.392274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.392937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.562618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.572167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b83ef754-a77c-4226-b15c-ce615d6c43b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.320979 May 10 02:14:46.581920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 549/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:46 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:46.587827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7c63e0dd-a43e-4485-bb3e-b31461941808 req-3a985f20-5c5c-482e-90d1-d5b5e734c314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10aa49-ee3f-42e5-9761-83bdf2d0299b", "name": "network-vif-unplugged", "status": "completed", "tag": "12ad8c9f-0bcb-460c-b95d-b477061d65b2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:46.600750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7c63e0dd-a43e-4485-bb3e-b31461941808 req-3a985f20-5c5c-482e-90d1-d5b5e734c314 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.601630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7c63e0dd-a43e-4485-bb3e-b31461941808 req-3a985f20-5c5c-482e-90d1-d5b5e734c314 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.620239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.630710 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7c63e0dd-a43e-4485-bb3e-b31461941808 req-3a985f20-5c5c-482e-90d1-d5b5e734c314 service nova] Creating event network-vif-unplugged:12ad8c9f-0bcb-460c-b95d-b477061d65b2 for instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b on n-h2-841089-2 May 10 02:14:46.631939 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cae4cf48-3438-4f67-9e40-a95698328b24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.256166 May 10 02:14:46.633752 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 597/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:46 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:46.639497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:46.641829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:46.648617 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7c63e0dd-a43e-4485-bb3e-b31461941808 req-3a985f20-5c5c-482e-90d1-d5b5e734c314 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065073 May 10 02:14:46.651599 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 550/1147] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:46.656835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.657303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.658101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.658551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.659373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:46.660317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:46.668844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.669790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.671441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.672057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.858111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.865796 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab73666d-39cd-41f4-b99c-2cfdd47c854f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1527 microversion: 2.1 time: 0.229975 May 10 02:14:46.876114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 598/1148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:46 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1527 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:46.881405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:46.882366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:46.889067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:46.889599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.890147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.891211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:46.891867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:46.910229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aad14e07-fb7b-407a-81ed-3903ba189d01 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.257368 May 10 02:14:46.914995 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 551/1149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:46 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:47.031935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:47.041010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee376997-d062-4d3c-acbb-445084872647 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.162535 May 10 02:14:47.048190 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 599/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:46 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:47.189631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:47.190441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:47.197272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:47.197975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:47.198950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:47.199718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:47.381996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:47.382673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:47.393526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:47.394228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:47.395230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:47.395843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:47.794998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:47.809308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:47.812279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:47.816767 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aac553f4-1d1c-4766-97e2-04a6263af948 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.632079 May 10 02:14:47.817524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 552/1151] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:47 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:47.823852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:47.824657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:47.833442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:47.834675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:47.836169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:47.836962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.027687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:48.036707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35540f54-e4dd-46d6-be0c-d29ba513b755 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.658993 May 10 02:14:48.042771 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 600/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:47 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:14:48.047848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:48.048483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:48.066780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.067520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.068353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.068810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.464762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:48.479198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-977071fb-e81a-47ff-8446-c31c29c6b7a6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.659740 May 10 02:14:48.481693 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 553/1153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:47 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:48.490338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:48.491913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:48.504177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.505336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.509519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.510297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.657484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:48.665673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3d6bc35e-ecc2-4f5c-a4d8-0064d062f017 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.620985 May 10 02:14:48.666375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 601/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:48 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:48.673787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:48.674562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:48.681368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.681963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.682927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.683552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.922858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:48.930290 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e005cd18-a1b4-437b-9eaa-309001042c5a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 200 len: 1527 microversion: 2.1 time: 0.446118 May 10 02:14:48.931342 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 554/1155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:48 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 1527 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:48.935858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:48.936602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:48.942188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.942638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:48.943449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:48.943887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:49.071672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:49.079543 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-22973b3a-d516-4dcc-a735-d6c91ad12d3e tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.411011 May 10 02:14:49.080220 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 602/1156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:48 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:49.084682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e7d85bb5-5a96-49d7-874c-84cb3bdc7234 req-245f4a50-f7b8-4a61-9004-9cd5b3175932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8962c96e-b870-4700-bf38-f78601e5854e", "name": "network-vif-plugged", "status": "completed", "tag": "845550c8-69e5-4cd3-91b8-30fd8a345295"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:49.093124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e7d85bb5-5a96-49d7-874c-84cb3bdc7234 req-245f4a50-f7b8-4a61-9004-9cd5b3175932 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:49.093651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e7d85bb5-5a96-49d7-874c-84cb3bdc7234 req-245f4a50-f7b8-4a61-9004-9cd5b3175932 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:49.105442 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e7d85bb5-5a96-49d7-874c-84cb3bdc7234 req-245f4a50-f7b8-4a61-9004-9cd5b3175932 service nova] Creating event network-vif-plugged:845550c8-69e5-4cd3-91b8-30fd8a345295 for instance 8962c96e-b870-4700-bf38-f78601e5854e on n-h2-841089-2 May 10 02:14:49.110312 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e7d85bb5-5a96-49d7-874c-84cb3bdc7234 req-245f4a50-f7b8-4a61-9004-9cd5b3175932 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028899 May 10 02:14:49.110911 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 603/1157] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:49.281606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c302352-bb6b-4f3d-8ee0-abc494dbc545 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] Action: 'create', calling method: .version_select at 0x7f3d37187c10>, body: {"security_group": {"name": "tempest-securitygroup-2113589975", "description": "tempest-description-206373059"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:49.314154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:49.324049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bcb4354a-4e01-453b-8c2b-38a16a4b3cd7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.391591 May 10 02:14:49.324630 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 555/1158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:48 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:49.340449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:49.341065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:49.347743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:49.348395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:49.349200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:49.349625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:49.696645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:49.706450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:49.708054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:49.709225 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f4f4970d-7ac3-4e57-8574-e722f1e7e746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.372674 May 10 02:14:49.719792 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 556/1159] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:49 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:49.724784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:49.725069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:49.731303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:49.731812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:49.732600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:49.733036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.006739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:50.015326 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b373d5c7-2017-405a-a07e-afcd3b2b5ff3 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.294479 May 10 02:14:50.015999 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 557/1160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:49 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:50.021656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-567f7bda-62a8-4055-8e19-9d4c8f67f026 req-f46f058a-d863-488e-b747-308e89dea521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb10aa49-ee3f-42e5-9761-83bdf2d0299b", "name": "network-vif-deleted", "tag": "12ad8c9f-0bcb-460c-b95d-b477061d65b2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:50.031130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-567f7bda-62a8-4055-8e19-9d4c8f67f026 req-f46f058a-d863-488e-b747-308e89dea521 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.031594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-567f7bda-62a8-4055-8e19-9d4c8f67f026 req-f46f058a-d863-488e-b747-308e89dea521 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.043023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-567f7bda-62a8-4055-8e19-9d4c8f67f026 req-f46f058a-d863-488e-b747-308e89dea521 service nova] Creating event network-vif-deleted:12ad8c9f-0bcb-460c-b95d-b477061d65b2 for instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b on n-h2-841089-2 May 10 02:14:50.048865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-567f7bda-62a8-4055-8e19-9d4c8f67f026 req-f46f058a-d863-488e-b747-308e89dea521 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 May 10 02:14:50.050495 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 558/1161] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:50.060160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:50.061470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:50.067750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.068379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.069385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.070034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.094783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c302352-bb6b-4f3d-8ee0-abc494dbc545 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.982076 May 10 02:14:50.099821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 604/1162] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:50.106070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:50.108006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:50.115782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.116658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.118177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.118743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.372822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:50.380309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-561f6157-c24b-4e78-9fbd-b8a757bbb7f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1312 microversion: 2.1 time: 0.328334 May 10 02:14:50.381041 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 559/1163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:50 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:50.394152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:50.394771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:50.400473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.400920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.401701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.402143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.406482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:50.415465 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ecc989ad-74da-4bab-93c3-f9cf88ff6153 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.314198 May 10 02:14:50.416055 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 605/1164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:50 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:50.418732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b HTTP/1.1 May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:14:50.421061 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:14:50.422339 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'cb10aa49-ee3f-42e5-9761-83bdf2d0299b'} May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:14:50.423102 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:14:50.424419 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:14:50.425487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:14:50.425487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6bdf442-83d9-4213-b9bf-8557d842ff0e tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 404 len: 111 microversion: 2.1 time: 0.031931 May 10 02:14:50.425487 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 560/1165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:50 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:14:50.426695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:50.427501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:50.427683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfd9f759-8646-4f6d-bf43-9a35fc9dce14 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] Action: 'create', calling method: .version_select at 0x7f3d3703ed30>, body: {"security_group": {"name": "tempest-securitygroup-22029796", "description": "tempest-description-13430425"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:50.433861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.434326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.435150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.435693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.757339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:50.765140 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6759222c-508a-4185-962d-413f14ac4dea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1472 microversion: 2.1 time: 0.347671 May 10 02:14:50.765734 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 606/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:50 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:50.770247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:50.770862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:50.777412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.777950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.779196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:50.780239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:50.878829 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfd9f759-8646-4f6d-bf43-9a35fc9dce14 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 217 microversion: 2.1 time: 0.454496 May 10 02:14:50.879941 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 561/1167] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:50 2022] POST /compute/v2.1/os-security-groups => generated 217 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:50.885195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1942667787", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:50.940104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] validate_networks() for [('0d719d6b-b89f-4847-9aaf-10a99b24bfcf', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:14:51.469324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:51.477696 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6542b0c-e5fb-4c82-9123-2513c82d8925 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.710995 May 10 02:14:51.478279 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 607/1168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:50 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:51.483530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:51.484152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:51.490079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:51.490546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:51.491363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:51.491814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:51.891637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:51.899983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:51.901489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:51.902657 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2a89af5-f915-48b5-a50a-227f2b004b02 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1646 microversion: 2.25 time: 0.423290 May 10 02:14:51.903556 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 608/1169] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:51 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1646 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:51.960834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc81ec88-e24d-40ca-b585-e59972b1dd82 tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] Action: 'create', calling method: .version_select at 0x7f3d371e5940>, body: {"security_group": {"name": "tempest-securitygroup-35115358", "description": "tempest-description-245406167"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:52.173856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:52.174766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:52.175049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:52.175669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:52.176807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:52.196588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.197248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.198643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.199592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.223537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:14:52.229684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Getting quotas for user fa657ea59867462a91093cea627895f8 and project b8656b70052a47bcaa4c2c25a0a929ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:14:52.245102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:14:52.248929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:14:52.311005 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-997dfd6c-bc3b-4b46-a865-083820890e35 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.428976 May 10 02:14:52.312112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 562/1170] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:14:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:14:52.318153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:52.319170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:52.327167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.328200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.329382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.330256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.475510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc81ec88-e24d-40ca-b585-e59972b1dd82 tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.570643 May 10 02:14:52.481999 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 609/1171] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:51 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:52.488290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d789321a-0cd2-4289-b6b2-f124b5d695cf req-2928bf71-a7eb-4a7e-9b3c-8067ba23f24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9509d8d2-b9af-4154-a5e7-e0a9815ea577", "name": "network-vif-plugged", "status": "completed", "tag": "6f4ae02f-7a5a-4484-9667-07d4192bd89c"}, {"server_uuid": "4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb", "name": "network-vif-plugged", "status": "completed", "tag": "37eeb610-2295-49f7-8a36-15f4b415874b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:52.498005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d789321a-0cd2-4289-b6b2-f124b5d695cf req-2928bf71-a7eb-4a7e-9b3c-8067ba23f24f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.498703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d789321a-0cd2-4289-b6b2-f124b5d695cf req-2928bf71-a7eb-4a7e-9b3c-8067ba23f24f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.514061 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d789321a-0cd2-4289-b6b2-f124b5d695cf req-2928bf71-a7eb-4a7e-9b3c-8067ba23f24f service nova] Creating event network-vif-plugged:6f4ae02f-7a5a-4484-9667-07d4192bd89c for instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 on n-h1-841089-2 May 10 02:14:52.514533 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d789321a-0cd2-4289-b6b2-f124b5d695cf req-2928bf71-a7eb-4a7e-9b3c-8067ba23f24f service nova] Creating event network-vif-plugged:37eeb610-2295-49f7-8a36-15f4b415874b for instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb on n-h2-841089-2 May 10 02:14:52.525510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d789321a-0cd2-4289-b6b2-f124b5d695cf req-2928bf71-a7eb-4a7e-9b3c-8067ba23f24f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041329 May 10 02:14:52.526830 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 610/1172] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:52.533044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:52.533892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:52.540195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.540854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.541915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.542524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.555535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:52.563853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2240ec38-1f5f-46b1-a1d6-88607f66e149 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.250447 May 10 02:14:52.564532 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 563/1173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:52 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:52.568819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:52.569424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:52.575143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.575603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.576418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.576859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.739148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:52.747310 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c8eeae1-3462-44ac-b442-0f302274dc97 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1461 microversion: 2.1 time: 0.219224 May 10 02:14:52.748395 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 611/1174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:52 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1461 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:52.753876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:52.754547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:52.760882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.762807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.763784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.764233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.771054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:52.779643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47ac6dac-bc0a-4a8c-a65e-88455d711125 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.213759 May 10 02:14:52.783221 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 564/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:52 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:52.787253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-156c3fb5-4254-415e-81b8-f910abbaf6bb req-6f90647d-31d5-474c-9f6a-ee446fa0a443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ba2859-735c-49d1-94e0-48d745fcad0e", "name": "network-vif-unplugged", "status": "completed", "tag": "a8ec29aa-bdf9-420a-b041-1bcced8ee65f"}, {"name": "network-changed", "server_uuid": "39ba2859-735c-49d1-94e0-48d745fcad0e", "tag": "a8ec29aa-bdf9-420a-b041-1bcced8ee65f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:52.807973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-156c3fb5-4254-415e-81b8-f910abbaf6bb req-6f90647d-31d5-474c-9f6a-ee446fa0a443 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.808910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-156c3fb5-4254-415e-81b8-f910abbaf6bb req-6f90647d-31d5-474c-9f6a-ee446fa0a443 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.822409 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-156c3fb5-4254-415e-81b8-f910abbaf6bb req-6f90647d-31d5-474c-9f6a-ee446fa0a443 service nova] Creating event network-vif-unplugged:a8ec29aa-bdf9-420a-b041-1bcced8ee65f for instance 39ba2859-735c-49d1-94e0-48d745fcad0e on n-h2-841089-2 May 10 02:14:52.822604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-156c3fb5-4254-415e-81b8-f910abbaf6bb req-6f90647d-31d5-474c-9f6a-ee446fa0a443 service nova] Creating event network-changed:a8ec29aa-bdf9-420a-b041-1bcced8ee65f for instance 39ba2859-735c-49d1-94e0-48d745fcad0e on n-h2-841089-2 May 10 02:14:52.838547 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-156c3fb5-4254-415e-81b8-f910abbaf6bb req-6f90647d-31d5-474c-9f6a-ee446fa0a443 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.056946 May 10 02:14:52.839349 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 565/1176] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:52.845062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:52.846223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:52.853221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.854140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.855386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:52.856045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:52.980461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:52.988937 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee014791-55d6-45bd-9abe-ac511274afee tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1229 microversion: 2.1 time: 0.148583 May 10 02:14:52.990189 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 566/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:52 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1229 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:52.997731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6dcbac4b-04c8-4843-af3e-d7d3f7a7f8bf tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] Action: 'create', calling method: .version_select at 0x7f3d45ac6c10>, body: {"security_group": {"name": "tempest-securitygroup-72929823", "description": "tempest-description-1939648864"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:53.028460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.046515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4f15346-31d9-4f4a-a200-2ef3cef4b3ec tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1478 microversion: 2.1 time: 0.297036 May 10 02:14:53.047299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 612/1178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:52 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1478 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:53.056857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:53.062119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:53.069563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.071674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.072576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.072959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.306861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.317098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c29251f-68ed-4988-bdca-ff87d56c6d11 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.264015 May 10 02:14:53.327139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 613/1179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:53 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:53.332704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:53.333941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:53.341804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.342514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.343599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.343775 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6dcbac4b-04c8-4843-af3e-d7d3f7a7f8bf tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.351094 May 10 02:14:53.344371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.352478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 567/1180] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:14:52 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:53.360635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:53.360635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:53.367100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.367557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.368331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.368761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.442135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.448546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Old instance type m1.heat2, new instance type m1.heat {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 02:14:53.455679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:14:53.456107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:14:53.456589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:14:53.457002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:14:53.457420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:14:53.510109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.519613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.521185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.522330 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13a69641-4010-41f6-b835-524d73e72fcb tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1636 microversion: 2.25 time: 0.168019 May 10 02:14:53.522885 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 568/1181] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:53 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1636 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:53.527209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3db33757-c70c-4d31-8c42-f28ba9a89424 tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] Calling method '.version_select at 0x7f3d3703e670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:53.565546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fec16501-44f5-44a9-9ff9-189ea1c4832f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e/action" status: 202 len: 0 microversion: 2.1 time: 0.236636 May 10 02:14:53.566504 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 614/1182] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:53 2022] POST /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:53.570850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a510ca1-100b-4b93-8ed1-fc477c48cab3 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '.version_select at 0x7f3d37194550>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:53.573473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a510ca1-100b-4b93-8ed1-fc477c48cab3 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.574226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a510ca1-100b-4b93-8ed1-fc477c48cab3 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.587652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a510ca1-100b-4b93-8ed1-fc477c48cab3 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3448 microversion: 2.25 time: 0.020136 May 10 02:14:53.588611 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 615/1183] 10.222.0.52 () {60 vars in 1183 bytes} [Tue May 10 02:14:53 2022] GET /compute/v2.1/os-migrations => generated 3448 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:53.594068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:53.594682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:53.600978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.601432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.602564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:53.602976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:53.981802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:53.997151 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-73e70a1f-166a-4c9e-9f88-06a0ab0be9b1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1470 microversion: 2.1 time: 0.407256 May 10 02:14:54.011194 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 616/1184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:53 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:54.019175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:54.020934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:54.028591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:54.029940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:54.033106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:54.033571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:54.282261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:54.298766 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ffe623b1-46a3-4f0c-86cb-23dd2ba68e93 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1322 microversion: 2.1 time: 0.286208 May 10 02:14:54.312441 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 617/1185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:54 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:54.312441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:54.314693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:54.323648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:54.324356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:54.325224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:54.325751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:54.651172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 2caaf280-a323-44ef-a538-116e02a6af60 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:54.669735 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43c5dcbe-2b3e-4858-9bb5-a9ef7ed050e1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 2129 microversion: 2.25 time: 0.364616 May 10 02:14:54.670321 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 618/1186] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:54 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 2129 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:54.687725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:54.693029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:54.701349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:54.701872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:54.704824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:54.705428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.042281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:55.051173 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-986ae4f0-765a-48c0-b5f3-0bec54c12ced tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1315 microversion: 2.1 time: 0.379595 May 10 02:14:55.052328 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 619/1187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:54 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:55.057200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:55.058042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:55.064538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.064994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.065780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.066220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.157899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:55.165170 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17b3d799-ec64-486c-be0e-d23f2ed873f9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1283 microversion: 2.1 time: 0.111553 May 10 02:14:55.165749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 620/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:55 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1283 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:55.179461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:55.180077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:55.186525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.186993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.187800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.188246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.447591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:55.456292 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-713093e4-25aa-4737-a2d2-5c8270d03717 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1478 microversion: 2.1 time: 0.280288 May 10 02:14:55.457133 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 621/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:55 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1478 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:55.461889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:55.462499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:55.470075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.470662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.471654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.472293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.731898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:55.740516 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-34a3b5a2-9691-4d1b-82b9-d54ba5845d85 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.282192 May 10 02:14:55.741766 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 622/1190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:55 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:55.754315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:55.754941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:55.760978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.761435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:55.762213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:55.762659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:56.466794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid 2caaf280-a323-44ef-a538-116e02a6af60 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:56.480202 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1d5cf608-07e1-4433-86b4-739a10703632 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 2129 microversion: 2.25 time: 0.737404 May 10 02:14:56.480796 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 623/1191] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:14:55 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 2129 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:14:56.485242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:56.485856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:56.491695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:56.492375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:56.494411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:56.494873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:56.841730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:56.849132 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-81a1cbd7-ef17-473a-a71d-975bd55fa5ba tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1470 microversion: 2.1 time: 0.367342 May 10 02:14:56.861130 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 624/1192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:56 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:56.861130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:56.861130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:56.864340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:56.864801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:56.865635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:56.866072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:57.181242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:57.188620 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d13ba167-6444-4812-b829-6e10fb60c7e0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1471 microversion: 2.1 time: 0.337954 May 10 02:14:57.189359 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 625/1193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:56 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:57.193621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:57.194411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:57.200162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:57.200840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:57.201631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:57.202075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:57.525154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:57.538834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82aaa685-e51f-4b35-b11f-9570b7612537 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1501 microversion: 2.1 time: 0.348557 May 10 02:14:57.539440 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 626/1194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:57 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1501 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:57.544803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:57.545627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:57.561594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:57.562078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:57.563497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:57.564131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:57.798441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:57.808637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce16d55a-6013-4f65-bf8d-79c81d55988f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1325 microversion: 2.1 time: 0.267932 May 10 02:14:57.819438 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 627/1195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:57 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:57.825384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:57.826721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:57.838445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:57.839012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:57.840007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:57.840655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.065549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:58.075598 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49c65c3c-2164-4edb-9ab0-153cecbc9df5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1478 microversion: 2.1 time: 0.254107 May 10 02:14:58.077129 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 628/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:57 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1478 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:58.113601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:58.114290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:58.122733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.123321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.124949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.125469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.272842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lazy-loading 'services' on Instance uuid 2caaf280-a323-44ef-a538-116e02a6af60 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:58.398805 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c379fa6-aeac-4419-a6f1-23e8fcd663f0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments/63e46c85-b4f4-428e-96d8-6e4c7aa10a43" status: 202 len: 0 microversion: 2.25 time: 0.311333 May 10 02:14:58.399813 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 629/1197] 10.222.0.52 () {60 vars in 1456 bytes} [Tue May 10 02:14:58 2022] DELETE /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments/63e46c85-b4f4-428e-96d8-6e4c7aa10a43 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:14:58.406079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:58.406793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:58.413146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.415722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.416611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.417077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.568113 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3db33757-c70c-4d31-8c42-f28ba9a89424 tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12419 microversion: 2.1 time: 5.043864 May 10 02:14:58.580809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 569/1198] 10.222.0.52 () {58 vars in 1190 bytes} [Tue May 10 02:14:53 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12419 bytes in 5050 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:14:58.580809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:58.580809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:58.587259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.587821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.588714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.589153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.616924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lazy-loading 'flavor' on Instance uuid 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:14:58.657503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:58.665946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24c3a1e8-20f8-4c8f-b09c-3595e8402c96 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.264573 May 10 02:14:58.677307 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 630/1199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:58 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:58.687320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5f413bff-f221-487e-b444-7bbb49bc0a4f req-ea1eb954-8bfd-45c8-a3c9-db4d36f8a542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f14d520-8ca8-49ee-af8e-5c0b6a52b570", "name": "network-vif-plugged", "status": "completed", "tag": "3f95e3d9-24f4-4658-86c3-0e9a1abaf85d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:58.697270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5f413bff-f221-487e-b444-7bbb49bc0a4f req-ea1eb954-8bfd-45c8-a3c9-db4d36f8a542 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.697739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5f413bff-f221-487e-b444-7bbb49bc0a4f req-ea1eb954-8bfd-45c8-a3c9-db4d36f8a542 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.711443 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5f413bff-f221-487e-b444-7bbb49bc0a4f req-ea1eb954-8bfd-45c8-a3c9-db4d36f8a542 service nova] Creating event network-vif-plugged:3f95e3d9-24f4-4658-86c3-0e9a1abaf85d for instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 on n-h1-841089-2 May 10 02:14:58.719575 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5f413bff-f221-487e-b444-7bbb49bc0a4f req-ea1eb954-8bfd-45c8-a3c9-db4d36f8a542 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038986 May 10 02:14:58.721070 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 631/1200] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:58.729222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5c749c3f-4748-4c2f-b978-38cdbc1fffd6 req-f5dc6fa8-4c6e-4b4c-889c-73f296f623ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9da626-6b12-4cba-9271-167623296ff7", "tag": "31faa4e2-e052-4f02-9e96-08a21bf43ab4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:14:58.743943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5c749c3f-4748-4c2f-b978-38cdbc1fffd6 req-f5dc6fa8-4c6e-4b4c-889c-73f296f623ef service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.744405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5c749c3f-4748-4c2f-b978-38cdbc1fffd6 req-f5dc6fa8-4c6e-4b4c-889c-73f296f623ef service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.751938 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f1376051-71a0-424f-9bcd-60a301c2860c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb/action" status: 202 len: 0 microversion: 2.1 time: 0.176732 May 10 02:14:58.752926 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 570/1201] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:14:58 2022] POST /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:58.759225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:58.759682 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5c749c3f-4748-4c2f-b978-38cdbc1fffd6 req-f5dc6fa8-4c6e-4b4c-889c-73f296f623ef service nova] Creating event network-changed:31faa4e2-e052-4f02-9e96-08a21bf43ab4 for instance 8b9da626-6b12-4cba-9271-167623296ff7 on n-h2-841089-2 May 10 02:14:58.766024 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5c749c3f-4748-4c2f-b978-38cdbc1fffd6 req-f5dc6fa8-4c6e-4b4c-889c-73f296f623ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043377 May 10 02:14:58.767040 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 632/1202] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:14:58.773293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:58.775109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:58.776541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:58.783272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.784562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.785402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.785871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.786094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.786658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:58.786979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.787124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:58.827855 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f313c9b4-e3b7-4176-b93b-3f8ae4afa0ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058553 May 10 02:14:58.828666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 633/1203] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:14:58 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:14:58.842117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78fea11c-1be6-4ba9-b701-f162cdc7c2f3 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] Calling method '.version_select at 0x7f3d37194c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.042211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:59.050882 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-083dc6d1-26ff-4445-8e3d-0f043f66a242 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.296121 May 10 02:14:59.051766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 571/1204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:58 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:59.056839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.057785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:59.064557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.065152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.066047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.066701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.213860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78fea11c-1be6-4ba9-b701-f162cdc7c2f3 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1108 microversion: 2.1 time: 0.383939 May 10 02:14:59.214475 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 634/1205] 10.222.0.52 () {58 vars in 1190 bytes} [Tue May 10 02:14:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1108 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:59.221136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.221913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:59.228972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.229521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.230457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.230939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.424780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:59.432886 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2de968b3-41fb-4961-a082-3e5f60c7278b tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1325 microversion: 2.1 time: 0.217310 May 10 02:14:59.434256 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 635/1206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:59 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:59.436365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-78fd865f-72c5-4749-ad29-28929181fef9 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1630 microversion: 2.1 time: 0.383300 May 10 02:14:59.436942 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 572/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:59 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1630 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:59.439132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.439755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:59.442010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef4cc260-d348-487b-9fb6-05af9e9ff1c9 tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] Calling method '.version_select at 0x7f3d370143a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.445901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.446375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.447181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.447633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.620024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:59.628281 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-47d84177-375a-4d9b-a5c6-70e08c801bc3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1478 microversion: 2.1 time: 0.193159 May 10 02:14:59.628959 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 636/1208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:59 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:59.677661 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef4cc260-d348-487b-9fb6-05af9e9ff1c9 tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/61090909-a4b7-4e5c-b8b1-7e2c3321bc52" status: 202 len: 0 microversion: 2.1 time: 0.239488 May 10 02:14:59.681407 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 573/1209] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:59 2022] DELETE /compute/v2.1/os-security-groups/61090909-a4b7-4e5c-b8b1-7e2c3321bc52 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:59.684940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.686263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:59.687202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5941acc2-9455-4844-9a19-1a7fdb3a5aad tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] Calling method '.version_select at 0x7f3d370160d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.697242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.703249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.704122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.705011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.886332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:14:59.894140 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e19460c8-8f98-4a8d-8929-54675307faf3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.213790 May 10 02:14:59.894801 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 637/1210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:14:59 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:14:59.899493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.900514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:14:59.906502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.906960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.907772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:14:59.908219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:14:59.922813 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5941acc2-9455-4844-9a19-1a7fdb3a5aad tempest-SecurityGroupsTestAdminJSON-2032232908 tempest-SecurityGroupsTestAdminJSON-2032232908-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/209d5c71-97c1-4c49-89f0-0a72f3f74f3c" status: 202 len: 0 microversion: 2.1 time: 0.240112 May 10 02:14:59.923686 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 574/1211] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:59 2022] DELETE /compute/v2.1/os-security-groups/209d5c71-97c1-4c49-89f0-0a72f3f74f3c => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:14:59.932064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-809a4977-8ddc-4866-afb6-68d1da023132 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] Calling method '.version_select at 0x7f3d3703e5e0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:14:59.938729 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-309d6ff1-0e5f-4c12-b1e3-46723deda902 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.042722 May 10 02:14:59.940043 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 638/1212] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:14:59 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:00.011317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33bd2539-84c9-46e0-b6ab-57344c79c253"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:00.012443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:00.018327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.018788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.019606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.020055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.111883 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-809a4977-8ddc-4866-afb6-68d1da023132 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/31024bc1-1862-4163-9f17-c6d8033532ed" status: 202 len: 0 microversion: 2.1 time: 0.183661 May 10 02:15:00.112497 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 575/1213] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:14:59 2022] DELETE /compute/v2.1/os-security-groups/31024bc1-1862-4163-9f17-c6d8033532ed => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:00.116962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:00.117566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:00.124569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.125020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.131637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.132076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.279412 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71a33085-1362-4c90-9811-2d47a9ef60f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270739 May 10 02:15:00.284576 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 639/1214] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:15:00 2022] POST /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:00.284733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:00.289040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05649da5-2f16-4b2e-95da-71415490c6c1 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] Calling method '.version_select at 0x7f3d371d2e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:00.291981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04afc747-5db8-41bf-986a-730f33473ae5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.178483 May 10 02:15:00.296288 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 576/1215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:00 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:00.452106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:00.453348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:00.461387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.461848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.463286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.463741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.551029 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05649da5-2f16-4b2e-95da-71415490c6c1 tempest-SecurityGroupsTestAdminJSON-774346865 tempest-SecurityGroupsTestAdminJSON-774346865-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3850b823-c4cf-4828-8a83-470ffdffdf18" status: 202 len: 0 microversion: 2.1 time: 0.269310 May 10 02:15:00.558389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 640/1216] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:15:00 2022] DELETE /compute/v2.1/os-security-groups/3850b823-c4cf-4828-8a83-470ffdffdf18 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:00.564023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:00.565589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:00.586930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.588315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.589307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.589927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.694634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:00.711984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c520c583-2b7d-4879-a6dd-cdd31293f2e9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1325 microversion: 2.1 time: 0.265056 May 10 02:15:00.721963 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 577/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:00 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:00.725559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:00.727687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:00.734978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.735511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.736458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.736907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.784925 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0867a4ec-efeb-4277-aeb3-fbb4fb348114 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1630 microversion: 2.1 time: 0.224045 May 10 02:15:00.787117 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 641/1218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:00 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1630 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:00.912348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:00.913347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:00.922924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.925259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:00.926269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:00.927733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.131230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:01.139240 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c528d300-556b-4375-87ab-178a8fd529ea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1463 microversion: 2.1 time: 0.421347 May 10 02:15:01.142229 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 578/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:00 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1463 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:01.150501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:01.157951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:01.173382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.174208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.175273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.175918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.239000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c6387e37-29a9-44af-b1ac-a1381563ada7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095375 May 10 02:15:01.246620 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 579/1220] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:01 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:01.266170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:01.268321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:01.282713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.283520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.284735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.285653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.342603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:01.362942 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bb15c060-6e3f-4811-9097-9abdb3ce8cb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.454668 May 10 02:15:01.364897 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 642/1221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:00 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:01.378135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:01.381865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:01.398540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.400071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.401951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.407393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.421782 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-603512ce-4568-4b7c-9c9c-0ee95a05969a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 0 microversion: 2.1 time: 0.173754 May 10 02:15:01.426577 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 580/1222] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:01 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:01.432698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:01.433970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:01.444461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.445415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.446673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.447474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.487320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:01.488031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:01.488894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lazy-loading 'fault' on Instance uuid 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:15:02.226068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:02.233700 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76465a9e-1e32-4fa5-9e78-8a465a61f83b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.866731 May 10 02:15:02.245295 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 643/1223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:01 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:02.253387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:02.254044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:02.263949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.267885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.268739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.270684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.314548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0fbbaea5-4aba-4fb2-9a85-5c540abc921a tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1597 microversion: 2.1 time: 0.886277 May 10 02:15:02.315160 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 581/1224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:01 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1597 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:02.340520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:02.341106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:02.361786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.366271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.367107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.371373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.686519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:02.698333 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00bafc30-cb1f-4ecb-a084-01a378dc73dc tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1325 microversion: 2.1 time: 0.451029 May 10 02:15:02.699502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 644/1225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:02 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:02.706765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:02.712870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:02.735032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.735929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.737335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.740215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.780923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb0701d0-b09d-4222-924b-fe641821ccb6 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1613 microversion: 2.1 time: 0.443978 May 10 02:15:02.781999 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 582/1226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:02 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1613 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:02.793977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:02.795007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:02.803754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.805031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.806038 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-033bed62-447b-48a3-82e6-9960aa9747af tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105289 May 10 02:15:02.806587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.807396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.809106 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 645/1227] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:02 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:02.814390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:02.815492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:02.832709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.833367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.834335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.834938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.935975 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d2d01c44-8e3d-42ba-a69a-3d85f244a04b tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action" status: 202 len: 0 microversion: 2.1 time: 0.151377 May 10 02:15:02.939474 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 583/1228] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:02 2022] POST /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:02.946194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:02.947440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:02.961327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.964427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:02.965369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:02.967406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.004402 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb while it is in vm_state suspended May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Request method failure captured: May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb/action HTTP/1.1 May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecp4GB4JXtDFAuzqrYVjJBmMBEDTVImVYZQj610Ket3faNAJr2XXtiQyoNS2vNISyw9ttflE1IVaAz4J_AY9kTvvVq4iMMLF17mKe7Ecl7lQaglLEfO6S6W4Zt1Y6a4OmJBa9zMg4U7ai7fLmPrAmc-sune40oiqwuxsTGmCtRXnkdQ May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:15:03.006296 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4029b18a5bd44ff383ff29746faa1ebc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: a9ebb70734704baaa43b0d46c0314e89 May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: {"migrate": {}} May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:15:03.010225 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'migrate' instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb while it is in vm_state suspended May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb', 'body': {'migrate': {}}} May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb in vm_state suspended. Cannot resize while the instance is in this state. May 10 02:15:03.011092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb while it is in vm_state suspended May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:03.012314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb while it is in vm_state suspended May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Returning 409 to user: Cannot 'migrate' instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb while it is in vm_state suspended {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d17c0917-9709-40c4-9944-a7f9e5e8b405 tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb/action" status: 409 len: 148 microversion: 2.1 time: 0.069874 May 10 02:15:03.014190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 584/1229] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:02 2022] POST /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb/action => generated 148 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:15:03.018764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.019429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.026366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.026829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.027747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.028511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.158222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:03.166984 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5a454059-d2d1-4c5f-b281-737512d40e40 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.356030 May 10 02:15:03.167799 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 646/1230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:02 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:03.172325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-467b3f2d-b3c7-41b7-98eb-0f3d70b4431b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-467b3f2d-b3c7-41b7-98eb-0f3d70b4431b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Request method failure captured: May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665/action HTTP/1.1 May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 39 May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp4GB4JXtDFAuzqrYVjJBmMBEDTVImVYZQj610Ket3faNAJr2XXtiQyoNS2vNISyw9ttflE1IVaAz4J_AY9kTvvVq4iMMLF17mKe7Ecl7lQaglLEfO6S6W4Zt1Y6a4OmJBa9zMg4U7ai7fLmPrAmc-sune40oiqwuxsTGmCtRXnkdQ May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:15:03.174712 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4029b18a5bd44ff383ff29746faa1ebc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: a9ebb70734704baaa43b0d46c0314e89 May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: {"os-resetState": {"state": "invalid"}} May 10 02:15:03.176052 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '19c68ee3-4ef4-429a-b82f-ebaf1db59665', 'body': {'os-resetState': {'state': 'invalid'}}} May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'invalid' May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.176775 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:15:03.178111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 10 02:15:03.179277 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.179277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-467b3f2d-b3c7-41b7-98eb-0f3d70b4431b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:03.179277 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-467b3f2d-b3c7-41b7-98eb-0f3d70b4431b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665/action" status: 400 len: 144 microversion: 2.1 time: 0.007612 May 10 02:15:03.184432 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 647/1231] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:03 2022] POST /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665/action => generated 144 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:03.190034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80a0f3e1-be3d-4a35-b632-62c355ef2e9b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80a0f3e1-be3d-4a35-b632-62c355ef2e9b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Request method failure captured: May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665/action HTTP/1.1 May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 31 May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp4GB4JXtDFAuzqrYVjJBmMBEDTVImVYZQj610Ket3faNAJr2XXtiQyoNS2vNISyw9ttflE1IVaAz4J_AY9kTvvVq4iMMLF17mKe7Ecl7lQaglLEfO6S6W4Zt1Y6a4OmJBa9zMg4U7ai7fLmPrAmc-sune40oiqwuxsTGmCtRXnkdQ May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:15:03.192311 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4029b18a5bd44ff383ff29746faa1ebc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: a9ebb70734704baaa43b0d46c0314e89 May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: {"os-resetState": {"state": 1}} May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:03.193589 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '19c68ee3-4ef4-429a-b82f-ebaf1db59665', 'body': {'os-resetState': {'state': 1}}} May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 1 May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:03.194394 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 10 02:15:03.196030 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.197133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80a0f3e1-be3d-4a35-b632-62c355ef2e9b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:03.197133 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80a0f3e1-be3d-4a35-b632-62c355ef2e9b tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665/action" status: 400 len: 120 microversion: 2.1 time: 0.007680 May 10 02:15:03.201181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 648/1232] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:03 2022] POST /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665/action => generated 120 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:03.207642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32d65c2c-5a1b-4adb-97db-a0f5b665ea1c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:03.208559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32d65c2c-5a1b-4adb-97db-a0f5b665ea1c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Failed to fetch instance by id 999 {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:15:03.209079 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-32d65c2c-5a1b-4adb-97db-a0f5b665ea1c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] HTTP exception thrown: Instance 999 could not be found. May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32d65c2c-5a1b-4adb-97db-a0f5b665ea1c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Request method failure captured: May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 37 May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp4GB4JXtDFAuzqrYVjJBmMBEDTVImVYZQj610Ket3faNAJr2XXtiQyoNS2vNISyw9ttflE1IVaAz4J_AY9kTvvVq4iMMLF17mKe7Ecl7lQaglLEfO6S6W4Zt1Y6a4OmJBa9zMg4U7ai7fLmPrAmc-sune40oiqwuxsTGmCtRXnkdQ May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:15:03.210966 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4029b18a5bd44ff383ff29746faa1ebc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4029b18a5bd44ff383ff29746faa1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 4029b18a5bd44ff383ff29746faa1ebc May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1096229079 May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: a9ebb70734704baaa43b0d46c0314e89 May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1096229079-project-admin May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: {"os-resetState": {"state": "error"}} May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:03.212390 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 999 could not be found. May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:03.213193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32d65c2c-5a1b-4adb-97db-a0f5b665ea1c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:03.214597 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32d65c2c-5a1b-4adb-97db-a0f5b665ea1c tempest-ServersAdminNegativeTestJSON-1096229079 tempest-ServersAdminNegativeTestJSON-1096229079-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010077 May 10 02:15:03.218751 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 649/1233] 10.222.0.52 () {60 vars in 1178 bytes} [Tue May 10 02:15:03 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:15:03.223983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.224492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.231098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.231631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.232528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.232978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.262310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:03.319094 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb19e6b6-d804-410b-9ce0-149006c4b66e tempest-ServersAdminTestJSON-513281919 tempest-ServersAdminTestJSON-513281919-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1614 microversion: 2.1 time: 0.309791 May 10 02:15:03.323173 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 585/1234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:03 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1614 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:03.339258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.340278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.356278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.358692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.362371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.363344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.367479 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3cbbe4a7-e36e-4cec-87f9-3a18f39a567b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 204 len: 0 microversion: 2.1 time: 0.147150 May 10 02:15:03.369190 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 650/1235] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:03 2022] DELETE /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:03.378638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.380123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.387586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.388158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.389018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.389688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.424632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:03.551769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc56c67b-0124-4fd2-b067-3cdb6a63d8d4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "DELETE /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 204 len: 0 microversion: 2.1 time: 0.180963 May 10 02:15:03.552474 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 651/1236] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:03 2022] DELETE /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:03.565005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.565880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.588165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.588625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.597189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.599375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.617991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:03.631349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a7dded6d-20d1-4d89-9908-cd0d999db595 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.304361 May 10 02:15:03.632197 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 586/1237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:03 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:03.637675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.638522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.646834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.647625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.648589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.649325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.900081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:03.922596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-298a65e5-161a-4950-b402-25d542af1992 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1468 microversion: 2.1 time: 0.368610 May 10 02:15:03.933025 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 652/1238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:03 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1468 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:03.937870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.938499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.941612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:03.945802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.946388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.947321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.947873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:03.949353 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb7b8b96-23da-463d-9b6d-e10d7a06b083 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1468 microversion: 2.1 time: 0.315790 May 10 02:15:03.962903 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 587/1239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:03 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:03.976957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:03.977973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:03.992095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:03.998298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.001465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.003674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.047225 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-110aba13-ee9a-4734-8ea1-cbbb9eb76919 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083107 May 10 02:15:04.047933 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 588/1240] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:03 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:04.052510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d0f40edf-f01e-4b9b-b387-f0385d5703b2 req-d0e8874e-0db6-4dd8-b94e-831d1bc3c0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9da626-6b12-4cba-9271-167623296ff7", "name": "network-vif-plugged", "status": "completed", "tag": "31faa4e2-e052-4f02-9e96-08a21bf43ab4"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:04.062296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d0f40edf-f01e-4b9b-b387-f0385d5703b2 req-d0e8874e-0db6-4dd8-b94e-831d1bc3c0e3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.062837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d0f40edf-f01e-4b9b-b387-f0385d5703b2 req-d0e8874e-0db6-4dd8-b94e-831d1bc3c0e3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.076256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d0f40edf-f01e-4b9b-b387-f0385d5703b2 req-d0e8874e-0db6-4dd8-b94e-831d1bc3c0e3 service nova] Creating event network-vif-plugged:31faa4e2-e052-4f02-9e96-08a21bf43ab4 for instance 8b9da626-6b12-4cba-9271-167623296ff7 on n-h2-841089-2 May 10 02:15:04.081802 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d0f40edf-f01e-4b9b-b387-f0385d5703b2 req-d0e8874e-0db6-4dd8-b94e-831d1bc3c0e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 May 10 02:15:04.083007 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 589/1241] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:04.191775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.192831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:04.195188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:04.206422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.207190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.208573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.209115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.209738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18502506-426b-4b7c-9c75-ec2178cc10b5 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1325 microversion: 2.1 time: 0.275573 May 10 02:15:04.210628 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 653/1242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:03 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:04.338788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Action: 'update', calling method: .version_select at 0x7f3d3708b3a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:04.340472 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.340472 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:15:04.342208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.342665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.350264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.350720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.361716 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] HTTP exception thrown: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Request method failure captured: May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b HTTP/1.1 May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 56 May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecqorac8SaFF26xAhafXl_NNvW-OWcSaTuJ-8OJe_scJ8vltC40HEsPULLQ2Nkyjt2XsNM1D9eN8HHDw78FUC2dDbbBx3sI_5Xpiqzwf7k2cWM_p0XKh8p6_94yDySSTmfV7C5w1n0Wn5dXvQRoe8oalbOQJOW9gSSv9CzwY1V7A7tU May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.53 May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 75dbb0ccff2e497f855bf727d63becbe May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:15:04.364160 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75dbb0ccff2e497f855bf727d63becbe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 75dbb0ccff2e497f855bf727d63becbe May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 465c6026b8284262bcbecf6ba37885b5 May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: {"status": "disabled", "disabled_reason": "maintenance"} May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:04.365530 n-d-841089-2 devstack@n-api.service[118716]: exception: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e3b3c8d3-bcee-43fa-aa93-45932341279b', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5938, in _find_service_in_cell May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6080, in service_get_by_id May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.366370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.367814 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:04.369023 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:04.369023 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.369023 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.370863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Returning 404 to user: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:04.371975 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a590d9a-a2f3-4f69-bf82-5006d78c1974 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b" status: 404 len: 110 microversion: 2.53 time: 0.160283 May 10 02:15:04.372814 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 654/1243] 10.222.0.52 () {62 vars in 1308 bytes} [Tue May 10 02:15:04 2022] PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b => generated 110 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:04.377756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:04.382463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Action: 'update', calling method: .version_select at 0x7f3d3708bc10>, body: {"status": "disabled"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:04.385682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.385825 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46372090-e541-44b3-ac98-5a87d49e7b92 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.199119 May 10 02:15:04.386143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.387115 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 590/1244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:04.396179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.396635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.401428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] HTTP exception thrown: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Request method failure captured: May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b HTTP/1.1 May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 22 May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecqorac8SaFF26xAhafXl_NNvW-OWcSaTuJ-8OJe_scJ8vltC40HEsPULLQ2Nkyjt2XsNM1D9eN8HHDw78FUC2dDbbBx3sI_5Xpiqzwf7k2cWM_p0XKh8p6_94yDySSTmfV7C5w1n0Wn5dXvQRoe8oalbOQJOW9gSSv9CzwY1V7A7tU May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.53 May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 75dbb0ccff2e497f855bf727d63becbe May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:15:04.403363 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75dbb0ccff2e497f855bf727d63becbe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 75dbb0ccff2e497f855bf727d63becbe May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 465c6026b8284262bcbecf6ba37885b5 May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: {"status": "disabled"} May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: exception: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.405297 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e3b3c8d3-bcee-43fa-aa93-45932341279b', 'body': {'status': 'disabled'}} May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5938, in _find_service_in_cell May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6080, in service_get_by_id May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.406174 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:04.408830 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:04.411516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.411516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.411516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Returning 404 to user: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:04.411516 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a846f925-814b-41ff-b232-584f84361303 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b" status: 404 len: 110 microversion: 2.53 time: 0.026880 May 10 02:15:04.411516 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 655/1245] 10.222.0.52 () {62 vars in 1308 bytes} [Tue May 10 02:15:04 2022] PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 02:15:04.415044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Action: 'update', calling method: .version_select at 0x7f3d36fcd0d0>, body: {"status": "enabled"} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:04.416443 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.416443 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:15:04.417587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.418041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.425646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.426106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.433239 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] HTTP exception thrown: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Request method failure captured: May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: request: PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b HTTP/1.1 May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 21 May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecqorac8SaFF26xAhafXl_NNvW-OWcSaTuJ-8OJe_scJ8vltC40HEsPULLQ2Nkyjt2XsNM1D9eN8HHDw78FUC2dDbbBx3sI_5Xpiqzwf7k2cWM_p0XKh8p6_94yDySSTmfV7C5w1n0Wn5dXvQRoe8oalbOQJOW9gSSv9CzwY1V7A7tU May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.53 May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 75dbb0ccff2e497f855bf727d63becbe May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:15:04.435279 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75dbb0ccff2e497f855bf727d63becbe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75dbb0ccff2e497f855bf727d63becbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 75dbb0ccff2e497f855bf727d63becbe May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425 May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 465c6026b8284262bcbecf6ba37885b5 May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: {"status": "enabled"} May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: exception: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.436635 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'e3b3c8d3-bcee-43fa-aa93-45932341279b', 'body': {'status': 'enabled'}} May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5938, in _find_service_in_cell May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6080, in service_get_by_id May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.437543 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:04.438775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:04.441907 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. May 10 02:15:04.441907 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:04.441907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Returning 404 to user: Service e3b3c8d3-bcee-43fa-aa93-45932341279b could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:04.441907 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1ab9144-ba43-4dad-ad95-f94ddcec8ad3 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b" status: 404 len: 110 microversion: 2.53 time: 0.025544 May 10 02:15:04.441907 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 591/1246] 10.222.0.52 () {62 vars in 1308 bytes} [Tue May 10 02:15:04 2022] PUT /compute/v2.1/os-services/e3b3c8d3-bcee-43fa-aa93-45932341279b => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:04.446253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05bfba92-91a6-4009-9cf4-c76b21dd5276 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.447525 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.447525 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:15:04.448727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bfba92-91a6-4009-9cf4-c76b21dd5276 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.449182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bfba92-91a6-4009-9cf4-c76b21dd5276 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.449982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bfba92-91a6-4009-9cf4-c76b21dd5276 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.450966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bfba92-91a6-4009-9cf4-c76b21dd5276 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.474431 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05bfba92-91a6-4009-9cf4-c76b21dd5276 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.031723 May 10 02:15:04.475308 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 656/1247] 10.222.0.52 () {60 vars in 1177 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:15:04.488127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7b081e17-ef8b-4208-868b-b007cfebda3f tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.489336 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.489336 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:15:04.490546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b081e17-ef8b-4208-868b-b007cfebda3f tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.491022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b081e17-ef8b-4208-868b-b007cfebda3f tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.491849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b081e17-ef8b-4208-868b-b007cfebda3f tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.492296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b081e17-ef8b-4208-868b-b007cfebda3f tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.517658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7b081e17-ef8b-4208-868b-b007cfebda3f tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.034983 May 10 02:15:04.518427 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 592/1248] 10.222.0.52 () {60 vars in 1210 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:15:04.530113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19d16cc1-d26b-4543-8626-c6912f7853a8 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.531315 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.531315 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:15:04.532520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19d16cc1-d26b-4543-8626-c6912f7853a8 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.533249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19d16cc1-d26b-4543-8626-c6912f7853a8 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.534063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19d16cc1-d26b-4543-8626-c6912f7853a8 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.534726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19d16cc1-d26b-4543-8626-c6912f7853a8 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.558005 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19d16cc1-d26b-4543-8626-c6912f7853a8 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.031786 May 10 02:15:04.558600 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 657/1249] 10.222.0.52 () {60 vars in 1177 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:15:04.569844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40bc4327-0557-41c2-ab66-0ac93f5ef63a tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.571528 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.571528 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:15:04.572823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40bc4327-0557-41c2-ab66-0ac93f5ef63a tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.573457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40bc4327-0557-41c2-ab66-0ac93f5ef63a tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.574350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40bc4327-0557-41c2-ab66-0ac93f5ef63a tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.575164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40bc4327-0557-41c2-ab66-0ac93f5ef63a tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.598691 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40bc4327-0557-41c2-ab66-0ac93f5ef63a tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-841089-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.032349 May 10 02:15:04.599447 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 593/1250] 10.222.0.52 () {60 vars in 1234 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services?host=n-d-841089-2&binary=xxx => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:04.610689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46d91c75-1714-4dc5-948a-a23d8ddcd73e tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.612022 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.612022 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:15:04.613238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d91c75-1714-4dc5-948a-a23d8ddcd73e tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.613698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d91c75-1714-4dc5-948a-a23d8ddcd73e tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.614551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d91c75-1714-4dc5-948a-a23d8ddcd73e tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.614997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d91c75-1714-4dc5-948a-a23d8ddcd73e tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.652479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.653637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:04.659475 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46d91c75-1714-4dc5-948a-a23d8ddcd73e tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.052509 May 10 02:15:04.663423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.664418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.665481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.666154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.668258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 658/1251] 10.222.0.52 () {60 vars in 1177 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:15:04.675289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95fc612a-ef7d-401f-a43e-077a1fe7ee05 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.676593 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.676593 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:15:04.678124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95fc612a-ef7d-401f-a43e-077a1fe7ee05 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.678794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95fc612a-ef7d-401f-a43e-077a1fe7ee05 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.679808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95fc612a-ef7d-401f-a43e-077a1fe7ee05 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.680709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95fc612a-ef7d-401f-a43e-077a1fe7ee05 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.719023 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-95fc612a-ef7d-401f-a43e-077a1fe7ee05 tempest-ServicesAdminNegativeV253TestJSON-247266425 tempest-ServicesAdminNegativeV253TestJSON-247266425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.048202 May 10 02:15:04.726639 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 659/1252] 10.222.0.52 () {60 vars in 1238 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:04.851694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:04.862212 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-edac64e1-41cd-46d8-8100-0846ad3bc7a3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.216603 May 10 02:15:04.873074 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 594/1253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:04.898278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db5e8c2c-04f2-4fba-a286-361b0adbcfc3 tempest-ServicesAdminNegativeV253TestJSON-1717259135 tempest-ServicesAdminNegativeV253TestJSON-1717259135-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.899189 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:04.899189 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:15:04.900326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db5e8c2c-04f2-4fba-a286-361b0adbcfc3 tempest-ServicesAdminNegativeV253TestJSON-1717259135 tempest-ServicesAdminNegativeV253TestJSON-1717259135-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e196fad67e7b43e9ae4aabb587e8f602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b9a6a0b6d549029193bf87b3626b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db5e8c2c-04f2-4fba-a286-361b0adbcfc3 tempest-ServicesAdminNegativeV253TestJSON-1717259135 tempest-ServicesAdminNegativeV253TestJSON-1717259135-project] Request method failure captured: May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-services HTTP/1.1 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecqn-fDQrtHRg-RTiC-EdOSfSTyt2DcK4LqMovDYonUHoWkL-3tQqC--cfGbPwlLxcbf74QEJXR03WM4KQlkZUz1UoRFWNVEpSlNMw3sE2bwZWIPKtpGO_7U4aorTt0JuMkhkG-qM3kQNsnV8mME03bGtvpzbbKP0ASE77Kb8G3GzUs May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.53 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 32b9a6a0b6d549029193bf87b3626b91 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1717259135 May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:04.901955 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_32b9a6a0b6d549029193bf87b3626b91", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32b9a6a0b6d549029193bf87b3626b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/32b9a6a0b6d549029193bf87b3626b91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32b9a6a0b6d549029193bf87b3626b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1717259135 May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 32b9a6a0b6d549029193bf87b3626b91 May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1717259135 May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1717259135-project May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: e196fad67e7b43e9ae4aabb587e8f602 May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1717259135-project May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 10 02:15:04.903716 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:15:04.904495 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 10 02:15:04.905654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:04.906870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db5e8c2c-04f2-4fba-a286-361b0adbcfc3 tempest-ServicesAdminNegativeV253TestJSON-1717259135 tempest-ServicesAdminNegativeV253TestJSON-1717259135-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:04.906870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db5e8c2c-04f2-4fba-a286-361b0adbcfc3 tempest-ServicesAdminNegativeV253TestJSON-1717259135 tempest-ServicesAdminNegativeV253TestJSON-1717259135-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.175503 May 10 02:15:04.908837 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 660/1254] 10.222.0.52 () {60 vars in 1177 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/os-services => generated 112 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:04.940254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.940912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:04.947305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.947770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.948558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.949011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.969260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:04.970364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:04.978699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.979286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:04.980273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:04.980783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.359891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:05.365137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:05.383948 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-003c0008-ce2d-4aa6-97c3-01cfc5e199f4 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1468 microversion: 2.1 time: 0.447626 May 10 02:15:05.388461 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a4aa1b6-852c-487d-ba95-3daec0ef2a3a tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1468 microversion: 2.1 time: 0.422957 May 10 02:15:05.389633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 595/1255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1468 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:05.391865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 661/1256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:04 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1468 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:05.406668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:05.407348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:05.408528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:05.410150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:05.422615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.423091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.427339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.427793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.428868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.430291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.430842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.432469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.500978 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41ba793b-165a-40ff-a6e4-1ce57b139912 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110229 May 10 02:15:05.502245 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 596/1257] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:05 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:05.506760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:05.507543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:05.515702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.515702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.516430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.516864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.856038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:05.863502 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8f6a67d-5c73-46f1-aff3-f46620220bab tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1325 microversion: 2.1 time: 0.470579 May 10 02:15:05.868085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 662/1258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:05 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:05.880304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:05.881122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:05.887220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.887710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:05.889120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:05.889570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.057911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:06.067138 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98a34917-7c37-4714-8bd3-1a85b4fc58e2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.563627 May 10 02:15:06.078107 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 597/1259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:05 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:06.192879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:06.201554 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-045244e2-0205-4e11-b5c1-5cf1a13979ea tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.326275 May 10 02:15:06.211732 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 663/1260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:05 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:06.413687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:06.414281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:06.415466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:06.416706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:06.434211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.436269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.437405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.438047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.438699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.439646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.440374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.443090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.701479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:06.712293 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-281e1713-526f-4e2c-bd20-c9958f6048c6 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 200 len: 1426 microversion: 2.1 time: 0.307423 May 10 02:15:06.712941 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 664/1261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:06 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 1426 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:06.722948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:06.726193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:06.739629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.740094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.741005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.741452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.761984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:06.798388 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b20283c-f722-4fde-8927-6121846bccd0 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 200 len: 1426 microversion: 2.1 time: 0.372523 May 10 02:15:06.808017 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 598/1262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:06 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 1426 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:06.814276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-880f168a-f132-4964-8feb-adbcc15928f3 req-1d0eaa4a-55b6-4e9c-b218-78d91ec51863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb", "name": "network-vif-deleted", "tag": "37eeb610-2295-49f7-8a36-15f4b415874b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:06.860653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-880f168a-f132-4964-8feb-adbcc15928f3 req-1d0eaa4a-55b6-4e9c-b218-78d91ec51863 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.863184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-880f168a-f132-4964-8feb-adbcc15928f3 req-1d0eaa4a-55b6-4e9c-b218-78d91ec51863 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.890392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-880f168a-f132-4964-8feb-adbcc15928f3 req-1d0eaa4a-55b6-4e9c-b218-78d91ec51863 service nova] Creating event network-vif-deleted:37eeb610-2295-49f7-8a36-15f4b415874b for instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb on n-h2-841089-2 May 10 02:15:06.893033 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cfbcfaf6-6efd-485d-901a-91fb138ebf47 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.161218 May 10 02:15:06.893994 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 665/1263] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:06 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:06.913228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:06.913509 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-880f168a-f132-4964-8feb-adbcc15928f3 req-1d0eaa4a-55b6-4e9c-b218-78d91ec51863 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107085 May 10 02:15:06.913980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:06.914710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 599/1264] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:06.927755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.928229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:06.929030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:06.929480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.086477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:07.087587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:07.096863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.097638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.107693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.110064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.433558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:07.443315 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59f2a17b-5d69-4c1f-a830-b82d351e3d09 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1521 microversion: 2.1 time: 0.547960 May 10 02:15:07.457419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 666/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:06 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:07.474558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:07.475379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:07.511454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.512355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.516150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.527686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.594923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:07.608432 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4e13006-dd17-40c2-94e0-e578c6bcdf39 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.526373 May 10 02:15:07.610040 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 600/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:07 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:07.618408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:07.619366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:07.627164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.627971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.629129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.630111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.662428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:07.765851 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc48dbfb-07e2-4046-b28b-a507d1facaec tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 204 len: 0 microversion: 2.1 time: 0.153883 May 10 02:15:07.766778 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 601/1267] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:07 2022] DELETE /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:07.914764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7da08585-b87e-4737-bb42-ad689d1a9dab tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:07.924741 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7da08585-b87e-4737-bb42-ad689d1a9dab tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.156607 May 10 02:15:07.929132 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 602/1268] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:15:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:07.933340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:07.934234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 54eee163-ad8b-421c-be94-e5a973f28745] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:07.942505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.943084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.943952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.944608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.964238 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] HTTP exception thrown: Instance 54eee163-ad8b-421c-be94-e5a973f28745 could not be found. May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Request method failure captured: May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 HTTP/1.1 May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecowXNU6C6Mbc5Wr7suoqypjUXetw5avK66fH4Z-nrcbQgJuDYzv2foOK8y_UBe9Txs-JkWhD5lRv4ESS1xzHyP4DmXXOOcTNxekp5PH_VwgXgwJg8wbDQJwZJkRcvYj_OQeco5ZW89qIlaN3QAuCfPcwPG-Paklm-XJ1UC8XFz0xzk May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 107552c6b0a94d33b3a7b66af44f9740 May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:15:07.966273 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_107552c6b0a94d33b3a7b66af44f9740", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 107552c6b0a94d33b3a7b66af44f9740 May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersAdminTestJSON-1541196951-project May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 3425cd583e7d46e7aef80bc35e859b15 May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersAdminTestJSON-1541196951-project May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 54eee163-ad8b-421c-be94-e5a973f28745 could not be found. May 10 02:15:07.968072 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '54eee163-ad8b-421c-be94-e5a973f28745'} May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54eee163-ad8b-421c-be94-e5a973f28745 could not be found. May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:07.969029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54eee163-ad8b-421c-be94-e5a973f28745 could not be found. May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54eee163-ad8b-421c-be94-e5a973f28745 could not be found. May 10 02:15:07.970515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:07.971862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Returning 404 to user: Instance 54eee163-ad8b-421c-be94-e5a973f28745 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:07.971862 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0befe568-4194-4fe6-82cb-9af0d6564709 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745" status: 404 len: 111 microversion: 2.1 time: 0.042103 May 10 02:15:07.971862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 603/1269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:07 2022] GET /compute/v2.1/servers/54eee163-ad8b-421c-be94-e5a973f28745 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:07.978144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:07.978781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:07.987929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.989962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:07.991145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:07.992310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.213460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:08.224316 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e5817da-e7ea-4a3b-9a74-4b6b21686070 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.763523 May 10 02:15:08.238370 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 667/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:07 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:08.245375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.246110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.258469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.258955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.259964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.260638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.283004 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] HTTP exception thrown: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb could not be found. May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Request method failure captured: May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb HTTP/1.1 May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp3eR7RIAOxowqK450DoAiTz8Gq8tLHj9gTxYxpYueJx6hcVaWNfb_0yQun6gRjJ-MDkQ-LpfVKtYpOnJNBo9Ik6VyQw9wAo0RXmYCOGaRSU8Zvzqy-3vsC0yH3rO24ZS2TvMj1VbVRKkReye7pIm-unN9whI7-wAhPYeq0L2JZoNk May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: d1b2066e0b794483b3d7cf8aca6ad655 May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-978416446 May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:08.284649 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1b2066e0b794483b3d7cf8aca6ad655", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1b2066e0b794483b3d7cf8aca6ad655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1b2066e0b794483b3d7cf8aca6ad655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1b2066e0b794483b3d7cf8aca6ad655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminNegativeTestJSON-978416446 May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: d1b2066e0b794483b3d7cf8aca6ad655 May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-978416446 May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminNegativeTestJSON-978416446-project May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f0951d520ac94a8f80efa1986944a0fc May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminNegativeTestJSON-978416446-project May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb could not be found. May 10 02:15:08.285963 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb'} May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb could not be found. May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:08.286725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb could not be found. May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb could not be found. May 10 02:15:08.288455 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.289534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Returning 404 to user: Instance 4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:08.289534 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ce55733-5a92-4625-86de-82ab4175b07c tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb" status: 404 len: 111 microversion: 2.1 time: 0.046579 May 10 02:15:08.290176 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 668/1271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:08 2022] GET /compute/v2.1/servers/4bb96eab-4b7f-4164-bc8b-7e7b3a2305bb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:08.295619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.296594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.302774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.303153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.303940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.304377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.305189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:08.313546 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cecec1ce-90b9-4411-abcc-600820d1ec9f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1527 microversion: 2.1 time: 0.340862 May 10 02:15:08.323397 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 604/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:07 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:08.328371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.329056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.336146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.336779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.337734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.337863 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a05c8ff4-e5c1-4cf2-b649-994cafd346c0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046496 May 10 02:15:08.338459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.338902 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 669/1273] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:08 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:08.346499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.347881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.355158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.355158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.356325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.357562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.369307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:08.395730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:08.474681 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92d7a1d1-7ebf-4835-a925-8135c9c55bea tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "DELETE /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 204 len: 0 microversion: 2.1 time: 0.149317 May 10 02:15:08.476110 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 605/1274] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:08 2022] DELETE /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:08.488055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.489067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.498563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.499262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.500347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.500948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.531623 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b9f30f8-0b43-48f1-9939-d2dae74f92a8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "DELETE /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 204 len: 0 microversion: 2.1 time: 0.188799 May 10 02:15:08.532830 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 670/1275] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:08 2022] DELETE /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:08.538337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbcd854c-4b0a-4aa2-9736-f8f72d2a5e30 tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1130200541", "imageRef": "12916bb4-fcb7-437c-96b6-ecaac8b15a7e", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:08.589603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-dbcd854c-4b0a-4aa2-9736-f8f72d2a5e30 tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:15:08.724921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:08.733804 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ea7320c-b2b5-4990-97eb-b89fecd42ba3 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1469 microversion: 2.1 time: 0.253178 May 10 02:15:08.743605 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 606/1276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:08 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:08.743605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.743605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.745601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.746059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.747175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.747361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.856030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-dbcd854c-4b0a-4aa2-9736-f8f72d2a5e30 tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbcd854c-4b0a-4aa2-9736-f8f72d2a5e30 tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] Request method failure captured: May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 143 May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecqrF2gAwDz-V9s2gHLfn_N5uyeJUzPFyCTAxl6K_QpKOOaOclfuk6vHBsDrg6H72bOEVYYTQI8go9ZvSrNGIbW7g0iz6HSeAis1sSIqHbTn0oWnQ7jMzsNprZ4KEQA-XvomwuLdWOK1CgRN1r0V7dBs7YXoa16UbU6hXwNq6XrAtdw May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 9b3a2b4c5e0045939ac0fcbcc5ee46b2 May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FlavorsV2NegativeTest-1896550930 May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:08.857975 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b3a2b4c5e0045939ac0fcbcc5ee46b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b3a2b4c5e0045939ac0fcbcc5ee46b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b3a2b4c5e0045939ac0fcbcc5ee46b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b3a2b4c5e0045939ac0fcbcc5ee46b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FlavorsV2NegativeTest-1896550930 May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 9b3a2b4c5e0045939ac0fcbcc5ee46b2 May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1896550930 May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FlavorsV2NegativeTest-1896550930-project May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: d4c088f2fedb4a82a8b18fdf819b59e2 May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FlavorsV2NegativeTest-1896550930-project May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1130200541", "imageRef": "12916bb4-fcb7-437c-96b6-ecaac8b15a7e", "flavorRef": "452"}} May 10 02:15:08.859330 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: exception: Flavor's memory is too small for requested image. May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1130200541', 'imageRef': '12916bb4-fcb7-437c-96b6-ecaac8b15a7e', 'flavorRef': '452'}}} May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:08.860074 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.861291 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbcd854c-4b0a-4aa2-9736-f8f72d2a5e30 tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbcd854c-4b0a-4aa2-9736-f8f72d2a5e30 tempest-FlavorsV2NegativeTest-1896550930 tempest-FlavorsV2NegativeTest-1896550930-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.325251 May 10 02:15:08.862591 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 671/1277] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:15:08 2022] POST /compute/v2.1/servers => generated 93 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:15:08.868282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:08.869200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:08.876177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.876846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.877698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.878226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:08.934049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:08.945700 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9e524eb-b977-4d5d-bc2a-0d2b03c8315e tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1478 microversion: 2.1 time: 0.210005 May 10 02:15:08.950152 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 607/1278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:08 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:08.974132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-08ce8100-0765-4fd6-8f37-bfd9d09d239a req-3d9c51e5-d6a2-49e2-b5f6-4cd39930a012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eee163-ad8b-421c-be94-e5a973f28745", "name": "network-vif-deleted", "tag": "303dbe9d-d2f7-43d3-a59d-7e86baf9d76b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:08.984594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-08ce8100-0765-4fd6-8f37-bfd9d09d239a req-3d9c51e5-d6a2-49e2-b5f6-4cd39930a012 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:08.985398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-08ce8100-0765-4fd6-8f37-bfd9d09d239a req-3d9c51e5-d6a2-49e2-b5f6-4cd39930a012 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.000046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-08ce8100-0765-4fd6-8f37-bfd9d09d239a req-3d9c51e5-d6a2-49e2-b5f6-4cd39930a012 service nova] Creating event network-vif-deleted:303dbe9d-d2f7-43d3-a59d-7e86baf9d76b for instance 54eee163-ad8b-421c-be94-e5a973f28745 on n-h1-841089-2 May 10 02:15:09.005602 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-08ce8100-0765-4fd6-8f37-bfd9d09d239a req-3d9c51e5-d6a2-49e2-b5f6-4cd39930a012 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048113 May 10 02:15:09.006489 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 608/1279] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:09.073243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:09.082444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd6e82d5-b8d6-4ff7-bf76-e61ef583441a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.220782 May 10 02:15:09.083024 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 672/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:08 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:09.245318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:09.246123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:09.253596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.254050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.254862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.255693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.336619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:09.338188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:09.346391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.347138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.348956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.349509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.429906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:09.439233 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c032019-9f07-4524-b7b8-1381e30a59ab tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.198317 May 10 02:15:09.440631 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 609/1281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:09 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:09.446419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:09.447575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:09.454788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.455727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.456714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.457376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.498204 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3517ffa6-4fa0-410f-b49d-85cf91ce3030 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055624 May 10 02:15:09.501991 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 610/1282] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:09 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:09.504214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:09.512240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37086010-3788-48d7-8737-2ace65487317 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1527 microversion: 2.1 time: 0.184999 May 10 02:15:09.519105 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 673/1283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:09 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1527 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:09.751348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:09.751977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:09.764323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.765845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.766924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.767604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.963651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:09.964277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:09.972311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.972762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:09.974223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:09.974670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.012820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:10.020750 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf1c34ac-b04b-4e8a-a2ac-3415b853f53b tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1469 microversion: 2.1 time: 0.273226 May 10 02:15:10.035373 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 611/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:09 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:10.100578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:10.101589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:10.109156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.111298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.113794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.115099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.372677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:10.388523 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2af0c97c-7f17-4d7e-9184-a39c3feea9d8 tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1478 microversion: 2.1 time: 0.428102 May 10 02:15:10.399865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 674/1285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:09 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1478 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:10.464213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:10.466614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:10.478667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.480242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.481635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.482671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.779406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:10.789615 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee6ae932-9ad8-4e15-bfdd-ff9e6c93eecd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.693637 May 10 02:15:10.790760 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 612/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:10 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:10.803781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:10.805389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:10.813275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.814068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.815336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.816018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.849424 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d67e1ed2-910b-489f-ae10-cc8f709e1960 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057240 May 10 02:15:10.850756 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 613/1287] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:10 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:10.856245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:10.857549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:10.866284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.866788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:10.872024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:10.872753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:11.276533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:11.293425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a87eafd2-227c-4727-b652-edcf069972b4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.838075 May 10 02:15:11.299789 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 675/1288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:10 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:11.312338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:11.313215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:11.324177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:11.325020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:11.328128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:11.329887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:11.453877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:11.471750 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6bb0c555-60aa-4b29-9440-b8f85dec3b0a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1527 microversion: 2.1 time: 0.618841 May 10 02:15:11.478604 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 614/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:10 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1527 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:11.490677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:11.491692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:11.516715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:11.517020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:11.517837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:11.518281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.269810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:12.277148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6d0d977f-22c1-4fa8-94ae-48776a651ec5 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1469 microversion: 2.1 time: 0.976063 May 10 02:15:12.277773 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 676/1290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:11 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1469 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:12.293144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:12.293807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:12.320864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.321333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.322149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.322596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.682509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:12.687835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0951d520ac94a8f80efa1986944a0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b2066e0b794483b3d7cf8aca6ad655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:12.696244 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3cd6812-79eb-4f89-9e7c-1f1a7a2af3c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1550 microversion: 2.1 time: 0.416659 May 10 02:15:12.697338 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 677/1291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:12 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1550 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:12.697807 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a12b40a-5339-42ac-b99c-f3f827b9cb0b tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 200 len: 1478 microversion: 2.1 time: 1.217595 May 10 02:15:12.700678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 615/1292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:11 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 1478 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:12.703568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:12.705100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:12.711038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:12.711614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:12.718228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.719037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.720271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.720983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.730911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.732245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.733218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.733665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.775154 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3cd43c8a-a9ca-4253-b7e8-dfe693380111 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076054 May 10 02:15:12.786080 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 678/1293] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:12 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:12.827482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:12.831477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:12.853816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.854643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:12.855739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:12.856987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.056602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa657ea59867462a91093cea627895f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656b70052a47bcaa4c2c25a0a929ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:13.077251 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f9aa7da1-ed79-4d6e-9b80-4bc2984ff507 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 200 len: 1485 microversion: 2.1 time: 0.289811 May 10 02:15:13.081127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 679/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:12 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 1485 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:13.086143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1cd589fb-1800-4fc8-b017-0219476fed08 req-e74d6f77-3959-4d97-bba7-71097e381ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c68ee3-4ef4-429a-b82f-ebaf1db59665", "name": "network-vif-deleted", "tag": "504f6793-d980-40d9-8613-eab5f925ba97"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:13.122821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1cd589fb-1800-4fc8-b017-0219476fed08 req-e74d6f77-3959-4d97-bba7-71097e381ad1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.123446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1cd589fb-1800-4fc8-b017-0219476fed08 req-e74d6f77-3959-4d97-bba7-71097e381ad1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.149169 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1cd589fb-1800-4fc8-b017-0219476fed08 req-e74d6f77-3959-4d97-bba7-71097e381ad1 service nova] Creating event network-vif-deleted:504f6793-d980-40d9-8613-eab5f925ba97 for instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 on n-h1-841089-2 May 10 02:15:13.161543 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1cd589fb-1800-4fc8-b017-0219476fed08 req-e74d6f77-3959-4d97-bba7-71097e381ad1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078824 May 10 02:15:13.162527 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 680/1295] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:13.298002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:13.299504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:13.306204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:13.314640 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9463e4d2-8ee2-4494-bd66-070b643f541a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.612924 May 10 02:15:13.321076 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 616/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:12 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:13.324253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.324942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.327576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.330139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.461904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:13.472452 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c2e1d3e6-c4fc-45df-b26f-b64364a0ae90 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 200 len: 1299 microversion: 2.1 time: 0.179613 May 10 02:15:13.481357 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 681/1297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:13 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:13.717111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:13.719321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:13.720571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:13.720966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] [instance: 19c68ee3-4ef4-429a-b82f-ebaf1db59665] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:13.733450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.735528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.736305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.737377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.738062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.739567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.742463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.743312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.773398 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] HTTP exception thrown: Instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 could not be found. May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Request method failure captured: May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 HTTP/1.1 May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecp3eR7RIAOxowqK450DoAiTz8Gq8tLHj9gTxYxpYueJx6hcVaWNfb_0yQun6gRjJ-MDkQ-LpfVKtYpOnJNBo9Ik6VyQw9wAo0RXmYCOGaRSU8Zvzqy-3vsC0yH3rO24ZS2TvMj1VbVRKkReye7pIm-unN9whI7-wAhPYeq0L2JZoNk May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: d1b2066e0b794483b3d7cf8aca6ad655 May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-978416446 May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:13.775774 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1b2066e0b794483b3d7cf8aca6ad655", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1b2066e0b794483b3d7cf8aca6ad655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1b2066e0b794483b3d7cf8aca6ad655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1b2066e0b794483b3d7cf8aca6ad655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminNegativeTestJSON-978416446 May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: d1b2066e0b794483b3d7cf8aca6ad655 May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-978416446 May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminNegativeTestJSON-978416446-project May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f0951d520ac94a8f80efa1986944a0fc May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminNegativeTestJSON-978416446-project May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 could not be found. May 10 02:15:13.777300 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '19c68ee3-4ef4-429a-b82f-ebaf1db59665'} May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 could not be found. May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:13.778309 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 could not be found. May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 could not be found. May 10 02:15:13.779561 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:13.782731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] Returning 404 to user: Instance 19c68ee3-4ef4-429a-b82f-ebaf1db59665 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:13.783813 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28366040-3548-4ed0-98b6-d01bc42d73ca tempest-ServersAdminNegativeTestJSON-978416446 tempest-ServersAdminNegativeTestJSON-978416446-project] 10.222.0.52 "GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665" status: 404 len: 111 microversion: 2.1 time: 0.070602 May 10 02:15:13.790572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 682/1298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:13 2022] GET /compute/v2.1/servers/19c68ee3-4ef4-429a-b82f-ebaf1db59665 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:13.803274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:13.804213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:13.818533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.819000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.819855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:13.821404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:13.921792 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32763f8c-29b0-4132-9970-04777436ba2b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128141 May 10 02:15:13.923883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 683/1299] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:13 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:14.010209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:14.020949 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-958c11c6-b343-4d75-b2a2-ad9d2ff7d794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1540 microversion: 2.1 time: 0.311214 May 10 02:15:14.022388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 617/1300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:13 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1540 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:14.042671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c89af80-78db-49c7-a453-d270ee590852 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '.version_select at 0x7f3d371d2700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.046977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c89af80-78db-49c7-a453-d270ee590852 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.047864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c89af80-78db-49c7-a453-d270ee590852 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.062239 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c89af80-78db-49c7-a453-d270ee590852 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3104 microversion: 2.1 time: 0.027701 May 10 02:15:14.063502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 684/1301] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/os-migrations => generated 3104 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:14.077386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.078312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.088256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.088589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.089579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.090191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.097507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.098136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 8b9da626-6b12-4cba-9271-167623296ff7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.108130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.109942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.110928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.118387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.141843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance 8b9da626-6b12-4cba-9271-167623296ff7 could not be found. May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 HTTP/1.1 May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:14.149688 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 8b9da626-6b12-4cba-9271-167623296ff7 could not be found. May 10 02:15:14.151127 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '8b9da626-6b12-4cba-9271-167623296ff7'} May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9da626-6b12-4cba-9271-167623296ff7 could not be found. May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:14.151912 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9da626-6b12-4cba-9271-167623296ff7 could not be found. May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9da626-6b12-4cba-9271-167623296ff7 could not be found. May 10 02:15:14.153421 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.154529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance 8b9da626-6b12-4cba-9271-167623296ff7 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:14.154529 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a02cd44-3d2a-475a-b0b9-e72de445e5be tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7" status: 404 len: 111 microversion: 2.1 time: 0.057621 May 10 02:15:14.155482 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 685/1302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/8b9da626-6b12-4cba-9271-167623296ff7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:15:14.166620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4411ef3-4c00-4a85-beb3-fcbbfc9c3755 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '.version_select at 0x7f3d371d2e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.195980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f4411ef3-4c00-4a85-beb3-fcbbfc9c3755 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Image not found. May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4411ef3-4c00-4a85-beb3-fcbbfc9c3755 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b HTTP/1.1 May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:14.197768 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '85367d9d-d69b-422d-a05f-716174ce005b'} May 10 02:15:14.199554 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 85367d9d-d69b-422d-a05f-716174ce005b to delete May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.200547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85367d9d-d69b-422d-a05f-716174ce005b could not be found. May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:14.202635 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4411ef3-4c00-4a85-beb3-fcbbfc9c3755 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:14.204227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4411ef3-4c00-4a85-beb3-fcbbfc9c3755 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b" status: 404 len: 62 microversion: 2.1 time: 0.043185 May 10 02:15:14.205415 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 686/1303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] DELETE /compute/v2.1/images/85367d9d-d69b-422d-a05f-716174ce005b => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:15:14.219690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.220425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.240094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.241709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.243633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.245354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.287056 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b HTTP/1.1 May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:14.291840 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.293282 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'cb10aa49-ee3f-42e5-9761-83bdf2d0299b'} May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:14.294123 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.295874 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.300862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:14.303890 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2355c57-27de-404c-a23b-3ab3597e3cd9 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 404 len: 111 microversion: 2.1 time: 0.096725 May 10 02:15:14.306195 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 687/1304] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:14 2022] DELETE /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:14.319837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.320712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: cb10aa49-ee3f-42e5-9761-83bdf2d0299b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.329269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.330109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.331446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.332770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.353231 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cf93561-9481-4c9c-b62f-a28fe200488d tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1691 microversion: 2.1 time: 0.281117 May 10 02:15:14.360795 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 618/1305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1691 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:14.393701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.393945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.394811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b HTTP/1.1 May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:14.396138 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.397878 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'cb10aa49-ee3f-42e5-9761-83bdf2d0299b'} May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:14.398752 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. May 10 02:15:14.400015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.401380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance cb10aa49-ee3f-42e5-9761-83bdf2d0299b could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:14.401380 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c8821af-8a3e-4263-b056-91e4863a2b1f tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b" status: 404 len: 111 microversion: 2.1 time: 0.084783 May 10 02:15:14.401380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 688/1306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/cb10aa49-ee3f-42e5-9761-83bdf2d0299b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:14.409439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.410386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.417318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.417994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.418842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.420556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.421223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.422304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.427891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.430428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.744673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91f41ca0-3832-47b6-808b-9a1c703e555f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1691 microversion: 2.1 time: 0.341431 May 10 02:15:14.747779 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 689/1307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1691 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:14.761060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a13ff4a-70d0-4947-bd5c-6791b8c0055a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '.version_select at 0x7f3d36ff6430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.832621 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a13ff4a-70d0-4947-bd5c-6791b8c0055a tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820328996" status: 202 len: 0 microversion: 2.1 time: 0.080972 May 10 02:15:14.836383 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 690/1308] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:15:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820328996 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:14.872704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:14.873276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.874054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 77517283-8636-44f0-8c0a-a9df64000a56] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.880543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.881008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.881819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.882275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.885732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4be4c244-a41e-4d4a-b4cb-1132f16c64f6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.505255 May 10 02:15:14.903211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 619/1309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:14.921767 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] HTTP exception thrown: Instance 77517283-8636-44f0-8c0a-a9df64000a56 could not be found. May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Request method failure captured: May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 HTTP/1.1 May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecowXNU6C6Mbc5Wr7suoqypjUXetw5avK66fH4Z-nrcbQgJuDYzv2foOK8y_UBe9Txs-JkWhD5lRv4ESS1xzHyP4DmXXOOcTNxekp5PH_VwgXgwJg8wbDQJwZJkRcvYj_OQeco5ZW89qIlaN3QAuCfPcwPG-Paklm-XJ1UC8XFz0xzk May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 107552c6b0a94d33b3a7b66af44f9740 May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:14.926020 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_107552c6b0a94d33b3a7b66af44f9740", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 107552c6b0a94d33b3a7b66af44f9740 May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminTestJSON-1541196951-project May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3425cd583e7d46e7aef80bc35e859b15 May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminTestJSON-1541196951-project May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 77517283-8636-44f0-8c0a-a9df64000a56 could not be found. May 10 02:15:14.927455 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '77517283-8636-44f0-8c0a-a9df64000a56'} May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77517283-8636-44f0-8c0a-a9df64000a56 could not be found. May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:14.928191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77517283-8636-44f0-8c0a-a9df64000a56 could not be found. May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77517283-8636-44f0-8c0a-a9df64000a56 could not be found. May 10 02:15:14.929399 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:14.930653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Returning 404 to user: Instance 77517283-8636-44f0-8c0a-a9df64000a56 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:14.930653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f329f14-7700-4102-8675-2be0d3016694 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56" status: 404 len: 111 microversion: 2.1 time: 0.090926 May 10 02:15:14.930653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 691/1310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/77517283-8636-44f0-8c0a-a9df64000a56 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:14.939954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.940472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.943340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:14.944693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:14.959901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.965279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.966716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.967537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.968538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.969589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:14.970241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:14.970876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:15.049926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:15.057815 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d7fcc38-e38a-49c7-9275-c4b1e7cb5734 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128319 May 10 02:15:15.061658 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 620/1311] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:14 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:15:15.215977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-167f7931-2f0f-4162-a030-92883b937f87 req-29a9b109-bca1-4e51-bbbf-f1a762460b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9da626-6b12-4cba-9271-167623296ff7", "name": "network-vif-deleted", "tag": "31faa4e2-e052-4f02-9e96-08a21bf43ab4"}, {"server_uuid": "77517283-8636-44f0-8c0a-a9df64000a56", "name": "network-vif-deleted", "tag": "c80677e4-247c-4eca-9d7b-a5f69cc0ce3f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:15.256784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-167f7931-2f0f-4162-a030-92883b937f87 req-29a9b109-bca1-4e51-bbbf-f1a762460b84 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:15.257364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-167f7931-2f0f-4162-a030-92883b937f87 req-29a9b109-bca1-4e51-bbbf-f1a762460b84 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:15.269779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ddc6a48-c94d-403b-bce6-f1371f1f07f4 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 204 len: 0 microversion: 2.1 time: 0.334390 May 10 02:15:15.270921 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 692/1312] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:14 2022] DELETE /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:15.290184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:15.294643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:15.315041 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-167f7931-2f0f-4162-a030-92883b937f87 req-29a9b109-bca1-4e51-bbbf-f1a762460b84 service nova] Creating event network-vif-deleted:31faa4e2-e052-4f02-9e96-08a21bf43ab4 for instance 8b9da626-6b12-4cba-9271-167623296ff7 on n-h2-841089-2 May 10 02:15:15.316015 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-167f7931-2f0f-4162-a030-92883b937f87 req-29a9b109-bca1-4e51-bbbf-f1a762460b84 service nova] Creating event network-vif-deleted:c80677e4-247c-4eca-9d7b-a5f69cc0ce3f for instance 77517283-8636-44f0-8c0a-a9df64000a56 on n-h2-841089-2 May 10 02:15:15.320081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:15.320572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:15.323833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:15.325623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:15.339029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-167f7931-2f0f-4162-a030-92883b937f87 req-29a9b109-bca1-4e51-bbbf-f1a762460b84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125235 May 10 02:15:15.340061 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 621/1313] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:15.670342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:15.678034 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-354bc4a5-1053-4ba6-8300-e3274ff06649 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1469 microversion: 2.1 time: 0.400044 May 10 02:15:15.687584 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 693/1314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:15 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:15.905342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:15.906645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:15.918201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:15.920177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:15.921245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:15.923699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.071650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:16.072518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:16.088538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.089003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.099139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.099615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.165078 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f4a79ec-e14b-42ed-a5cb-735dde06ddcd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096528 May 10 02:15:16.169207 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 694/1315] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:16 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:16.171085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e328c073-d47b-45f2-8f6f-92831863444c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '.version_select at 0x7f3d3708bb80>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:16.206015 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e328c073-d47b-45f2-8f6f-92831863444c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Image not found. May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e328c073-d47b-45f2-8f6f-92831863444c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/41220bf0-5575-4683-9d28-15bd64fee6ba HTTP/1.1 May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:16.208425 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '41220bf0-5575-4683-9d28-15bd64fee6ba'} May 10 02:15:16.209767 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 41220bf0-5575-4683-9d28-15bd64fee6ba to delete May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.210548 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41220bf0-5575-4683-9d28-15bd64fee6ba could not be found. May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:16.211706 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:15:16.212917 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.215977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e328c073-d47b-45f2-8f6f-92831863444c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:16.217275 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e328c073-d47b-45f2-8f6f-92831863444c tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/images/41220bf0-5575-4683-9d28-15bd64fee6ba" status: 404 len: 62 microversion: 2.1 time: 0.050504 May 10 02:15:16.218085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 695/1316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:16 2022] DELETE /compute/v2.1/images/41220bf0-5575-4683-9d28-15bd64fee6ba => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:15:16.227593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:16.228546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:16.240430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.241304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.242472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.243220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.276099 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa HTTP/1.1 May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:16.278900 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.280264 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa'} May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:16.281003 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.282258 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.286852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:16.288019 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4ce3d22c-fcf5-4c53-a33c-6283b50eae37 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 404 len: 111 microversion: 2.1 time: 0.065684 May 10 02:15:16.298118 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 696/1317] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:16 2022] DELETE /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:16.306577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:16.310191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] [instance: 70be7911-c078-4bad-91e9-b38423508afa] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:16.326542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:16.336319 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-140c2925-f111-4dea-b6dc-7c399b3dd050 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.437098 May 10 02:15:16.337036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.339278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.343158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.344795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.345168 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 622/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:15 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:16.368732 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] HTTP exception thrown: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Request method failure captured: May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa HTTP/1.1 May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpV2MNLUKrWQIOviag43qp3K8hBy4Hjwgdcz6XTo9CfMETM8JwJb6J0VyAYegm7-AQiBzUVp8W-IFZ2MjZeO-D0qUoQqYyPbx1qdC6P0s2YGKD3HOe2xDl7WjgqUW-lO3w4ZAyPwJJNtJktUzfnL5LCUBCacNOC92SeYMD41BtlS2Q May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:16.370284 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b8656b70052a47bcaa4c2c25a0a929ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b8656b70052a47bcaa4c2c25a0a929ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b8656b70052a47bcaa4c2c25a0a929ec May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-663643548 May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: fa657ea59867462a91093cea627895f8 May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-663643548-project May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.371701 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '70be7911-c078-4bad-91e9-b38423508afa'} May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:16.372500 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. May 10 02:15:16.373709 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:16.374827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] Returning 404 to user: Instance 70be7911-c078-4bad-91e9-b38423508afa could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:16.374827 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ebdb5de-c2b1-45f6-9fa3-1eaf8e159c33 tempest-ImagesOneServerNegativeTestJSON-663643548 tempest-ImagesOneServerNegativeTestJSON-663643548-project] 10.222.0.52 "GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa" status: 404 len: 111 microversion: 2.1 time: 0.071976 May 10 02:15:16.375875 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 697/1319] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:16 2022] GET /compute/v2.1/servers/70be7911-c078-4bad-91e9-b38423508afa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:16.697230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:16.698368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:16.712015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.713853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:16.717580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:16.718329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:17.177281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:17.178619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:17.182466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:17.196561 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-774bcb49-1b1d-4386-bed2-f4c057e89bdc tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1469 microversion: 2.1 time: 0.504597 May 10 02:15:17.200410 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 623/1320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:16 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:17.202138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:17.202809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:17.203949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:17.204897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:17.245767 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-306e6409-79d8-4484-93bd-fb6b2dab8def tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072999 May 10 02:15:17.247439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 698/1321] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:17 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:17.366296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:17.367376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:17.386299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:17.388523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:17.389553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:17.391013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:17.915831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b17abbe-6f8b-44fe-8f2c-3d6115f8313a tempest-ListImageFiltersNegativeTestJSON-203150202 tempest-ListImageFiltersNegativeTestJSON-203150202-project] Calling method '.version_select at 0x7f3d374d6e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:17.946316 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6b17abbe-6f8b-44fe-8f2c-3d6115f8313a tempest-ListImageFiltersNegativeTestJSON-203150202 tempest-ListImageFiltersNegativeTestJSON-203150202-project] HTTP exception thrown: Image not found. May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b17abbe-6f8b-44fe-8f2c-3d6115f8313a tempest-ListImageFiltersNegativeTestJSON-203150202 tempest-ListImageFiltersNegativeTestJSON-203150202-project] Request method failure captured: May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/images/454ebdc7-081f-4b5a-a79a-4fa643737fc3 HTTP/1.1 May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq15VFsHo7mHPdHV_d0mQKyA0DNqw38uY0XdAsuGOIHFaM-q4UYWWZKjZU5QEa9_OCHgDkhHsI-eZBA9wXmeAjqelowVLpfgMmcWuCqePDLFIZy2mloRL1l0baBgJ3m0Sv9T6NeJwnxuBK2v8jwFU20_8300Yx1q38cU2-Si6Kk6FU May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: de10a84b75184732908c6cfe0071a6e8 May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-203150202 May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:17.951915 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_de10a84b75184732908c6cfe0071a6e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de10a84b75184732908c6cfe0071a6e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/de10a84b75184732908c6cfe0071a6e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/de10a84b75184732908c6cfe0071a6e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-203150202 May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: de10a84b75184732908c6cfe0071a6e8 May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-203150202 May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListImageFiltersNegativeTestJSON-203150202-project May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 748b244440464bb08ab7117b16cc02c7 May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-203150202-project May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '454ebdc7-081f-4b5a-a79a-4fa643737fc3'} May 10 02:15:17.953583 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:15:17.954524 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 454ebdc7-081f-4b5a-a79a-4fa643737fc3 May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:15:17.955890 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 454ebdc7-081f-4b5a-a79a-4fa643737fc3 could not be found. May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:17.957450 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:15:17.958832 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:17.961633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b17abbe-6f8b-44fe-8f2c-3d6115f8313a tempest-ListImageFiltersNegativeTestJSON-203150202 tempest-ListImageFiltersNegativeTestJSON-203150202-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:17.963549 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b17abbe-6f8b-44fe-8f2c-3d6115f8313a tempest-ListImageFiltersNegativeTestJSON-203150202 tempest-ListImageFiltersNegativeTestJSON-203150202-project] 10.222.0.52 "GET /compute/v2.1/images/454ebdc7-081f-4b5a-a79a-4fa643737fc3" status: 404 len: 62 microversion: 2.1 time: 0.329403 May 10 02:15:17.972326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 699/1322] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:17 2022] GET /compute/v2.1/images/454ebdc7-081f-4b5a-a79a-4fa643737fc3 => generated 62 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:15:18.077060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:18.087353 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ce06e78-d650-492d-8908-e9c8dce2f0ac tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.726311 May 10 02:15:18.088036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 624/1323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:17 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:18.221141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:18.222074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:18.251443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:18.251922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:18.257867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:18.258879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:18.273171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:18.275512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:18.276270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:18.285261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:18.288700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:18.291152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:18.423029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19994d44-7fae-4452-be95-bb1e0fe97758 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164189 May 10 02:15:18.432190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 625/1324] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:18 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:15:18.467531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-42134829-7cbb-4b59-a4f2-a8ba018198fe req-0f3500f3-ac56-42b6-9e8e-2ebbb86c17f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f14d520-8ca8-49ee-af8e-5c0b6a52b570", "name": "network-vif-deleted", "tag": "3f95e3d9-24f4-4658-86c3-0e9a1abaf85d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:18.477428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3425cd583e7d46e7aef80bc35e859b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107552c6b0a94d33b3a7b66af44f9740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:18.488043 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-66ce8a6e-eb13-448c-89c3-18661f0b0d22 tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 200 len: 1427 microversion: 2.1 time: 0.273010 May 10 02:15:18.489343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 700/1325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:18 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 1427 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:18.499233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42134829-7cbb-4b59-a4f2-a8ba018198fe req-0f3500f3-ac56-42b6-9e8e-2ebbb86c17f8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:18.506415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42134829-7cbb-4b59-a4f2-a8ba018198fe req-0f3500f3-ac56-42b6-9e8e-2ebbb86c17f8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:18.530632 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-42134829-7cbb-4b59-a4f2-a8ba018198fe req-0f3500f3-ac56-42b6-9e8e-2ebbb86c17f8 service nova] Creating event network-vif-deleted:3f95e3d9-24f4-4658-86c3-0e9a1abaf85d for instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 on n-h1-841089-2 May 10 02:15:18.541986 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-42134829-7cbb-4b59-a4f2-a8ba018198fe req-0f3500f3-ac56-42b6-9e8e-2ebbb86c17f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085638 May 10 02:15:18.546288 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 626/1326] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:19.110605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:19.111382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:19.125336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:19.125803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:19.127615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:19.129243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:19.349447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:19.357132 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b97ee19-183b-417e-9341-4ddc2369a5a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.256607 May 10 02:15:19.360056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 701/1327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:19 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:19.438665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:19.440306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:19.448510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:19.449232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:19.450549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:19.450990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:19.491880 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7686678b-47d6-44cf-aa0e-aebb297e20e2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058692 May 10 02:15:19.496124 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 627/1328] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:19 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:19.506864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:19.507841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] [instance: 9f14d520-8ca8-49ee-af8e-5c0b6a52b570] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:19.517902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:19.520286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:19.521933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:19.523255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:19.551909 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] HTTP exception thrown: Instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 could not be found. May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Request method failure captured: May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 HTTP/1.1 May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecowXNU6C6Mbc5Wr7suoqypjUXetw5avK66fH4Z-nrcbQgJuDYzv2foOK8y_UBe9Txs-JkWhD5lRv4ESS1xzHyP4DmXXOOcTNxekp5PH_VwgXgwJg8wbDQJwZJkRcvYj_OQeco5ZW89qIlaN3QAuCfPcwPG-Paklm-XJ1UC8XFz0xzk May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 107552c6b0a94d33b3a7b66af44f9740 May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:19.554638 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_107552c6b0a94d33b3a7b66af44f9740", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/107552c6b0a94d33b3a7b66af44f9740"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 107552c6b0a94d33b3a7b66af44f9740 May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminTestJSON-1541196951 May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminTestJSON-1541196951-project May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 3425cd583e7d46e7aef80bc35e859b15 May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminTestJSON-1541196951-project May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 could not be found. May 10 02:15:19.555980 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '9f14d520-8ca8-49ee-af8e-5c0b6a52b570'} May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 could not be found. May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:19.556726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 could not be found. May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 could not be found. May 10 02:15:19.557936 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:19.566091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] Returning 404 to user: Instance 9f14d520-8ca8-49ee-af8e-5c0b6a52b570 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:19.568288 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8efde2f1-f1a9-4fe5-aa1a-1c5de404f4ac tempest-ServersAdminTestJSON-1541196951 tempest-ServersAdminTestJSON-1541196951-project] 10.222.0.52 "GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570" status: 404 len: 111 microversion: 2.1 time: 0.065902 May 10 02:15:19.570470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 702/1329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:19 2022] GET /compute/v2.1/servers/9f14d520-8ca8-49ee-af8e-5c0b6a52b570 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:20.061881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1309206744", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "6f040b79-baa5-4476-b3e3-ad726a292d10"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:20.156876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] validate_networks() for [('6f040b79-baa5-4476-b3e3-ad726a292d10', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:15:20.377121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:20.378346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:20.392303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:20.393025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:20.393996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:20.394735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:20.857154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:15:20.857665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:15:20.858055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:15:20.858474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:15:20.858900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:15:20.877916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:20.890454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:20.890686 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94b81b3f-1d84-46ab-98e2-c319cdc57f4b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.517644 May 10 02:15:20.890916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:20.891931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:20.892543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:20.894294 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 703/1330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:20 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:20.900449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:20.902256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:20.927790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:20.928167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:20.929357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:20.929803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:20.936720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Getting quotas for project 8161100b518d4d68bb77b0052a6efc7f. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:20.950636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Getting quotas for user 5f339a3525a549f6958b4cc77e40f606 and project 8161100b518d4d68bb77b0052a6efc7f. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:20.981662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:15:20.984111 n-d-841089-2 devstack@n-api.service[118717]: WARNING nova.utils [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1309206744 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-130920674 May 10 02:15:20.988047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:15:21.019762 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a734e645-6b7a-4bd6-961f-373e91bf31dd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120707 May 10 02:15:21.021463 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 704/1331] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:20 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:21.095224 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4cce852-4221-47b5-8a9c-23fc60ae8150 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241791 May 10 02:15:21.096663 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 628/1332] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:15:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:15:21.107228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b20027b9-7002-43b5-abb4-57c39a650006 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:21.107967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b20027b9-7002-43b5-abb4-57c39a650006 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:21.272695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b20027b9-7002-43b5-abb4-57c39a650006 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:21.304285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b20027b9-7002-43b5-abb4-57c39a650006 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1232 microversion: 2.1 time: 0.201900 May 10 02:15:21.305866 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 705/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:21 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1232 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:21.819456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-698e5319-a2b4-405f-a7dc-a2e2b7107952 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Action: 'create', calling method: .version_select at 0x7f3d36ffd1f0>, body: {"keypair": {"name": "tempest-keypair-1247000153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcug+rt/DcE8YElLO3sbwrqF+A6QACF4LgF/n+FzQok/BI/Ad4I3Oel2RfN0NzlmrrMxrYToNcv4UyVUfZEr5N9GQKgz7LDKEh2WKH+h8O8qxYZJA6BbtpYvDpqYeruLA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:21.843663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-698e5319-a2b4-405f-a7dc-a2e2b7107952 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:21.849325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-698e5319-a2b4-405f-a7dc-a2e2b7107952 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for user 5718fe990b704d6f8a8105e287b8823e and project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:21.888639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-698e5319-a2b4-405f-a7dc-a2e2b7107952 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299034 May 10 02:15:21.890831 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 629/1334] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:21.900195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a838dc16-1d06-470e-8684-4ba65fe30ea7 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d36fcc550>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:21.910100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:21.910601 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a838dc16-1d06-470e-8684-4ba65fe30ea7 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1247000153" status: 200 len: 497 microversion: 2.1 time: 0.013725 May 10 02:15:21.910990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:21.917860 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 706/1335] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:15:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1247000153 => generated 497 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:21.921645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:21.924357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:21.925559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:21.926411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:21.928646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c0bfcd5-0ea2-4c64-9f1e-7e032d5aa375 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d36f43310>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:21.958195 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c0bfcd5-0ea2-4c64-9f1e-7e032d5aa375 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247000153" status: 202 len: 0 microversion: 2.1 time: 0.038866 May 10 02:15:21.967296 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 707/1336] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247000153 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:21.972717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-abba050c-5001-483a-9db4-fb0227f615bd tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Action: 'create', calling method: .version_select at 0x7f3d36f97d30>, body: {"keypair": {"name": "tempest-keypair-1374825840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL1FGzf9YBJUAtUDu6d3kAfh3wfH+ZPh607dG+HyJMNi8u6TGQhV1RJsfYZC88Shl6H8dHORaZCz0De+pYYxze9t0gh96xRgxwsh5+vhg408GheXjJfydySIJNh2Eu5wg=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:21.994286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-abba050c-5001-483a-9db4-fb0227f615bd tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:22.002832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-abba050c-5001-483a-9db4-fb0227f615bd tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for user 5718fe990b704d6f8a8105e287b8823e and project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:22.040906 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-abba050c-5001-483a-9db4-fb0227f615bd tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072121 May 10 02:15:22.047805 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 708/1337] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:22.055468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.056578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:22.066001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:22.066812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:22.067926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:22.068608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:22.130881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-be41454a-7ab6-4833-a577-32185d166568 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081216 May 10 02:15:22.135524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 709/1338] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:22 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:22.151605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f084b12e-fb08-4332-98b2-b68bc437cc2f tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d3708bdc0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.209694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f084b12e-fb08-4332-98b2-b68bc437cc2f tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374825840" status: 202 len: 0 microversion: 2.1 time: 0.070374 May 10 02:15:22.221965 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 710/1339] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374825840 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:22.234917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5a9c304d-d07c-4053-bbf0-85e0a85b4031 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Action: 'create', calling method: .version_select at 0x7f3d36fcc310>, body: {"keypair": {"name": "tempest-keypair-202260553", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:22.252343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:22.260248 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61bcf87c-61a4-49c7-bc9e-beb0621a5223 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.354446 May 10 02:15:22.260809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 630/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:21 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:22.268498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-5a9c304d-d07c-4053-bbf0-85e0a85b4031 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:22.276728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-5a9c304d-d07c-4053-bbf0-85e0a85b4031 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for user 5718fe990b704d6f8a8105e287b8823e and project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:22.321524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.322130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:22.330017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:22.330482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:22.331306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:22.331753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:22.340051 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5a9c304d-d07c-4053-bbf0-85e0a85b4031 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.116305 May 10 02:15:22.341445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 711/1341] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:22 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:22.351057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2db6e21f-ab40-408b-b724-076545626f88 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d3700fca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.381908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2db6e21f-ab40-408b-b724-076545626f88 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202260553" status: 202 len: 0 microversion: 2.1 time: 0.034799 May 10 02:15:22.382913 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 712/1342] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202260553 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:22.396199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6d81356-74c9-4255-bfce-96d2c97c9b8c tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Action: 'create', calling method: .version_select at 0x7f3d3704edc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1179482082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVZJqSsZ5GfpTRR7vuRiNUxo5tBBPnurw6dQDnLFQT/OLe34Myv54H7Ghgd9YCtSYg81fPRSZHrzQ0gSbprmCQOFom6WF45J1pSHYSXhEOsgKiuQH8TJKYmZSjlZT0X2Q=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:22.423544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c6d81356-74c9-4255-bfce-96d2c97c9b8c tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:22.431428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c6d81356-74c9-4255-bfce-96d2c97c9b8c tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for user 5718fe990b704d6f8a8105e287b8823e and project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:22.448452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:22.456481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d41a733-d764-42d6-bf68-0ae003707bc2 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1284 microversion: 2.1 time: 0.138757 May 10 02:15:22.457762 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 631/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:22 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:22.463471 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6d81356-74c9-4255-bfce-96d2c97c9b8c tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.072125 May 10 02:15:22.464419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 713/1344] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:22.476722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abc057e6-1428-4ae4-95fc-0c6eed22d9e5 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Action: 'create', calling method: .version_select at 0x7f3d36fa3160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1231416377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG302ZP4X36TLnvoT0FLDjxOyrR/9hDBiLqy1QdnhZlK3ETCtWhiCTb4tQF6nLa3NxSqpCBw8edpOXnL/0wWF+b6Ml8uGRfjpcKyQz1CMZ9vCxaCHAXgP0auWVyk11Vf1Q=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:22.501643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-abc057e6-1428-4ae4-95fc-0c6eed22d9e5 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:22.513379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-abc057e6-1428-4ae4-95fc-0c6eed22d9e5 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for user 5718fe990b704d6f8a8105e287b8823e and project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:22.563854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abc057e6-1428-4ae4-95fc-0c6eed22d9e5 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.090335 May 10 02:15:22.565938 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 632/1345] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:22.581855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ce9696b-5096-4403-a172-e62924b35fca tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Action: 'create', calling method: .version_select at 0x7f3d3700f3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1159917640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK5lMfQ/JBXj7p4jjG5LlMHo1EVqfsMCElBhWUPg/+zJizmh8TFphu8SnPzzpW/cOPP+qVlKthe/Y+/er7laf0TfKTQYH134IZjil6r1Be1PEb0cFs0nklL6wfR+gLjrw=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:22.628792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7ce9696b-5096-4403-a172-e62924b35fca tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:22.643294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7ce9696b-5096-4403-a172-e62924b35fca tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Getting quotas for user 5718fe990b704d6f8a8105e287b8823e and project e89718a116ae48a6a567a4abd17ad189. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:22.693095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ce9696b-5096-4403-a172-e62924b35fca tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.117489 May 10 02:15:22.696362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 714/1346] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:22.708692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46b420ce-6cec-4e48-9e5c-244cfaeb7f7b tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d36fa19d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.713447 n-d-841089-2 devstack@n-api.service[118717]: WARNING oslo_db.sqlalchemy.utils [None req-46b420ce-6cec-4e48-9e5c-244cfaeb7f7b tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Unique keys not in sort_keys. The sorting order may be unstable. May 10 02:15:22.727102 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46b420ce-6cec-4e48-9e5c-244cfaeb7f7b tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.024263 May 10 02:15:22.728536 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 633/1347] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:15:22 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:22.740143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a8c8c7e-56d4-4ff1-b074-54de124c1455 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d3708b310>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.769449 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a8c8c7e-56d4-4ff1-b074-54de124c1455 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1159917640" status: 202 len: 0 microversion: 2.1 time: 0.033717 May 10 02:15:22.773707 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 715/1348] 10.222.0.52 () {58 vars in 1277 bytes} [Tue May 10 02:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1159917640 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:22.780053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-25102f9a-49a4-4650-8a27-66e62b2b3fab tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d370168b0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.817915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-25102f9a-49a4-4650-8a27-66e62b2b3fab tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1231416377" status: 202 len: 0 microversion: 2.1 time: 0.042916 May 10 02:15:22.818883 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 634/1349] 10.222.0.52 () {58 vars in 1277 bytes} [Tue May 10 02:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1231416377 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:15:22.828736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed2d65a5-4574-4222-84e0-a7714f4906a3 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] Calling method '.version_select at 0x7f3d36fcc0d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:22.878861 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed2d65a5-4574-4222-84e0-a7714f4906a3 tempest-KeyPairsV2TestJSON-541993589 tempest-KeyPairsV2TestJSON-541993589-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1179482082" status: 202 len: 0 microversion: 2.1 time: 0.055151 May 10 02:15:22.881136 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 716/1350] 10.222.0.52 () {58 vars in 1277 bytes} [Tue May 10 02:15:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1179482082 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:23.082315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3edaeef-459c-4ef2-891a-9cc3777eeca7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3703e790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:23.148763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:23.149691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:23.151886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3edaeef-459c-4ef2-891a-9cc3777eeca7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/60822800-905b-47b3-8c8f-8eb607eef708" status: 200 len: 661 microversion: 2.1 time: 0.073413 May 10 02:15:23.155939 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 635/1351] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:23 2022] GET /compute/v2.1/images/60822800-905b-47b3-8c8f-8eb607eef708 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:23.159041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:23.159847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:23.162065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:23.163980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:23.171722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b10e67ef-6539-4357-ab84-0aa5d8ee14f6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fa3550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:23.208456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29a07c22-388a-4a30-9b32-d3beb77723a4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064787 May 10 02:15:23.211136 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 717/1352] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:23 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:23.252215 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b10e67ef-6539-4357-ab84-0aa5d8ee14f6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/60822800-905b-47b3-8c8f-8eb607eef708" status: 200 len: 661 microversion: 2.1 time: 0.089904 May 10 02:15:23.255674 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 636/1353] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:23 2022] GET /compute/v2.1/images/60822800-905b-47b3-8c8f-8eb607eef708 => generated 661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:23.285965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:23.292204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:23.303029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:23.308173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:23.309821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:23.310505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:23.474868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:23.475720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:23.487241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:23.487712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:23.488518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:23.488968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:23.642854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:23.661604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fed44338-93d2-4127-ac1d-ca0f612e5e28 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1290 microversion: 2.1 time: 0.191595 May 10 02:15:23.671842 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 637/1354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:23 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1290 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:23.746518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:23.757200 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b657af0a-5c88-46d1-901a-f8a96b7081c5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1475 microversion: 2.1 time: 0.481823 May 10 02:15:23.758360 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 718/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:23 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1475 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:24.221029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:24.222805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:24.236611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:24.247018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:24.249436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:24.250831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:24.332254 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa8b497a-b5bf-4c87-a0f8-36e6800ca362 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115445 May 10 02:15:24.333841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 719/1356] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:24 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:24.377215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-459355295", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:24.460775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:15:24.678957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:24.679807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:24.687816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:24.688276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:24.689077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:24.689525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.527180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:25.540927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:15:25.541593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:15:25.542316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:15:25.542833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:15:25.544015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:15:25.545201 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b1d65ce8-903c-400d-93f6-fc1a1d160ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1332 microversion: 2.1 time: 0.869246 May 10 02:15:25.546335 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 720/1357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:24 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1332 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:25.552878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:25.554737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:25.570512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:25.570512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.572605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:25.575309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.580639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:25.583708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.585088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:25.586304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.634418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Getting quotas for project d377cce88d6f46d3959a0cf83da19a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:25.648394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Getting quotas for user 26957233390644629311bafe1f30123c and project d377cce88d6f46d3959a0cf83da19a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:25.661289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:15:25.663785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:15:25.727416 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e19ae210-5cd9-4629-846c-ab0fdc49a0b0 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.636845 May 10 02:15:25.728862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 638/1358] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:15:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:15:25.734399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ef05c4d-6f9b-4c92-bfaf-ae613e09b9c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36ff2790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:25.795680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ef05c4d-6f9b-4c92-bfaf-ae613e09b9c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/0502edc6-0adc-462f-bd59-2d21e8bf197e" status: 200 len: 661 microversion: 2.1 time: 0.065539 May 10 02:15:25.796969 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 639/1359] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:25 2022] GET /compute/v2.1/images/0502edc6-0adc-462f-bd59-2d21e8bf197e => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:25.807594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:25.809383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:25.818541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:25.819361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.820474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:25.821445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:25.864704 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e4bb616-1316-495b-904e-e4daf09be84b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066241 May 10 02:15:25.865279 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 640/1360] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:25 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:25.873763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bee85c1e-3041-46ea-97d4-cfdab931cd2f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:25.874951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bee85c1e-3041-46ea-97d4-cfdab931cd2f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:26.023136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bee85c1e-3041-46ea-97d4-cfdab931cd2f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:26.031442 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bee85c1e-3041-46ea-97d4-cfdab931cd2f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1213 microversion: 2.1 time: 0.164897 May 10 02:15:26.033256 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 641/1361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:25 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:26.040091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40e8682c-f6fb-473d-9263-efb2d2a1649a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f40940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:26.122226 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40e8682c-f6fb-473d-9263-efb2d2a1649a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/0502edc6-0adc-462f-bd59-2d21e8bf197e" status: 200 len: 661 microversion: 2.1 time: 0.079903 May 10 02:15:26.123090 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 642/1362] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:26 2022] GET /compute/v2.1/images/0502edc6-0adc-462f-bd59-2d21e8bf197e => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:26.123472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:26.139432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bd1386ed-8352-4d00-8a5a-c42c21069e60 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1474 microversion: 2.1 time: 0.583634 May 10 02:15:26.140100 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 721/1363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:25 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1474 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:26.527180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-df41151f-710d-4a7d-820b-4ac6b449d688 req-310f7c5a-4cbd-49ca-992c-63eccb0bd5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8962c96e-b870-4700-bf38-f78601e5854e", "name": "network-vif-unplugged", "status": "completed", "tag": "845550c8-69e5-4cd3-91b8-30fd8a345295"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:26.557049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-df41151f-710d-4a7d-820b-4ac6b449d688 req-310f7c5a-4cbd-49ca-992c-63eccb0bd5cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:26.557694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-df41151f-710d-4a7d-820b-4ac6b449d688 req-310f7c5a-4cbd-49ca-992c-63eccb0bd5cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:26.561897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:26.562879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:26.576052 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-df41151f-710d-4a7d-820b-4ac6b449d688 req-310f7c5a-4cbd-49ca-992c-63eccb0bd5cf service nova] Creating event network-vif-unplugged:845550c8-69e5-4cd3-91b8-30fd8a345295 for instance 8962c96e-b870-4700-bf38-f78601e5854e on n-h1-841089-2 May 10 02:15:26.581413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:26.581888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:26.582732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:26.583208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:26.593003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-df41151f-710d-4a7d-820b-4ac6b449d688 req-310f7c5a-4cbd-49ca-992c-63eccb0bd5cf service nova] Instance 8962c96e-b870-4700-bf38-f78601e5854e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:15:26.609990 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-df41151f-710d-4a7d-820b-4ac6b449d688 req-310f7c5a-4cbd-49ca-992c-63eccb0bd5cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091698 May 10 02:15:26.611185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 643/1364] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:26.715200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:26.719562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:26.730467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:26.731228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:26.732048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:26.732840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:26.976417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lazy-loading 'services' on Instance uuid 39ba2859-735c-49d1-94e0-48d745fcad0e {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:15:27.151574 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85f7a204-ec8a-400f-b44b-7b35c931223d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments/a102ccf9-e8ba-4081-91e8-3afef36a0140" status: 202 len: 0 microversion: 2.1 time: 0.442208 May 10 02:15:27.153724 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 644/1365] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:15:26 2022] DELETE /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments/a102ccf9-e8ba-4081-91e8-3afef36a0140 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:27.162547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:27.164224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:27.178460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.179367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.180457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.181394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.204528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:27.221269 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-74ef2a05-2dac-4ba9-92e3-cbdd3554ae61 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1332 microversion: 2.1 time: 0.662828 May 10 02:15:27.223754 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 722/1366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:26 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1332 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:27.241545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:27.242201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:27.268062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.272580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.273727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.274354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.276674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c66ef08-7a2a-4bb8-93a4-b6429026ee75 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.120749 May 10 02:15:27.288806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 645/1367] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:15:27 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:27.302338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:27.304297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:27.320922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.322506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.324500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.327601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.555444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:27.569506 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc790c4f-1ac9-4c06-8672-9b7fce6d5e5f tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1273 microversion: 2.1 time: 0.344570 May 10 02:15:27.571036 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 723/1368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:27 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:27.578815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:27.580158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:27.594985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.595734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.596547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:27.597322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:27.643994 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05d4cc13-eddc-462b-80fc-b9056e01fe49 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071482 May 10 02:15:27.644574 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 724/1369] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:27 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:27.852278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d8b03064-586b-4e4e-b4d7-67ce31c1862e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37194160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:27.916831 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d8b03064-586b-4e4e-b4d7-67ce31c1862e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/929e997f-9272-428e-bb03-48ec717cd582" status: 200 len: 662 microversion: 2.1 time: 0.068846 May 10 02:15:27.917412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 725/1370] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:27 2022] GET /compute/v2.1/images/929e997f-9272-428e-bb03-48ec717cd582 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:27.929711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad61d39a-c3bb-4fae-a6ab-a989947195aa tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fcc820>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:27.951565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:27.959363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8220e0e-01d1-41b5-959d-065cd3705a3e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1474 microversion: 2.1 time: 0.668119 May 10 02:15:27.966181 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 646/1371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:27 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1474 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:28.001307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad61d39a-c3bb-4fae-a6ab-a989947195aa tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/929e997f-9272-428e-bb03-48ec717cd582" status: 200 len: 662 microversion: 2.1 time: 0.075356 May 10 02:15:28.002326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 726/1372] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:27 2022] GET /compute/v2.1/images/929e997f-9272-428e-bb03-48ec717cd582 => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:28.201309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-687468473", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:28.241123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:28.241870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:28.253132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:28.253722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:28.254568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:28.259400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:28.296110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:15:28.758922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:28.780614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f96da17c-a613-4d5b-a88b-e4d51e6cece7 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1332 microversion: 2.1 time: 0.543880 May 10 02:15:28.783680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 727/1373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:28 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1332 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:28.943101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:15:28.943370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:15:28.945107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:15:28.945763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:15:28.946427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:15:28.966355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:28.967583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:28.968593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:28.969230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:28.988991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Getting quotas for project 5165ac7eab8e4c9f882bc2b4f9b3be3d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:28.994703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Getting quotas for user 1331ab40bf914278a9263a566496752a and project 5165ac7eab8e4c9f882bc2b4f9b3be3d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:29.012305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Calling method '.version_select at 0x7f3d36f438b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:29.020929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:15:29.024304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:15:29.050441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc587235-0322-43df-a973-7a091e40db0f does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:15:29.051453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Neutron security group cc587235-0322-43df-a973-7a091e40db0f not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:15:29.052306 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] HTTP exception thrown: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.052306 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Request method failure captured: May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-security-groups/cc587235-0322-43df-a973-7a091e40db0f HTTP/1.1 May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecrAZAOEx48DPe3R2riqT9FPJDnGDbb_a-S1XtySaL2Il70QuHNUVzQeOxrL4FKzTzGb06Ai1-ip1_2mfI11jHSdJxcXUridDOKG1Wdz6G6pM7382AAvPRASsbB00N8squR2RKSQF4AVQn4fKeMw77dMvY6R1ig6bbZXvDq-lPmBQyI May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:29.055036 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ceff6fdb81fc4d84ab6a785d8295299d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a80d63f3919473499a59d60078bcf3f May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] May 10 02:15:29.057010 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'cc587235-0322-43df-a973-7a091e40db0f'} May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:29.057940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:15:29.060439 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.062900 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Returning 404 to user: Security group cc587235-0322-43df-a973-7a091e40db0f does not exist May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-0e6c1449-ffd1-41cc-a672-36199ef1a011'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01f614f2-c147-4a7d-a7c1-773217c210b2 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cc587235-0322-43df-a973-7a091e40db0f" status: 404 len: 194 microversion: 2.1 time: 0.262331 May 10 02:15:29.066670 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 728/1374] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:15:28 2022] DELETE /compute/v2.1/os-security-groups/cc587235-0322-43df-a973-7a091e40db0f => generated 194 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:29.070175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:29.071289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:29.089328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.090979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.093408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.093968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.119877 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-451542ef-e57e-4ef4-a802-8450e094ed01 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920969 May 10 02:15:29.133553 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 647/1375] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:15:29.158292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:29.159589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:29.167549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.168299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.171156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.172310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.232099 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f38aaf3-7a64-4454-854d-e34e8eec7cbd tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101020 May 10 02:15:29.233692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 648/1376] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:29 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:29.244807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010feee6-4f48-4682-bb79-b95d27eda2e3", "tag": "3caa9309-fd85-4fe2-b113-092d695f252c"}, {"name": "network-changed", "server_uuid": "8962c96e-b870-4700-bf38-f78601e5854e", "tag": "845550c8-69e5-4cd3-91b8-30fd8a345295"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:29.267755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.268735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.286087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:29.292143 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] Creating event network-changed:3caa9309-fd85-4fe2-b113-092d695f252c for instance 010feee6-4f48-4682-bb79-b95d27eda2e3 on n-h1-841089-2 May 10 02:15:29.293260 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] Creating event network-changed:845550c8-69e5-4cd3-91b8-30fd8a345295 for instance 8962c96e-b870-4700-bf38-f78601e5854e on n-h1-841089-2 May 10 02:15:29.295640 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00221e7b-559a-4709-9ae8-9ddb4512df31 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1271 microversion: 2.1 time: 0.236603 May 10 02:15:29.297028 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 729/1377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:29 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:29.307518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:29.307518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:29.312193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] Instance 8962c96e-b870-4700-bf38-f78601e5854e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:15:29.322454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.322916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.323742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:29.324191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:29.330066 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7be60515-eec8-4c9b-8cea-0cf03e4823e7 req-6fa35de4-914c-4d41-938f-49a265c8359f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094435 May 10 02:15:29.337008 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 649/1378] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:29.343700 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8159884-ec1d-4b6d-9e90-d8f8b1d4b35a tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004217 May 10 02:15:29.351118 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 650/1379] 10.222.0.52 () {58 vars in 1163 bytes} [Tue May 10 02:15:29 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 02:15:29.359893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-641298497", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:29.460341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:15:30.270539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:30.282625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ca743f9-3e02-44bf-840f-b0568557ee49 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1474 microversion: 2.1 time: 0.982634 May 10 02:15:30.292455 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 730/1380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:29 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1474 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:30.295987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75f069e6-8723-4ef5-b0fd-02fb2eca84be tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Calling method '.version_select at 0x7f3d36fcc160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:30.716549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:15:30.718024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:15:30.719601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:15:30.720594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:15:30.721244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:15:30.750204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:30.751036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:30.752262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:30.753150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:30.789299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Getting quotas for project 5165ac7eab8e4c9f882bc2b4f9b3be3d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:30.796625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Getting quotas for user 1331ab40bf914278a9263a566496752a and project 5165ac7eab8e4c9f882bc2b4f9b3be3d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:30.812327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:15:30.816220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:15:30.878622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dcb48ab1-7d06-47fa-9655-d00b0123b350 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526202 May 10 02:15:30.879941 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 651/1381] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:15:30.886021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:30.887198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:30.897423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:30.900491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:30.901861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:30.903095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:31.778192 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75f069e6-8723-4ef5-b0fd-02fb2eca84be tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.487816 May 10 02:15:31.779389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 731/1382] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:15:30 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:31.794152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:31.804433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:31.812573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:31.816784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:31.822673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:31.823808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:31.826028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:31.833851 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e7c05cc-c778-4c8a-b932-a1cae638629e tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1332 microversion: 2.1 time: 0.947023 May 10 02:15:31.836214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 652/1383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:30 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1332 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:31.856722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:31.859926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:31.882362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:31.883626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:31.886767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:31.889939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:31.925352 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5530b98-3999-4314-a3f4-4e8d162af405 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137650 May 10 02:15:31.935005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 732/1384] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:31 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:31.942139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:31.944983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:31.960930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:31.963025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:31.965496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:31.968437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:32.298357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:32.309940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1a97500-cf94-429a-b2b5-c0e2036074c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1213 microversion: 2.1 time: 0.372091 May 10 02:15:32.311334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 733/1385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:31 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1213 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:32.316738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:32.317858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:32.342356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:32.343500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:32.346363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:32.347079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:32.444311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:32.459459 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-591d9075-c6bf-4dcc-9112-a0cafb52766e tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1313 microversion: 2.1 time: 0.616846 May 10 02:15:32.462316 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 653/1386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:31 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:32.485182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3bb5d7b-d34a-4602-8d56-7af843388409 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Calling method '.version_select at 0x7f3d36e8cd30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:32.653449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:32.669472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8e8a1329-8525-4131-afc4-51848427503b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1472 microversion: 2.1 time: 0.356815 May 10 02:15:32.670070 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 734/1387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:32 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:32.853380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:32.853967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:32.865945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:32.867077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:32.869577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:32.870204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:33.520202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-d3bb5d7b-d34a-4602-8d56-7af843388409 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:15:33.522694 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d3bb5d7b-d34a-4602-8d56-7af843388409 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] HTTP exception thrown: Insufficient rights for removing default security group. May 10 02:15:33.522694 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3bb5d7b-d34a-4602-8d56-7af843388409 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Request method failure captured: May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/7dc52936-6f9e-400d-ac42-0684b174b5b7 HTTP/1.1 May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecrAZAOEx48DPe3R2riqT9FPJDnGDbb_a-S1XtySaL2Il70QuHNUVzQeOxrL4FKzTzGb06Ai1-ip1_2mfI11jHSdJxcXUridDOKG1Wdz6G6pM7382AAvPRASsbB00N8squR2RKSQF4AVQn4fKeMw77dMvY6R1ig6bbZXvDq-lPmBQyI May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:15:33.528818 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ceff6fdb81fc4d84ab6a785d8295299d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 5a80d63f3919473499a59d60078bcf3f May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: exception: Insufficient rights for removing default security group. May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] May 10 02:15:33.530567 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '7dc52936-6f9e-400d-ac42-0684b174b5b7'} May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:33.531615 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 10 02:15:33.533067 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:33.534398 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:33.536006 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:33.536006 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:33.536006 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:33.536006 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 10 02:15:33.536006 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] May 10 02:15:33.536006 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:33.536489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3bb5d7b-d34a-4602-8d56-7af843388409 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Returning 400 to user: Insufficient rights for removing default security group. May 10 02:15:33.536489 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-c2b2bd82-34e7-4486-9c81-e1d6405cd6bd'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:33.537371 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d3bb5d7b-d34a-4602-8d56-7af843388409 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/7dc52936-6f9e-400d-ac42-0684b174b5b7" status: 400 len: 182 microversion: 2.1 time: 1.064947 May 10 02:15:33.537954 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 654/1388] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:15:32 2022] DELETE /compute/v2.1/os-security-groups/7dc52936-6f9e-400d-ac42-0684b174b5b7 => generated 182 bytes in 1075 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:33.555537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:33.557251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:33.569622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:33.574096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:33.576060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:33.576808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:33.617872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e340ee53-9441-4212-8a2b-0322e073cc10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069566 May 10 02:15:33.618854 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 655/1389] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:33 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:33.625715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:33.627936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:33.628740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:33.639204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:33.643284 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63651c2d-e2c9-4aaf-b36d-09153db3d4ca tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1332 microversion: 2.1 time: 0.795873 May 10 02:15:33.643629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:33.643883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 735/1390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:32 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1332 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:33.645140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:33.645775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:33.689533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:33.694431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:33.746717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:33.747216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:33.751690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:33.755768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.059687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:34.071424 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b034ed8a-372b-4d3d-9c85-97c671a5be23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1275 microversion: 2.1 time: 0.449743 May 10 02:15:34.075576 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 656/1391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:33 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1275 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:34.088870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Calling method '.version_select at 0x7f3d36e41670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:34.202539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:15:34.203944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.security_group_api [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Neutron security group fbcac1c2-6521-4967-b572-4b9400bda6ab not found {{(pid=118717) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:15:34.204981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] HTTP exception thrown: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.204981 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Request method failure captured: May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-security-groups/fbcac1c2-6521-4967-b572-4b9400bda6ab HTTP/1.1 May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecrAZAOEx48DPe3R2riqT9FPJDnGDbb_a-S1XtySaL2Il70QuHNUVzQeOxrL4FKzTzGb06Ai1-ip1_2mfI11jHSdJxcXUridDOKG1Wdz6G6pM7382AAvPRASsbB00N8squR2RKSQF4AVQn4fKeMw77dMvY6R1ig6bbZXvDq-lPmBQyI May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:15:34.207099 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ceff6fdb81fc4d84ab6a785d8295299d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 5a80d63f3919473499a59d60078bcf3f May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: exception: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] May 10 02:15:34.208410 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fbcac1c2-6521-4967-b572-4b9400bda6ab'} May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.209224 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:15:34.210424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.211804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Returning 404 to user: Security group fbcac1c2-6521-4967-b572-4b9400bda6ab does not exist May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-22ce1055-86b4-441d-af1e-e32d7bd012b6'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b37d1a71-77a0-4a35-8f65-e91515d97842 tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/fbcac1c2-6521-4967-b572-4b9400bda6ab" status: 404 len: 194 microversion: 2.1 time: 0.131604 May 10 02:15:34.214058 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 657/1392] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:15:34 2022] GET /compute/v2.1/os-security-groups/fbcac1c2-6521-4967-b572-4b9400bda6ab => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:34.215718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:34.218480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:34.247453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.247997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.252410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.254005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.301413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:34.309163 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f318ebd-88f5-4f27-aa2c-6b3a267b1f67 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1313 microversion: 2.1 time: 0.656893 May 10 02:15:34.321712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 736/1393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:33 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:34.332553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ed8d9db2-a664-4498-876c-121c6ffeaf72 req-18b895e5-da69-4e4d-a23d-f82604b121c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010feee6-4f48-4682-bb79-b95d27eda2e3", "name": "network-vif-plugged", "status": "completed", "tag": "3caa9309-fd85-4fe2-b113-092d695f252c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:34.362338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ed8d9db2-a664-4498-876c-121c6ffeaf72 req-18b895e5-da69-4e4d-a23d-f82604b121c0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.363077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ed8d9db2-a664-4498-876c-121c6ffeaf72 req-18b895e5-da69-4e4d-a23d-f82604b121c0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.385963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ed8d9db2-a664-4498-876c-121c6ffeaf72 req-18b895e5-da69-4e4d-a23d-f82604b121c0 service nova] Creating event network-vif-plugged:3caa9309-fd85-4fe2-b113-092d695f252c for instance 010feee6-4f48-4682-bb79-b95d27eda2e3 on n-h1-841089-2 May 10 02:15:34.396632 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ed8d9db2-a664-4498-876c-121c6ffeaf72 req-18b895e5-da69-4e4d-a23d-f82604b121c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073546 May 10 02:15:34.397577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 737/1394] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:34.410678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Action: 'update', calling method: .version_select at 0x7f3d36fcc430>, body: {"security_group": {"name": "tempest-sg-1094167949", "description": "tempest-description-220254548"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:34.637141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:15:34.638010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Neutron security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:15:34.638766 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] HTTP exception thrown: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.638766 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Request method failure captured: May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/os-security-groups/8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 HTTP/1.1 May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 101 May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecrAZAOEx48DPe3R2riqT9FPJDnGDbb_a-S1XtySaL2Il70QuHNUVzQeOxrL4FKzTzGb06Ai1-ip1_2mfI11jHSdJxcXUridDOKG1Wdz6G6pM7382AAvPRASsbB00N8squR2RKSQF4AVQn4fKeMw77dMvY6R1ig6bbZXvDq-lPmBQyI May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:34.643330 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ceff6fdb81fc4d84ab6a785d8295299d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ceff6fdb81fc4d84ab6a785d8295299d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ceff6fdb81fc4d84ab6a785d8295299d May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-787581099 May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a80d63f3919473499a59d60078bcf3f May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-787581099-project May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: {"security_group": {"name": "tempest-sg-1094167949", "description": "tempest-description-220254548"}} May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:34.644990 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64', 'body': {'security_group': {'name': 'tempest-sg-1094167949', 'description': 'tempest-description-220254548'}}} May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:15:34.645985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:15:34.648724 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] May 10 02:15:34.657506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] Returning 404 to user: Security group 8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 does not exist May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-e19467fe-73d1-4654-8d02-eed337d9bc31'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:34.660663 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa954d9a-709c-4bfc-869d-917e22cca6dd tempest-SecurityGroupsNegativeTestJSON-787581099 tempest-SecurityGroupsNegativeTestJSON-787581099-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64" status: 404 len: 194 microversion: 2.1 time: 0.247497 May 10 02:15:34.664046 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 738/1395] 10.222.0.52 () {60 vars in 1289 bytes} [Tue May 10 02:15:34 2022] PUT /compute/v2.1/os-security-groups/8147c0c7-1b79-4fe1-9eaf-185ebb1a4d64 => generated 194 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:15:34.664046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:34.669499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:34.684536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.684991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.685781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.686225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.743957 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-64d4000e-2599-4054-9173-660912b51b07 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095211 May 10 02:15:34.747756 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 739/1396] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:34 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:34.749878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:34.750496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:34.767026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.767518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:34.768314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:34.768752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:35.179628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:35.194332 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2b5ea8e7-bba6-47d1-a236-f385a7fe808d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1469 microversion: 2.1 time: 0.982574 May 10 02:15:35.195250 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 658/1397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:34 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1469 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:35.199834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:35.201759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:35.234400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:35.234907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:35.235927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:35.236374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:35.692028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:35.704597 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5c98e0c-d7ec-4139-b04a-6b60e028693f tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1332 microversion: 2.1 time: 0.955883 May 10 02:15:35.706324 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 740/1398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:34 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1332 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:35.731497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-aea5c339-db8a-47f4-b3d9-9efb6073b118 req-305a7454-7b5b-40c3-aacc-9fe584ed8507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b982e97f-604e-42ff-9c05-95d2529e9cd6", "tag": "f26b3c05-b982-431a-97a5-5cdf1be07742"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:35.773289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-aea5c339-db8a-47f4-b3d9-9efb6073b118 req-305a7454-7b5b-40c3-aacc-9fe584ed8507 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:35.773751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-aea5c339-db8a-47f4-b3d9-9efb6073b118 req-305a7454-7b5b-40c3-aacc-9fe584ed8507 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:35.804790 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-aea5c339-db8a-47f4-b3d9-9efb6073b118 req-305a7454-7b5b-40c3-aacc-9fe584ed8507 service nova] Creating event network-changed:f26b3c05-b982-431a-97a5-5cdf1be07742 for instance b982e97f-604e-42ff-9c05-95d2529e9cd6 on n-h2-841089-2 May 10 02:15:35.815503 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-aea5c339-db8a-47f4-b3d9-9efb6073b118 req-305a7454-7b5b-40c3-aacc-9fe584ed8507 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104815 May 10 02:15:35.818157 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 741/1399] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:35.824629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:35.825519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:35.839934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:35.841361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:35.843701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:35.844574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:35.958591 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-125bd326-a497-4398-a190-c1ef7b7e5020 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e/action" status: 204 len: 0 microversion: 2.1 time: 0.138563 May 10 02:15:35.959779 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 742/1400] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:35 2022] POST /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e/action => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:35.970470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:35.972123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:35.992049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:35.992528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:36.005271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:36.005658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:36.397868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:36.410187 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de71e0ee-9a60-4aa0-a7b8-7e2a54964e3f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 1.213839 May 10 02:15:36.410793 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 659/1401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:35 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:36.426509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:36.437093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:36.453820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:36.454275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:36.455102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:36.455547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:36.558957 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-021a738b-db8f-48a8-b3a8-14c799039d41 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146774 May 10 02:15:36.564347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 660/1402] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:36 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:36.578578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:36.588889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:36.619644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:36.620454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:36.622831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:36.629447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.278457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:37.290768 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c415ab3-964b-473d-bacd-2bfc3c3325dc tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1313 microversion: 2.1 time: 1.329485 May 10 02:15:37.307115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:37.307375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 743/1403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:35 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1313 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:37.312454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8b144234-0bd7-439a-8a93-167eebf3130a req-c96dc79d-6eb8-4bd1-9185-c1b13627e39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:37.314598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b392e87e-081b-489f-9799-8d9f6cab8ac4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1469 microversion: 2.1 time: 0.747223 May 10 02:15:37.323756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b144234-0bd7-439a-8a93-167eebf3130a req-c96dc79d-6eb8-4bd1-9185-c1b13627e39b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.325152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b144234-0bd7-439a-8a93-167eebf3130a req-c96dc79d-6eb8-4bd1-9185-c1b13627e39b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.326289 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 661/1404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:36 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1469 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:37.334211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:37.339816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:37.354711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.358940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.359975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.362413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.372657 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8b144234-0bd7-439a-8a93-167eebf3130a req-c96dc79d-6eb8-4bd1-9185-c1b13627e39b service nova] Creating event network-changed:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:15:37.391346 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8b144234-0bd7-439a-8a93-167eebf3130a req-c96dc79d-6eb8-4bd1-9185-c1b13627e39b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083829 May 10 02:15:37.392269 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 744/1405] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:37.428497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:37.429735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:37.438398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.439664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.440646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.441362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.782104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:37.797408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:37.802631 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ea8d04d2-00f1-405d-987b-623c78783748 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1536 microversion: 2.1 time: 0.473282 May 10 02:15:37.803271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 662/1406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:37 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1536 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:37.805113 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d54db037-6711-4dc4-9ead-8a8437a1725e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 0.381549 May 10 02:15:37.809944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 745/1407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:37 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:37.819484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e5bd895-98a1-4535-8877-ef4aede13557 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'create', calling method: .version_select at 0x7f3d36f43c10>, body: {"pool": "d7850721-b379-4b74-b269-d31e4717b7b9"} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:37.822084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:37.823366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:37.833648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.834451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.835863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:37.836458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:37.885515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f86e4520-1170-4edf-89da-0f962e8188c6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067899 May 10 02:15:37.888385 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 663/1408] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:37 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:38.051147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2d29d422-3557-47ee-99ab-4f6cb42bb23d req-a715cca7-4d6e-4dd9-80cb-b256539e8dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8962c96e-b870-4700-bf38-f78601e5854e", "name": "network-vif-plugged", "status": "completed", "tag": "845550c8-69e5-4cd3-91b8-30fd8a345295"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:38.062136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2d29d422-3557-47ee-99ab-4f6cb42bb23d req-a715cca7-4d6e-4dd9-80cb-b256539e8dc6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:38.062998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2d29d422-3557-47ee-99ab-4f6cb42bb23d req-a715cca7-4d6e-4dd9-80cb-b256539e8dc6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:38.079364 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2d29d422-3557-47ee-99ab-4f6cb42bb23d req-a715cca7-4d6e-4dd9-80cb-b256539e8dc6 service nova] Creating event network-vif-plugged:845550c8-69e5-4cd3-91b8-30fd8a345295 for instance 8962c96e-b870-4700-bf38-f78601e5854e on n-h1-841089-2 May 10 02:15:38.093163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-2d29d422-3557-47ee-99ab-4f6cb42bb23d req-a715cca7-4d6e-4dd9-80cb-b256539e8dc6 service nova] Instance 8962c96e-b870-4700-bf38-f78601e5854e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:15:38.109706 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2d29d422-3557-47ee-99ab-4f6cb42bb23d req-a715cca7-4d6e-4dd9-80cb-b256539e8dc6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063007 May 10 02:15:38.111276 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 664/1409] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:38.315964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:38.317742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:38.331970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:38.332870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:38.334437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:38.335476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:39.187581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:39.196332 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ce223b2d-55fa-4fdd-9179-507475efa701 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1313 microversion: 2.1 time: 0.885543 May 10 02:15:39.208913 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 665/1410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:38 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:39.222591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:39.223406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:39.238007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:39.238936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:39.239961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:39.241480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:39.531950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:39.540662 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-451e5d27-d2ba-4c94-8c61-de80deffd460 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1469 microversion: 2.1 time: 0.329314 May 10 02:15:39.543756 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 666/1411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:39 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:39.551420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:39.552321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:39.567866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:39.568441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:39.569245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:39.571513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:39.895031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:39.906106 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c6b8d9b-5a31-4540-b8b4-7f449fd340ce tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 0.359916 May 10 02:15:39.907633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 667/1412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:39 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:39.934736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:39.937079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:39.951924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:39.952440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:39.956611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:39.957330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.025222 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-187ff9ce-87d7-4b83-91e3-c2738a6c3fa5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103393 May 10 02:15:40.026593 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 668/1413] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:39 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:40.032242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-cb624fa0-5139-4f2e-b5c3-c7fee85d5267 req-2a1ffdab-b563-47cb-afc6-d24db2d99435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9abf345-a804-4182-b3d9-629a74655e94", "tag": "8482d275-6998-47a8-b8c1-d3cc029ed00f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:40.043720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cb624fa0-5139-4f2e-b5c3-c7fee85d5267 req-2a1ffdab-b563-47cb-afc6-d24db2d99435 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.045429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cb624fa0-5139-4f2e-b5c3-c7fee85d5267 req-2a1ffdab-b563-47cb-afc6-d24db2d99435 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.063742 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-cb624fa0-5139-4f2e-b5c3-c7fee85d5267 req-2a1ffdab-b563-47cb-afc6-d24db2d99435 service nova] Creating event network-changed:8482d275-6998-47a8-b8c1-d3cc029ed00f for instance e9abf345-a804-4182-b3d9-629a74655e94 on n-h2-841089-2 May 10 02:15:40.073766 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-cb624fa0-5139-4f2e-b5c3-c7fee85d5267 req-2a1ffdab-b563-47cb-afc6-d24db2d99435 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 May 10 02:15:40.081128 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 669/1414] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:40.218622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:40.220134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:40.245303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.245866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.257871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.258343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.696605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:40.714914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f6f23643-637e-409e-8725-93a44f589a3c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1313 microversion: 2.1 time: 0.501754 May 10 02:15:40.720709 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 670/1415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:40 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:40.728750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:40.729617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:40.737288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.738123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.741800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.742615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.792066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:40.929954 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8633fc2-5b08-464f-b76a-8f39cb7265d6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 204 len: 0 microversion: 2.1 time: 0.207428 May 10 02:15:40.930855 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 671/1416] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:40 2022] DELETE /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:40.943130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:40.943817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:40.960272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.960742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:40.961555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:40.961998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:41.538120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:41.555593 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64e2fe94-ba93-4837-857a-0a96e208d78c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1469 microversion: 2.1 time: 0.619770 May 10 02:15:41.559205 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 672/1417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:40 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1469 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:41.561105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:41.561727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:41.569726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:41.570191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:41.571036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:41.571520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.291650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e5bd895-98a1-4535-8877-ef4aede13557 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.476284 May 10 02:15:42.293977 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 746/1418] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:15:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:42.307366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:42.312892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:42.326143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:42.335347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-befc62a8-2923-478d-878e-10a132a124ad tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 0.777665 May 10 02:15:42.350794 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 673/1419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:41 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:42.355337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.356023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.356878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.357259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:42.358423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:42.359552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.365540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.365994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.366951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.367690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.405989 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45195a21-08ff-42c9-a2b8-4b014b116fca tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053732 May 10 02:15:42.407600 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 674/1420] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:42 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:42.413764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:42.414672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:42.422395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.423199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.424215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.424874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.890054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:42.909928 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b629b2a0-5035-4f74-a29e-621a92a79ca4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1553 microversion: 2.1 time: 0.614067 May 10 02:15:42.913778 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 747/1421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:42 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1553 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:42.922637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'action', calling method: .version_select at 0x7f3d45e004c0>, body: {"addFloatingIp": {"address": "172.25.8.87"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:42.924110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:42.931371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.932082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:42.934018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:42.934624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:43.019166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:43.032506 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08b3b79c-0e77-4b24-acff-855d2bc6dc13 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1313 microversion: 2.1 time: 0.623444 May 10 02:15:43.034269 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 675/1422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:42 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:43.045073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-5a20ef89-20a0-4e85-8032-ccc63ec78661 req-b2cc3293-a96f-4588-989b-b7c89b976419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b982e97f-604e-42ff-9c05-95d2529e9cd6", "name": "network-vif-plugged", "status": "completed", "tag": "f26b3c05-b982-431a-97a5-5cdf1be07742"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:43.056903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5a20ef89-20a0-4e85-8032-ccc63ec78661 req-b2cc3293-a96f-4588-989b-b7c89b976419 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:43.057790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5a20ef89-20a0-4e85-8032-ccc63ec78661 req-b2cc3293-a96f-4588-989b-b7c89b976419 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:43.077670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Acquired lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:15:43.083958 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-5a20ef89-20a0-4e85-8032-ccc63ec78661 req-b2cc3293-a96f-4588-989b-b7c89b976419 service nova] Creating event network-vif-plugged:f26b3c05-b982-431a-97a5-5cdf1be07742 for instance b982e97f-604e-42ff-9c05-95d2529e9cd6 on n-h2-841089-2 May 10 02:15:43.091440 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-5a20ef89-20a0-4e85-8032-ccc63ec78661 req-b2cc3293-a96f-4588-989b-b7c89b976419 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055223 May 10 02:15:43.092629 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 676/1423] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:43.099161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:43.100097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:43.107515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:43.108244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:43.109477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:43.110111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:43.601581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:43.612363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c859b13e-9135-4aca-b0c3-412106e568e8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1461 microversion: 2.1 time: 0.518297 May 10 02:15:43.612967 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 677/1424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:43 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1461 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:43.622166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:43.622799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:43.631405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:43.631873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:43.632661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:43.633112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.064861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:44.083292 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-48eade2e-102e-4eb3-a121-5b93027f63c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 0.466156 May 10 02:15:44.085669 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 678/1425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:43 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:44.097663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a90e5855-1761-4821-9e48-94471378bf15 req-6efa31c1-0f5f-4480-bcdb-e81fe5ea7697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9509d8d2-b9af-4154-a5e7-e0a9815ea577", "name": "network-vif-deleted", "tag": "6f4ae02f-7a5a-4484-9667-07d4192bd89c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:44.109833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a90e5855-1761-4821-9e48-94471378bf15 req-6efa31c1-0f5f-4480-bcdb-e81fe5ea7697 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.110586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a90e5855-1761-4821-9e48-94471378bf15 req-6efa31c1-0f5f-4480-bcdb-e81fe5ea7697 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.134251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a90e5855-1761-4821-9e48-94471378bf15 req-6efa31c1-0f5f-4480-bcdb-e81fe5ea7697 service nova] Creating event network-vif-deleted:6f4ae02f-7a5a-4484-9667-07d4192bd89c for instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 on n-h1-841089-2 May 10 02:15:44.142348 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a90e5855-1761-4821-9e48-94471378bf15 req-6efa31c1-0f5f-4480-bcdb-e81fe5ea7697 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052765 May 10 02:15:44.143654 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 679/1426] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:44.151952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:44.154051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:44.164113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.168511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.169941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.172643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.237417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-197e0ea7-7ae6-4280-ac17-416df71d548b tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087918 May 10 02:15:44.238146 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 680/1427] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:44 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:44.251699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:44.252770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:44.262447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.267356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.268804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.269508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.742819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:44.751600 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23ffd52b-b555-469c-beaf-5772bd99acbc tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1461 microversion: 2.1 time: 0.511564 May 10 02:15:44.754413 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 681/1428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:44 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1461 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:44.763545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:44.764933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:44.793531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.797935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:44.803473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:44.804195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:45.028172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:45.036218 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54964183-c30a-46dc-a5d7-00bd92218bee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.280560 May 10 02:15:45.045564 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 682/1429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:44 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:45.053494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:45.054142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:45.066141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:45.066909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:45.067406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:45.068355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:45.466575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:45.490389 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ef2a1b7-a6fb-43f8-82ca-0d989af1a672 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1463 microversion: 2.1 time: 0.445873 May 10 02:15:45.514606 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 683/1430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:45 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1463 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:45.529149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64eddb79-43c8-49d3-99d9-b0e813d1c490 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '.version_select at 0x7f3d36e43160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:45.533324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64eddb79-43c8-49d3-99d9-b0e813d1c490 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:45.533779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64eddb79-43c8-49d3-99d9-b0e813d1c490 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:45.553135 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64eddb79-43c8-49d3-99d9-b0e813d1c490 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3106 microversion: 2.1 time: 0.038144 May 10 02:15:45.561578 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 684/1431] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:15:45 2022] GET /compute/v2.1/os-migrations => generated 3106 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:45.561578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:45.562015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:45.567704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:45.568162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:45.568927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:45.569366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:45.971432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:45.979774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60e99609-25d7-417c-8d56-46d124537feb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 0.424536 May 10 02:15:45.987280 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 685/1432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:45 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:45.998645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-519231ab-a912-4aa9-b07e-d9d149e9ed20 req-c2881b65-b4c0-40a5-952b-1394d1f88dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "name": "network-vif-plugged", "status": "completed", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}, {"server_uuid": "e9abf345-a804-4182-b3d9-629a74655e94", "name": "network-vif-plugged", "status": "completed", "tag": "8482d275-6998-47a8-b8c1-d3cc029ed00f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:46.040208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-519231ab-a912-4aa9-b07e-d9d149e9ed20 req-c2881b65-b4c0-40a5-952b-1394d1f88dbb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.040208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-519231ab-a912-4aa9-b07e-d9d149e9ed20 req-c2881b65-b4c0-40a5-952b-1394d1f88dbb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:46.056222 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-519231ab-a912-4aa9-b07e-d9d149e9ed20 req-c2881b65-b4c0-40a5-952b-1394d1f88dbb service nova] Creating event network-vif-plugged:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:15:46.056969 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-519231ab-a912-4aa9-b07e-d9d149e9ed20 req-c2881b65-b4c0-40a5-952b-1394d1f88dbb service nova] Creating event network-vif-plugged:8482d275-6998-47a8-b8c1-d3cc029ed00f for instance e9abf345-a804-4182-b3d9-629a74655e94 on n-h2-841089-2 May 10 02:15:46.069719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-519231ab-a912-4aa9-b07e-d9d149e9ed20 req-c2881b65-b4c0-40a5-952b-1394d1f88dbb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080714 May 10 02:15:46.070715 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 686/1433] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:46.090745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:46.092589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:46.107921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.108671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:46.111751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.115223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:46.170102 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6bd7a918-b826-431f-876d-be26cb9870ea tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090080 May 10 02:15:46.171360 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 687/1434] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:15:46 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:15:46.401907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Building network info cache for instance {{(pid=118716) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:15:46.720055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef43d1b2-c1f2-4683-a1f1-733f8a4780db tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Calling method '.version_select at 0x7f3d36ecad30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:46.742089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef43d1b2-c1f2-4683-a1f1-733f8a4780db tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.742539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef43d1b2-c1f2-4683-a1f1-733f8a4780db tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:46.775441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef43d1b2-c1f2-4683-a1f1-733f8a4780db tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.776087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef43d1b2-c1f2-4683-a1f1-733f8a4780db tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:46.827992 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef43d1b2-c1f2-4683-a1f1-733f8a4780db tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/d377cce88d6f46d3959a0cf83da19a5b?start=2022-05-09T02%3A15%3A45.500029&end=2022-05-11T02%3A15%3A45.500029" status: 200 len: 694 microversion: 2.1 time: 0.655177 May 10 02:15:46.837767 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 688/1435] 10.222.0.52 () {58 vars in 1411 bytes} [Tue May 10 02:15:46 2022] GET /compute/v2.1/os-simple-tenant-usage/d377cce88d6f46d3959a0cf83da19a5b?start=2022-05-09T02%3A15%3A45.500029&end=2022-05-11T02%3A15%3A45.500029 => generated 694 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:46.843503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3a7beb4-6f02-4a9d-bfb1-0dc78bd4c7c7 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:46.852655 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3a7beb4-6f02-4a9d-bfb1-0dc78bd4c7c7 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013435 May 10 02:15:46.853647 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 689/1436] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:15:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:46.858664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:46.859553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:46.866289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.867044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:46.868200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:46.869722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:47.001348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:47.010839 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d3036b1-4954-451e-a38a-685a1a296ff6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.156001 May 10 02:15:47.017704 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 690/1437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:46 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:47.022474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-53847166-55e1-4eed-829f-d20cdb67b7a4 req-c58846fc-d507-4370-991e-2da2b49b2196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010feee6-4f48-4682-bb79-b95d27eda2e3", "tag": "3caa9309-fd85-4fe2-b113-092d695f252c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:47.050608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-53847166-55e1-4eed-829f-d20cdb67b7a4 req-c58846fc-d507-4370-991e-2da2b49b2196 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:47.051104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-53847166-55e1-4eed-829f-d20cdb67b7a4 req-c58846fc-d507-4370-991e-2da2b49b2196 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:47.089000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-53847166-55e1-4eed-829f-d20cdb67b7a4 req-c58846fc-d507-4370-991e-2da2b49b2196 service nova] Creating event network-changed:3caa9309-fd85-4fe2-b113-092d695f252c for instance 010feee6-4f48-4682-bb79-b95d27eda2e3 on n-h1-841089-2 May 10 02:15:47.100356 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-53847166-55e1-4eed-829f-d20cdb67b7a4 req-c58846fc-d507-4370-991e-2da2b49b2196 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075234 May 10 02:15:47.101745 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 691/1438] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:47.110793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8eb1b209-344f-429f-a39d-b668cd5d90cd tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '.version_select at 0x7f3d36d9ae50>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:47.139607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb1b209-344f-429f-a39d-b668cd5d90cd tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:47.143675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb1b209-344f-429f-a39d-b668cd5d90cd tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:47.187028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb1b209-344f-429f-a39d-b668cd5d90cd tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:47.187772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb1b209-344f-429f-a39d-b668cd5d90cd tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:47.218441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8eb1b209-344f-429f-a39d-b668cd5d90cd tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/d377cce88d6f46d3959a0cf83da19a5b?start=2022-05-09T02%3A15%3A45.500029&end=2022-05-11T02%3A15%3A45.500029" status: 200 len: 694 microversion: 2.1 time: 0.115243 May 10 02:15:47.219810 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 692/1439] 10.222.0.52 () {58 vars in 1411 bytes} [Tue May 10 02:15:47 2022] GET /compute/v2.1/os-simple-tenant-usage/d377cce88d6f46d3959a0cf83da19a5b?start=2022-05-09T02%3A15%3A45.500029&end=2022-05-11T02%3A15%3A45.500029 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:47.237479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28d82e59-d887-4590-b089-5b9b72c4c162 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-89436569", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:47.240051 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:15:47.240051 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:15:47.267942 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28d82e59-d887-4590-b089-5b9b72c4c162 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.046797 May 10 02:15:47.275006 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 693/1440] 10.222.0.52 () {60 vars in 1145 bytes} [Tue May 10 02:15:47 2022] POST /compute/v2.1/flavors => generated 497 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:47.307796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:47.308876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:47.319093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:47.322976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:47.324033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:47.324563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:48.429197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Updating instance_info_cache with network_info: [{"id": "3caa9309-fd85-4fe2-b113-092d695f252c", "address": "fa:16:3e:9e:bd:02", "network": {"id": "6f040b79-baa5-4476-b3e3-ad726a292d10", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1271836838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8161100b518d4d68bb77b0052a6efc7f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3caa9309-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118716) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:15:48.453710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:48.467340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Releasing lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:15:48.471658 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f160054-c0f4-4824-ac25-8e3574b5f102 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action" status: 202 len: 0 microversion: 2.1 time: 5.553854 May 10 02:15:48.477832 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 748/1441] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:42 2022] POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action => generated 0 bytes in 5563 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:15:48.482361 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24d770e2-fbfa-4c25-9ad8-cb97a10a3ac3 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1317 microversion: 2.1 time: 1.203332 May 10 02:15:48.485121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0f81f0c-931a-4499-b797-0640aecb1980 tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Calling method '.version_select at 0x7f3d36fdb040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:48.502134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 694/1442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:47 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1317 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:48.511021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da096aba-e9da-4c80-81c4-e3339077bd22 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:48.525704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f81f0c-931a-4499-b797-0640aecb1980 tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:48.526175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f81f0c-931a-4499-b797-0640aecb1980 tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:48.531104 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da096aba-e9da-4c80-81c4-e3339077bd22 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027808 May 10 02:15:48.532862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 695/1443] 10.222.0.52 () {58 vars in 1181 bytes} [Tue May 10 02:15:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:15:48.539697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:48.540572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:48.561450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:48.561921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:48.562796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:48.581139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:48.607313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f81f0c-931a-4499-b797-0640aecb1980 tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:48.607313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f81f0c-931a-4499-b797-0640aecb1980 tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:48.751662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:48.760170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94a09a73-8b78-4f50-ad2d-9360e06e354c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.224927 May 10 02:15:48.760661 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 696/1444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:48 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:48.780269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c4552f0-1973-4d89-a38a-20990897c972 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'create', calling method: .version_select at 0x7f3d36ecaa60>, body: {"pool": "d7850721-b379-4b74-b269-d31e4717b7b9"} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:48.853178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0f81f0c-931a-4499-b797-0640aecb1980 tempest-TenantUsagesTestJSON-27205661 tempest-TenantUsagesTestJSON-27205661-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-09T02%3A15%3A45.500029&end=2022-05-11T02%3A15%3A45.500029&detailed=1" status: 200 len: 16111 microversion: 2.1 time: 0.374137 May 10 02:15:48.853798 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 749/1445] 10.222.0.52 () {58 vars in 1334 bytes} [Tue May 10 02:15:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-09T02%3A15%3A45.500029&end=2022-05-11T02%3A15%3A45.500029&detailed=1 => generated 16111 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:15:48.860379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1246486594", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "ffa1d6cb-083b-428b-bf50-5ac0969365a9"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:48.997475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:15:49.885281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:15:49.885912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:15:49.886450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:15:49.887052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:15:49.887815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:15:49.908322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:49.909211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:49.911297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:49.912594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:49.961693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:49.973309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for user ea129546ff474fd0aa9c93c1bfaac5fd and project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:50.001470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:15:50.008218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:15:50.146920 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9b532bff-b957-4cad-81bc-a5bfe5fe75dd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283900 May 10 02:15:50.150536 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 750/1446] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:15:50.169282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:50.169818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:50.187240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:50.187710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:50.192921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:50.194002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:50.272325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:15:50.450582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-562d1588-d2c5-4747-ace4-b0c7e95f91ac tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 204 len: 0 microversion: 2.1 time: 0.292603 May 10 02:15:50.453904 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 751/1447] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:15:50 2022] DELETE /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:15:50.477489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:50.478226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:50.494902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:50.495435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:50.496305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:50.496759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:50.988459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:51.019738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-244a99fc-452f-40aa-8d93-b8fd3a58a757 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1466 microversion: 2.1 time: 0.558002 May 10 02:15:51.020822 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 752/1448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:50 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1466 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:51.035099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:51.039969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:51.062773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:51.071781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:51.072898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:51.074257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:51.451244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:51.466211 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e9ae7769-1868-4c3e-a319-a1b7badbb2f5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.443378 May 10 02:15:51.476085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 753/1449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:51 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:51.488201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:51.488839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:51.496147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:51.505332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:51.507148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:51.507618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:51.650874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:51.668044 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1b3f743-2e85-404a-9e0c-7f859e25f41e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1331 microversion: 2.1 time: 0.190712 May 10 02:15:51.669173 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 754/1450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:51 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1331 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:51.684341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:51.696058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:51.703524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:51.704348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:51.705482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:51.706164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.194783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:52.218859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5a6aa34-d3f8-4fe7-8873-f2064583f6e5 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1469 microversion: 2.1 time: 0.538644 May 10 02:15:52.221826 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 755/1451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:51 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1469 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:52.227428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:52.228327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:52.264168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.269877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.271787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.274872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.503144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c4552f0-1973-4d89-a38a-20990897c972 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.731170 May 10 02:15:52.504562 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 697/1452] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:15:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:52.510775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:52.512032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:52.536197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.540037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.541214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.543608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.700755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:52.717753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e35d4c02-0639-4fb4-853e-312cb4de6775 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1466 microversion: 2.1 time: 0.494555 May 10 02:15:52.718788 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 756/1453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:52 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1466 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:52.723783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.248"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:52.725019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:52.746069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.752216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.753274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.753925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.825816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Acquired lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:15:52.849887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:52.866064 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d50ec541-9164-4f0d-a779-a46964cc62d7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.359200 May 10 02:15:52.866952 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 698/1454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:52 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:52.882183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:52.882815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:52.903741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.904153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:52.906959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:52.916825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:53.064862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:53.074258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9e6ceff1-e0cd-4174-9a35-cb05b1ee10ff tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1337 microversion: 2.1 time: 0.200900 May 10 02:15:53.085316 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 699/1455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:52 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1337 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:53.090590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2029300753"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:53.091783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:53.111875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:53.112347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:53.113159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:53.113694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.226965 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ed860ab-88b4-4b2b-9554-55789172a8ec tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "POST /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e/action" status: 202 len: 0 microversion: 2.1 time: 1.131182 May 10 02:15:54.229081 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 700/1456] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:53 2022] POST /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e/action => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:15:54.252634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:54.260422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:54.289809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.289809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.295674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.299756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.341771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9.", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:15:54.342368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Releasing lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:15:54.343261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.343261 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Request method failure captured: May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action HTTP/1.1 May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 46 May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq3KM3RmQ9sdoYSb45rqyYZKD_LRhkikmcKTNlfiuqEKMG99kYgBw5hWg4pil1xQvahzMCcotJLAIgd26L5fdXSpUKbGGGj3cM5IzvVUJmnjaMrB3Y-PefZEdAw1Ve_E1t0i0h0-SPoEpjc-kw_MNIm9WxtfNcwUhhuful1q3iQXyc May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:54.345433 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8161100b518d4d68bb77b0052a6efc7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5f339a3525a549f6958b4cc77e40f606 May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: {"addFloatingIp": {"address": "172.25.8.248"}} May 10 02:15:54.347178 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: exception: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '010feee6-4f48-4682-bb79-b95d27eda2e3', 'body': {'addFloatingIp': {'address': '172.25.8.248'}}} May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2688, in associate_floating_ip May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:54.348040 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:15:54.349265 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2690, in associate_floating_ip May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.350352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.351609 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] May 10 02:15:54.352928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:54.355343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Returning 400 to user: Cannot associate floating IP 172.25.8.248 (28925171-c8bb-44b5-9c78-9d71bef2eaf1) with port 3caa9309-fd85-4fe2-b113-092d695f252c using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network d7850721-b379-4b74-b269-d31e4717b7b9. May 10 02:15:54.355343 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-d3518e75-a92a-4061-a8cc-aef5d4fbda77'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:54.362757 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a7258ea-58a9-4b18-8456-070b3a5576b5 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action" status: 400 len: 381 microversion: 2.1 time: 1.637520 May 10 02:15:54.369572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 757/1457] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:52 2022] POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action => generated 381 bytes in 1650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:15:54.377575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:54.387443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:54.415185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.415901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.420623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.421315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.636336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26957233390644629311bafe1f30123c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd377cce88d6f46d3959a0cf83da19a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:54.645568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b8ef6a6-8746-41d6-b419-866dfb96492c tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 200 len: 1298 microversion: 2.1 time: 0.411197 May 10 02:15:54.656996 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 701/1458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:54 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 1298 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:54.694391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:54.695108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:54.730637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.736110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.738825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.741628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:54.741841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:54.760614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7ec0c01-3f02-4692-b5e4-8756fe942eae tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.388002 May 10 02:15:54.772630 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 758/1459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:54 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:54.786199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f692ced3-2152-4e69-b487-8c4ec5c356c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e970d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:54.953522 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f692ced3-2152-4e69-b487-8c4ec5c356c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.178345 May 10 02:15:54.954418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 759/1460] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:54 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:54.965245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-27f3ea22-6a9a-49f5-a6ad-e26e3536ffb4 req-500f1165-51b5-4635-b27a-42752338f4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b982e97f-604e-42ff-9c05-95d2529e9cd6", "name": "network-vif-deleted", "tag": "f26b3c05-b982-431a-97a5-5cdf1be07742"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:54.992294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-27f3ea22-6a9a-49f5-a6ad-e26e3536ffb4 req-500f1165-51b5-4635-b27a-42752338f4af service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:54.993000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-27f3ea22-6a9a-49f5-a6ad-e26e3536ffb4 req-500f1165-51b5-4635-b27a-42752338f4af service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:55.014249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:55.022876 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc8d45a9-f634-4e50-8af9-6b96ff79e91b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1337 microversion: 2.1 time: 0.351732 May 10 02:15:55.023564 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 702/1461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:54 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1337 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:55.030436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-27f3ea22-6a9a-49f5-a6ad-e26e3536ffb4 req-500f1165-51b5-4635-b27a-42752338f4af service nova] Creating event network-vif-deleted:f26b3c05-b982-431a-97a5-5cdf1be07742 for instance b982e97f-604e-42ff-9c05-95d2529e9cd6 on n-h2-841089-2 May 10 02:15:55.036270 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-27f3ea22-6a9a-49f5-a6ad-e26e3536ffb4 req-500f1165-51b5-4635-b27a-42752338f4af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080454 May 10 02:15:55.037209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 760/1462] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:55.051000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-767ef3ab-f629-496e-b3a0-68fd8a86efe8 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '.version_select at 0x7f3d36e89f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:55.675826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:55.677131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] [instance: b982e97f-604e-42ff-9c05-95d2529e9cd6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:55.689939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:55.691372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:55.696790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:55.697497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:55.731559 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] HTTP exception thrown: Instance b982e97f-604e-42ff-9c05-95d2529e9cd6 could not be found. May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Request method failure captured: May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 HTTP/1.1 May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq6-CYkIS0B_HRQCW3DftJZByXERlbKRHbZDxAHzLanimKGAlEeDgC9nymWLroNSr0cFWpvG25_JbQwr_DGBdtIFXN1qlITdKY91FJ8T57F_x4WTEuYJg1NB42eDH9YHFSEbDRqs6FB0z69yae4ir2vLp2cW_5BZNB_Xdw3MD4SAc4 May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: d377cce88d6f46d3959a0cf83da19a5b May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TenantUsagesTestJSON-1573618836 May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:15:55.733471 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d377cce88d6f46d3959a0cf83da19a5b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d377cce88d6f46d3959a0cf83da19a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d377cce88d6f46d3959a0cf83da19a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d377cce88d6f46d3959a0cf83da19a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TenantUsagesTestJSON-1573618836 May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: d377cce88d6f46d3959a0cf83da19a5b May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1573618836 May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TenantUsagesTestJSON-1573618836-project May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 26957233390644629311bafe1f30123c May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TenantUsagesTestJSON-1573618836-project May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance b982e97f-604e-42ff-9c05-95d2529e9cd6 could not be found. May 10 02:15:55.735105 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'b982e97f-604e-42ff-9c05-95d2529e9cd6'} May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b982e97f-604e-42ff-9c05-95d2529e9cd6 could not be found. May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:15:55.736057 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b982e97f-604e-42ff-9c05-95d2529e9cd6 could not be found. May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b982e97f-604e-42ff-9c05-95d2529e9cd6 could not be found. May 10 02:15:55.737538 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:15:55.741590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] Returning 404 to user: Instance b982e97f-604e-42ff-9c05-95d2529e9cd6 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:15:55.752259 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a748975e-9b95-4e65-a0de-266d4a6de3f7 tempest-TenantUsagesTestJSON-1573618836 tempest-TenantUsagesTestJSON-1573618836-project] 10.222.0.52 "GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6" status: 404 len: 111 microversion: 2.1 time: 0.082410 May 10 02:15:55.757454 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 761/1463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:55 2022] GET /compute/v2.1/servers/b982e97f-604e-42ff-9c05-95d2529e9cd6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:15:55.779271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:55.780152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:55.794153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:55.794790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:55.796571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:55.798555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:56.127235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:56.139612 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db7f4375-ca11-4aa1-a703-4c6a408100be tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.365343 May 10 02:15:56.149965 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 762/1464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:55 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:56.161134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f9c657e3-695f-452e-81aa-b49368068213 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e979d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:56.254691 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f9c657e3-695f-452e-81aa-b49368068213 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.103166 May 10 02:15:56.260652 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 763/1465] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:56 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:56.266669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:56.274796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:56.298600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:56.310981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:56.311886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:56.312344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:56.703270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:56.713559 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ddf5ea1-7625-4452-8bfc-a487dad065ce tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1379 microversion: 2.1 time: 0.456623 May 10 02:15:56.726662 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 764/1466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:56 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1379 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:57.051296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d28ea618-6ada-45f7-a7bc-79c2742a1ab6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Action: 'create', calling method: .version_select at 0x7f3d36fe0ee0>, body: {"keypair": {"name": "tempest-keypair-1721610165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9+lGq/Xror1VxStAU4Mid2aVmwdP97Xr8Np2nm/TIMKd+Rpt+qvDFsMj7pF48u6N36xLBQWJaeyJnluKtonHmgyLYPomA3m7/Ggfpu91fbvc7GLyd5yYCkzMAoF/AuQA=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:57.096841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d28ea618-6ada-45f7-a7bc-79c2742a1ab6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Getting quotas for project 0fae12a937d945878994de3ab3d90883. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:15:57.112672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d28ea618-6ada-45f7-a7bc-79c2742a1ab6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Getting quotas for user 838304e2f8bc4973a3fd7af06eed08d5 and project 0fae12a937d945878994de3ab3d90883. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:15:57.161151 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d28ea618-6ada-45f7-a7bc-79c2742a1ab6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.432973 May 10 02:15:57.162363 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 765/1467] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:15:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:15:57.167209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:57.184131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:57.199087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:57.199871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:57.200724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:57.201273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:57.471094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:57.484689 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f40cc6cf-a2de-48be-90f2-cf02f64020e3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.321092 May 10 02:15:57.485382 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 766/1468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:57 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:57.498007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d4e1f2c2-bdff-44e9-814b-3073362db116 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36ea2e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:57.613985 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d4e1f2c2-bdff-44e9-814b-3073362db116 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.127460 May 10 02:15:57.614573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 767/1469] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:57 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:57.664337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-26134bac-1c55-4ba5-8c46-6ce86c95ff5d req-dce71af2-d980-4666-927e-b9e9a5bb99df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:57.684654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-26134bac-1c55-4ba5-8c46-6ce86c95ff5d req-dce71af2-d980-4666-927e-b9e9a5bb99df service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:57.685108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-26134bac-1c55-4ba5-8c46-6ce86c95ff5d req-dce71af2-d980-4666-927e-b9e9a5bb99df service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:57.737518 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-26134bac-1c55-4ba5-8c46-6ce86c95ff5d req-dce71af2-d980-4666-927e-b9e9a5bb99df service nova] Creating event network-changed:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:15:57.766592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-26134bac-1c55-4ba5-8c46-6ce86c95ff5d req-dce71af2-d980-4666-927e-b9e9a5bb99df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101931 May 10 02:15:57.773174 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 768/1470] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:15:57.792027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:57.794135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:57.818181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:57.821326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:57.824299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:57.827816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:58.065827 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-767ef3ab-f629-496e-b3a0-68fd8a86efe8 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/28925171-c8bb-44b5-9c78-9d71bef2eaf1" status: 202 len: 0 microversion: 2.1 time: 3.041134 May 10 02:15:58.069482 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 703/1471] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:15:55 2022] DELETE /compute/v2.1/os-floating-ips/28925171-c8bb-44b5-9c78-9d71bef2eaf1 => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:15:58.083636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'action', calling method: .version_select at 0x7f3d45e12160>, body: {"removeFloatingIp": {"address": "172.25.8.87"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:15:58.251894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:58.259810 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-855a7982-5ffa-4c10-9e1a-c6ad132ede1c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1379 microversion: 2.1 time: 0.480985 May 10 02:15:58.264215 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 769/1472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:57 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1379 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:15:58.501981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:15:58.502955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:58.523282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:58.525465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:58.527061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:58.528796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:58.800910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:15:58.809761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:58.810407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:58.811414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:15:58.813251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:15:58.991060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:15:59.001274 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b596df84-a0c3-4374-9bdd-80f93330ff05 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.503088 May 10 02:15:59.018395 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 770/1473] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:15:58 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:15:59.038146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-834b8dfe-f978-44f2-a6dc-d51601cc69e9 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f76c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:00.006021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Acquired lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:16:05.135173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:16:06.540613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Updating instance_info_cache with network_info: [{"id": "3caa9309-fd85-4fe2-b113-092d695f252c", "address": "fa:16:3e:9e:bd:02", "network": {"id": "6f040b79-baa5-4476-b3e3-ad726a292d10", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1271836838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8161100b518d4d68bb77b0052a6efc7f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3caa9309-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:16:06.559400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Releasing lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:16:06.560856 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfa67965-1e13-47f3-8e08-e0c2fe40ba54 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action" status: 202 len: 0 microversion: 2.1 time: 8.488250 May 10 02:16:06.565289 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 704/1474] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:15:58 2022] POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action => generated 0 bytes in 8491 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:16:06.577585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:06.579591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:06.600682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:06.602908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:06.605343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:06.609425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:06.905748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:06.920095 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a815e73-b394-499b-8214-97d1e53a5429 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1379 microversion: 2.1 time: 0.352457 May 10 02:16:06.929234 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 705/1475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:06 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1379 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:06.936372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:06.937452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:06.956343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:06.956833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:06.957669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:06.960066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:07.162821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:07.177465 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-086fbf8b-1178-4838-811f-608cf44a3a24 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 200 len: 1346 microversion: 2.1 time: 0.254014 May 10 02:16:07.178388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 706/1476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:06 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 1346 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:07.195699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3d35aaec-cb93-4c3e-996f-f9122472324e req-abfeea30-929a-4a6e-94a4-0753ad649b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "name": "network-vif-plugged", "status": "completed", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:07.219143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3d35aaec-cb93-4c3e-996f-f9122472324e req-abfeea30-929a-4a6e-94a4-0753ad649b99 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:07.236939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3d35aaec-cb93-4c3e-996f-f9122472324e req-abfeea30-929a-4a6e-94a4-0753ad649b99 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:07.259484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3d35aaec-cb93-4c3e-996f-f9122472324e req-abfeea30-929a-4a6e-94a4-0753ad649b99 service nova] Creating event network-vif-plugged:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:16:07.280391 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3d35aaec-cb93-4c3e-996f-f9122472324e req-abfeea30-929a-4a6e-94a4-0753ad649b99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100391 May 10 02:16:07.283459 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 707/1477] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:07.567667 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56a34950-b633-4ee6-bcfb-97c1030d8631 tempest-TenantUsagesNegativeTestJSON-1007542887 tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-09T02%3A16%3A03.812906&end=2022-05-11T02%3A16%3A03.812906" status: 404 len: 112 microversion: - time: 0.283295 May 10 02:16:07.573302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 708/1478] 10.222.0.52 () {58 vars in 1315 bytes} [Tue May 10 02:16:07 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-09T02%3A16%3A03.812906&end=2022-05-11T02%3A16%3A03.812906 => generated 112 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 02:16:07.613232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f12d6595-dbf7-4da6-bc9c-ab010ccb3cee req-18ea7488-d75c-4863-87fc-4d19c69efdce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010feee6-4f48-4682-bb79-b95d27eda2e3", "tag": "3caa9309-fd85-4fe2-b113-092d695f252c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:07.662074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f12d6595-dbf7-4da6-bc9c-ab010ccb3cee req-18ea7488-d75c-4863-87fc-4d19c69efdce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:07.666241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f12d6595-dbf7-4da6-bc9c-ab010ccb3cee req-18ea7488-d75c-4863-87fc-4d19c69efdce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:07.696866 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f12d6595-dbf7-4da6-bc9c-ab010ccb3cee req-18ea7488-d75c-4863-87fc-4d19c69efdce service nova] Creating event network-changed:3caa9309-fd85-4fe2-b113-092d695f252c for instance 010feee6-4f48-4682-bb79-b95d27eda2e3 on n-h1-841089-2 May 10 02:16:07.710488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f12d6595-dbf7-4da6-bc9c-ab010ccb3cee req-18ea7488-d75c-4863-87fc-4d19c69efdce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135475 May 10 02:16:07.712424 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 709/1479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:07.733530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-493636267", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e3cbada0-2a6f-4d01-abb8-cc23a194887f"}], "security_groups": [{"name": "tempest-securitygroup--1330162496"}], "key_name": "tempest-keypair-1721610165", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:09.873969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-834b8dfe-f978-44f2-a6dc-d51601cc69e9 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 10.852323 May 10 02:16:09.875384 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 771/1480] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:15:59 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 10856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:09.899778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d2f3923-dda0-4b16-8403-da7bbd099407 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '.version_select at 0x7f3d36fccee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:10.036660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] validate_networks() for [('e3cbada0-2a6f-4d01-abb8-cc23a194887f', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:11.045007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Getting quotas for project 0fae12a937d945878994de3ab3d90883. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:11.057503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Getting quotas for user 838304e2f8bc4973a3fd7af06eed08d5 and project 0fae12a937d945878994de3ab3d90883. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:11.094639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:11.095391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:11.096056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:11.096660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:11.097086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:11.131450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.133251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.134338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.135052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.167015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Getting quotas for project 0fae12a937d945878994de3ab3d90883. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:11.178321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Getting quotas for user 838304e2f8bc4973a3fd7af06eed08d5 and project 0fae12a937d945878994de3ab3d90883. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:11.205401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:11.209091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:11.298328 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b617b95-84eb-4dbc-a05c-65788f5b9481 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.578936 May 10 02:16:11.299133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 710/1481] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:07 2022] POST /compute/v2.1/servers => generated 407 bytes in 3586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:11.306423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d1609508-d583-4e1f-b44b-2d8ecc7c7773 tempest-TenantUsagesNegativeTestJSON-1007542887 tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin] Calling method '.version_select at 0x7f3d36fe4670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:11.310117 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d1609508-d583-4e1f-b44b-2d8ecc7c7773 tempest-TenantUsagesNegativeTestJSON-1007542887 tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d1609508-d583-4e1f-b44b-2d8ecc7c7773 tempest-TenantUsagesNegativeTestJSON-1007542887 tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin] Request method failure captured: May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-simple-tenant-usage/808a9d7fc2d0420d878272867eb0d19e?start=2022-05-11T02%3A16%3A03.812906&end=2022-05-09T02%3A16%3A03.812906 HTTP/1.1 May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecrjv4i-MluKI_rC2kpvou3pJq71v_5JY8-vElCf5e3XhMh2hU4qgSkhUtIBmFaEj1WxSCIAH0OC79mjKMFxY6RJiiMtoQ8znPKRmyD4EyUJonzEiUMtck6iCPvd0TK7f19_Wn71BH03_iku-mJya8LbCbJOkj7PFq07agYZI47pQfo May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: a8292a72ac5d4558a7af38c6396bd364 May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1007542887 May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:16:11.314489 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8292a72ac5d4558a7af38c6396bd364", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8292a72ac5d4558a7af38c6396bd364"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8292a72ac5d4558a7af38c6396bd364"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8292a72ac5d4558a7af38c6396bd364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1007542887 May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: a8292a72ac5d4558a7af38c6396bd364 May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1007542887 May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 43835eee6be643c2a62b1305ac4608a3 May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid start time. The start time cannot occur after the end time. May 10 02:16:11.316388 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '808a9d7fc2d0420d878272867eb0d19e'} May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 10 02:16:11.317486 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d1609508-d583-4e1f-b44b-2d8ecc7c7773 tempest-TenantUsagesNegativeTestJSON-1007542887 tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:11.318890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d1609508-d583-4e1f-b44b-2d8ecc7c7773 tempest-TenantUsagesNegativeTestJSON-1007542887 tempest-TenantUsagesNegativeTestJSON-1007542887-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/808a9d7fc2d0420d878272867eb0d19e?start=2022-05-11T02%3A16%3A03.812906&end=2022-05-09T02%3A16%3A03.812906" status: 400 len: 111 microversion: 2.1 time: 0.016111 May 10 02:16:11.319726 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 711/1482] 10.222.0.52 () {58 vars in 1411 bytes} [Tue May 10 02:16:11 2022] GET /compute/v2.1/os-simple-tenant-usage/808a9d7fc2d0420d878272867eb0d19e?start=2022-05-11T02%3A16%3A03.812906&end=2022-05-09T02%3A16%3A03.812906 => generated 111 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:16:11.324131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:11.325217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:11.340214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.341435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.343211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.344060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.759641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:11.773303 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-897a9139-9bb3-478c-a7b4-a1374ae4e692 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1379 microversion: 2.1 time: 0.452049 May 10 02:16:11.775594 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 712/1483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:11 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1379 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:11.790721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:11.792207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:11.799573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.800371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.801464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.802212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.819288 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 HTTP/1.1 May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:11.821304 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:11.822838 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '9509d8d2-b9af-4154-a5e7-e0a9815ea577'} May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:11.823658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:11.824904 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:11.827545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:11.828880 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b0637f0-6ffd-4680-9298-e5bfdf74fcee tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 404 len: 111 microversion: 2.1 time: 0.043208 May 10 02:16:11.830019 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 713/1484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:11 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:16:11.846121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a64e7fee-cb26-4c79-ae9d-dbf7018e7143 req-a51a5843-03a3-4bab-a389-7171b9cd8d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "name": "network-vif-plugged", "status": "completed", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:11.874209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a64e7fee-cb26-4c79-ae9d-dbf7018e7143 req-a51a5843-03a3-4bab-a389-7171b9cd8d52 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:11.875088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a64e7fee-cb26-4c79-ae9d-dbf7018e7143 req-a51a5843-03a3-4bab-a389-7171b9cd8d52 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:11.898924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a64e7fee-cb26-4c79-ae9d-dbf7018e7143 req-a51a5843-03a3-4bab-a389-7171b9cd8d52 service nova] Creating event network-vif-plugged:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:16:11.925875 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d2f3923-dda0-4b16-8403-da7bbd099407 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/59484906-aafb-4bea-8aa5-4732e08d601a" status: 202 len: 0 microversion: 2.1 time: 2.035376 May 10 02:16:11.927549 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 772/1485] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:16:09 2022] DELETE /compute/v2.1/os-floating-ips/59484906-aafb-4bea-8aa5-4732e08d601a => generated 0 bytes in 2052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:16:11.944036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b466ce12-b40a-487a-af03-8a5b42eb26c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e97940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:11.951679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a64e7fee-cb26-4c79-ae9d-dbf7018e7143 req-a51a5843-03a3-4bab-a389-7171b9cd8d52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120092 May 10 02:16:11.953940 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 714/1486] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:11.969194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7c76436-aa24-4e6a-bc65-1fdd98fcac29 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:11.969916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7c76436-aa24-4e6a-bc65-1fdd98fcac29 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:12.056582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b466ce12-b40a-487a-af03-8a5b42eb26c8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.127064 May 10 02:16:12.058318 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 773/1487] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:11 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:12.125371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7c76436-aa24-4e6a-bc65-1fdd98fcac29 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:12.132655 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7c76436-aa24-4e6a-bc65-1fdd98fcac29 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1269 microversion: 2.1 time: 0.177470 May 10 02:16:12.133237 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 715/1488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:11 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:12.145814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6759bb81-336c-4ffc-b3b8-4345010eeffb tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'action', calling method: .version_select at 0x7f3d45e121f0>, body: {"addFloatingIp": {"address": ""}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6759bb81-336c-4ffc-b3b8-4345010eeffb tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Request method failure captured: May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action HTTP/1.1 May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 34 May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecq3KM3RmQ9sdoYSb45rqyYZKD_LRhkikmcKTNlfiuqEKMG99kYgBw5hWg4pil1xQvahzMCcotJLAIgd26L5fdXSpUKbGGGj3cM5IzvVUJmnjaMrB3Y-PefZEdAw1Ve_E1t0i0h0-SPoEpjc-kw_MNIm9WxtfNcwUhhuful1q3iQXyc May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:12.148437 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8161100b518d4d68bb77b0052a6efc7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 5f339a3525a549f6958b4cc77e40f606 May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: {"addFloatingIp": {"address": ""}} May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:16:12.150037 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '010feee6-4f48-4682-bb79-b95d27eda2e3', 'body': {'addFloatingIp': {'address': ''}}} May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi '' May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:12.151689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:16:12.153963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:16:12.156276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 10 02:16:12.156276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.157323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6759bb81-336c-4ffc-b3b8-4345010eeffb tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:12.158375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6759bb81-336c-4ffc-b3b8-4345010eeffb tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action" status: 400 len: 142 microversion: 2.1 time: 0.020356 May 10 02:16:12.159483 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 716/1489] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:16:12 2022] POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:16:12.164349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:12.166217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:12.173953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.174612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.175672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.176309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.190959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577/os-volume_attachments HTTP/1.1 May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:12.193330 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:12.194667 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '9509d8d2-b9af-4154-a5e7-e0a9815ea577'} May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:12.195516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:16:12.196723 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.199736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:12.200875 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77b4e25c-0a85-48fe-872a-3f1173a33ffb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040261 May 10 02:16:12.215217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 717/1490] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:16:12 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:16:12.222653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:12.228461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:12.235535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.243221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.245940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.247468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.329220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Acquired lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:16:12.457407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b94cfa4-d0fb-4383-9772-c001b27b5987 tempest-TenantUsagesNegativeTestJSON-834986937 tempest-TenantUsagesNegativeTestJSON-834986937-project] Calling method '.version_select at 0x7f3d36fcc4c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:12.459888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3b94cfa4-d0fb-4383-9772-c001b27b5987 tempest-TenantUsagesNegativeTestJSON-834986937 tempest-TenantUsagesNegativeTestJSON-834986937-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '1e044f26d9f742f4af9a3a74f00eb2e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a9d7fc2d0420d878272867eb0d19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b94cfa4-d0fb-4383-9772-c001b27b5987 tempest-TenantUsagesNegativeTestJSON-834986937 tempest-TenantUsagesNegativeTestJSON-834986937-project] Request method failure captured: May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-09T02%3A16%3A03.812906&end=2022-05-11T02%3A16%3A03.812906&detailed=1 HTTP/1.1 May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecrh2xmyI_3wogtbp11s_R7i2roDgvZyolBGumFn0__1Zon7MJxvRMJBLZ1eTCIFE2aVWoueokWAl7jDY9Uv743e31ZIw3wIJfFMhmos1CdeK1uUAB8KCbW1-68N_eE_WbGjzmjE_7jNYXqjXBgN10e8i4ciMSPMx_ZKSTCKQ70bHcg May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 808a9d7fc2d0420d878272867eb0d19e May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-834986937 May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:12.461905 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_808a9d7fc2d0420d878272867eb0d19e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/808a9d7fc2d0420d878272867eb0d19e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/808a9d7fc2d0420d878272867eb0d19e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/808a9d7fc2d0420d878272867eb0d19e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-834986937 May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 808a9d7fc2d0420d878272867eb0d19e May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-834986937 May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TenantUsagesNegativeTestJSON-834986937-project May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1e044f26d9f742f4af9a3a74f00eb2e0 May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-834986937-project May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:16:12.464111 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._index(req) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:16:12.465111 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:16:12.466496 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:16:12.468464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 10 02:16:12.468464 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.468464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b94cfa4-d0fb-4383-9772-c001b27b5987 tempest-TenantUsagesNegativeTestJSON-834986937 tempest-TenantUsagesNegativeTestJSON-834986937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:12.468464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b94cfa4-d0fb-4383-9772-c001b27b5987 tempest-TenantUsagesNegativeTestJSON-834986937 tempest-TenantUsagesNegativeTestJSON-834986937-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-09T02%3A16%3A03.812906&end=2022-05-11T02%3A16%3A03.812906&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.403504 May 10 02:16:12.478946 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 774/1491] 10.222.0.52 () {58 vars in 1334 bytes} [Tue May 10 02:16:12 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-09T02%3A16%3A03.812906&end=2022-05-11T02%3A16%3A03.812906&detailed=1 => generated 123 bytes in 420 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:16:12.494040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Releasing lock "refresh_cache-010feee6-4f48-4682-bb79-b95d27eda2e3" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:16:12.494596 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] HTTP exception thrown: floating IP not found May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Request method failure captured: May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action HTTP/1.1 May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 41 May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecq3KM3RmQ9sdoYSb45rqyYZKD_LRhkikmcKTNlfiuqEKMG99kYgBw5hWg4pil1xQvahzMCcotJLAIgd26L5fdXSpUKbGGGj3cM5IzvVUJmnjaMrB3Y-PefZEdAw1Ve_E1t0i0h0-SPoEpjc-kw_MNIm9WxtfNcwUhhuful1q3iQXyc May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:12.496921 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8161100b518d4d68bb77b0052a6efc7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 5f339a3525a549f6958b4cc77e40f606 May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: {"addFloatingIp": {"address": "0.0.0.0"}} May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:16:12.498270 n-d-841089-2 devstack@n-api.service[118717]: exception: floating IP not found May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '010feee6-4f48-4682-bb79-b95d27eda2e3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2684, in associate_floating_ip May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.499105 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 10 02:16:12.500278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:12.501607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Returning 404 to user: floating IP not found {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:12.501607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8bb0f5cb-7ca4-4e18-90ea-e863cb50cddf tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action" status: 404 len: 67 microversion: 2.1 time: 0.281811 May 10 02:16:12.501607 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 718/1492] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:16:12 2022] POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action => generated 67 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:12.509316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6d06371-c291-460f-82e0-a7c232873b62 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Action: 'action', calling method: .version_select at 0x7f3d45e00550>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:12.551278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-399713040", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:12.561268 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f6d06371-c291-460f-82e0-a7c232873b62 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6d06371-c291-460f-82e0-a7c232873b62 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Request method failure captured: May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action HTTP/1.1 May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 44 May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq3KM3RmQ9sdoYSb45rqyYZKD_LRhkikmcKTNlfiuqEKMG99kYgBw5hWg4pil1xQvahzMCcotJLAIgd26L5fdXSpUKbGGGj3cM5IzvVUJmnjaMrB3Y-PefZEdAw1Ve_E1t0i0h0-SPoEpjc-kw_MNIm9WxtfNcwUhhuful1q3iQXyc May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:12.562848 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8161100b518d4d68bb77b0052a6efc7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5f339a3525a549f6958b4cc77e40f606 May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:16:12.564258 n-d-841089-2 devstack@n-api.service[118716]: exception: Floating IP not found for address 0.0.0.0. May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '010feee6-4f48-4682-bb79-b95d27eda2e3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2912, in get_instance_id_by_floating_address May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:12.565118 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 10 02:16:12.566409 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:12.567690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6d06371-c291-460f-82e0-a7c232873b62 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:12.567690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f6d06371-c291-460f-82e0-a7c232873b62 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action" status: 404 len: 88 microversion: 2.1 time: 0.059283 May 10 02:16:12.567690 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 775/1493] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:16:12 2022] POST /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3/action => generated 88 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:12.576296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:12.591956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:12.615485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.615964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.616772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.630779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.633710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:12.690040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:16:12.837784 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aad38883-1817-478c-9251-c3de215b5b12 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 204 len: 0 microversion: 2.1 time: 0.266176 May 10 02:16:12.839138 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 776/1494] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:16:12 2022] DELETE /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:16:12.845542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:12.846819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:12.854766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.856714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:12.857805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:12.858502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:13.479295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:13.497311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d48d4ff7-8c29-48e8-a061-fe115f66bf91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1379 microversion: 2.1 time: 0.656606 May 10 02:16:13.498142 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 777/1495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:12 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1379 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:13.511302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:13.512139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:13.526229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:13.528885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:13.530233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:13.531095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:13.816731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:13.817172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:13.817598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:13.818236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:13.818840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:13.832430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:13.833240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:13.834263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:13.834918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:13.854797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:13.861883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:13.895804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:13.898102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:13.909593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:13.917759 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee02299f-2297-4044-b6ed-9cc752274fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1542 microversion: 2.1 time: 0.418553 May 10 02:16:13.918351 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 778/1496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:13 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1542 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:13.931362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-109e07b9-bc28-4325-adaa-dfcf3c9c776d tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e86790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:13.991667 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-16d24cac-2870-4774-847a-d751ef354671 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444995 May 10 02:16:14.001464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 719/1497] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:16:14.004509 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-109e07b9-bc28-4325-adaa-dfcf3c9c776d tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.085101 May 10 02:16:14.005484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 779/1498] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:13 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:14.011908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:14.012579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:14.022230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1584777196", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7fe840c0-65b0-4d12-94df-84e1e8a62759"}], "block_device_mapping_v2": [{"uuid": "da498990-3181-4d07-afe1-a3c4d3bda692", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:14.039167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:14.039650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:14.040535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:14.042776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:14.145467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] validate_networks() for [('7fe840c0-65b0-4d12-94df-84e1e8a62759', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:14.619217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:14.648498 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8efbb93-d4ad-4dfa-ad1c-4cde2551562d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1327 microversion: 2.1 time: 0.644192 May 10 02:16:14.665294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 720/1499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:14 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1327 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:14.688037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:14.697259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:14.770391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:14.770870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:14.771707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:14.782012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.079253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:15.087876 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59dc728b-6477-4e50-bf41-97683aeada1c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1218 microversion: 2.1 time: 0.409677 May 10 02:16:15.088512 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 721/1500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:14 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1218 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:15.107179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:15.108191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:15.126904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:15.127408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.128221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:15.128669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.621815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:15.640775 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e1b119c2-6863-4d65-9074-446959226e48 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1529 microversion: 2.1 time: 0.537522 May 10 02:16:15.668500 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 722/1501] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:15 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1529 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:15.681004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:15.682496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:15.704216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:15.704693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.705508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:15.705962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.813196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:15.813672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:15.814331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:15.814748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:15.815407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:15.846400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:15.846871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.847735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:15.848184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:15.924973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:15.948751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Getting quotas for user b31e1f4aa1eb4cceb37e10f1b8f7b3f2 and project 4769c530b40f4f60a8f28b291bcc5c31. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:16.304722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f339a3525a549f6958b4cc77e40f606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8161100b518d4d68bb77b0052a6efc7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:16.320512 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62e7c093-a339-48de-b282-f8ff4274fc60 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 200 len: 1542 microversion: 2.1 time: 0.650475 May 10 02:16:16.326453 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 723/1502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:15 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 1542 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:16.342862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36dd34bb-c2e8-4c10-b6a5-2e375ac579ca tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e8cf70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:16.446681 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36dd34bb-c2e8-4c10-b6a5-2e375ac579ca tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.119069 May 10 02:16:16.447504 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 724/1503] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:16 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:16.460500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:16.465201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:16.489136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:16.504005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:16.505152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:16.507092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:16.625890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:16:16.753244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:16.755750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da498990-3181-4d07-afe1-a3c4d3bda692',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:16.873915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fcb23ce3-15b0-4bcc-a611-8b7b49bed200 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 204 len: 0 microversion: 2.1 time: 0.425241 May 10 02:16:16.881348 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 725/1504] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:16:16 2022] DELETE /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:16:16.890048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:16.891468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:16.914170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:16.916550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:16.919490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:16.920604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:17.094886 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7b21ca8-a4d9-4764-a5e2-924b562030b0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.088184 May 10 02:16:17.096847 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 780/1505] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:16:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:16:17.107625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:17.108591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:17.117976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:17.118722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:17.119841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:17.120451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:17.892144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:17.899403 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae720da6-bf72-4ffc-8492-378298c0c368 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 0.797466 May 10 02:16:17.912860 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 781/1506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:17 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:17.918107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-026f989e-1506-4d42-9604-b09dd002f90e req-9106f323-b71a-441a-802a-c0d20188c969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010feee6-4f48-4682-bb79-b95d27eda2e3", "name": "network-vif-deleted", "tag": "3caa9309-fd85-4fe2-b113-092d695f252c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:17.939382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-026f989e-1506-4d42-9604-b09dd002f90e req-9106f323-b71a-441a-802a-c0d20188c969 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:17.940041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-026f989e-1506-4d42-9604-b09dd002f90e req-9106f323-b71a-441a-802a-c0d20188c969 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:17.941319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:17.954116 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c56b7b8-35c8-41e4-a306-a4a949974956 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1529 microversion: 2.1 time: 1.074246 May 10 02:16:17.954723 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 726/1507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:16 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1529 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:17.966752 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-026f989e-1506-4d42-9604-b09dd002f90e req-9106f323-b71a-441a-802a-c0d20188c969 service nova] Creating event network-vif-deleted:3caa9309-fd85-4fe2-b113-092d695f252c for instance 010feee6-4f48-4682-bb79-b95d27eda2e3 on n-h1-841089-2 May 10 02:16:17.969831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:17.970555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:17.985835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:17.986489 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-026f989e-1506-4d42-9604-b09dd002f90e req-9106f323-b71a-441a-802a-c0d20188c969 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071692 May 10 02:16:17.987624 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 782/1508] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:17.988124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:17.991270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:17.991761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:17.995180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39b261e7-dcaf-4ab2-912e-6163cf90d3ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.004086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39b261e7-dcaf-4ab2-912e-6163cf90d3ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:18.208270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39b261e7-dcaf-4ab2-912e-6163cf90d3ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:18.219627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39b261e7-dcaf-4ab2-912e-6163cf90d3ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:18.221583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39b261e7-dcaf-4ab2-912e-6163cf90d3ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:18.226520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39b261e7-dcaf-4ab2-912e-6163cf90d3ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1104 microversion: 2.25 time: 0.237149 May 10 02:16:18.228389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 783/1509] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:17 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1104 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:18.238235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.241137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] [instance: 010feee6-4f48-4682-bb79-b95d27eda2e3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:18.248560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:18.257198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.260199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.264894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.268962 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe7f4766-e59d-48b8-8a5a-9582950ff410 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1272 microversion: 2.1 time: 0.311650 May 10 02:16:18.271570 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 727/1510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:17 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:18.283119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a1bc62d-6574-4ed1-88f8-d0c73271c846 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36feb160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.283322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.298341 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] HTTP exception thrown: Instance 010feee6-4f48-4682-bb79-b95d27eda2e3 could not be found. May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Request method failure captured: May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 HTTP/1.1 May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq3KM3RmQ9sdoYSb45rqyYZKD_LRhkikmcKTNlfiuqEKMG99kYgBw5hWg4pil1xQvahzMCcotJLAIgd26L5fdXSpUKbGGGj3cM5IzvVUJmnjaMrB3Y-PefZEdAw1Ve_E1t0i0h0-SPoEpjc-kw_MNIm9WxtfNcwUhhuful1q3iQXyc May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:18.337301 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8161100b518d4d68bb77b0052a6efc7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8161100b518d4d68bb77b0052a6efc7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 8161100b518d4d68bb77b0052a6efc7f May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5f339a3525a549f6958b4cc77e40f606 May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 010feee6-4f48-4682-bb79-b95d27eda2e3 could not be found. May 10 02:16:18.339447 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '010feee6-4f48-4682-bb79-b95d27eda2e3'} May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010feee6-4f48-4682-bb79-b95d27eda2e3 could not be found. May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:18.340185 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010feee6-4f48-4682-bb79-b95d27eda2e3 could not be found. May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010feee6-4f48-4682-bb79-b95d27eda2e3 could not be found. May 10 02:16:18.341383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:18.342458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] Returning 404 to user: Instance 010feee6-4f48-4682-bb79-b95d27eda2e3 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:18.342458 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1129c89-1961-4f32-b600-495c73838746 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650 tempest-FloatingIPsAssociationNegativeTestJSON-1992239650-project] 10.222.0.52 "GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3" status: 404 len: 111 microversion: 2.1 time: 0.109770 May 10 02:16:18.342458 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 784/1511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:18 2022] GET /compute/v2.1/servers/010feee6-4f48-4682-bb79-b95d27eda2e3 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:16:18.358773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a5bd70d-90a7-4194-9d75-b34bb28ed7a0 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.359584 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:16:18.359584 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:16:18.418960 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a5bd70d-90a7-4194-9d75-b34bb28ed7a0 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/ffa1d6cb-083b-428b-bf50-5ac0969365a9" status: 202 len: 0 microversion: 2.1 time: 0.077948 May 10 02:16:18.419588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 785/1512] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:16:18 2022] DELETE /compute/v2.1/flavors/ffa1d6cb-083b-428b-bf50-5ac0969365a9 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:16:18.436004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2f3f27b-6bff-42da-a9a1-a0d597552da5 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.479853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2f3f27b-6bff-42da-a9a1-a0d597552da5 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047514 May 10 02:16:18.495368 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 786/1513] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:16:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:18.510907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:18.512246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:18.523056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.524666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.528540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.530004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.597363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:18.613438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Old instance type tempest-test_resize_flavor_-89436569, new instance type m1.heat {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 02:16:18.631627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:18.632600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:18.633241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:18.633829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:18.634400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:18.756079 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a1bc62d-6574-4ed1-88f8-d0c73271c846 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.483156 May 10 02:16:18.757208 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 728/1514] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:18 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:18.809921 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4db0d8bc-3981-4f41-a44d-4380e40f7e4c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d/action" status: 202 len: 0 microversion: 2.1 time: 0.304007 May 10 02:16:18.814400 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 787/1515] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:16:18 2022] POST /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:16:18.821943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.823487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:18.833673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.837705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.838655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.839330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.917664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:18.918352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:18.925949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.930635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:18.932747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:18.934572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:19.426450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:19.435243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-207b2c1d-1484-4ace-bc40-321dc7188f0c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1538 microversion: 2.1 time: 0.617733 May 10 02:16:19.435836 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 729/1516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:18 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1538 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:19.459887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:19.460427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:19.482262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:19.482723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:19.483550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:19.498972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:19.802479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:19.820757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:19.824911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:19.826471 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67fc725e-1317-40ba-8de8-edfe2c4b02c3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1251 microversion: 2.25 time: 0.389717 May 10 02:16:19.828092 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 730/1517] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:19 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1251 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:19.843824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:19.858024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:19.879115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:19.891965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:19.893349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:19.895061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:20.024716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:20.041480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-494edbf1-d0b6-4d51-8003-46ce54721c5e tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 1.125492 May 10 02:16:20.052301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 788/1518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:18 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:20.056858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0913d8a5-8d7a-413f-8f3c-7ed1d8dc8397 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f5ed30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:20.154622 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0913d8a5-8d7a-413f-8f3c-7ed1d8dc8397 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.109118 May 10 02:16:20.155225 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 789/1519] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:20 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:20.453224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:20.454087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:20.469882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:20.470610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:20.475786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:20.476629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:21.357335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:21.391582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1aa192c9-ce07-4f0d-babd-57e53d9fb29a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1538 microversion: 2.1 time: 0.931973 May 10 02:16:21.395783 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 790/1520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:20 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1538 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:21.416828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:21.420212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:21.439175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:21.439538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:21.440381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:21.447085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:21.585315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:21.599445 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5caad50f-7708-4d0f-9eb6-b599a13776a2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 1.766787 May 10 02:16:21.600706 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 731/1521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:19 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:21.620047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:21.621104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:21.630890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:21.644711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:21.645831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:21.646514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:21.831213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:21.843788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:21.850389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:21.855445 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e58ac956-370e-43fc-902c-0995db00c396 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1251 microversion: 2.25 time: 0.456128 May 10 02:16:21.857166 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 791/1522] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:21 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1251 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:21.871210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e455069e-1003-47c3-ab86-832eb9d8fa41 req-1da6c6b7-d528-49af-8e71-e86e6396bb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb155e6-b56b-4450-ac97-fe59725d517d", "tag": "e61d2354-d8b5-4efa-9cab-546d491231ab"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:21.896621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e455069e-1003-47c3-ab86-832eb9d8fa41 req-1da6c6b7-d528-49af-8e71-e86e6396bb39 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:21.897092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e455069e-1003-47c3-ab86-832eb9d8fa41 req-1da6c6b7-d528-49af-8e71-e86e6396bb39 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:21.938729 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e455069e-1003-47c3-ab86-832eb9d8fa41 req-1da6c6b7-d528-49af-8e71-e86e6396bb39 service nova] Creating event network-changed:e61d2354-d8b5-4efa-9cab-546d491231ab for instance 1bb155e6-b56b-4450-ac97-fe59725d517d on n-h2-841089-2 May 10 02:16:21.964661 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e455069e-1003-47c3-ab86-832eb9d8fa41 req-1da6c6b7-d528-49af-8e71-e86e6396bb39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103841 May 10 02:16:21.973948 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 792/1523] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:21.990833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4506c683-1ec5-45aa-8c51-c55001e46b2f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f764c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:22.094320 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4506c683-1ec5-45aa-8c51-c55001e46b2f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.118735 May 10 02:16:22.099838 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 793/1524] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:21 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:22.414581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:22.415430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:22.437977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:22.440681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:22.441035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:22.441510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:22.795585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:22.804676 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf2b22f0-3c9c-4e90-aa15-3bb1eb0b1977 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 1.202670 May 10 02:16:22.805260 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 732/1525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:21 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:22.830723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:22.831374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:22.863834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:22.864744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:22.870170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:22.870928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:24.209960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:24.224017 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4f4f6430-d412-4c49-b410-a9be6498435e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1538 microversion: 2.1 time: 1.814770 May 10 02:16:24.225191 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 794/1526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:22 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1538 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:24.230585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:24.244107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:24.250559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:24.251320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:24.252306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:24.252924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:24.423146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:24.433397 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c667f665-5c44-4bd5-b008-b16f980b3303 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 1.612695 May 10 02:16:24.435361 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 733/1527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:22 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:24.449319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8af7b36-634e-48e2-8f04-00868eb4b4df tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e43280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:24.543569 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8af7b36-634e-48e2-8f04-00868eb4b4df tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.104384 May 10 02:16:24.544529 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 734/1528] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:24 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:24.552321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:24.553348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:24.563428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:24.564337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:24.566016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:24.566688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:24.946184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:24.958486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:24.960490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:24.961879 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b53939d-dcfa-4442-9249-cccef82e9fbc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 0.735574 May 10 02:16:24.963514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 795/1529] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:24 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:24.968276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-10d782ee-585a-4c08-8c4d-183f422e2dc4 req-aaa33fa4-afca-416e-a6c2-da61e3b55f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb", "tag": "07187cc8-5452-48ca-b1cc-2e6dce8dba45"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:24.979329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-10d782ee-585a-4c08-8c4d-183f422e2dc4 req-aaa33fa4-afca-416e-a6c2-da61e3b55f6f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:24.979958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-10d782ee-585a-4c08-8c4d-183f422e2dc4 req-aaa33fa4-afca-416e-a6c2-da61e3b55f6f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:24.994947 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-10d782ee-585a-4c08-8c4d-183f422e2dc4 req-aaa33fa4-afca-416e-a6c2-da61e3b55f6f service nova] Creating event network-changed:07187cc8-5452-48ca-b1cc-2e6dce8dba45 for instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb on n-h2-841089-2 May 10 02:16:25.001733 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-10d782ee-585a-4c08-8c4d-183f422e2dc4 req-aaa33fa4-afca-416e-a6c2-da61e3b55f6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036859 May 10 02:16:25.002908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 796/1530] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:25.163340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:25.181491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8898bdf-f1b5-4f00-bf55-ee5627f0d557 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 0.634650 May 10 02:16:25.192792 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 735/1531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:24 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:25.247295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:25.249832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:25.268517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:25.272418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:25.274664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:25.277452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:25.453856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:25.455327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:25.467208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:25.469667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:25.472394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:25.476499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:26.568855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:26.579277 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07bf0f7c-58c2-4f0e-ae57-cc136ba453f3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1538 microversion: 2.1 time: 1.340905 May 10 02:16:26.583024 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 797/1532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:25 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1538 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:26.595807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00f4a0d4-8b34-4ff3-b349-395cba17ae45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdcee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:26.696457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00f4a0d4-8b34-4ff3-b349-395cba17ae45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1453 microversion: 2.1 time: 0.111455 May 10 02:16:26.697597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 798/1533] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:26 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:26.702507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:26.711983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:26.729802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:26.730753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:26.731824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:26.732505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:26.757154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:26.769676 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b6f4cf6-c2fc-4dd4-b166-6927d1527383 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 1.322841 May 10 02:16:26.770387 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 736/1534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:25 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:26.795948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:26.796804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:26.829023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:26.836883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:26.837909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:26.839918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:27.407992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:27.416962 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b5ade84a-b0e4-4729-add4-2951201f4d41 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 0.645401 May 10 02:16:27.425422 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 737/1535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:26 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:27.438867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bb122819-b234-4eae-a2fe-116a792172eb req-33c01751-55e0-4639-96dc-e2b15d6b04f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79ad69c-a8de-4eba-ae8a-15cabb868a48", "tag": "47f1f980-2bd4-4fa7-875b-5b3c3da7445f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:27.461782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bb122819-b234-4eae-a2fe-116a792172eb req-33c01751-55e0-4639-96dc-e2b15d6b04f2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:27.470562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bb122819-b234-4eae-a2fe-116a792172eb req-33c01751-55e0-4639-96dc-e2b15d6b04f2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:27.500855 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bb122819-b234-4eae-a2fe-116a792172eb req-33c01751-55e0-4639-96dc-e2b15d6b04f2 service nova] Creating event network-changed:47f1f980-2bd4-4fa7-875b-5b3c3da7445f for instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 on n-h1-841089-2 May 10 02:16:27.510646 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bb122819-b234-4eae-a2fe-116a792172eb req-33c01751-55e0-4639-96dc-e2b15d6b04f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083742 May 10 02:16:27.516517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 738/1536] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:27.600388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:27.601711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:27.622460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:27.622876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:27.625126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:27.627726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:27.842710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:27.853148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:27.855886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:27.857591 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-234f220a-4b5c-4248-a5b6-a3f4764df703 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 1.158843 May 10 02:16:27.858812 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 799/1537] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:26 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:27.864234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-851c1d4c-c0e1-490e-8c91-b9199e71ce1b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f94940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:27.938423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-851c1d4c-c0e1-490e-8c91-b9199e71ce1b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1462 microversion: 2.1 time: 0.078313 May 10 02:16:27.946463 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 800/1538] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:27 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:27.972392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:27.973027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:28.004623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.005086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.005896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.010637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.238257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:28.250703 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-016098c4-d4cf-4b0c-a1b6-c64f14442def tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 0.655409 May 10 02:16:28.266666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 739/1539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:27 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:28.272225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c4986e5-0fe7-4620-9cdb-c428f2059b19 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37014550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:28.340772 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c4986e5-0fe7-4620-9cdb-c428f2059b19 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 200 len: 1462 microversion: 2.1 time: 0.072441 May 10 02:16:28.342229 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 740/1540] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:28 2022] GET /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 1462 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:28.364844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:28.370616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:28.385019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.385484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.386283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.387471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.474430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:28.484005 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ca8f70fc-0cc2-4e2e-94c5-d889bbab80a1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 0.536206 May 10 02:16:28.494278 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 801/1541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:27 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:28.511355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:28.515307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:28.531712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.532173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.532971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.536844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.817095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:28.833534 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50646dbb-c46c-4e3a-8ca5-c12ee74851d5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1466 microversion: 2.1 time: 0.482511 May 10 02:16:28.834060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 741/1542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:28 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1466 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:28.851308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2075583100"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:28.858665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:28.873886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.879660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:28.881327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:28.881983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:29.094896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:29.103877 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d675d36-1376-44ab-8e6b-cb094c1bd71d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 0.607627 May 10 02:16:29.110379 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 802/1543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:28 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:29.127536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:29.128505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:29.148409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:29.148890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:29.149702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:29.150193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:29.480385 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f559b2af-bd1e-4a36-be72-731f67fe3b00 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "POST /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94/action" status: 202 len: 0 microversion: 2.1 time: 0.628578 May 10 02:16:29.483842 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 742/1544] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:16:28 2022] POST /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:16:29.488375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:29.512471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:29.519214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:29.521668 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ecda8ec-d982-4f51-a41c-35a5293a6b1e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 0.410202 May 10 02:16:29.522431 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 803/1545] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:29 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:29.528798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-331251638", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2f8708f8-b1bb-4099-8385-4858a3f8bcfb"}], "block_device_mapping_v2": [{"uuid": "269838ad-42c6-4415-b468-5e9efb1796b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:29.619858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] validate_networks() for [('2f8708f8-b1bb-4099-8385-4858a3f8bcfb', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:29.746215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1492484793", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "3f418dff-a81a-484f-9b38-0bc8e51ba8e1"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:29.829475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] validate_networks() for [('3f418dff-a81a-484f-9b38-0bc8e51ba8e1', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:30.825864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:30.826865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:30.828362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:30.828976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:30.829610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:30.848394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:30.850088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:30.853787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:30.854456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:30.892699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:30.909997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Getting quotas for user f3afba6df0eb454cbfa342f196e6727f and project 1d388f0dca2c4a5a933599c498cf3ae1. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:31.068382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:31.070810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='269838ad-42c6-4415-b468-5e9efb1796b3',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:31.132289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:31.132781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:31.133664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:31.134095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:31.134564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:31.155818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.157350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.160555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.161088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.212223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Getting quotas for project 22c3161fa839460a96a5566df55f20d8. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:31.218723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Getting quotas for user 6a29970c06014c5b8d9e69b46e5fb958 and project 22c3161fa839460a96a5566df55f20d8. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:31.234044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:31.237080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:31.298783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d256e26d-cf8e-41e8-bc74-cdaaf9fe2946 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813533 May 10 02:16:31.299484 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 743/1546] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:31.310948 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-077a173a-9138-4d98-9eef-be21f8c60eda tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787016 May 10 02:16:31.320292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:31.320292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:31.324516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.325361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.326460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.327159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.340724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 804/1547] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:31.354966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d79b9bc-7dae-4e30-bc75-e899ef8bed3d tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f76b80>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:31.435697 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d79b9bc-7dae-4e30-bc75-e899ef8bed3d tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.079511 May 10 02:16:31.436271 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 805/1548] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:31 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:31.459796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:31.460435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:31.476116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.476583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.477368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.477813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.580399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:31.592844 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82864671-7cd4-4a15-99e6-20003e9cf8b6 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 0.290793 May 10 02:16:31.593446 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 744/1549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:31 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:31.614937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:31.616079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:31.633714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.635325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.638721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.640594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.811736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:31.820839 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-320acbf8-7a08-4e43-9eef-6b88a01038e1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 0.368238 May 10 02:16:31.839960 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 806/1550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:31 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:31.906493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:31.920099 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c99e9a4-8f08-41e7-9a77-1050e2007565 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 0.319128 May 10 02:16:31.920346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 745/1551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:31 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:31.933518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2925050b-e3ae-4c24-82cd-30fc09120959 req-1f4aeee3-5902-4138-b5c7-4d148fcec9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb155e6-b56b-4450-ac97-fe59725d517d", "name": "network-vif-plugged", "status": "completed", "tag": "e61d2354-d8b5-4efa-9cab-546d491231ab"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:31.969937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2925050b-e3ae-4c24-82cd-30fc09120959 req-1f4aeee3-5902-4138-b5c7-4d148fcec9cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:31.972589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2925050b-e3ae-4c24-82cd-30fc09120959 req-1f4aeee3-5902-4138-b5c7-4d148fcec9cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:31.986473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2925050b-e3ae-4c24-82cd-30fc09120959 req-1f4aeee3-5902-4138-b5c7-4d148fcec9cf service nova] Creating event network-vif-plugged:e61d2354-d8b5-4efa-9cab-546d491231ab for instance 1bb155e6-b56b-4450-ac97-fe59725d517d on n-h2-841089-2 May 10 02:16:31.996059 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2925050b-e3ae-4c24-82cd-30fc09120959 req-1f4aeee3-5902-4138-b5c7-4d148fcec9cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074338 May 10 02:16:32.001245 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 746/1552] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:32.007286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.008196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:32.016910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.017601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.018582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.019493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.198702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.199823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:32.207220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.207748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.208696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.209144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.288689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:32.312234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da253a49-8bb2-47a1-8214-873db6336bca tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1222 microversion: 2.1 time: 0.309447 May 10 02:16:32.313575 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 747/1553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:32 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:32.331885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.332516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:32.348091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.348556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.349357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.349802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.440295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:32.448130 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c4ef213-6da1-4df2-a929-18aaff8c27ff tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1094 microversion: 2.1 time: 0.133409 May 10 02:16:32.458518 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 748/1554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:32 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:32.464969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3abaf9ed-bfda-42a1-a350-3a7657a701a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fa3310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.508720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:32.518351 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3abaf9ed-bfda-42a1-a350-3a7657a701a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.066046 May 10 02:16:32.519223 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 749/1555] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:32 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:32.519724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:32.521257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:32.522382 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-92a79081-5347-47d0-be4d-5e06c220a1c6 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 0.680530 May 10 02:16:32.522933 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 807/1556] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:31 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:32.611212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.611931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:32.620187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.621975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.623936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.625133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.839024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.839773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:32.855551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.856159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.861412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:32.862105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.862641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.895647 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44092480-932c-46ab-b70e-54390a0b8a02 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 0.286845 May 10 02:16:32.908376 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 750/1557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:32 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:32.936606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:32.939378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:32.953115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.953835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:32.954796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:32.955425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.116248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.124813 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2edd9488-9e4e-44f4-8229-3609230302b8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 0.290726 May 10 02:16:33.126005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 808/1558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:32 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:33.193739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.203674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e05f9f96-7826-4fce-899d-7f1867366431 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1395 microversion: 2.1 time: 0.271234 May 10 02:16:33.204248 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 751/1559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:32 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1395 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:33.254929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4aca9083-66f9-4539-a8b7-0148611bef37 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Calling method '.version_select at 0x7f3d36fdb700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.275175 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4aca9083-66f9-4539-a8b7-0148611bef37 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] HTTP exception thrown: Image not found. May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4aca9083-66f9-4539-a8b7-0148611bef37 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Request method failure captured: May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/1c1c6e0d-fde2-4831-888a-4ae202bfbb67/metadata/os_distro HTTP/1.1 May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecsAztkgHfWAVTK_lRzNZE1xXdoal2D-8JaoUdRT4IAGhxCcP4PyXjqpNh_9q1hAU835Zv2sGbuHMA3DACsWD6D4t8IIyB9LJUOarsgUdkqiOtYWFernIEy-eoxVcWEUGULQldOqnspa_c0XiUJCPc83GdPNe2E-PJElmtHQr-sH5f4 May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:33.277815 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f3ef08270e940d7baa6ba2cdb04a26c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 33b513489a094743ae2d8fbe2af14983 May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'image_id': '1c1c6e0d-fde2-4831-888a-4ae202bfbb67', 'id': 'os_distro'} May 10 02:16:33.279627 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.280895 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1c1c6e0d-fde2-4831-888a-4ae202bfbb67 May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.282305 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1c1c6e0d-fde2-4831-888a-4ae202bfbb67 could not be found. May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:33.283940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.285435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4aca9083-66f9-4539-a8b7-0148611bef37 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:33.286841 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4aca9083-66f9-4539-a8b7-0148611bef37 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] 10.222.0.52 "DELETE /compute/v2.1/images/1c1c6e0d-fde2-4831-888a-4ae202bfbb67/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.152018 May 10 02:16:33.286841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 809/1560] 10.222.0.52 () {58 vars in 1292 bytes} [Tue May 10 02:16:33 2022] DELETE /compute/v2.1/images/1c1c6e0d-fde2-4831-888a-4ae202bfbb67/metadata/os_distro => generated 62 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:33.290754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cee03d10-db0b-4782-a945-b751a442a2c4 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Calling method '.version_select at 0x7f3d36e89f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.310767 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-cee03d10-db0b-4782-a945-b751a442a2c4 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] HTTP exception thrown: Image not found. May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cee03d10-db0b-4782-a945-b751a442a2c4 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Request method failure captured: May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/images/e1d9e83b-ce11-49a1-b63c-5705338d5ea0/metadata/os_version HTTP/1.1 May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecsAztkgHfWAVTK_lRzNZE1xXdoal2D-8JaoUdRT4IAGhxCcP4PyXjqpNh_9q1hAU835Zv2sGbuHMA3DACsWD6D4t8IIyB9LJUOarsgUdkqiOtYWFernIEy-eoxVcWEUGULQldOqnspa_c0XiUJCPc83GdPNe2E-PJElmtHQr-sH5f4 May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:33.313283 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f3ef08270e940d7baa6ba2cdb04a26c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 33b513489a094743ae2d8fbe2af14983 May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'image_id': 'e1d9e83b-ce11-49a1-b63c-5705338d5ea0', 'id': 'os_version'} May 10 02:16:33.314917 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.315963 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1d9e83b-ce11-49a1-b63c-5705338d5ea0 May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.317295 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1d9e83b-ce11-49a1-b63c-5705338d5ea0 could not be found. May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:33.319079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.320522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cee03d10-db0b-4782-a945-b751a442a2c4 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:33.322572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cee03d10-db0b-4782-a945-b751a442a2c4 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] 10.222.0.52 "GET /compute/v2.1/images/e1d9e83b-ce11-49a1-b63c-5705338d5ea0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.030099 May 10 02:16:33.323107 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 752/1561] 10.222.0.52 () {58 vars in 1292 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/images/e1d9e83b-ce11-49a1-b63c-5705338d5ea0/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:33.328800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47898a80-1d2c-4dba-9027-7c6ebd731260 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Calling method '.version_select at 0x7f3d36fdc3a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.329185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.329811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:33.339349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.339814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.340601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.341053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.348859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-47898a80-1d2c-4dba-9027-7c6ebd731260 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] HTTP exception thrown: Image not found. May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47898a80-1d2c-4dba-9027-7c6ebd731260 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Request method failure captured: May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/images/3c768ca1-f3a6-4be1-81be-c795b4de8554/metadata HTTP/1.1 May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecsAztkgHfWAVTK_lRzNZE1xXdoal2D-8JaoUdRT4IAGhxCcP4PyXjqpNh_9q1hAU835Zv2sGbuHMA3DACsWD6D4t8IIyB9LJUOarsgUdkqiOtYWFernIEy-eoxVcWEUGULQldOqnspa_c0XiUJCPc83GdPNe2E-PJElmtHQr-sH5f4 May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:33.350888 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f3ef08270e940d7baa6ba2cdb04a26c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 33b513489a094743ae2d8fbe2af14983 May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'image_id': '3c768ca1-f3a6-4be1-81be-c795b4de8554'} May 10 02:16:33.352260 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.359153 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3c768ca1-f3a6-4be1-81be-c795b4de8554 May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.361326 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c768ca1-f3a6-4be1-81be-c795b4de8554 could not be found. May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:33.365943 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.368486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47898a80-1d2c-4dba-9027-7c6ebd731260 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:33.371749 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-47898a80-1d2c-4dba-9027-7c6ebd731260 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] 10.222.0.52 "GET /compute/v2.1/images/3c768ca1-f3a6-4be1-81be-c795b4de8554/metadata" status: 404 len: 62 microversion: 2.1 time: 0.027613 May 10 02:16:33.371749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 810/1562] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/images/3c768ca1-f3a6-4be1-81be-c795b4de8554/metadata => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:33.371749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0df4941f-5acd-4289-8900-34981b1086eb tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Action: 'update_all', calling method: .version_select at 0x7f3d36fdbe50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:33.386562 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0df4941f-5acd-4289-8900-34981b1086eb tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] HTTP exception thrown: Image not found. May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0df4941f-5acd-4289-8900-34981b1086eb tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Request method failure captured: May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/images/a9c02995-4335-4593-8d18-f52b2a6d3e68/metadata HTTP/1.1 May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 57 May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecsAztkgHfWAVTK_lRzNZE1xXdoal2D-8JaoUdRT4IAGhxCcP4PyXjqpNh_9q1hAU835Zv2sGbuHMA3DACsWD6D4t8IIyB9LJUOarsgUdkqiOtYWFernIEy-eoxVcWEUGULQldOqnspa_c0XiUJCPc83GdPNe2E-PJElmtHQr-sH5f4 May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:33.388827 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f3ef08270e940d7baa6ba2cdb04a26c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 33b513489a094743ae2d8fbe2af14983 May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:16:33.390487 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'image_id': 'a9c02995-4335-4593-8d18-f52b2a6d3e68', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.391613 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9c02995-4335-4593-8d18-f52b2a6d3e68 May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.392928 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9c02995-4335-4593-8d18-f52b2a6d3e68 could not be found. May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:33.394114 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:16:33.395520 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.398002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0df4941f-5acd-4289-8900-34981b1086eb tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:33.398002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0df4941f-5acd-4289-8900-34981b1086eb tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] 10.222.0.52 "PUT /compute/v2.1/images/a9c02995-4335-4593-8d18-f52b2a6d3e68/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032500 May 10 02:16:33.398361 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 811/1563] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:16:33 2022] PUT /compute/v2.1/images/a9c02995-4335-4593-8d18-f52b2a6d3e68/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:33.403385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f79cf549-06e3-4e24-8d17-cc7d6bb2fc58 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Action: 'update', calling method: .version_select at 0x7f3d36fdc8b0>, body: {"meta": {"os_distro": "alt"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:33.413200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.421846 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7a5a9ec-49e9-445f-83b6-7c545633a4f8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1270 microversion: 2.1 time: 0.096228 May 10 02:16:33.422513 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 753/1564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:33.425060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f79cf549-06e3-4e24-8d17-cc7d6bb2fc58 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] HTTP exception thrown: Image not found. May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f79cf549-06e3-4e24-8d17-cc7d6bb2fc58 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Request method failure captured: May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/images/ef0ac23d-9b16-48f6-9e9b-4f9f61570f34/metadata/os_distro HTTP/1.1 May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 30 May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecsAztkgHfWAVTK_lRzNZE1xXdoal2D-8JaoUdRT4IAGhxCcP4PyXjqpNh_9q1hAU835Zv2sGbuHMA3DACsWD6D4t8IIyB9LJUOarsgUdkqiOtYWFernIEy-eoxVcWEUGULQldOqnspa_c0XiUJCPc83GdPNe2E-PJElmtHQr-sH5f4 May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:33.427294 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f3ef08270e940d7baa6ba2cdb04a26c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 33b513489a094743ae2d8fbe2af14983 May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: {"meta": {"os_distro": "alt"}} May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:16:33.428968 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'image_id': 'ef0ac23d-9b16-48f6-9e9b-4f9f61570f34', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.430044 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ef0ac23d-9b16-48f6-9e9b-4f9f61570f34 May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.431967 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef0ac23d-9b16-48f6-9e9b-4f9f61570f34 could not be found. May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:33.433480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:16:33.434906 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:33.436763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f79cf549-06e3-4e24-8d17-cc7d6bb2fc58 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:33.436763 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f79cf549-06e3-4e24-8d17-cc7d6bb2fc58 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] 10.222.0.52 "PUT /compute/v2.1/images/ef0ac23d-9b16-48f6-9e9b-4f9f61570f34/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.035067 May 10 02:16:33.436763 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 812/1565] 10.222.0.52 () {60 vars in 1309 bytes} [Tue May 10 02:16:33 2022] PUT /compute/v2.1/images/ef0ac23d-9b16-48f6-9e9b-4f9f61570f34/metadata/os_distro => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:33.445209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef5db417-6b45-425b-a741-31c890e67f02 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Action: 'create', calling method: .version_select at 0x7f3d36fa3a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:33.466161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.466664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:33.467601 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ef5db417-6b45-425b-a741-31c890e67f02 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] HTTP exception thrown: Image not found. May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef5db417-6b45-425b-a741-31c890e67f02 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Request method failure captured: May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/images/23ffb2e5-9094-46fc-99f9-56e3af818a33/metadata HTTP/1.1 May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 57 May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecsAztkgHfWAVTK_lRzNZE1xXdoal2D-8JaoUdRT4IAGhxCcP4PyXjqpNh_9q1hAU835Zv2sGbuHMA3DACsWD6D4t8IIyB9LJUOarsgUdkqiOtYWFernIEy-eoxVcWEUGULQldOqnspa_c0XiUJCPc83GdPNe2E-PJElmtHQr-sH5f4 May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:33.470936 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f3ef08270e940d7baa6ba2cdb04a26c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f3ef08270e940d7baa6ba2cdb04a26c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7f3ef08270e940d7baa6ba2cdb04a26c May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441 May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 33b513489a094743ae2d8fbe2af14983 May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2053297441-project May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:16:33.472369 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'image_id': '23ffb2e5-9094-46fc-99f9-56e3af818a33', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.473275 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23ffb2e5-9094-46fc-99f9-56e3af818a33 May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:16:33.474371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23ffb2e5-9094-46fc-99f9-56e3af818a33 could not be found. May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:33.475577 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:16:33.476761 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:33.478587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.478932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.481493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.481671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef5db417-6b45-425b-a741-31c890e67f02 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:33.481671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef5db417-6b45-425b-a741-31c890e67f02 tempest-ImagesMetadataNegativeTestJSON-2053297441 tempest-ImagesMetadataNegativeTestJSON-2053297441-project] 10.222.0.52 "POST /compute/v2.1/images/23ffb2e5-9094-46fc-99f9-56e3af818a33/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039640 May 10 02:16:33.481671 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 754/1566] 10.222.0.52 () {60 vars in 1280 bytes} [Tue May 10 02:16:33 2022] POST /compute/v2.1/images/23ffb2e5-9094-46fc-99f9-56e3af818a33/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 02:16:33.487103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.532488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bedffd6d-cf8c-462d-b973-24dce5f4f541 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36d9aa60>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.573983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.581547 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bedffd6d-cf8c-462d-b973-24dce5f4f541 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.053113 May 10 02:16:33.582410 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 755/1567] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:33.583168 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c90beeca-3cef-45b6-b8a5-e491f0ccf4d2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1150 microversion: 2.1 time: 0.120817 May 10 02:16:33.584375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 813/1568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1150 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:33.587940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.588566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:33.594752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.595259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.596052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.596504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.746100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.754090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.755913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:33.757024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96caffeb-e685-4d69-985b-1d73c1c42dbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 0.173696 May 10 02:16:33.757829 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 756/1569] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:33.914046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:33.914728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:33.928011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.934288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:33.935308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:33.935774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.022559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3ce395df-c46f-4d1a-b592-dfe77cdb091e req-751a7457-a6eb-490a-847e-318ee458d4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}, {"server_uuid": "b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb", "name": "network-vif-plugged", "status": "completed", "tag": "07187cc8-5452-48ca-b1cc-2e6dce8dba45"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:34.037551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3ce395df-c46f-4d1a-b592-dfe77cdb091e req-751a7457-a6eb-490a-847e-318ee458d4bb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.042720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3ce395df-c46f-4d1a-b592-dfe77cdb091e req-751a7457-a6eb-490a-847e-318ee458d4bb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.070247 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3ce395df-c46f-4d1a-b592-dfe77cdb091e req-751a7457-a6eb-490a-847e-318ee458d4bb service nova] Creating event network-vif-unplugged:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:16:34.073118 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3ce395df-c46f-4d1a-b592-dfe77cdb091e req-751a7457-a6eb-490a-847e-318ee458d4bb service nova] Creating event network-vif-plugged:07187cc8-5452-48ca-b1cc-2e6dce8dba45 for instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb on n-h2-841089-2 May 10 02:16:34.093961 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3ce395df-c46f-4d1a-b592-dfe77cdb091e req-751a7457-a6eb-490a-847e-318ee458d4bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.068861 May 10 02:16:34.094855 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 757/1570] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:16:34.149569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:34.156383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:34.193016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.193830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.197730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.202977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.621488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:34.631583 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-15fe271e-7dc7-4bb1-8cef-a7e766fcc8a0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 0.721661 May 10 02:16:34.638447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:34.642451 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 814/1571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:33 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:34.648786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:34.650217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:34.655981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92948c6b-edc1-4d96-88b9-29ba7dda543a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 0.510028 May 10 02:16:34.665631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.667470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.669685 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 758/1572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:34 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:34.670376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.670833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.676413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:34.677559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:34.687036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.688034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:34.689209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:34.690131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.090921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:35.108813 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-329193db-dcd5-4433-b20b-22f027acdb6f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1276 microversion: 2.1 time: 0.431595 May 10 02:16:35.114344 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 759/1573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:34 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1276 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:35.122366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57db196b-f385-4330-90d5-17672e3ac98c tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fa3790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:35.213536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57db196b-f385-4330-90d5-17672e3ac98c tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.096121 May 10 02:16:35.214364 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 760/1574] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:35 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:35.231191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:35.232191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:35.235583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:35.243126 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a7fe43f-65e3-4f52-81d9-0da0bc3f2852 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1576 microversion: 2.1 time: 0.598884 May 10 02:16:35.247306 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 815/1575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:34 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1576 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:35.249085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.250192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.253546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.255094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.257763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:35.261007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:35.276339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.277236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.278188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.278947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.558821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:35.568999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac475490-7412-4562-8608-b86752814ab9 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1168 microversion: 2.1 time: 0.351111 May 10 02:16:35.570296 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 761/1576] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:35 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1168 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:35.576904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:35.577600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:35.592112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.593660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.596041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.596834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.871363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac40102c-4aac-460c-b31a-9fbfc35d62b2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299349 May 10 02:16:35.872717 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 762/1577] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:16:35 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:35.878427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:35.879216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:35.896416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.896898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:35.900753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:35.901675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.107050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:36.125557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:36.132778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:36.137070 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c70d80c9-0adf-43db-b5b3-1e7670ce8613 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 0.888748 May 10 02:16:36.147085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 816/1578] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:35 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:36.151647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:36.152540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:36.195354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.195815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.197266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.197715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.489949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:36.500178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5a889e97-3000-42bd-866e-eb7d1015c345 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 0.626089 May 10 02:16:36.507882 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 763/1579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:35 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:36.789309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:36.798961 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ccf485b-f074-41a2-9ce2-652a4353b2e7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1314 microversion: 2.1 time: 0.655444 May 10 02:16:36.804389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 817/1580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:36 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:36.811606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b59168bb-cbd1-45c8-842e-15bbe6426eae tempest-AbsoluteLimitsTestJSON-1324756974 tempest-AbsoluteLimitsTestJSON-1324756974-project] Calling method '.version_select at 0x7f3d36fcd550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:36.825811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8cf29c87-0d88-4c53-bd74-3f9523f1f818 req-0cafaeb4-59f1-41e0-8260-94d9447c8b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9abf345-a804-4182-b3d9-629a74655e94", "name": "network-vif-plugged", "status": "completed", "tag": "8482d275-6998-47a8-b8c1-d3cc029ed00f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:36.826683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b59168bb-cbd1-45c8-842e-15bbe6426eae tempest-AbsoluteLimitsTestJSON-1324756974 tempest-AbsoluteLimitsTestJSON-1324756974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.830071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b59168bb-cbd1-45c8-842e-15bbe6426eae tempest-AbsoluteLimitsTestJSON-1324756974 tempest-AbsoluteLimitsTestJSON-1324756974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.832787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b59168bb-cbd1-45c8-842e-15bbe6426eae tempest-AbsoluteLimitsTestJSON-1324756974 tempest-AbsoluteLimitsTestJSON-1324756974-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.835031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b59168bb-cbd1-45c8-842e-15bbe6426eae tempest-AbsoluteLimitsTestJSON-1324756974 tempest-AbsoluteLimitsTestJSON-1324756974-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.880418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8cf29c87-0d88-4c53-bd74-3f9523f1f818 req-0cafaeb4-59f1-41e0-8260-94d9447c8b2a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.881325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8cf29c87-0d88-4c53-bd74-3f9523f1f818 req-0cafaeb4-59f1-41e0-8260-94d9447c8b2a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.883515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b59168bb-cbd1-45c8-842e-15bbe6426eae tempest-AbsoluteLimitsTestJSON-1324756974 tempest-AbsoluteLimitsTestJSON-1324756974-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.374213 May 10 02:16:36.886861 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 764/1581] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 02:16:36 2022] GET /compute/v2.1/limits => generated 511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:36.913490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:36.915970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:36.934747 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8cf29c87-0d88-4c53-bd74-3f9523f1f818 req-0cafaeb4-59f1-41e0-8260-94d9447c8b2a service nova] Creating event network-vif-plugged:8482d275-6998-47a8-b8c1-d3cc029ed00f for instance e9abf345-a804-4182-b3d9-629a74655e94 on n-h2-841089-2 May 10 02:16:36.936352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.936821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.937633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:36.938087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:36.949144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8cf29c87-0d88-4c53-bd74-3f9523f1f818 req-0cafaeb4-59f1-41e0-8260-94d9447c8b2a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141490 May 10 02:16:36.955653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 818/1582] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:36.968359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e9cbc301-b399-4e4d-b2fe-c2eef7f83e25 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f5e280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:37.086082 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e9cbc301-b399-4e4d-b2fe-c2eef7f83e25 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.128500 May 10 02:16:37.094994 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 819/1583] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:36 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:37.108144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:37.111165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:37.131735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:37.135338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:37.136615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:37.138698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:37.665644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:37.673769 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ae909523-847d-47f4-82ff-4d5de70176ee tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.785620 May 10 02:16:37.674356 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 765/1584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:36 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:37.684599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:37.701932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:37.711432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:37.712464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:37.735735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:37.736934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.130258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:38.134375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:38.142549 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c25f577-9ac7-4e20-b47c-bd213381075d tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 1.045853 May 10 02:16:38.145987 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 820/1585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:37 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:38.153357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:38.155409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:38.169296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6c015ae2-8f1d-4727-adbd-67f3449e6c57 req-7ee3c614-57fa-4814-827c-23fcd56ea58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb", "name": "network-vif-deleted", "tag": "07187cc8-5452-48ca-b1cc-2e6dce8dba45"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:38.169615 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1336672a-ca1e-4a4a-9445-7903c7281768 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1293 microversion: 2.25 time: 0.489255 May 10 02:16:38.170218 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 766/1586] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:37 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1293 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:38.182897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6c015ae2-8f1d-4727-adbd-67f3449e6c57 req-7ee3c614-57fa-4814-827c-23fcd56ea58c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.183398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6c015ae2-8f1d-4727-adbd-67f3449e6c57 req-7ee3c614-57fa-4814-827c-23fcd56ea58c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.187187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:38.188028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:38.200769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.204429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.205700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.206310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.209009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6c015ae2-8f1d-4727-adbd-67f3449e6c57 req-7ee3c614-57fa-4814-827c-23fcd56ea58c service nova] Creating event network-vif-deleted:07187cc8-5452-48ca-b1cc-2e6dce8dba45 for instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb on n-h2-841089-2 May 10 02:16:38.232280 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6c015ae2-8f1d-4727-adbd-67f3449e6c57 req-7ee3c614-57fa-4814-827c-23fcd56ea58c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082805 May 10 02:16:38.235241 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 821/1587] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:38.249692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:38.256004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:38.275050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.280430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.281765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.284518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.576246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:38.584057 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33a5f41a-cce8-4aa7-b26f-29a64181e0fb tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1293 microversion: 2.1 time: 0.347479 May 10 02:16:38.588740 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 822/1588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:38 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1293 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:38.598863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac18e990-134c-4cc0-97b4-951aba5171ed tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3703da60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:38.693295 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac18e990-134c-4cc0-97b4-951aba5171ed tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.102385 May 10 02:16:38.693892 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 823/1589] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:38 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:38.709363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:38.714098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:38.726238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.729219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:38.732527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:38.733144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:39.632468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:39.654460 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-628e8bb6-4ae6-4676-afe2-8cf3c7a781b8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 1.475639 May 10 02:16:39.665716 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 767/1590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:38 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:39.677407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:39.678056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:39.700335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:39.700800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:39.707783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:39.708255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:39.710736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:39.723857 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-95729275-32ca-4232-9f41-633ccbe16cdd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1576 microversion: 2.1 time: 1.028867 May 10 02:16:39.724986 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 824/1591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:38 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1576 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:39.732020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:39.735470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:39.750776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:39.751627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:39.760803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:39.761554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:40.400664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:40.409437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:40.409759 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71f3e547-e666-4396-863c-0789e58fdb75 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.683372 May 10 02:16:40.414650 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 825/1592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:39 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:40.424043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c3afd99-87b7-4570-bd09-c7341f4f9626 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.761743 May 10 02:16:40.424712 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 768/1593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:39 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:40.439414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:40.441314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:40.444890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:40.453091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:40.480251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:40.482048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:40.482720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:40.483967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:40.484572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:40.487938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:40.489022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:40.496637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:40.575903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:40.576633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:40.577525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lazy-loading 'fault' on Instance uuid b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:16:40.736589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:40.746280 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af1762c3-ee8c-4ab2-8b4d-338679f450e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 200 len: 1304 microversion: 2.1 time: 0.309072 May 10 02:16:40.747148 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 769/1594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:40 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 1304 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:40.754269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ada11dd3-44ca-41ed-ae92-3fae56bb11f8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d370da550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:40.846784 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ada11dd3-44ca-41ed-ae92-3fae56bb11f8 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.097729 May 10 02:16:40.847579 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 770/1595] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:40 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:41.073323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b910e76a-b3ef-4101-941f-ba6727b24ce4 req-1f8d312f-d9d4-4f06-a91a-74ebc82ce042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb155e6-b56b-4450-ac97-fe59725d517d", "tag": "e61d2354-d8b5-4efa-9cab-546d491231ab"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:41.082575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:41.090627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:41.092152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:41.095270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b910e76a-b3ef-4101-941f-ba6727b24ce4 req-1f8d312f-d9d4-4f06-a91a-74ebc82ce042 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.095747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b910e76a-b3ef-4101-941f-ba6727b24ce4 req-1f8d312f-d9d4-4f06-a91a-74ebc82ce042 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.099599 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f3b3507-8c4c-4323-b5ba-a2a71cc5b4a2 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.670652 May 10 02:16:41.102085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 826/1596] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:40 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:41.128891 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b910e76a-b3ef-4101-941f-ba6727b24ce4 req-1f8d312f-d9d4-4f06-a91a-74ebc82ce042 service nova] Creating event network-changed:e61d2354-d8b5-4efa-9cab-546d491231ab for instance 1bb155e6-b56b-4450-ac97-fe59725d517d on n-h2-841089-2 May 10 02:16:41.158354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b910e76a-b3ef-4101-941f-ba6727b24ce4 req-1f8d312f-d9d4-4f06-a91a-74ebc82ce042 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308637 May 10 02:16:41.160729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 771/1597] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:41.292178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bdea524e-14f9-412b-b471-674fed2fe2e4 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Calling method '.version_select at 0x7f3d36f5e280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:41.319580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdea524e-14f9-412b-b471-674fed2fe2e4 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.323102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdea524e-14f9-412b-b471-674fed2fe2e4 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.327476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdea524e-14f9-412b-b471-674fed2fe2e4 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.329724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdea524e-14f9-412b-b471-674fed2fe2e4 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.336121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-15212a29-091f-4d96-97f0-703e3c071f1e req-b52484db-6def-49db-ac25-390b1bd1cc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012100fc-18a3-4765-8725-adadb1fd6e30", "tag": "945b6d27-774a-438f-90b4-e5fb912b2a9e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:41.356582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-15212a29-091f-4d96-97f0-703e3c071f1e req-b52484db-6def-49db-ac25-390b1bd1cc77 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.357224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-15212a29-091f-4d96-97f0-703e3c071f1e req-b52484db-6def-49db-ac25-390b1bd1cc77 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.363341 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bdea524e-14f9-412b-b471-674fed2fe2e4 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.258879 May 10 02:16:41.365930 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 827/1598] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 02:16:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:41.372205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:41.373284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:41.395930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-15212a29-091f-4d96-97f0-703e3c071f1e req-b52484db-6def-49db-ac25-390b1bd1cc77 service nova] Creating event network-changed:945b6d27-774a-438f-90b4-e5fb912b2a9e for instance 012100fc-18a3-4765-8725-adadb1fd6e30 on n-h2-841089-2 May 10 02:16:41.421249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-15212a29-091f-4d96-97f0-703e3c071f1e req-b52484db-6def-49db-ac25-390b1bd1cc77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256519 May 10 02:16:41.422280 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 772/1599] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:41.423414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.430292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.436002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:41.440372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:41.453350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.455639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.461766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.464062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:41.467292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:41.470022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.094713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:42.115590 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2a3afc0-7552-4971-9cc9-327aabf99091 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1543 microversion: 2.1 time: 0.747041 May 10 02:16:42.119644 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 828/1600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:41 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1543 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:42.136559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:42.137206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:42.142683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:42.151314 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a364ec6-76f6-4959-a177-93f677cdd941 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.722235 May 10 02:16:42.152738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 773/1601] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:41 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:42.158243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1583719613", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:42.160324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:42.162136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.163047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:42.164237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.226949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:42.480763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:42.489027 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c9701c4-7711-414e-bc7f-15e41d4a8e08 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.367101 May 10 02:16:42.489616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 829/1602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:42 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:42.503294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:42.515820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:42.534211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:42.534938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.535943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:42.536552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.557307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb HTTP/1.1 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb'} May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:42.559294 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:16:42.563466 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:16:42.566709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:42.567909 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ba22581-c4d2-455f-a341-630afc04c5ff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 404 len: 111 microversion: 2.1 time: 0.068734 May 10 02:16:42.579287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 830/1603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:42 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:16:42.585199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-de1abc2e-f353-4ab4-8a8e-0fc0db3ecb23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3704e160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:42.633404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Getting quotas for project ef3d8f2670934e32a0a9cdfdf38f4e7c. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:42.637245 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-de1abc2e-f353-4ab4-8a8e-0fc0db3ecb23 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.055995 May 10 02:16:42.638195 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 831/1604] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:42 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:42.639955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Getting quotas for user ab887aeab95e4669b1f578e3f63edd57 and project ef3d8f2670934e32a0a9cdfdf38f4e7c. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:42.644650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:42.645756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:42.654925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:42.656511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.657363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:42.657824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:42.679146 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Request method failure captured: May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 1752 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecsIxBcAq1sR0xMuSdy7K5SBGJrq7o6ZO4NBdHayWQ_QyEmXOEGwaPXWQE1H36quPwwjiluk39CT_M4fk98PuB4AzNS0UXqJEkwDLS7AONDnU3sVWX-ZaQdYQIM0QocgWOBs_Gvo2F8AZaj1Tjn4kd1hSQNDlikumxZt2UTveyspDl4 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ef3d8f2670934e32a0a9cdfdf38f4e7c May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-861709512 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ef3d8f2670934e32a0a9cdfdf38f4e7c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef3d8f2670934e32a0a9cdfdf38f4e7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ef3d8f2670934e32a0a9cdfdf38f4e7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef3d8f2670934e32a0a9cdfdf38f4e7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-861709512 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ef3d8f2670934e32a0a9cdfdf38f4e7c May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-861709512 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-861709512-project May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ab887aeab95e4669b1f578e3f63edd57 May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-861709512-project May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1583719613", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:16:42.685782 n-d-841089-2 devstack@n-api.service[118717]: exception: Maximum number of metadata items exceeds 128 May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1583719613', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:42.688441 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 10 02:16:42.691515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:16:42.695106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:16:42.696335 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ac0ffe4-b14c-413e-9711-8fad9df76017 tempest-AbsoluteLimitsNegativeTestJSON-861709512 tempest-AbsoluteLimitsNegativeTestJSON-861709512-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.542381 May 10 02:16:42.697493 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 774/1605] 10.222.0.52 () {60 vars in 1147 bytes} [Tue May 10 02:16:42 2022] POST /compute/v2.1/servers => generated 87 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 10 02:16:42.876740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-873818330", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:42.957209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:43.086655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:43.098797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:43.101440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:43.103435 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-578a94cd-eebf-42cb-9d29-2c07ed9347ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.463688 May 10 02:16:43.104435 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 832/1606] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:42 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:43.138391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:43.142776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:43.172016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:43.179554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:43.185331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:43.186505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:43.702124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:43.711199 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9dda50f0-d92e-470d-994d-1b4a3c8ce664 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1542 microversion: 2.1 time: 0.578327 May 10 02:16:43.714349 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 833/1607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:43 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1542 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:44.041296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:44.042235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:44.042920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:44.043532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:44.044114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:44.056119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.056690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.058280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.058820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.089950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:44.097603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:44.113143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:44.113902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:44.118668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:44.121373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:44.126589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.127192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.128098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.128644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.180380 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3802abe5-cbee-4089-b9f1-49dd3066f857 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308296 May 10 02:16:44.181449 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 775/1608] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:44.186696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fd04fa31-7698-418c-a8b6-f56b363958d4 req-e5460acc-27c9-4d86-afe0-8b7fede2b294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c903ce72-ce77-47a6-bf37-8712418785a7", "tag": "c1d64c5c-eb66-43af-990e-ab90cb339c0b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:44.210586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fd04fa31-7698-418c-a8b6-f56b363958d4 req-e5460acc-27c9-4d86-afe0-8b7fede2b294 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.211289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fd04fa31-7698-418c-a8b6-f56b363958d4 req-e5460acc-27c9-4d86-afe0-8b7fede2b294 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.242047 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fd04fa31-7698-418c-a8b6-f56b363958d4 req-e5460acc-27c9-4d86-afe0-8b7fede2b294 service nova] Creating event network-changed:c1d64c5c-eb66-43af-990e-ab90cb339c0b for instance c903ce72-ce77-47a6-bf37-8712418785a7 on n-h2-841089-2 May 10 02:16:44.256545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fd04fa31-7698-418c-a8b6-f56b363958d4 req-e5460acc-27c9-4d86-afe0-8b7fede2b294 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071965 May 10 02:16:44.259113 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 776/1609] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:44.271579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:44.272939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:44.290150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.290800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.292277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.294831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.796973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:44.805706 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0fb29b72-bd82-44e1-aa13-fe1b315211f8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 1.088534 May 10 02:16:44.808894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 834/1610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:43 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:44.823525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-224dfe40-bc49-4ed1-a8de-375df03518e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdc700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:44.943270 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-224dfe40-bc49-4ed1-a8de-375df03518e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.123742 May 10 02:16:44.944067 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 835/1611] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:44 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:44.949318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:44.960133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:44.969220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.974222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:44.975381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:44.975989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:45.039079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:45.064993 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-153db288-aa8d-4afe-bdc4-a560c5487ad4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.804810 May 10 02:16:45.078480 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 777/1612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:44 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:45.090202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:45.091121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:45.122262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:45.122734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:45.138744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:45.139762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:45.416821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:45.441342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24a9fdfa-6dde-4ab5-8f4e-31797fa44532 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1210 microversion: 2.1 time: 0.362950 May 10 02:16:45.442444 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 778/1613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:45 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1210 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:45.457831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:45.459731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:45.472000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:45.478600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:45.479815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:45.481062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:45.631060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:45.648869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:45.657569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:45.658883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6eb3b487-4162-4f03-938a-3e951d279c1b tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.713719 May 10 02:16:45.659591 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 836/1614] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:44 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:45.827088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:45.828117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:45.839445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:45.842071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:45.843690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:45.852208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.141729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:46.153931 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e1919a3-80cd-4a52-af61-6d6d4a6e9ce9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1542 microversion: 2.1 time: 0.709599 May 10 02:16:46.156110 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 779/1615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:45 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1542 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:46.166153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f17fef7d-d533-41a4-a2b0-a4d528900d06 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d370e6c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:46.293689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f17fef7d-d533-41a4-a2b0-a4d528900d06 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.135772 May 10 02:16:46.310545 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 780/1616] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:46 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:46.338133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:46.338772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:46.363803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.364265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.368641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.369100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.425532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:46.441112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39e06eb2-da6f-4076-8ee5-afd1d49e2442 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.619716 May 10 02:16:46.448844 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 837/1617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:45 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:46.461217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:46.462428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:46.489243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.490017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.492056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.496065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.591019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:46.600205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56faeaf2-521c-41bb-bb00-5c67eb158d90 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.288414 May 10 02:16:46.607965 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 781/1618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:46 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:46.659864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:46.670894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-67eaa594-e561-43e0-86bb-911b9af68870 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1274 microversion: 2.1 time: 0.213419 May 10 02:16:46.675209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 838/1619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:46 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:46.678706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:46.679358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:46.687398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.687863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.703309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.703944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.920106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-5c6fe603-0088-45b5-9bb2-662ac9731ddf req-dfd08138-3615-4469-b1a4-81b2fe46aada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "name": "network-vif-unplugged", "status": "completed", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:46.953766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5c6fe603-0088-45b5-9bb2-662ac9731ddf req-dfd08138-3615-4469-b1a4-81b2fe46aada service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:46.954392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5c6fe603-0088-45b5-9bb2-662ac9731ddf req-dfd08138-3615-4469-b1a4-81b2fe46aada service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:46.991247 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-5c6fe603-0088-45b5-9bb2-662ac9731ddf req-dfd08138-3615-4469-b1a4-81b2fe46aada service nova] Creating event network-vif-unplugged:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:16:47.002036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-5c6fe603-0088-45b5-9bb2-662ac9731ddf req-dfd08138-3615-4469-b1a4-81b2fe46aada service nova] Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:16:47.023463 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-5c6fe603-0088-45b5-9bb2-662ac9731ddf req-dfd08138-3615-4469-b1a4-81b2fe46aada service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.386381 May 10 02:16:47.024245 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 782/1620] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:47.032465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:47.048470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:47.050964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:47.052150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5f21dd6-6a93-4141-bfbc-a3c6224191ee tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.378390 May 10 02:16:47.056376 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 839/1621] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:46 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:16:47.174506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:47.176027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:47.190674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.192534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.193613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.194234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.318016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f14acfd-f00c-4a96-b4c8-e43fa8f23ecf tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f5ec10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:47.398383 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f14acfd-f00c-4a96-b4c8-e43fa8f23ecf tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.087430 May 10 02:16:47.405919 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 840/1622] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:47 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:47.433386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:47.445541 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a974f97-a717-47a4-957a-ae7e397b6917 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1474 microversion: 2.1 time: 0.276591 May 10 02:16:47.446795 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 783/1623] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:47 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1474 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:47.464338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:47.465418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:47.473176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.473860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.475154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.476243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.669859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:47.679816 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62e2dde0-dd1a-4ddc-9294-5a72a4f0b34f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.219406 May 10 02:16:47.680610 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 841/1624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:47 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:47.708890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:47.714063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:47.729735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.734867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.735849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.736510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.846986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bec814d5-1648-4e45-bca2-31db1def6396 tempest-AZV2TestJSON-1273174276 tempest-AZV2TestJSON-1273174276-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:47.849592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bec814d5-1648-4e45-bca2-31db1def6396 tempest-AZV2TestJSON-1273174276 tempest-AZV2TestJSON-1273174276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.850164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bec814d5-1648-4e45-bca2-31db1def6396 tempest-AZV2TestJSON-1273174276 tempest-AZV2TestJSON-1273174276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.852051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bec814d5-1648-4e45-bca2-31db1def6396 tempest-AZV2TestJSON-1273174276 tempest-AZV2TestJSON-1273174276-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.853168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bec814d5-1648-4e45-bca2-31db1def6396 tempest-AZV2TestJSON-1273174276 tempest-AZV2TestJSON-1273174276-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.923273 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bec814d5-1648-4e45-bca2-31db1def6396 tempest-AZV2TestJSON-1273174276 tempest-AZV2TestJSON-1273174276-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.348723 May 10 02:16:47.927239 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 784/1625] 10.222.0.52 () {58 vars in 1163 bytes} [Tue May 10 02:16:47 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:16:47.941988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:47.946486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:47.956602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.959632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:47.964489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:47.965249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.033996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:48.052888 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f7dc03b-8b42-437b-845e-e2230cb8650a tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.370224 May 10 02:16:48.054418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 842/1626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:47 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:48.073385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:48.074413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:48.108280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.109986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.113633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.114546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.170634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:48.178671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49a97eaa-6c81-4394-baa2-125416cb0894 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1284 microversion: 2.1 time: 0.250018 May 10 02:16:48.187051 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 785/1627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:47 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:48.382006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:48.392732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:48.394517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:48.396495 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-394ce7eb-da86-41f8-b4a1-cb199d3f5d04 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.327008 May 10 02:16:48.397575 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 843/1628] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:48 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:16:48.413141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33ab4f0f-b621-4ff4-a1c7-7ba1a4ffa781 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37007f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:48.469101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:48.469980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:48.489229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33ab4f0f-b621-4ff4-a1c7-7ba1a4ffa781 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.079992 May 10 02:16:48.489557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.490036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.493391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.493900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.495352 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 786/1629] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:48 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:48.697413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:48.698110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:48.709665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.713982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.716833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.719775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.818700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:48.832886 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-000bdee4-83b6-4882-9a4f-caa1147cc9e5 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1471 microversion: 2.1 time: 0.372679 May 10 02:16:48.840874 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 844/1630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:48 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:48.870536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:48.873509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:48.896237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.896964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:48.903520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:48.904280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.014823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.015305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.016120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.016579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.042725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:49.047545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for user ea129546ff474fd0aa9c93c1bfaac5fd and project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:49.202792 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f45c011f-4924-4ca2-b4fd-f0843158ade9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d/action" status: 202 len: 0 microversion: 2.1 time: 0.351384 May 10 02:16:49.207114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 845/1631] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:16:48 2022] POST /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:16:49.213477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:49.214358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:49.224832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.225531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.227567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.229249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.500422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:49.538146 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f1d44cc5-52a4-4664-a911-f386a7cb5eb0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.845036 May 10 02:16:49.555108 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 787/1632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:48 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:49.568550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-734d99bd-f982-4838-821a-0c9d92206fd6 req-f68933e4-9bfe-4869-bd23-056f3346c4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012100fc-18a3-4765-8725-adadb1fd6e30", "name": "network-vif-plugged", "status": "completed", "tag": "945b6d27-774a-438f-90b4-e5fb912b2a9e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:49.578045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-734d99bd-f982-4838-821a-0c9d92206fd6 req-f68933e4-9bfe-4869-bd23-056f3346c4c4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.578504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-734d99bd-f982-4838-821a-0c9d92206fd6 req-f68933e4-9bfe-4869-bd23-056f3346c4c4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.590918 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-734d99bd-f982-4838-821a-0c9d92206fd6 req-f68933e4-9bfe-4869-bd23-056f3346c4c4 service nova] Creating event network-vif-plugged:945b6d27-774a-438f-90b4-e5fb912b2a9e for instance 012100fc-18a3-4765-8725-adadb1fd6e30 on n-h2-841089-2 May 10 02:16:49.597873 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-734d99bd-f982-4838-821a-0c9d92206fd6 req-f68933e4-9bfe-4869-bd23-056f3346c4c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033048 May 10 02:16:49.599372 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 788/1633] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:49.606509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:49.607630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:49.615323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.616049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:49.617497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:49.619851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:50.162393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:50.175430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b8c9c4e6-32a5-4a3c-bfc1-5ae7168e73b4 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.966535 May 10 02:16:50.188490 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 846/1634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:49 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:50.188845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:50.193355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:50.207323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:50.207782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:50.208661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:50.209038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:50.664425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:50.672666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4313cd05-8963-4859-acaa-9d22b04217c2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1470 microversion: 2.1 time: 0.494317 May 10 02:16:50.677597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 847/1635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:50 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:50.688566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:50.689432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:50.707025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:50.707911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:50.708812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:50.709493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:50.920648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:50.929685 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68a6f352-ad85-4af1-8301-cf207dc53bcc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1314 microversion: 2.1 time: 1.328845 May 10 02:16:50.932390 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 789/1636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:49 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1314 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:50.939576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d8e9896-0606-4dcc-88c9-e1c748198cdd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d370e6d30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:51.036571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d8e9896-0606-4dcc-88c9-e1c748198cdd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.100540 May 10 02:16:51.037800 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 790/1637] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:50 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:51.048497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8e70854b-1d84-462b-a725-e4e88eca659a req-b8c6be33-366c-4dac-87f9-e83680612c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022bee10-c911-4367-97fb-620b97d46616", "tag": "2fe42b6b-9f4a-4d83-a67e-4de5c629da26"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:51.068641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8e70854b-1d84-462b-a725-e4e88eca659a req-b8c6be33-366c-4dac-87f9-e83680612c43 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.069866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8e70854b-1d84-462b-a725-e4e88eca659a req-b8c6be33-366c-4dac-87f9-e83680612c43 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.094290 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8e70854b-1d84-462b-a725-e4e88eca659a req-b8c6be33-366c-4dac-87f9-e83680612c43 service nova] Creating event network-changed:2fe42b6b-9f4a-4d83-a67e-4de5c629da26 for instance 022bee10-c911-4367-97fb-620b97d46616 on n-h1-841089-2 May 10 02:16:51.099603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:51.114802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:51.124252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:51.126262 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8e70854b-1d84-462b-a725-e4e88eca659a req-b8c6be33-366c-4dac-87f9-e83680612c43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087053 May 10 02:16:51.130881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18a57f51-3a16-4056-a51d-22ccd828bc40 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.451921 May 10 02:16:51.132344 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 848/1638] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:50 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:51.145240 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 791/1639] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:51.149113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:51.154609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:51.166978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.171229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.174063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.175555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.196815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:51.198411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:51.211988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.218328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.221967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.222805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.613881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:51.618933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:51.623560 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e392a1e-5f15-4abf-8e77-e87b41720375 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1318 microversion: 2.1 time: 0.432076 May 10 02:16:51.625847 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 792/1640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:51 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:51.631087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-60867cad-9ad7-470e-9d72-f91c9f269240 req-d1b0304f-f76b-45e5-b1a8-fffa1dda408c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ad69c-a8de-4eba-ae8a-15cabb868a48", "name": "network-vif-plugged", "status": "completed", "tag": "47f1f980-2bd4-4fa7-875b-5b3c3da7445f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:51.642564 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a009c5e1-c869-49db-b8df-11d976e26871 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.490580 May 10 02:16:51.644830 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 849/1641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:51 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:51.658741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-60867cad-9ad7-470e-9d72-f91c9f269240 req-d1b0304f-f76b-45e5-b1a8-fffa1dda408c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.659244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-60867cad-9ad7-470e-9d72-f91c9f269240 req-d1b0304f-f76b-45e5-b1a8-fffa1dda408c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.692292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:51.693594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:51.705719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-60867cad-9ad7-470e-9d72-f91c9f269240 req-d1b0304f-f76b-45e5-b1a8-fffa1dda408c service nova] Creating event network-vif-plugged:47f1f980-2bd4-4fa7-875b-5b3c3da7445f for instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 on n-h1-841089-2 May 10 02:16:51.718364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.720615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.721855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.723277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.724639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-60867cad-9ad7-470e-9d72-f91c9f269240 req-d1b0304f-f76b-45e5-b1a8-fffa1dda408c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097404 May 10 02:16:51.725264 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 793/1642] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:51.950510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:51.951276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:51.961436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:51.961729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.962035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.965991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:51.969545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:51.973322 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28c8de8f-69f5-4d4d-93df-cd5427d14603 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1470 microversion: 2.1 time: 0.285673 May 10 02:16:51.984719 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 850/1643] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:51 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:52.051921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24fcce3b-39dc-4b25-9d1d-47ed69c51110 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdc430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:52.126930 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24fcce3b-39dc-4b25-9d1d-47ed69c51110 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.080744 May 10 02:16:52.128145 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 851/1644] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:52 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:52.154690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:52.156615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:52.183922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:52.189419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:52.193041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:52.194161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:52.207507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:52.250884 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-456d2103-2d7e-4ef5-8012-723832b30a22 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1314 microversion: 2.1 time: 0.299912 May 10 02:16:52.252033 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 794/1645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:51 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:52.483716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:52.503438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:52.507816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:52.510992 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dcd046d2-6ec7-41bf-a800-680d87d66545 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.362717 May 10 02:16:52.512542 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 852/1646] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:52 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:52.646560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:52.648378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:52.660170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:52.663188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:52.663824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:52.667057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:52.670991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:52.672028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:52.672983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:52.673524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:52.673788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:52.674239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:52.959292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:52.970899 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e225452-4ee3-4df2-945c-ebbbb214e999 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1210 microversion: 2.1 time: 0.312351 May 10 02:16:52.975150 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 853/1647] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:52 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1210 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:52.994058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:52.995010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:52.999959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:53.004828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:53.005295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:53.006121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:53.006569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:53.007865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2cd9d4cd-e8a0-44c3-97c9-754ce16c95d1 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1507 microversion: 2.1 time: 0.366559 May 10 02:16:53.010445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 795/1648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:52 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:53.145702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afddea4f-1ce8-4f87-b80c-00c4168d230e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fe4670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:53.230360 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afddea4f-1ce8-4f87-b80c-00c4168d230e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.091931 May 10 02:16:53.231381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:53.240227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89092d9d-c0be-47ea-8440-ca17cc8d2ca8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1470 microversion: 2.1 time: 0.252115 May 10 02:16:53.241273 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 796/1649] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:53 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:53.245268 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 854/1650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:52 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:53.268657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:53.270532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:53.281662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:53.282158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:53.282926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:53.283592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:53.530773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:53.532050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:53.545592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:53.547338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:53.548160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:53.548607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:53.962922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:53.979678 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-63a9b283-5a2c-4bb5-8f47-2b08abb51ae4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1314 microversion: 2.1 time: 0.715181 May 10 02:16:53.980607 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 797/1651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:53 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:53.985507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a9e99320-7c52-49da-903e-69d6f4e9b30f req-cb02195c-6e3c-4162-b510-6e6911da86b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "name": "network-vif-plugged", "status": "completed", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:54.002797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a9e99320-7c52-49da-903e-69d6f4e9b30f req-cb02195c-6e3c-4162-b510-6e6911da86b0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:54.003384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a9e99320-7c52-49da-903e-69d6f4e9b30f req-cb02195c-6e3c-4162-b510-6e6911da86b0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:54.023554 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a9e99320-7c52-49da-903e-69d6f4e9b30f req-cb02195c-6e3c-4162-b510-6e6911da86b0 service nova] Creating event network-vif-plugged:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:16:54.032062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:54.033016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-a9e99320-7c52-49da-903e-69d6f4e9b30f req-cb02195c-6e3c-4162-b510-6e6911da86b0 service nova] Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:16:54.040933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:54.041376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a9e99320-7c52-49da-903e-69d6f4e9b30f req-cb02195c-6e3c-4162-b510-6e6911da86b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058980 May 10 02:16:54.042469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:54.043655 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71364107-7302-4106-8b4b-23d0a37bec37 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1281 microversion: 2.25 time: 0.518757 May 10 02:16:54.046863 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 798/1652] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:54.056201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 855/1653] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:53 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1281 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:54.062483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:54.063467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:54.070300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:54.071029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:54.072144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:54.072764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:54.247364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e66ee6fb-ba81-4155-8914-4cfcc4afd562 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdcd30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:54.351773 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e66ee6fb-ba81-4155-8914-4cfcc4afd562 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.108177 May 10 02:16:54.352666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 856/1654] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:54 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:54.359228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:54.372023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:54.404377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:54.404701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:54.405432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:54.406354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:54.406902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:54.421996 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-387d56cf-ca9d-4c53-860c-9150c9ab5c22 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.373544 May 10 02:16:54.423242 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 799/1655] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:54 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:54.788587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:54.838980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d295b6a3-ec66-4576-8649-5a9bd3aaf9c8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1470 microversion: 2.1 time: 0.485004 May 10 02:16:54.846944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 857/1656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:54 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1470 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:55.004404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:55.005301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:55.035691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:55.037761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:55.043691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:55.047012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:55.115800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-5846648", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "55df7d0f-6718-4c87-9bff-b3465eee9784"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:55.192254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] validate_networks() for [('55df7d0f-6718-4c87-9bff-b3465eee9784', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:55.781992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:55.801662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-23a94f4c-28dc-4934-b052-212eb71f31cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1314 microversion: 2.1 time: 0.805308 May 10 02:16:55.813191 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 858/1657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:54 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:16:55.825288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:55.826245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:55.836377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:55.843876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:55.845055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:55.847165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.154767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:56.164164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:56.166032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:56.167459 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a0ef2241-e947-420e-87a8-25f6156e7916 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1478 microversion: 2.25 time: 0.352897 May 10 02:16:56.168558 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 859/1658] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:55 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:56.186170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-febef490-2412-44ce-8100-4467541c753b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdb4c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:56.278237 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-febef490-2412-44ce-8100-4467541c753b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1453 microversion: 2.1 time: 0.106946 May 10 02:16:56.279841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 860/1659] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:56 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:56.285707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:56.286579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:56.294066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.295052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.296036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.296766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.354606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:56.355701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:56.356339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:56.356928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:56.357352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:56.369224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.369687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.370490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.370931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.412510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Getting quotas for project e74bbc4e5bd7461280d19a1719f1e817. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:56.417800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Getting quotas for user c2de0a50bc304f7aa3aec50df6d5f6a2 and project e74bbc4e5bd7461280d19a1719f1e817. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:56.450455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:56.454827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:56.531151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:56.539699 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef117e95-0d80-409c-9b1d-8c19232a3332 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.257789 May 10 02:16:56.540661 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 861/1660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:56 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:56.547302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:56.547302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:56.554726 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7aa40ba5-21e1-475e-beb3-e3413cddfc64 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640521 May 10 02:16:56.556764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.567180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.567180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.567180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.568753 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 800/1661] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:56.579994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:56.581046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:56.588128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.589100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.590085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.591726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.837183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:56.869268 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8bc7f430-ee7d-4623-9a6f-d1eda950516a tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1536 microversion: 2.1 time: 0.327543 May 10 02:16:56.870423 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 862/1662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:56 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1536 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:56.875036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1704841684", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "55df7d0f-6718-4c87-9bff-b3465eee9784"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:56.904963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid d79ad69c-a8de-4eba-ae8a-15cabb868a48 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:16:56.926540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-be2b49e3-00e0-4b6b-ab27-04939b128a71 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1971 microversion: 2.25 time: 0.356152 May 10 02:16:56.927715 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 801/1663] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:56 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1971 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:56.932803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:56.933631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:56.949101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.955921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.957713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:56.959709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:56.993893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] validate_networks() for [('55df7d0f-6718-4c87-9bff-b3465eee9784', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:57.250203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:57.281296 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff1bb8bb-97dc-4040-976a-5cf94b8e3391 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1314 microversion: 2.1 time: 0.351601 May 10 02:16:57.285427 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 802/1664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:56 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:57.297794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a317fae-7590-4e56-b1ee-ad6aac59855b"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:57.304181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:57.313056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.313807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.315501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.316347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.655856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:57.656534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:57.657450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:57.659435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:57.660216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:57.672422 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e1e6ad39-4dec-42db-9b89-88eaf992fbb8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "POST /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384494 May 10 02:16:57.673701 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 803/1665] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:16:57 2022] POST /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:57.675487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.675955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.676838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.677286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.678873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:57.679657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:57.687308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.687987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.689017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.689692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.716966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Getting quotas for project e74bbc4e5bd7461280d19a1719f1e817. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:57.722435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Getting quotas for user c2de0a50bc304f7aa3aec50df6d5f6a2 and project e74bbc4e5bd7461280d19a1719f1e817. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:57.740132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:57.751986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:57.833999 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c0ff139-7c01-47b8-967b-c55bdfcd72f9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962503 May 10 02:16:57.835880 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 863/1666] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:57.841333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-88ca5778-e4a3-401b-9a6a-f4608a51bc62 req-13f299f2-064f-4042-9b1b-19e6ffda7894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022bee10-c911-4367-97fb-620b97d46616", "name": "network-vif-plugged", "status": "completed", "tag": "2fe42b6b-9f4a-4d83-a67e-4de5c629da26"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:57.877453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-88ca5778-e4a3-401b-9a6a-f4608a51bc62 req-13f299f2-064f-4042-9b1b-19e6ffda7894 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.877935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-88ca5778-e4a3-401b-9a6a-f4608a51bc62 req-13f299f2-064f-4042-9b1b-19e6ffda7894 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.893811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid d79ad69c-a8de-4eba-ae8a-15cabb868a48 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:16:57.905920 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-88ca5778-e4a3-401b-9a6a-f4608a51bc62 req-13f299f2-064f-4042-9b1b-19e6ffda7894 service nova] Creating event network-vif-plugged:2fe42b6b-9f4a-4d83-a67e-4de5c629da26 for instance 022bee10-c911-4367-97fb-620b97d46616 on n-h1-841089-2 May 10 02:16:57.912100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a761a1a-ceac-49b0-87dc-b84061516e8e tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1971 microversion: 2.25 time: 0.237161 May 10 02:16:57.917714 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-88ca5778-e4a3-401b-9a6a-f4608a51bc62 req-13f299f2-064f-4042-9b1b-19e6ffda7894 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078595 May 10 02:16:57.921203 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 864/1667] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:16:57.924019 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 804/1668] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:16:57 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1971 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:16:57.926286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ee88a86-3285-4bfa-901f-e0624893abfb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdb4c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:57.931487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:57.932367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:57.942549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.943853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.947479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:57.948056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:57.999610 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ee88a86-3285-4bfa-901f-e0624893abfb tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1462 microversion: 2.1 time: 0.077800 May 10 02:16:58.023588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 865/1669] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:57 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:58.035088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:58.036398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:58.053762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:58.056102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:58.058953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:58.067892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:58.292835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:58.307212 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbb246d3-2403-4c6b-ae7f-8aa62ecdc85a tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.378033 May 10 02:16:58.316722 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 805/1670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:57 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:58.318595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1342759802", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "451", "networks": [{"uuid": "55df7d0f-6718-4c87-9bff-b3465eee9784"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:58.448925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:58.457202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] validate_networks() for [('55df7d0f-6718-4c87-9bff-b3465eee9784', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:16:58.468407 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8fda6c2b-921e-4cf4-bc08-faf235baa1a8 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1536 microversion: 2.1 time: 0.442891 May 10 02:16:58.473363 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 866/1671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:58 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1536 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:58.483968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c394dfe-e4d1-4ab5-b4b9-c64a20073956 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:58.494131 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:16:58.494131 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:16:58.511893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c394dfe-e4d1-4ab5-b4b9-c64a20073956 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:58.512655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c394dfe-e4d1-4ab5-b4b9-c64a20073956 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:58.514390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c394dfe-e4d1-4ab5-b4b9-c64a20073956 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:58.515115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c394dfe-e4d1-4ab5-b4b9-c64a20073956 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:58.593600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c394dfe-e4d1-4ab5-b4b9-c64a20073956 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.118542 May 10 02:16:58.602829 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 867/1672] 10.222.0.52 () {60 vars in 1216 bytes} [Tue May 10 02:16:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:16:58.617209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ebdc2efb-4478-4c96-bc0d-30f849c9f7e4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fdbc10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:58.693840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ebdc2efb-4478-4c96-bc0d-30f849c9f7e4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 200 len: 1462 microversion: 2.1 time: 0.089680 May 10 02:16:58.694574 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 868/1673] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:16:58 2022] GET /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:58.705530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:58.712671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:58.732882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:58.733373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:58.734204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:58.738442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.036004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:59.047562 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2987c24-7900-4fe2-89c5-7530c5b0f608 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1314 microversion: 2.1 time: 0.351876 May 10 02:16:59.056944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 869/1674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:58 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:59.061726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-841089-2", "block_migration": "auto"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:16:59.062928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:59.069881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.070347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.071817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.072280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.099498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'flavor' on Instance uuid d79ad69c-a8de-4eba-ae8a-15cabb868a48 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:16:59.111643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Going to try to live migrate instance to n-h2-841089-2 {{(pid=118716) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:16:59.129394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:16:59.130107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:16:59.130795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:16:59.131577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:16:59.131952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:16:59.141900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.142458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.159093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.159473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.178757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Getting quotas for project e74bbc4e5bd7461280d19a1719f1e817. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:16:59.183777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Getting quotas for user c2de0a50bc304f7aa3aec50df6d5f6a2 and project e74bbc4e5bd7461280d19a1719f1e817. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:16:59.202931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:16:59.205585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:16:59.261013 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2f8fead1-e242-4048-b602-bc78bf44287c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951694 May 10 02:16:59.262093 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 806/1675] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:16:59.266765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:59.267676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:59.273912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.274494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.275482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.276029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.490972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:59.499297 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5ddb9690-a9d7-40a6-98cf-86a7b4c2d9a2 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1466 microversion: 2.1 time: 0.235995 May 10 02:16:59.500201 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 807/1676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:59 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:59.504772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc4d7373-10bc-4de8-a861-e1b1ace997d6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:59.505394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc4d7373-10bc-4de8-a861-e1b1ace997d6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:59.577119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fc4d7373-10bc-4de8-a861-e1b1ace997d6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:59.604171 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc4d7373-10bc-4de8-a861-e1b1ace997d6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1221 microversion: 2.1 time: 0.098394 May 10 02:16:59.615009 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 808/1677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:59 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:59.620597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:59.621230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:59.639257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.639727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.640544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.640994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.860364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:16:59.869048 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fbe68fa2-3fbd-47da-bc81-043db9932e5c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.252871 May 10 02:16:59.869642 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 809/1678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:59 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:16:59.884405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:16:59.885101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:16:59.892784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.893307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:16:59.894192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:16:59.894650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:00.056536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:00.085762 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e26a7005-8314-429c-bf2b-452ceeb74fcd tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1529 microversion: 2.1 time: 0.215060 May 10 02:17:00.098127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 810/1679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:16:59 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1529 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:00.104144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-446713848"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:00.104949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:00.127099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:00.127569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:00.128497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:00.128945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:00.562274 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1173c4b9-633d-404b-a0d7-453092752000 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "POST /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.462753 May 10 02:17:00.563683 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 811/1680] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:17:00 2022] POST /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:17:00.573502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-6f0992a7-6f26-4123-b058-0bf6bb91ef10 req-663779a2-17d2-4623-9c2e-9268618cec12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "name": "network-vif-unplugged", "status": "completed", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:00.589252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6f0992a7-6f26-4123-b058-0bf6bb91ef10 req-663779a2-17d2-4623-9c2e-9268618cec12 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:00.589720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6f0992a7-6f26-4123-b058-0bf6bb91ef10 req-663779a2-17d2-4623-9c2e-9268618cec12 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:00.616965 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-6f0992a7-6f26-4123-b058-0bf6bb91ef10 req-663779a2-17d2-4623-9c2e-9268618cec12 service nova] Creating event network-vif-unplugged:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:17:00.625556 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-6f0992a7-6f26-4123-b058-0bf6bb91ef10 req-663779a2-17d2-4623-9c2e-9268618cec12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060254 May 10 02:17:00.626468 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 812/1681] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:00.636004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:00.636725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:00.653397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:00.654098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:00.655346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:00.660234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:00.981387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:00.989825 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-10f04350-d1b3-4f99-b71b-ae4edbc65fa3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1500 microversion: 2.1 time: 0.361776 May 10 02:17:00.991942 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 813/1682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:00 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1500 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:01.007869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:01.009355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:01.032102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:01.033306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:01.034476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:01.035121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:01.246430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-309474f5-90e3-479f-902c-16d78350c53c tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48/action" status: 202 len: 0 microversion: 2.25 time: 2.188272 May 10 02:17:01.247277 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 870/1683] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:16:59 2022] POST /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48/action => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:01.255511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ad6674c-cfb1-403e-8cb9-dd45bb1d0b62 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e8a940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:01.341896 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ad6674c-cfb1-403e-8cb9-dd45bb1d0b62 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.090746 May 10 02:17:01.343865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 871/1684] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:01 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:01.359992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:01.360928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:01.377853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:01.378435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:01.379605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:01.380856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:01.723300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:01.738903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d62882a3-6b9b-4741-9141-e6e3bf6524b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1273 microversion: 2.1 time: 0.393699 May 10 02:17:01.756070 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 872/1685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:01 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1273 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:01.768856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:01.769727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:01.779298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:01.791884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:01.793072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:01.793708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.137034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:02.151311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c83e128-373f-4754-80e7-35265c5c1f22 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1529 microversion: 2.1 time: 1.152969 May 10 02:17:02.152908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 814/1686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:00 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1529 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:02.167091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:02.167883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:02.178539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:02.179388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.181100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:02.182217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.272388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:02.280596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05e87193-97ac-453f-987f-dca429202ed2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.523100 May 10 02:17:02.286057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 873/1687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:01 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:02.290890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:02.291564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:02.309341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:02.309817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.310620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:02.321392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.346827 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-164d8d34-c454-4f5e-b1ef-1d92bec4242a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616/action" status: 202 len: 0 microversion: 2.1 time: 0.192350 May 10 02:17:02.348920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 815/1688] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:17:02 2022] POST /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:02.377395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3a57a77-7f88-4bbe-9dd5-fc1ebb394928 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:02.379938 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:17:02.379938 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:17:02.393580 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c3a57a77-7f88-4bbe-9dd5-fc1ebb394928 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] HTTP exception thrown: Flavor ffa1d6cb-083b-428b-bf50-5ac0969365a9 could not be found. May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3a57a77-7f88-4bbe-9dd5-fc1ebb394928 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Request method failure captured: May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/flavors/ffa1d6cb-083b-428b-bf50-5ac0969365a9 HTTP/1.1 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieco6bmqBaIBs6h5J47YdmnIksdWz7jHolMy0hKR5ucFJoAwQSq5k7Xzd-UTB41VqdMNMZm7pe5Rv2FBjlwmP77wNEjAlsQ_yeS8M1VO3bbHY-8ovpDtnEhhljBvyPzV0fYSj4qaYKm4tACCgFiKqB1GSuYu9pUayc7tp0LTk63SwzPU May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 2bc78bfaf22d48cda331932f097f8b85 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MigrationsAdminTest-1927221714 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2bc78bfaf22d48cda331932f097f8b85", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bc78bfaf22d48cda331932f097f8b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2bc78bfaf22d48cda331932f097f8b85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2bc78bfaf22d48cda331932f097f8b85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MigrationsAdminTest-1927221714 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 2bc78bfaf22d48cda331932f097f8b85 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MigrationsAdminTest-1927221714 May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MigrationsAdminTest-1927221714-project-admin May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fd929eec704e4295be1a82ed7f54deae May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MigrationsAdminTest-1927221714-project-admin May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: exception: Flavor ffa1d6cb-083b-428b-bf50-5ac0969365a9 could not be found. May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ffa1d6cb-083b-428b-bf50-5ac0969365a9'} May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi flavor.destroy() May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ffa1d6cb-083b-428b-bf50-5ac0969365a9 could not be found. May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ffa1d6cb-083b-428b-bf50-5ac0969365a9 could not be found. May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:02.398766 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ffa1d6cb-083b-428b-bf50-5ac0969365a9 could not be found. May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:02.403609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3a57a77-7f88-4bbe-9dd5-fc1ebb394928 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Returning 404 to user: Flavor ffa1d6cb-083b-428b-bf50-5ac0969365a9 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:02.404242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c3a57a77-7f88-4bbe-9dd5-fc1ebb394928 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/ffa1d6cb-083b-428b-bf50-5ac0969365a9" status: 404 len: 109 microversion: 2.1 time: 0.052147 May 10 02:17:02.408718 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 816/1689] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:17:02 2022] DELETE /compute/v2.1/flavors/ffa1d6cb-083b-428b-bf50-5ac0969365a9 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:17:02.428611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7dcb170-e139-4fdc-a54e-d8ee73a1c260 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37014dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:02.499733 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7dcb170-e139-4fdc-a54e-d8ee73a1c260 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.089493 May 10 02:17:02.500639 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 817/1690] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:02 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:02.519804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:02.523188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:02.568265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:02.569380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.569956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:02.570959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:02.848099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:02.865147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:02.866821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:02.876821 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90f984b3-7335-414e-a82a-3d36c6eddbfd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.581521 May 10 02:17:02.877757 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 874/1691] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:02 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:02.886844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-931514182", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:02.988028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:17:03.593870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:03.601828 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36fcad44-83c8-43e4-9620-bd17466567f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1505 microversion: 2.1 time: 1.095129 May 10 02:17:03.603043 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 818/1692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:02 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1505 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:03.608077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:03.608963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:03.633829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:03.634571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:03.640305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:03.641030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:03.803759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:03.812483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5f1c7ae-239a-48e3-9987-99183ddd522f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1279 microversion: 2.1 time: 0.207865 May 10 02:17:03.822081 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 819/1693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:03 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:03.824235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c5c239a2-3de3-4e96-8650-f2a633fffbc3 req-35fae6de-3556-45b0-94a0-07aae52ad62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c903ce72-ce77-47a6-bf37-8712418785a7", "name": "network-vif-plugged", "status": "completed", "tag": "c1d64c5c-eb66-43af-990e-ab90cb339c0b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:03.833931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c5c239a2-3de3-4e96-8650-f2a633fffbc3 req-35fae6de-3556-45b0-94a0-07aae52ad62c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:03.834384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c5c239a2-3de3-4e96-8650-f2a633fffbc3 req-35fae6de-3556-45b0-94a0-07aae52ad62c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:03.863182 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c5c239a2-3de3-4e96-8650-f2a633fffbc3 req-35fae6de-3556-45b0-94a0-07aae52ad62c service nova] Creating event network-vif-plugged:c1d64c5c-eb66-43af-990e-ab90cb339c0b for instance c903ce72-ce77-47a6-bf37-8712418785a7 on n-h2-841089-2 May 10 02:17:03.873796 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c5c239a2-3de3-4e96-8650-f2a633fffbc3 req-35fae6de-3556-45b0-94a0-07aae52ad62c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056437 May 10 02:17:03.875640 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 820/1694] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:03.882110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:03.883866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:03.893209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:03.893733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:03.894597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:03.895047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:03.984602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:17:03.985271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:17:03.985774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:17:03.986200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:17:03.986626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:17:04.011547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.012184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.021012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.022554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.076273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:17:04.087766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Getting quotas for user ea129546ff474fd0aa9c93c1bfaac5fd and project a18dfccd5dbf4743a117c907b8a1b8fe. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:17:04.111035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:17:04.113368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:17:04.194824 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69295cb3-ebf5-4924-a823-291046b1bb5c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315944 May 10 02:17:04.195562 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 875/1695] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:17:04.204964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdbc0aa-78f2-4f47-b1b6-5804248a1cbd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d371f5d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:04.310961 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afdbc0aa-78f2-4f47-b1b6-5804248a1cbd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.114315 May 10 02:17:04.315978 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 876/1696] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:04 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:04.332725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:04.341671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:04.362274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.362773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.363641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.364097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.545466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:04.562971 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ab9eb8c-98fc-42ba-af37-70c6ee1c2d93 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.684650 May 10 02:17:04.563625 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 821/1697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:03 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:04.573443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-673e0f39-35c2-4ce9-be9a-d42a8d12cc9d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:04.574091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-673e0f39-35c2-4ce9-be9a-d42a8d12cc9d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:04.671668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:04.687880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:04.690552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:04.692230 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7b8b02f5-4d08-4685-a8a9-cdf5684e6dcc tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.366451 May 10 02:17:04.705298 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 877/1698] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:04 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:04.710626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:04.712175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:04.719487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.720354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.721379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.722044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.802869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-673e0f39-35c2-4ce9-be9a-d42a8d12cc9d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:04.816146 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-673e0f39-35c2-4ce9-be9a-d42a8d12cc9d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1212 microversion: 2.1 time: 0.250269 May 10 02:17:04.817436 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 822/1699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:04 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1212 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:04.831473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:04.832066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:04.856760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.857227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:04.858038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:04.858489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:05.332220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:05.347876 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb36cee0-3d8e-4edd-a764-9cce30d47425 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1485 microversion: 2.1 time: 0.639719 May 10 02:17:05.350355 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 878/1700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:04 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1485 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:05.365358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86ee5d2c-4b3d-48de-b82c-5af98ac6a7de tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36e8a790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:05.489692 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86ee5d2c-4b3d-48de-b82c-5af98ac6a7de tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.135922 May 10 02:17:05.490305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 879/1701] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:05 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:05.505762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:05.511208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:05.533782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:05.535184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:05.542286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:05.542824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:05.564035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:05.579692 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d428b0f-334c-42ed-93f4-efd2d1a72683 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1321 microversion: 2.1 time: 0.748813 May 10 02:17:05.581636 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 823/1702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:04 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1321 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:05.592991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:05.593898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:05.611413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:05.617004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:05.618890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:05.620072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:05.664964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:17:05.936473 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a6f72d66-4d21-47ec-ae6b-c69e92890193 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 204 len: 0 microversion: 2.1 time: 0.444690 May 10 02:17:05.937770 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 880/1703] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:17:05 2022] DELETE /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:05.952850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:05.954170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:05.968726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:05.970796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:05.973127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:05.974890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:06.500973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:06.511356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:06.518026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:06.522255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4f82be73-c912-4a59-a31b-3e40d8f45737 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.581517 May 10 02:17:06.526731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 881/1704] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:05 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:06.535183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:06.544572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c56f189-bd1c-4cc7-a8e8-fa1be15b7906 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1198 microversion: 2.1 time: 0.961629 May 10 02:17:06.548466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:06.549080 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 824/1705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:05 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1198 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:06.551156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:06.565083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:06.569194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:06.569708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:06.577004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:06.578516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:06.583362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:06.596283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:06.597934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:06.600547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:06.601257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:06.981189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:07.006536 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9adc5979-8195-4b0f-b01b-f838f9f70ad3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1272 microversion: 2.1 time: 0.478243 May 10 02:17:07.012087 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 882/1706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:06 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1272 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:07.026030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9eb78c7d-5cba-444a-b015-356c57d66f9c req-2e798733-4de3-4afa-be3a-2b7fb9c6aef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9abf345-a804-4182-b3d9-629a74655e94", "name": "network-vif-unplugged", "status": "completed", "tag": "8482d275-6998-47a8-b8c1-d3cc029ed00f"}, {"server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "name": "network-vif-plugged", "status": "completed", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:07.061363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9eb78c7d-5cba-444a-b015-356c57d66f9c req-2e798733-4de3-4afa-be3a-2b7fb9c6aef3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:07.062268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9eb78c7d-5cba-444a-b015-356c57d66f9c req-2e798733-4de3-4afa-be3a-2b7fb9c6aef3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:07.095541 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9eb78c7d-5cba-444a-b015-356c57d66f9c req-2e798733-4de3-4afa-be3a-2b7fb9c6aef3 service nova] Creating event network-vif-unplugged:8482d275-6998-47a8-b8c1-d3cc029ed00f for instance e9abf345-a804-4182-b3d9-629a74655e94 on n-h2-841089-2 May 10 02:17:07.100923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9eb78c7d-5cba-444a-b015-356c57d66f9c req-2e798733-4de3-4afa-be3a-2b7fb9c6aef3 service nova] Creating event network-vif-plugged:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:17:07.121735 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9eb78c7d-5cba-444a-b015-356c57d66f9c req-2e798733-4de3-4afa-be3a-2b7fb9c6aef3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.106384 May 10 02:17:07.122945 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 883/1707] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:07.134168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-23219e3e-30d0-4545-ab9d-b41493f839ec req-30802526-8889-421f-845e-f45cb1f136bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed2100f-bdfb-43dc-8068-e25ab97b403f", "tag": "b9017b41-7fbf-47c4-ba08-e41b333dbb52"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:07.157320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-23219e3e-30d0-4545-ab9d-b41493f839ec req-30802526-8889-421f-845e-f45cb1f136bc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:07.158195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-23219e3e-30d0-4545-ab9d-b41493f839ec req-30802526-8889-421f-845e-f45cb1f136bc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:07.185434 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-23219e3e-30d0-4545-ab9d-b41493f839ec req-30802526-8889-421f-845e-f45cb1f136bc service nova] Creating event network-changed:b9017b41-7fbf-47c4-ba08-e41b333dbb52 for instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f on n-h1-841089-2 May 10 02:17:07.200986 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-23219e3e-30d0-4545-ab9d-b41493f839ec req-30802526-8889-421f-845e-f45cb1f136bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073047 May 10 02:17:07.203578 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 884/1708] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:07.215193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc9a77ae-1642-4600-a831-159bcf2fb01b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d371f5790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:07.324078 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc9a77ae-1642-4600-a831-159bcf2fb01b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.118788 May 10 02:17:07.327219 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 885/1709] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:07 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:07.336739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:07.348543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:07.354022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:07.360091 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f1794f1-f250-4611-85e4-3f525eda26a6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1491 microversion: 2.1 time: 0.809541 May 10 02:17:07.361034 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 825/1710] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:06 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1491 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:07.370039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:07.370648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:07.371690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:07.372250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:07.544144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:07.545572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:07.566912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:07.570214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:07.573600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:07.575395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:08.525488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:08.535856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:08.541488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:08.551352 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a24ab3dc-148f-421d-b4a4-18cb94bfd1ec tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 1.013259 May 10 02:17:08.563800 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 826/1711] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:07 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:08.571372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:08.574221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:08.588769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:08.591468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:08.592579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:08.593375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:08.640735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:08.650399 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b4f30d3-c8b6-44e1-92b3-9d8dd4d22933 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1321 microversion: 2.1 time: 1.319958 May 10 02:17:08.658681 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 886/1712] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:07 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1321 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:08.675816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:08.676845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:08.694688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:08.696669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:08.697795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:08.703736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:09.336658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:09.347379 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80787bf3-620d-4f86-90df-f235e8c3468e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1270 microversion: 2.1 time: 0.684823 May 10 02:17:09.352223 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 887/1713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:08 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1270 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:09.363247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19414856-88db-4163-a9d5-b50bf84c4c92 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37187310>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:09.437904 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19414856-88db-4163-a9d5-b50bf84c4c92 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.084007 May 10 02:17:09.438863 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 888/1714] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:09 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:09.443699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:09.447019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:09.459603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:09.460432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:09.462065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:09.468723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.208813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:10.221559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee73e78f-65ae-4cd6-b51c-7a59d185570f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1380 microversion: 2.1 time: 1.652364 May 10 02:17:10.222370 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 827/1715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:08 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1380 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:10.229811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f8fa9449-3e98-4a65-a184-d32de44bb7d5 req-01e7c7b5-7a2f-43d8-bf0d-3d06129ebaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "name": "network-vif-plugged", "status": "completed", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:10.258594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f8fa9449-3e98-4a65-a184-d32de44bb7d5 req-01e7c7b5-7a2f-43d8-bf0d-3d06129ebaf4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.262396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f8fa9449-3e98-4a65-a184-d32de44bb7d5 req-01e7c7b5-7a2f-43d8-bf0d-3d06129ebaf4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.283078 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f8fa9449-3e98-4a65-a184-d32de44bb7d5 req-01e7c7b5-7a2f-43d8-bf0d-3d06129ebaf4 service nova] Creating event network-vif-plugged:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:17:10.289642 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f8fa9449-3e98-4a65-a184-d32de44bb7d5 req-01e7c7b5-7a2f-43d8-bf0d-3d06129ebaf4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064471 May 10 02:17:10.290259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 828/1716] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:10.300443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d8c712b0-6112-40c0-a830-b8172df1901f req-83f66e18-8f9c-452c-911e-2d32194625f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe149f07-9f6d-4e73-b603-4ab1f3c25f3f", "tag": "5277daba-8e22-46ef-a059-b95c0b10c1f1"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:10.311724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d8c712b0-6112-40c0-a830-b8172df1901f req-83f66e18-8f9c-452c-911e-2d32194625f0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.313468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d8c712b0-6112-40c0-a830-b8172df1901f req-83f66e18-8f9c-452c-911e-2d32194625f0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.325650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:10.334494 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bda6dbad-bf4d-42b0-a359-6f472fa42ee3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1491 microversion: 2.1 time: 0.894343 May 10 02:17:10.350894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 889/1717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:09 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1491 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:10.351254 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d8c712b0-6112-40c0-a830-b8172df1901f req-83f66e18-8f9c-452c-911e-2d32194625f0 service nova] Creating event network-changed:5277daba-8e22-46ef-a059-b95c0b10c1f1 for instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f on n-h1-841089-2 May 10 02:17:10.357916 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d8c712b0-6112-40c0-a830-b8172df1901f req-83f66e18-8f9c-452c-911e-2d32194625f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061987 May 10 02:17:10.358744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 829/1718] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:10.364034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:10.364678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:10.366869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:10.369020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:10.376695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.377417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.378365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.378964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.384188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.385054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.386022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.386636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.724939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:10.752804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:10.756676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:10.759040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:10.763154 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef13cfa6-607a-496b-bf27-385ce1177a03 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.407521 May 10 02:17:10.765110 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3edb676e-24eb-40ba-b650-9f28aa557083 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1321 microversion: 2.1 time: 0.404306 May 10 02:17:10.775441 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 830/1720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:10 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:10.775629 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 890/1720] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:10 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:10.787907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:10.788652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:10.809235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.814120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:10.815410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:10.816102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.047752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:11.048505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:11.069257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.069795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.072562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.078267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.601724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:11.609597 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bcc5cc8e-13ca-4244-81bb-67c849aa7bed tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.832334 May 10 02:17:11.612631 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 831/1721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:10 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:11.617589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c8652c2-d621-457f-a9d9-77c625d8a001 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3717f310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:11.620592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52298810-efce-4e00-a722-1ae1ab6ae362 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1531 microversion: 2.1 time: 0.843283 May 10 02:17:11.622438 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 891/1722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:10 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1531 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:11.629597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2d6287a2-57ca-4b85-9dcf-59795b8ad92e req-95b0566f-41d7-4a2a-9ff8-b00cb81fd993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a780ec-ee5c-47ef-8d19-a3ea5b345af2", "tag": "0d9c374f-57d1-4bde-9cc6-0dab263a8a93"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:11.664731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2d6287a2-57ca-4b85-9dcf-59795b8ad92e req-95b0566f-41d7-4a2a-9ff8-b00cb81fd993 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.666513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2d6287a2-57ca-4b85-9dcf-59795b8ad92e req-95b0566f-41d7-4a2a-9ff8-b00cb81fd993 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.690408 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2d6287a2-57ca-4b85-9dcf-59795b8ad92e req-95b0566f-41d7-4a2a-9ff8-b00cb81fd993 service nova] Creating event network-changed:0d9c374f-57d1-4bde-9cc6-0dab263a8a93 for instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 on n-h1-841089-2 May 10 02:17:11.707379 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2d6287a2-57ca-4b85-9dcf-59795b8ad92e req-95b0566f-41d7-4a2a-9ff8-b00cb81fd993 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080746 May 10 02:17:11.712884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 892/1723] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:11.726193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c8652c2-d621-457f-a9d9-77c625d8a001 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.112263 May 10 02:17:11.726838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 832/1724] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:11 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:11.726955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:11.728003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:11.732351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:11.732980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:11.745882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.746344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.747178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.747665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.760353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.763994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.765127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.767557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.816771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:11.817297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:11.817700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lazy-loading 'fault' on Instance uuid 022bee10-c911-4367-97fb-620b97d46616 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:17:11.998944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:12.017695 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f85dbbda-6bae-4a9a-9228-2a4b4bd02464 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 200 len: 1304 microversion: 2.1 time: 0.301790 May 10 02:17:12.035197 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 893/1725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:11 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 1304 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:12.050930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:12.052429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:12.068280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.071272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.072862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.078682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.529729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:12.542745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:12.544508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:12.550859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb7d9103-3c90-4805-9f0a-c8062788eeb7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.513988 May 10 02:17:12.551589 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 894/1726] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:12 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:12.560261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:12.565852 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b25a29b3-81fd-44ed-8026-7fc5155ac69a tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1531 microversion: 2.1 time: 0.837937 May 10 02:17:12.569039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:12.569470 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 833/1727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:11 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1531 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:12.582439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.584220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22814752-0421-450d-ab21-00cc261adde6 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:12.585858 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:17:12.585858 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:17:12.586513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.587967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.588203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22814752-0421-450d-ab21-00cc261adde6 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.588850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22814752-0421-450d-ab21-00cc261adde6 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.589388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.590017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22814752-0421-450d-ab21-00cc261adde6 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.591602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22814752-0421-450d-ab21-00cc261adde6 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.661856 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-22814752-0421-450d-ab21-00cc261adde6 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.081680 May 10 02:17:12.671147 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 834/1728] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:17:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:12.676120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:12.694631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:12.708663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.709494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:12.710464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:12.711696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.403309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:13.428868 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e45a948-384c-4124-92fb-50bc1cd87563 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1321 microversion: 2.1 time: 0.875737 May 10 02:17:13.438134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 895/1729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:12 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:13.444617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-841089-2", "block_migration": false, "disk_over_commit": false}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:13.446487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:13.454063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.454516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.455349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.455796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.483012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:13.485833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lazy-loading 'flavor' on Instance uuid c903ce72-ce77-47a6-bf37-8712418785a7 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:17:13.500509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Going to try to live migrate instance to n-h1-841089-2 {{(pid=118716) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:17:13.501256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c1efab4a-6ab6-49fe-adbd-4ae843ea9426 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.827859 May 10 02:17:13.513185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 835/1730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:12 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:13.523149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cd062944-a93a-42be-abfc-c570edce1e69 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37e2fee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:13.584196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cd062944-a93a-42be-abfc-c570edce1e69 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.068602 May 10 02:17:13.601129 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 836/1731] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:13 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:13.610988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:13.612088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:13.671491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.672728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.673734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.676041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.707365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 HTTP/1.1 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '022bee10-c911-4367-97fb-620b97d46616'} May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:13.709208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a2c0cb5-42fc-4b92-b446-5ff49d15152c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 404 len: 111 microversion: 2.1 time: 0.107673 May 10 02:17:13.726855 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 837/1732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:13 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:17:13.737199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ce198adc-70ba-4662-9e2d-1438b554d952 req-2323b4c3-f741-43b7-93e5-8c629b625bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:13.761740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ce198adc-70ba-4662-9e2d-1438b554d952 req-2323b4c3-f741-43b7-93e5-8c629b625bd4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.762193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ce198adc-70ba-4662-9e2d-1438b554d952 req-2323b4c3-f741-43b7-93e5-8c629b625bd4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.799052 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ce198adc-70ba-4662-9e2d-1438b554d952 req-2323b4c3-f741-43b7-93e5-8c629b625bd4 service nova] Creating event network-changed:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h1-841089-2 May 10 02:17:13.804034 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ce198adc-70ba-4662-9e2d-1438b554d952 req-2323b4c3-f741-43b7-93e5-8c629b625bd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089969 May 10 02:17:13.804984 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 838/1733] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:13.811383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:13.812094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:13.818285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.818750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:13.819562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:13.820549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:14.017704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:14.038394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:14.039974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:14.041152 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e7a2d70-3160-4881-b328-16dfef4538a8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.235093 May 10 02:17:14.053306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 839/1734] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:13 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:14.065930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9ad722b6-bd85-46f4-9a91-079e1e8b251b req-4f5cb8a9-604e-462e-895a-5db6c7f3eff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022bee10-c911-4367-97fb-620b97d46616", "name": "network-vif-deleted", "tag": "2fe42b6b-9f4a-4d83-a67e-4de5c629da26"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:14.084284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9ad722b6-bd85-46f4-9a91-079e1e8b251b req-4f5cb8a9-604e-462e-895a-5db6c7f3eff0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:14.084727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9ad722b6-bd85-46f4-9a91-079e1e8b251b req-4f5cb8a9-604e-462e-895a-5db6c7f3eff0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:14.110561 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9ad722b6-bd85-46f4-9a91-079e1e8b251b req-4f5cb8a9-604e-462e-895a-5db6c7f3eff0 service nova] Creating event network-vif-deleted:2fe42b6b-9f4a-4d83-a67e-4de5c629da26 for instance 022bee10-c911-4367-97fb-620b97d46616 on n-h1-841089-2 May 10 02:17:14.128522 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9ad722b6-bd85-46f4-9a91-079e1e8b251b req-4f5cb8a9-604e-462e-895a-5db6c7f3eff0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073712 May 10 02:17:14.129127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 840/1735] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:14.135803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-476798708", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:14.239731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:17:14.768765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:17:14.769433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:17:14.769570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:17:14.770624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:17:14.771269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:17:14.783660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:14.784395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:14.785403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:14.786034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:14.816397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:17:14.821999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:17:14.836280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:17:14.838848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:17:14.901036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1475e827-202f-4244-9cf5-9860f072ef4f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770519 May 10 02:17:14.902700 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 841/1736] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:17:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:17:14.907520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f41ea874-542e-447d-9d47-d320e06f6c3b req-524792b6-6390-4a34-8565-b591545c6cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe149f07-9f6d-4e73-b603-4ab1f3c25f3f", "name": "network-vif-plugged", "status": "completed", "tag": "5277daba-8e22-46ef-a059-b95c0b10c1f1"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:14.916871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f41ea874-542e-447d-9d47-d320e06f6c3b req-524792b6-6390-4a34-8565-b591545c6cce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:14.917592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f41ea874-542e-447d-9d47-d320e06f6c3b req-524792b6-6390-4a34-8565-b591545c6cce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:14.929998 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f41ea874-542e-447d-9d47-d320e06f6c3b req-524792b6-6390-4a34-8565-b591545c6cce service nova] Creating event network-vif-plugged:5277daba-8e22-46ef-a059-b95c0b10c1f1 for instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f on n-h1-841089-2 May 10 02:17:14.957012 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f41ea874-542e-447d-9d47-d320e06f6c3b req-524792b6-6390-4a34-8565-b591545c6cce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052862 May 10 02:17:14.963901 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 842/1737] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:14.969140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:14.982539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:14.990284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Searching by: {'deleted': False, 'project_id': '0fae12a937d945878994de3ab3d90883'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:15.000364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.000827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.001859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.002604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.162603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:15.235468 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-09c5f4b7-2a55-40ba-888c-3a912b6b7315 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.270371 May 10 02:17:15.236473 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 843/1738] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:17:14 2022] GET /compute/v2.1/servers => generated 333 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:15.252824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:15.254560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:15.263905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.264623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.266305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.266997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.437569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:15.447996 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b75386af-8beb-4a81-9af5-ea58afeed280 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1321 microversion: 2.1 time: 0.210179 May 10 02:17:15.459834 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 844/1739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:15 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:15.466781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:15.467639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:15.476198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.477101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.478108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.478901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.690788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:15.699529 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a843774-6f2a-4da7-a801-697489a18a57 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.237314 May 10 02:17:15.700110 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 845/1740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:15 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:15.715998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c56c636-5c8c-410d-bef5-bf965e146819 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36fe49d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:15.805645 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c56c636-5c8c-410d-bef5-bf965e146819 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.103226 May 10 02:17:15.812958 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 846/1741] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:15 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:15.818354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:15.819340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:15.834543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.835400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:15.836453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:15.839814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:16.036320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:16.054045 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2651d10c-1485-46bd-82fb-3216ef1fef2f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1210 microversion: 2.1 time: 0.239664 May 10 02:17:16.055223 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 847/1742] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:15 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1210 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:16.068191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:16.068733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:16.084146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:16.084623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:16.085418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:16.085893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.070827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:17.081590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:17.083641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:17.085248 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb4c4e58-c2f3-487b-968c-014830d616a9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 1.029079 May 10 02:17:17.095924 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 848/1743] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:16 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:17.101638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:17.105351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:17.106518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Searching by: {'deleted': False, 'project_id': '0fae12a937d945878994de3ab3d90883'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:17.112531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.113403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.114456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.115184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.152442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:17.254732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:17.263774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.265076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.492255 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43700b12-bca3-4960-b167-5bff36d27a4b tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.394789 May 10 02:17:17.493165 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 849/1744] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:17:17 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:17.498016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:17.498846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:17.515397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.515676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.516354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.516807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.749883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:17.759082 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acca3d1f-2532-4ad2-b9e0-7d80775af468 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1321 microversion: 2.1 time: 0.264827 May 10 02:17:17.764821 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 850/1745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:17 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:17.773161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:17.776745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:17.790126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.791223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:17.792043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:17.792493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:18.662226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddf9e6df-ce62-44fd-9109-056a1ad67835 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7/action" status: 202 len: 0 microversion: 2.1 time: 5.231434 May 10 02:17:18.665572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 896/1746] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:17:13 2022] POST /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7/action => generated 0 bytes in 5235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:18.674195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ae8f5e4-96d7-4857-801e-de2442d181bd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d374c5f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:18.730321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:18.738501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-26f3ab83-be04-45f4-991a-10e1c591a9ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.972544 May 10 02:17:18.744247 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 851/1747] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:17 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:18.750944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:18.756775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:18.767648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ae8f5e4-96d7-4857-801e-de2442d181bd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.100696 May 10 02:17:18.768982 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 897/1748] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:18 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:18.769951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:18.771515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:18.777321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:18.778202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:18.791928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c222776f-4263-4ffa-9ad5-f27019047a4d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:18.813606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c222776f-4263-4ffa-9ad5-f27019047a4d tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040333 May 10 02:17:18.817176 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 898/1749] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:17:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:18.825219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:18.826421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:18.833828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:18.834550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:18.836370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:18.837234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:19.240354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:19.252630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:19.258769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:19.264517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc50610e-5638-49ef-8c89-95cc77105339 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.445924 May 10 02:17:19.265431 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 899/1750] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:18 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:19.274025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-37203fd2-d928-4ac3-a31d-72e92a7f87b1 req-37811473-7a74-48fe-922e-933ac28f7a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a780ec-ee5c-47ef-8d19-a3ea5b345af2", "name": "network-vif-plugged", "status": "completed", "tag": "0d9c374f-57d1-4bde-9cc6-0dab263a8a93"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:19.296377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-37203fd2-d928-4ac3-a31d-72e92a7f87b1 req-37811473-7a74-48fe-922e-933ac28f7a06 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:19.297270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-37203fd2-d928-4ac3-a31d-72e92a7f87b1 req-37811473-7a74-48fe-922e-933ac28f7a06 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:19.308556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:19.316883 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c1dba8dd-7e62-4301-9022-8e4100f9f530 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.571243 May 10 02:17:19.322979 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 852/1751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:18 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:19.337395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:19.340900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:19.343108 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-37203fd2-d928-4ac3-a31d-72e92a7f87b1 req-37811473-7a74-48fe-922e-933ac28f7a06 service nova] Creating event network-vif-plugged:0d9c374f-57d1-4bde-9cc6-0dab263a8a93 for instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 on n-h1-841089-2 May 10 02:17:19.356647 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-37203fd2-d928-4ac3-a31d-72e92a7f87b1 req-37811473-7a74-48fe-922e-933ac28f7a06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087358 May 10 02:17:19.361557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:19.362095 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 900/1752] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:19.365320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:19.369500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:19.370299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:19.375745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:19.385028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:19.402931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:19.409402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:19.411077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:19.413238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.020394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:20.032188 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af4e88c1-9588-4b27-a99a-5e02c3df1be2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.705893 May 10 02:17:20.033300 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 853/1753] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:19 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:20.038088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:20.038617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:20.047513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:20.056832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afbebc63-29ff-4f04-899c-b4bfd472cde3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1513 microversion: 2.1 time: 0.693230 May 10 02:17:20.058127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 901/1754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:19 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1513 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:20.069451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.070553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.071435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.071881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.081826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:20.082714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:20.091872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.092569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.093611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.094219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.141782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:17:20.368028 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa43d03a-242c-43bd-9677-058ff2312731 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 204 len: 0 microversion: 2.1 time: 0.332348 May 10 02:17:20.369856 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 854/1755] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:17:20 2022] DELETE /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:20.379965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c80116c8-e8c6-4122-8dee-df1aca189ff9 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37b9eee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:20.451389 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c80116c8-e8c6-4122-8dee-df1aca189ff9 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.079125 May 10 02:17:20.452300 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 855/1756] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:20 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:20.459734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:20.460856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:20.469534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.470245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.472206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.473059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.854314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:20.863768 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-768f4693-94a6-44ec-822d-2b636609144c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.804415 May 10 02:17:20.875318 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 902/1757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:20 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:20.881864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:20.882717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:20.890475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.892102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.893114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.893732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.934553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:20.943328 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56baf05e-6a4e-4606-8ac9-65cd8adf2b4e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1318 microversion: 2.1 time: 0.487289 May 10 02:17:20.944114 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 856/1758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:20 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:20.956430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:20.957599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:20.967134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.967599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:20.968508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:20.968951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:21.184750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:21.196838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:21.201716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:21.205436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f4ca38c-8539-41d7-99c7-24b2a74fd553 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.328713 May 10 02:17:21.206038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 903/1759] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:20 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:21.234634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:21.236127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:21.248699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:21.249325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:21.251544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:21.252354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:21.424872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:21.435406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-301729d6-6c16-495d-bb12-1694d5c09976 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.487517 May 10 02:17:21.440762 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 857/1760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:20 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:21.470074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:21.474567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:21.495360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:21.496577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:21.499147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:21.502773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:21.900688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:21.910210 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa03749a-09c4-4aac-a023-729d0c8271f7 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1701 microversion: 2.1 time: 0.701106 May 10 02:17:21.913412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 904/1761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:21 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1701 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:21.923244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7981a93c-a87a-496b-b3b9-07e2a42cbf95 req-a16811c2-4e1e-4236-80f3-7464608d192a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbaee6dd-516c-4d79-a64e-f315148ab080", "tag": "2b6e05e6-bd81-4a6b-a0b7-defb0654e450"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:21.942735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7981a93c-a87a-496b-b3b9-07e2a42cbf95 req-a16811c2-4e1e-4236-80f3-7464608d192a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:21.943257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7981a93c-a87a-496b-b3b9-07e2a42cbf95 req-a16811c2-4e1e-4236-80f3-7464608d192a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:21.971130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7981a93c-a87a-496b-b3b9-07e2a42cbf95 req-a16811c2-4e1e-4236-80f3-7464608d192a service nova] Creating event network-changed:2b6e05e6-bd81-4a6b-a0b7-defb0654e450 for instance dbaee6dd-516c-4d79-a64e-f315148ab080 on n-h2-841089-2 May 10 02:17:21.983047 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7981a93c-a87a-496b-b3b9-07e2a42cbf95 req-a16811c2-4e1e-4236-80f3-7464608d192a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066039 May 10 02:17:21.986401 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 905/1762] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:21.991462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af8c7ecb-5377-4425-8499-7b5849adb776 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37212040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:22.061181 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-af8c7ecb-5377-4425-8499-7b5849adb776 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.073473 May 10 02:17:22.067757 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 906/1763] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:21 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:22.076923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:22.088527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:22.090098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:22.090754 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e9dc0c2-db1a-48d4-8886-ff20f1f81e5f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.633114 May 10 02:17:22.093637 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 858/1764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:21 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:22.104428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.105940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:22.106758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:22.107436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.110480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.112200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.125270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.126030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.128770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.131167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.509318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:22.526705 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98b7ce12-a82a-4d9c-9fc4-4982d5473097 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1318 microversion: 2.1 time: 0.430226 May 10 02:17:22.527729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 859/1765] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:22 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:22.541877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:22.542520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:22.555288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.555753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.556576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.557018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.654991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:22.665737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-306e73db-5592-4953-bfc3-5116b12f2115 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.596227 May 10 02:17:22.668362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 907/1766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:22 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:22.677802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:22.696644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:22.707570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.708033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:22.712315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:22.713231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.063959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:23.074240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:23.077968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:23.081795 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ae59fea8-d655-4436-a1a1-782c1f4fb5c1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.551122 May 10 02:17:23.082953 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 860/1767] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:22 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:23.090706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:23.102094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:23.113816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.118737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.119879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.120542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.147422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:23.156872 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14334ac7-5326-4f67-b9a1-528d40d2ebd6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.486048 May 10 02:17:23.158018 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 908/1768] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:22 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:23.162718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3053e925-10c1-4167-ac3b-c7f7b4e40b39 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d36f5ec10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:23.236366 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3053e925-10c1-4167-ac3b-c7f7b4e40b39 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.076978 May 10 02:17:23.237586 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 909/1769] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:23 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:23.249688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:23.250724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:23.260846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.263524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.266087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.267812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.464532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838304e2f8bc4973a3fd7af06eed08d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fae12a937d945878994de3ab3d90883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:23.475213 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e0e9db6-06c1-41a6-8596-0a93b9edf1fd tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 200 len: 1701 microversion: 2.1 time: 0.385092 May 10 02:17:23.476034 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 861/1770] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:23 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 1701 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:23.484564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:23.493413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f7f1e2d-ebf6-4caa-8512-9ffbb75d4443 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.254400 May 10 02:17:23.495225 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 910/1771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:23 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:23.544275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:23.545821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:23.567597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.568781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.573639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.576085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.685315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:23.686739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:23.709459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.710880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:23.711948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:23.714038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:24.124460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:24.138744 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20d889a9-c7ec-4d9a-9403-0072cc29def3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1318 microversion: 2.1 time: 0.595149 May 10 02:17:24.139432 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 862/1772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:23 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:24.158482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:24.159143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:24.184275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:24.184737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:24.185530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:24.185972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:24.198295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:24.216720 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4986d8eb-8312-43a3-a5b4-4ddbcfec1524 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.533275 May 10 02:17:24.226913 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 911/1773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:23 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:24.227581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:24.237113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:24.260774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:24.261727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:24.264058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:24.274171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.121971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:25.131665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:25.139818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:25.141796 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d5ab528-0f7d-4a52-a46b-42c260b21f9d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 1.001341 May 10 02:17:25.157758 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 863/1774] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:24 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:25.179631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:25.185211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8e84cf33-6937-4bae-b9c0-d3bc9bdb278a req-88545424-7da7-4b23-b3ae-adc3f322b35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb155e6-b56b-4450-ac97-fe59725d517d", "name": "network-vif-deleted", "tag": "e61d2354-d8b5-4efa-9cab-546d491231ab"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:25.195663 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5885d9f7-6a40-4d5e-8b49-0ebf170b8502 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.972062 May 10 02:17:25.196270 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 912/1775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:24 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:25.210453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8e84cf33-6937-4bae-b9c0-d3bc9bdb278a req-88545424-7da7-4b23-b3ae-adc3f322b35f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.210922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8e84cf33-6937-4bae-b9c0-d3bc9bdb278a req-88545424-7da7-4b23-b3ae-adc3f322b35f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.220051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e894379-1d78-4169-ae15-1164e0ef761e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d371e5e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:25.293209 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8e84cf33-6937-4bae-b9c0-d3bc9bdb278a req-88545424-7da7-4b23-b3ae-adc3f322b35f service nova] Creating event network-vif-deleted:e61d2354-d8b5-4efa-9cab-546d491231ab for instance 1bb155e6-b56b-4450-ac97-fe59725d517d on n-h2-841089-2 May 10 02:17:25.309538 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e894379-1d78-4169-ae15-1164e0ef761e tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.112144 May 10 02:17:25.309793 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8e84cf33-6937-4bae-b9c0-d3bc9bdb278a req-88545424-7da7-4b23-b3ae-adc3f322b35f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150328 May 10 02:17:25.310928 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 913/1776] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:25 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:25.319593 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 864/1777] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:25.324148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:25.325887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] [instance: 1bb155e6-b56b-4450-ac97-fe59725d517d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:25.347994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:25.349346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.349593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:25.350185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.351801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.358544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.378948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.380954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.381779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.386887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.401828 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] HTTP exception thrown: Instance 1bb155e6-b56b-4450-ac97-fe59725d517d could not be found. May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Request method failure captured: May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d HTTP/1.1 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecrc-qOfEK7Ssh2p3d8fgmldBxWp2BzpL0JfFb0LWkuxjRmJGge-TAyABFc8dB4-ca9-d4RCi8LlEvQT4sUiDVgmTDOMQQaUhp1S4rXKZFqKP7XabRZFF7_xxGwHuyPAFpYeYV3yMv5vfF4tAdYljRDrHuIZf9XwjR9re1m1ei3sNgA May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 0fae12a937d945878994de3ab3d90883 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-720564452 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0fae12a937d945878994de3ab3d90883", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fae12a937d945878994de3ab3d90883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0fae12a937d945878994de3ab3d90883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0fae12a937d945878994de3ab3d90883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-720564452 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 0fae12a937d945878994de3ab3d90883 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-720564452 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-720564452-project May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 838304e2f8bc4973a3fd7af06eed08d5 May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-720564452-project May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1bb155e6-b56b-4450-ac97-fe59725d517d could not be found. May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1bb155e6-b56b-4450-ac97-fe59725d517d'} May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb155e6-b56b-4450-ac97-fe59725d517d could not be found. May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb155e6-b56b-4450-ac97-fe59725d517d could not be found. May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:25.416973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:25.421663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:25.421663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:25.421663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:25.421663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:25.421663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb155e6-b56b-4450-ac97-fe59725d517d could not be found. May 10 02:17:25.421663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:25.423845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Returning 404 to user: Instance 1bb155e6-b56b-4450-ac97-fe59725d517d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:25.425109 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-74d588ca-62f2-4570-beb0-1fd93d22ffd6 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d" status: 404 len: 111 microversion: 2.1 time: 0.112168 May 10 02:17:25.429843 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 914/1778] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:25 2022] GET /compute/v2.1/servers/1bb155e6-b56b-4450-ac97-fe59725d517d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:17:25.435856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:25.437560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:25.450101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.450966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.452034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.458807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.757965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:25.767737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ecc560e9-2380-4950-b42e-008b79da0bdd tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1318 microversion: 2.1 time: 0.336483 May 10 02:17:25.768572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 915/1779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:25 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:25.795027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:25.795739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:25.812613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.813810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.817400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:25.819059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:25.878579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:25.893204 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-feee4142-ed68-4367-904f-5384797bae60 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.569170 May 10 02:17:25.903780 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 865/1780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:25 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:25.914751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a01c0d52-6aeb-4c5b-93f6-2354c537e0c2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] Calling method '.version_select at 0x7f3d370b30d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:25.965351 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a01c0d52-6aeb-4c5b-93f6-2354c537e0c2 tempest-ServersTestJSON-720564452 tempest-ServersTestJSON-720564452-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721610165" status: 202 len: 0 microversion: 2.1 time: 0.065168 May 10 02:17:25.969450 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 866/1781] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:17:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721610165 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:26.113723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fa9dae8e-a2f0-4df3-88b2-f5aa2221596a req-ff8123af-0c62-4cc4-9169-71904f80fbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed2100f-bdfb-43dc-8068-e25ab97b403f", "name": "network-vif-plugged", "status": "completed", "tag": "b9017b41-7fbf-47c4-ba08-e41b333dbb52"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:26.135020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fa9dae8e-a2f0-4df3-88b2-f5aa2221596a req-ff8123af-0c62-4cc4-9169-71904f80fbf3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.135623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fa9dae8e-a2f0-4df3-88b2-f5aa2221596a req-ff8123af-0c62-4cc4-9169-71904f80fbf3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.167727 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fa9dae8e-a2f0-4df3-88b2-f5aa2221596a req-ff8123af-0c62-4cc4-9169-71904f80fbf3 service nova] Creating event network-vif-plugged:b9017b41-7fbf-47c4-ba08-e41b333dbb52 for instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f on n-h1-841089-2 May 10 02:17:26.176326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:26.183771 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fa9dae8e-a2f0-4df3-88b2-f5aa2221596a req-ff8123af-0c62-4cc4-9169-71904f80fbf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077206 May 10 02:17:26.184953 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 867/1782] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:17:26.188830 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-520c1a67-9f14-4879-a415-e68849cc7cec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.419405 May 10 02:17:26.192999 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 916/1783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:25 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:26.208135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:26.212512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:26.216427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:26.217430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:26.229726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.230086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.230703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.231533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.232977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.234514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.235018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.238693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.642109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:26.660351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:26.664779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:26.666157 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e8d50e24-c50e-4d57-b676-934220d1d459 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.479933 May 10 02:17:26.668914 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 868/1784] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:26 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:26.678711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:26.690883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34a1f748-7198-4846-940e-172f41cf96c9 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37131430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:26.698895 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16a5f0ae-ceac-41b2-8cc5-61a90f08b7fe tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.487646 May 10 02:17:26.701676 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 917/1785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:26 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:26.787294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:26.788123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:26.792119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34a1f748-7198-4846-940e-172f41cf96c9 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1452 microversion: 2.1 time: 0.122108 May 10 02:17:26.798003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.798003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.799823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.800282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.801321 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 869/1786] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:26 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:26.912679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:26.913869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:26.928164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.934242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:26.937780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:26.941792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.161069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:27.171690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2105fdf3-14d2-4e0c-9bc4-06bea11c3e47 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1318 microversion: 2.1 time: 0.386948 May 10 02:17:27.183670 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 918/1787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:26 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:27.213691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:27.215254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:27.238950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:27.240280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.242797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:27.243481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.320389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:27.332432 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0a5a84d-5203-44e2-a56b-240f13cd41ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.424807 May 10 02:17:27.334787 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 870/1788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:26 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:27.456741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:27.466662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2585dce8-6b3b-4bb8-8947-b45cad1b4580 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.258723 May 10 02:17:27.467890 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 919/1789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:27 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:27.684810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:27.685888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:27.703251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:27.703721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.705374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:27.705845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.718131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:27.718754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:27.736981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:27.737780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.739141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:27.739802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:27.990685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.029996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.045364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.048095 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-70925e6f-a3dd-41b0-a94a-b52ce490db0d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.367651 May 10 02:17:28.052942 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 871/1790] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:27 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:28.066561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-877db0c8-6065-4804-abb3-2a89318dd145 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37629ca0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.077653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.087614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7cf087e2-531e-4650-8eb0-a91cdc9708c8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.373522 May 10 02:17:28.088640 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 920/1791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:27 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:28.126739 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-877db0c8-6065-4804-abb3-2a89318dd145 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1461 microversion: 2.1 time: 0.070357 May 10 02:17:28.128149 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 872/1792] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1461 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:28.139555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fef31b92-536b-4069-8177-163a2cdd67a7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d370d0280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.196179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.197231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:28.217654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fef31b92-536b-4069-8177-163a2cdd67a7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 200 len: 1461 microversion: 2.1 time: 0.082223 May 10 02:17:28.218334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 921/1793] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:28.220433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.220433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.221210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.221653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.229917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.230539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:28.246499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.247610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.248647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.249373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.425622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.439599 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d2c3a264-886e-4435-b79f-50f610c72f68 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1509 microversion: 2.1 time: 0.251909 May 10 02:17:28.440894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 873/1794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:28.446455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9423faf1-39b6-43d3-9110-0309d9a75a37 req-224f1ade-de08-4636-b1a9-4c5fa5fb21cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "name": "network-vif-plugged", "status": "completed", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:28.456759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9423faf1-39b6-43d3-9110-0309d9a75a37 req-224f1ade-de08-4636-b1a9-4c5fa5fb21cd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.457282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9423faf1-39b6-43d3-9110-0309d9a75a37 req-224f1ade-de08-4636-b1a9-4c5fa5fb21cd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.457697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.466720 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb76e950-f75a-4164-9572-377a1d4300d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1466 microversion: 2.1 time: 0.241047 May 10 02:17:28.474637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9423faf1-39b6-43d3-9110-0309d9a75a37 req-224f1ade-de08-4636-b1a9-4c5fa5fb21cd service nova] Creating event network-vif-plugged:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h1-841089-2 May 10 02:17:28.479669 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 922/1795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1466 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:28.483715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9423faf1-39b6-43d3-9110-0309d9a75a37 req-224f1ade-de08-4636-b1a9-4c5fa5fb21cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040718 May 10 02:17:28.485778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.487563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:28.487707 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 874/1796] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:28.494353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.494713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.495079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:28.495551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.496518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.497120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.501687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.502639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.503867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.504973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.806513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.814674 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ca28411f-7687-40e1-9df8-771853cb86d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.333428 May 10 02:17:28.831025 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 923/1797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:28.839450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:28.840243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:28.850600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.851416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.852611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:28.853535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:28.878881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:28.888220 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-800909fa-26bb-460b-bd2b-02e6c4d89589 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2" status: 200 len: 1512 microversion: 2.1 time: 0.399366 May 10 02:17:28.889013 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 875/1798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:28.893569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f38b2cf-afac-4f1a-8a7a-ac68d22ec0ab tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37880700>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.012179 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f38b2cf-afac-4f1a-8a7a-ac68d22ec0ab tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?changes-since=2022-05-10T02%3A15%3A26Z" status: 200 len: 1903 microversion: 2.1 time: 0.121907 May 10 02:17:29.013428 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 876/1799] 10.222.0.52 () {58 vars in 1198 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/images?changes-since=2022-05-10T02%3A15%3A26Z => generated 1903 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:29.018415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.023225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.024081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:29.038767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.039280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.040171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.040614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.076118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.093510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa1be681-85e9-44d3-94ec-b7f9fef8d83e tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.258233 May 10 02:17:29.095903 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 924/1800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:28 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:29.108930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-beb81820-6416-4b6b-bf86-be4d46d203cc tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37840a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.173750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:29.253804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-beb81820-6416-4b6b-bf86-be4d46d203cc tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-214872228" status: 200 len: 484 microversion: 2.1 time: 0.156323 May 10 02:17:29.254389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 925/1801] 10.222.0.52 () {58 vars in 1228 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-214872228 => generated 484 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:29.270591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.272350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:29.287586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.290391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.292632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.293126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.319349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.335728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.336372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.539367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa796328-9279-4dc6-8ca1-c4578b9b0de0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.524004 May 10 02:17:29.540349 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 877/1802] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:29.545160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.545783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:29.558580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.562666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.563967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.565600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.581894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.595256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.602430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.605477 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b681517a-872b-48d3-9b67-34128b868461 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.348042 May 10 02:17:29.608297 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 926/1803] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:29.618541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af161209-c6d3-448f-b07b-8b217fd6ec30 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d378409d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.745110 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-af161209-c6d3-448f-b07b-8b217fd6ec30 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?server=9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 957 microversion: 2.1 time: 0.135414 May 10 02:17:29.745713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 927/1804] 10.222.0.52 () {58 vars in 1208 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/images?server=9434c01b-1f40-4741-af78-75d469874c9e => generated 957 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:29.752658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.770873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.771704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-5846648', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:29.785242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.785707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.786524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.786976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.832411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:29.843416 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40271af6-1c87-47d7-8831-6420a587fead tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.301657 May 10 02:17:29.844702 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 878/1805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:29.850019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-99e0a7e5-6b9d-499d-a1d2-00ede624ed85 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37014ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.917896 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-99e0a7e5-6b9d-499d-a1d2-00ede624ed85 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 485 microversion: 2.1 time: 0.071365 May 10 02:17:29.919239 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 879/1806] 10.222.0.52 () {58 vars in 1316 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94 => generated 485 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:29.924602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:29.925777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:29.934717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.936097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:29.937549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:29.938332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.075106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:30.156517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:30.166309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d001179-5ced-4864-90c6-5504528c38df tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.245568 May 10 02:17:30.167246 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 880/1807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:30.172124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ca23206-a11d-4bfa-8050-5dd00013fd8b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d379b6790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:30.243367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:30.251954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.253565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.268881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ca23206-a11d-4bfa-8050-5dd00013fd8b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 485 microversion: 2.1 time: 0.100373 May 10 02:17:30.270104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 881/1808] 10.222.0.52 () {58 vars in 1302 bytes} [Tue May 10 02:17:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94 => generated 485 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:30.285854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:30.288294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:30.309694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.310536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.311667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.312361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.544992 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e951cd15-2236-43d3-8c1d-5511301ab790 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-5846648" status: 200 len: 1512 microversion: 2.1 time: 0.798068 May 10 02:17:30.545761 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 928/1809] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 02:17:29 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-5846648 => generated 1512 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:30.545761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43e11e4f-7dcc-4e5b-94ff-6a20f4ecd661 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d370d0ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:30.563367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:30.571035 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b724c23e-178c-483c-b017-d2bb100482cf tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1312 microversion: 2.1 time: 0.299858 May 10 02:17:30.585502 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 882/1810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:30 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:30.594755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1949374d-009f-4381-a4bc-bee31c1a9548 req-6e7ac034-1454-4d01-b9a2-8e68da0be769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbaee6dd-516c-4d79-a64e-f315148ab080", "name": "network-vif-plugged", "status": "completed", "tag": "2b6e05e6-bd81-4a6b-a0b7-defb0654e450"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:30.612326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1949374d-009f-4381-a4bc-bee31c1a9548 req-6e7ac034-1454-4d01-b9a2-8e68da0be769 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.615821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1949374d-009f-4381-a4bc-bee31c1a9548 req-6e7ac034-1454-4d01-b9a2-8e68da0be769 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.640262 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1949374d-009f-4381-a4bc-bee31c1a9548 req-6e7ac034-1454-4d01-b9a2-8e68da0be769 service nova] Creating event network-vif-plugged:2b6e05e6-bd81-4a6b-a0b7-defb0654e450 for instance dbaee6dd-516c-4d79-a64e-f315148ab080 on n-h2-841089-2 May 10 02:17:30.649305 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1949374d-009f-4381-a4bc-bee31c1a9548 req-6e7ac034-1454-4d01-b9a2-8e68da0be769 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058010 May 10 02:17:30.664205 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 883/1811] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:30.764815 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43e11e4f-7dcc-4e5b-94ff-6a20f4ecd661 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.208672 May 10 02:17:30.766516 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 929/1812] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:17:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:30.783098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:30.807551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:30.809129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:30.817194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.817665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.818496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.818949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.932400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "486c665a-c4e4-4fba-8d6e-5b55f2ae5547"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:30.933555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:30.952791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.953263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.954068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:30.954857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:30.973215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:31.080915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.090543 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] HTTP exception thrown: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. May 10 02:17:31.091334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.091818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Request method failure captured: May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: request: PUT /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/2a317fae-7590-4e56-b1ee-ad6aac59855b HTTP/1.1 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 74 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecr8JGVMHh9HseC7IhTXkynENNGpeqKF1hcYVQ0D_JhkPE0GfgEa3nEMj28t8wiP38OjSKPvAi8Q_qLNvIizSHAd3zvuuIaQp2iSrHdiaO30nsHS4TbzgAC8BcyV5feYRvilFYiCJk3gvXmq16hiFr7KikY5o4Hr9EnTh-GSq5vhWjY May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ddf69af366a94465afaabaec20b37f92 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesAdminNegativeTest-39409459 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ddf69af366a94465afaabaec20b37f92", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ddf69af366a94465afaabaec20b37f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ddf69af366a94465afaabaec20b37f92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ddf69af366a94465afaabaec20b37f92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesAdminNegativeTest-39409459 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ddf69af366a94465afaabaec20b37f92 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-39409459 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesAdminNegativeTest-39409459-project-admin May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 12ce5eaca9cc4023a2c110065ea86c15 May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesAdminNegativeTest-39409459-project-admin May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: {"volumeAttachment": {"volumeId": "486c665a-c4e4-4fba-8d6e-5b55f2ae5547"}} May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: exception: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '012100fc-18a3-4765-8725-adadb1fd6e30', 'id': '2a317fae-7590-4e56-b1ee-ad6aac59855b', 'body': {'volumeAttachment': {'volumeId': '486c665a-c4e4-4fba-8d6e-5b55f2ae5547'}}} May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. (HTTP 404) (Request-ID: req-715bd989-11af-468c-bf8e-e21f537090d2) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:17:31.107115 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. May 10 02:17:31.112805 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:31.118052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Returning 400 to user: Volume 486c665a-c4e4-4fba-8d6e-5b55f2ae5547 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:31.119167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e300a23f-df14-4917-93e7-9ac65f9ee5d2 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/2a317fae-7590-4e56-b1ee-ad6aac59855b" status: 400 len: 107 microversion: 2.1 time: 0.453146 May 10 02:17:31.123218 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 884/1813] 10.222.0.52 () {60 vars in 1432 bytes} [Tue May 10 02:17:30 2022] PUT /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/2a317fae-7590-4e56-b1ee-ad6aac59855b => generated 107 bytes in 455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:17:31.124741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:31.125444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:31.138104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.140064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.140413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.140926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.440451 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99a54052-9e44-45fb-8c6a-948945f76d42 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.672738 May 10 02:17:31.441780 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 930/1814] 10.222.0.52 () {58 vars in 1172 bytes} [Tue May 10 02:17:30 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:31.450227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-616883cc-ce40-406f-9f73-fd5535aa1ddd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37840040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:31.492839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.507720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.510257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.511566 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afd5c14c-3a21-436b-8b6e-fe8ae05ec9b3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.390605 May 10 02:17:31.514026 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 885/1815] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:31 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:31.519392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:31.520253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:31.528326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.528941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.529731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.530348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.553227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-616883cc-ce40-406f-9f73-fd5535aa1ddd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.108779 May 10 02:17:31.556695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 931/1816] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:17:31 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:31.566895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:31.568497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:31.576916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.577698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.578792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.579506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.948699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.956934 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51715d8f-bf19-428e-ba51-20e541d52606 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.398731 May 10 02:17:31.959587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.969679 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 932/1817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:31 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:31.973990 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56eb69a9-09ad-460e-9eaa-10733631f274 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1314 microversion: 2.1 time: 0.458696 May 10 02:17:31.974780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:31.980780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:31.982856 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 886/1818] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:31 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:31.988406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:31.989822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.990287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.993281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:31.993981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:31.994664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:31.995469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.servers [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Removing options 'limit' from query {{(pid=118717) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 10 02:17:31.996562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:32.003234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.003737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.004730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.005250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.045592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:32.053639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.054010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.144279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lazy-loading 'services' on Instance uuid 012100fc-18a3-4765-8725-adadb1fd6e30 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:17:32.306671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e4424b2-31da-4337-a040-00e075090f71 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.321937 May 10 02:17:32.307787 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 887/1819] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 02:17:31 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:32.314560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dac93cd-f6ca-443d-9526-91e6db8afdd0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37131790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.339267 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3d57527c-aa31-4769-a8d1-cd51b304cc4f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "DELETE /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/2a317fae-7590-4e56-b1ee-ad6aac59855b" status: 202 len: 0 microversion: 2.1 time: 0.368194 May 10 02:17:32.340199 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 933/1820] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:17:31 2022] DELETE /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/2a317fae-7590-4e56-b1ee-ad6aac59855b => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:32.358277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.359008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:32.366627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.367458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.368495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.379774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.508251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dac93cd-f6ca-443d-9526-91e6db8afdd0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.197488 May 10 02:17:32.509210 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 888/1821] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:32.519561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.530446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:32.531498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:32.549405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.549888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.550702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.551573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.666513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:32.741693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5baf3099-e50e-4c46-9d1c-58ab00ba69b3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.230648 May 10 02:17:32.743435 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 889/1822] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:32.749928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.750979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:32.758610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.759144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.759967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.760636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.760818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:32.776350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4102a18e-c17f-418d-b05e-dfd19a2dee68 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1461 microversion: 2.1 time: 0.434612 May 10 02:17:32.777908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 934/1823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1461 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:32.789092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-071ff653-c715-4dac-931a-8c8b3d5b3759 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d372b3c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.805055 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ccdb13ea-f635-45af-a4e2-2f76ecb686a8 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059403 May 10 02:17:32.806087 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 890/1824] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:32.811379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.815278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:32.822641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.822641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.822641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.822641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.899518 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-071ff653-c715-4dac-931a-8c8b3d5b3759 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?changes-since=2022-05-10T02%3A15%3A21Z" status: 200 len: 6327 microversion: 2.1 time: 0.118659 May 10 02:17:32.908201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 935/1825] 10.222.0.52 () {58 vars in 1219 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-10T02%3A15%3A21Z => generated 6327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:32.919327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:32.922782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:32.923259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.servers [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Removing options 'limit' from query {{(pid=118716) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 10 02:17:32.924209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:32.938595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.939377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:32.940534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:32.942484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.122377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.143407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.145888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.151462 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c65a4a5-727b-4920-966c-e2d416106315 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.343630 May 10 02:17:33.154445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 891/1826] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:33.156654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:33.160950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:33.167742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:33.176158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.176615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.177597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.178214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.279748 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf17e91a-a428-45e5-b4db-e6208052568c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.367411 May 10 02:17:33.280728 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 936/1827] 10.222.0.52 () {58 vars in 1149 bytes} [Tue May 10 02:17:32 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:33.291651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12d2b001-1dff-4500-ae7d-3c2a2e9c938c tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d371f5a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:33.330586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3cbea72-2bd5-4582-830f-a5c73972ae05 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1612 microversion: 2.1 time: 0.173499 May 10 02:17:33.331986 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 892/1828] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:33 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1612 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:33.337227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:33.338048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:33.344602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.345070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.346088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.346710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.358504 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12d2b001-1dff-4500-ae7d-3c2a2e9c938c tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-214872228" status: 200 len: 664 microversion: 2.1 time: 0.076388 May 10 02:17:33.367128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 937/1829] 10.222.0.52 () {58 vars in 1249 bytes} [Tue May 10 02:17:33 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-214872228 => generated 664 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:33.373239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:33.374133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:33.382248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.383213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.384124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.384643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.552011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.559957 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b71ef049-d35b-44db-b6d0-38ad038ba5ab tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.226975 May 10 02:17:33.570578 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 893/1830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:33 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:33.576865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0e031c78-85fd-4169-80eb-75063b8dff90 req-3cad4052-4ab0-4e70-a6d5-290e06c90f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:33.585911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0e031c78-85fd-4169-80eb-75063b8dff90 req-3cad4052-4ab0-4e70-a6d5-290e06c90f1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.586573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0e031c78-85fd-4169-80eb-75063b8dff90 req-3cad4052-4ab0-4e70-a6d5-290e06c90f1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.598571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0e031c78-85fd-4169-80eb-75063b8dff90 req-3cad4052-4ab0-4e70-a6d5-290e06c90f1f service nova] Creating event network-vif-unplugged:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:17:33.603312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.605083 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0e031c78-85fd-4169-80eb-75063b8dff90 req-3cad4052-4ab0-4e70-a6d5-290e06c90f1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032729 May 10 02:17:33.606703 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 894/1831] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:33.613149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:33.614105 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d8b62671-f5e8-4f78-83e8-1fb44e1e0889 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1500 microversion: 2.1 time: 0.244944 May 10 02:17:33.624219 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 938/1832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:33 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:33.624219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:33.624219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:33.628112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.628656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.628799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.629720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:33.630112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.630668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.636738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.637414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.638555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.639201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.673174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:33.711775 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b664dd5f-0931-4e51-8e0d-4f293e6e2c56 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.103573 May 10 02:17:33.712359 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 895/1833] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:17:33 2022] GET /compute/v2.1/servers => generated 1009 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:33.717015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4806dc88-a53e-410e-9c2e-30fe355ab26f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3761c820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:33.719313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fd929eec704e4295be1a82ed7f54deae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc78bfaf22d48cda331932f097f8b85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:33.720042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] flavor_id is None. Assuming migration. {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4142}} May 10 02:17:33.720866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 02:17:33.777375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4806dc88-a53e-410e-9c2e-30fe355ab26f tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1465 microversion: 2.1 time: 0.063822 May 10 02:17:33.778388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 896/1834] 10.222.0.52 () {58 vars in 1337 bytes} [Tue May 10 02:17:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94 => generated 1465 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:33.787455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:33.788442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:33.797814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.798374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.799429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:33.800594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:33.828262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lazy-loading 'flavor' on Instance uuid dbaee6dd-516c-4d79-a64e-f315148ab080 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:17:34.201958 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9cd26f81-3468-4b5f-aafb-dadc052168e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080/action" status: 202 len: 0 microversion: 2.1 time: 0.421691 May 10 02:17:34.206364 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 897/1835] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:17:33 2022] POST /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:34.210540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.215004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:34.215822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:34.230739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.231777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.233334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.233509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.253209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9901f3ca-1eea-4116-a530-e5b9fbde519e tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17/action" status: 202 len: 0 microversion: 2.1 time: 0.636628 May 10 02:17:34.253844 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 939/1836] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:17:33 2022] POST /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:34.262227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56c9d36b-c6a9-41a7-b036-03ce72ab6bc0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3796d940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.340467 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56c9d36b-c6a9-41a7-b036-03ce72ab6bc0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1465 microversion: 2.1 time: 0.085331 May 10 02:17:34.344910 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 940/1837] 10.222.0.52 () {58 vars in 1323 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fe9abf345-a804-4182-b3d9-629a74655e94 => generated 1465 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:34.356765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.362012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:34.364433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:34.374694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.375860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.378234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.379543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.427282 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-670d90de-f85e-4d41-a68e-c8f2af31f8cd tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080861 May 10 02:17:34.432564 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 941/1838] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:34.437865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.438702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:34.445253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.445805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.446735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.447308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.496624 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00711e45-ee57-4a6d-81a7-a9c0e97c96da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.292027 May 10 02:17:34.519739 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 898/1839] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:34.527498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.528253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:34.545142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.545618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.546422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.546872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.708091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:34.728208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:34.730303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:34.731923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f1bfceec-e0c8-406d-b2ba-fc33860fd0d0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.298093 May 10 02:17:34.733023 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 942/1840] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:34.738758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.739729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:34.747308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.748175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.749906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:34.750580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:34.799483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:34.814091 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-528d5cb5-1be9-42f8-97ae-9b97e35519bd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.290518 May 10 02:17:34.814091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 899/1841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:34.830223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c59bc80a-10d4-4503-ac9f-277d290c6227 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d374615e0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:34.984941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:34.992586 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-84e33c1f-72db-4971-b738-ea219d500cc4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1470 microversion: 2.1 time: 0.257938 May 10 02:17:35.003409 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 943/1842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:35.008736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.012262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:35.012721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.servers [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Removing options 'limit' from query {{(pid=118716) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 10 02:17:35.013357 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c59bc80a-10d4-4503-ac9f-277d290c6227 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.197755 May 10 02:17:35.013505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:35.013997 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 900/1843] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:17:34 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:35.019181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.019650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.020466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.020915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.021029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.021674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:35.042048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.042311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.043319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.043929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.066395 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9ce25d1-302c-4da7-8bb8-982e669e5a5c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.061834 May 10 02:17:35.066994 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 944/1844] 10.222.0.52 () {58 vars in 1139 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:35.074018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7cee93a3-00c2-49d9-bc8d-d98f479470bc tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3798d940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.164866 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7cee93a3-00c2-49d9-bc8d-d98f479470bc tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.096604 May 10 02:17:35.165464 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 945/1845] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:35.174132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.175553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:35.176951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-5846648', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:17:35.184480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.185041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.185972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.186557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.284729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:17:35.365099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:35.387622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59894696-7a6a-4af8-af44-dfaa665dabe7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.368939 May 10 02:17:35.388464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 901/1846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:35.393080 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57f2b6d3-59cc-41d6-b6cd-34f7a7959a40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-5846648" status: 200 len: 343 microversion: 2.1 time: 0.226223 May 10 02:17:35.393944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 946/1847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-5846648 => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:35.396732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a087ba16-ac17-422d-9877-834de0e3de92 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d37e2f940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.414826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7d8be1e-3ab6-4ee7-887a-0a140579f5e4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:35.424625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7d8be1e-3ab6-4ee7-887a-0a140579f5e4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.425549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7d8be1e-3ab6-4ee7-887a-0a140579f5e4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.469851 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a087ba16-ac17-422d-9877-834de0e3de92 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/193324a5-9e6a-4320-a184-bbef949b550f" status: 200 len: 784 microversion: 2.1 time: 0.080020 May 10 02:17:35.470762 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 902/1848] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/images/193324a5-9e6a-4320-a184-bbef949b550f => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:35.476928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.481122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:35.491695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.492459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.496081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.497052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.543783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3fc57124-8d6d-4002-9a20-8567b43ba957 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071629 May 10 02:17:35.548092 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 903/1849] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:35.557729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f7d8be1e-3ab6-4ee7-887a-0a140579f5e4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Going to try to stop instance {{(pid=118716) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:17:35.559267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf4340ab-a752-4bdf-aef5-9db81833f77c tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d375a1af0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.618644 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7d8be1e-3ab6-4ee7-887a-0a140579f5e4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "POST /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f/action" status: 202 len: 0 microversion: 2.1 time: 0.210556 May 10 02:17:35.619837 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 947/1850] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:17:35 2022] POST /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:17:35.625517 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf4340ab-a752-4bdf-aef5-9db81833f77c tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.073715 May 10 02:17:35.626510 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 904/1851] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:35.634386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.640325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a44315c-58b3-4e73-851d-67b351aec20b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d379e5b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.642770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:35.649195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.649862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.650653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.651700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.908388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:35.921022 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae54202d-3a9c-420b-bc50-dd914b9a3ab0 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.288568 May 10 02:17:35.922744 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 948/1852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:35.929026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:35.929816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:35.937954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.938422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:35.939866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:35.940314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.115730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:36.125563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:36.127246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:36.128795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-77372bf9-e02a-407b-bbf3-14bb54215f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.205002 May 10 02:17:36.133055 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 949/1853] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:35 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:36.138025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:36.146783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:36.153979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:36.154465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.155291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:36.155739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.398811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:36.409007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71de06de-fb50-4e00-81bb-d1b05444d62b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.274783 May 10 02:17:36.409606 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 950/1854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:36 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:36.463094 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a44315c-58b3-4e73-851d-67b351aec20b tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b" status: 204 len: 0 microversion: 2.1 time: 0.826700 May 10 02:17:36.463897 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 905/1855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:35 2022] DELETE /compute/v2.1/images/30dcb9e6-b087-42df-8dd5-f2437e592e4b => generated 0 bytes in 828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:36.469744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:36.470599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:36.477921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:36.478646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.479673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:36.480110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.576780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8927cfc7-cd14-4275-98b8-fe9123f67203 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Action: 'create', calling method: .version_select at 0x7f3d374ec700>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:36.595495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8927cfc7-cd14-4275-98b8-fe9123f67203 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Getting quotas for project 15550188c81246f498bdefede48197c7. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:17:36.604767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8927cfc7-cd14-4275-98b8-fe9123f67203 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Getting quotas for user 85c48bbdc01347848b30d375d178eafb and project 15550188c81246f498bdefede48197c7. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:17:36.668018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8927cfc7-cd14-4275-98b8-fe9123f67203 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Getting quotas for project 15550188c81246f498bdefede48197c7. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:17:36.674611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8927cfc7-cd14-4275-98b8-fe9123f67203 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Getting quotas for user 85c48bbdc01347848b30d375d178eafb and project 15550188c81246f498bdefede48197c7. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:17:36.704388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8927cfc7-cd14-4275-98b8-fe9123f67203 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.293437 May 10 02:17:36.707594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 951/1856] 10.222.0.52 () {62 vars in 1213 bytes} [Tue May 10 02:17:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:17:36.722329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:36.725327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:36.744329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:36.745304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.746120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:36.746581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:36.772663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:36.784793 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8226d0ed-5202-4a7a-8fad-8a92a8ea48b3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1470 microversion: 2.1 time: 0.317302 May 10 02:17:36.787673 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 906/1857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:36 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:36.800118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2436c0a-e9bf-43d3-865b-53726b3298c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d375a1550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.144092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:37.163739 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3a7cd06-4cdd-4223-94a0-2437e53e2005 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.452246 May 10 02:17:37.165967 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 952/1858] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:36 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:37.172888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.176022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:37.184150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.184863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.185982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.188193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.238672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-486cb48a-103e-4bab-b22d-244b5d2c8865 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069332 May 10 02:17:37.239290 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 953/1859] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:37 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:37.244907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09ff430b-6797-44b2-a344-2524a33add2d tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.270483 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09ff430b-6797-44b2-a344-2524a33add2d tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.029888 May 10 02:17:37.276757 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 954/1860] 10.222.0.52 () {60 vars in 1192 bytes} [Tue May 10 02:17:37 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:17:37.280555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.282759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:37.291454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.291999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.293499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.294402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.339741 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a2436c0a-e9bf-43d3-865b-53726b3298c7 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a" status: 204 len: 0 microversion: 2.1 time: 0.550534 May 10 02:17:37.340352 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 907/1861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:36 2022] DELETE /compute/v2.1/images/c9ca03bd-43ac-4c25-b840-5f4ac6993b9a => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:37.348425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-60c781f0-6b24-4a82-9d5e-24b9ec0173ba req-f44a64f3-a5b4-4974-b70b-122ca2123db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ad69c-a8de-4eba-ae8a-15cabb868a48", "name": "network-vif-unplugged", "status": "completed", "tag": "47f1f980-2bd4-4fa7-875b-5b3c3da7445f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:37.358952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-60c781f0-6b24-4a82-9d5e-24b9ec0173ba req-f44a64f3-a5b4-4974-b70b-122ca2123db4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.359666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-60c781f0-6b24-4a82-9d5e-24b9ec0173ba req-f44a64f3-a5b4-4974-b70b-122ca2123db4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.373132 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-60c781f0-6b24-4a82-9d5e-24b9ec0173ba req-f44a64f3-a5b4-4974-b70b-122ca2123db4 service nova] Creating event network-vif-unplugged:47f1f980-2bd4-4fa7-875b-5b3c3da7445f for instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 on n-h1-841089-2 May 10 02:17:37.379738 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-60c781f0-6b24-4a82-9d5e-24b9ec0173ba req-f44a64f3-a5b4-4974-b70b-122ca2123db4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037679 May 10 02:17:37.380676 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 908/1862] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:37.387944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.389080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:37.397933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.398681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.399988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.400745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.881250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:37.887141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:37.890017 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ccc60e80-9e0d-4709-a550-7c7d863447fe tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.615415 May 10 02:17:37.891264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 955/1863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:37 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:37.897162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2548fc8b-1ef4-4511-9ae6-b256a475d313 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.898287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:37.900768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:37.902630 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5ecc1fe-968d-4700-a416-4e4e4722f23f tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.519959 May 10 02:17:37.915255 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 909/1864] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:37 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:37.917067 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2548fc8b-1ef4-4511-9ae6-b256a475d313 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e" status: 200 len: 235 microversion: 2.64 time: 0.024675 May 10 02:17:37.917939 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 956/1865] 10.222.0.52 () {60 vars in 1303 bytes} [Tue May 10 02:17:37 2022] GET /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e => generated 235 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:17:37.920983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08a8047b-157e-469e-bbec-5a2ec01fe9f5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d374fa1f0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.923305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:37.923983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:37.931581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.932044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:37.932895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:37.933345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.242852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:38.267084 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e32b1a0-c6b9-4d71-b201-b80fb12723e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.347644 May 10 02:17:38.284319 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 957/1866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:37 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:38.291543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.292297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:38.299783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.301256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.303725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.305379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.436150 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08a8047b-157e-469e-bbec-5a2ec01fe9f5 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c" status: 204 len: 0 microversion: 2.1 time: 0.519426 May 10 02:17:38.436731 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 910/1867] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:37 2022] DELETE /compute/v2.1/images/b32b9b5b-e1ad-419a-ab72-9bad30a8520c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:38.445392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0671e1f7-db54-4dd5-8c69-f727b752ce5e tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.503738 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0671e1f7-db54-4dd5-8c69-f727b752ce5e tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e" status: 204 len: 0 microversion: 2.64 time: 0.062347 May 10 02:17:38.506181 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 911/1868] 10.222.0.52 () {60 vars in 1306 bytes} [Tue May 10 02:17:38 2022] DELETE /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:17:38.515228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.516601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:38.525529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.526834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.527976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.529222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.551575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:38.560262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ced77807-9dd8-4e35-895b-77877b367928 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1470 microversion: 2.1 time: 0.274292 May 10 02:17:38.561097 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 958/1869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:38 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1470 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:38.566078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.567681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:38.582035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.582739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.584293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.585559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.639610 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-070349ca-871c-4f33-81b7-2121c4e8f358 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075433 May 10 02:17:38.642192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 959/1870] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:38 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:38.650525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.651958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:38.659480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.660018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.660884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.661401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.697830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:17:38.723998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:38.731881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9a7a018b-0533-4eec-8611-9e0f53ec0e3f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.221677 May 10 02:17:38.733030 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 912/1871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:38 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:38.738583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36ade120-da2d-4893-b630-09fccd736308 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.744484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-36ade120-da2d-4893-b630-09fccd736308 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] HTTP exception thrown: Instance group fa85cd91-66f6-4661-b693-a13ab397d31e could not be found. May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36ade120-da2d-4893-b630-09fccd736308 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Request method failure captured: May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e HTTP/1.1 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecs_KosiXYjWGEEQ3q3L0g8k7JDo19b1jhhBfcKJru_fzCaR7CMGIRAejb7dsulkeE2gZuY8QArG7fiIcyzu1aGCMlDTERHY5MtILiwWtSgjbfnGKsP8BXmNwzTALT8EmqPfkcuRfn73Ix7iETjbCiqoEexN99gAw-JVZGgLQCxv6tk May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.64 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 15550188c81246f498bdefede48197c7 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerGroup264TestJSON-416877151 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15550188c81246f498bdefede48197c7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15550188c81246f498bdefede48197c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15550188c81246f498bdefede48197c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15550188c81246f498bdefede48197c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerGroup264TestJSON-416877151 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 15550188c81246f498bdefede48197c7 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerGroup264TestJSON-416877151 May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerGroup264TestJSON-416877151-project May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 85c48bbdc01347848b30d375d178eafb May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerGroup264TestJSON-416877151-project May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance group fa85cd91-66f6-4661-b693-a13ab397d31e could not be found. May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fa85cd91-66f6-4661-b693-a13ab397d31e'} May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fa85cd91-66f6-4661-b693-a13ab397d31e could not be found. May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fa85cd91-66f6-4661-b693-a13ab397d31e could not be found. May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:38.747112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fa85cd91-66f6-4661-b693-a13ab397d31e could not be found. May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36ade120-da2d-4893-b630-09fccd736308 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] Returning 404 to user: Instance group fa85cd91-66f6-4661-b693-a13ab397d31e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36ade120-da2d-4893-b630-09fccd736308 tempest-ServerGroup264TestJSON-416877151 tempest-ServerGroup264TestJSON-416877151-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e" status: 404 len: 117 microversion: 2.64 time: 0.013508 May 10 02:17:38.755363 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 913/1872] 10.222.0.52 () {60 vars in 1306 bytes} [Tue May 10 02:17:38 2022] DELETE /compute/v2.1/os-server-groups/fa85cd91-66f6-4661-b693-a13ab397d31e => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:17:38.807993 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd28bba7-48b0-403e-ba0a-7ddd649279cd tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 204 len: 0 microversion: 2.1 time: 0.160431 May 10 02:17:38.808696 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 960/1873] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:17:38 2022] DELETE /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:38.822441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.823307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:38.832180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.833061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.834136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.835561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.909797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:38.910796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:38.920873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.921478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:38.922338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:38.922785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.104063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.113167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-84f2ba81-c25b-4e33-9842-61846b3fd61a tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1472 microversion: 2.1 time: 0.299506 May 10 02:17:39.123185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 914/1874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:38 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:39.123185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:39.123185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:39.128899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.129359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.130288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.131000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.201530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.212910 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10a6d098-a971-441d-8cc0-5503e392c4ad tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.308126 May 10 02:17:39.213908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 961/1875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:38 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:39.292306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:39.293230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:39.301493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.306477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.310130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.311048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.311616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.322703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.325117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.326365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a21d5bc-cd5f-4c40-9c81-8b46722b1131 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.210891 May 10 02:17:39.337278 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 915/1876] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:39 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:39.476846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.485788 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c96fe439-8af0-49d4-8c4d-09ce2c8e91b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.198339 May 10 02:17:39.486484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 962/1877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:39 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:39.581365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:39.582050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:39.583713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3f2ef179-8475-4a74-a254-e0e806644ff1 req-f0549ee8-3321-4fa5-9131-f211fb4f10ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79ad69c-a8de-4eba-ae8a-15cabb868a48", "tag": "47f1f980-2bd4-4fa7-875b-5b3c3da7445f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:39.591946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.592406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.593630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.594635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.595524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3f2ef179-8475-4a74-a254-e0e806644ff1 req-f0549ee8-3321-4fa5-9131-f211fb4f10ca service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.596258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3f2ef179-8475-4a74-a254-e0e806644ff1 req-f0549ee8-3321-4fa5-9131-f211fb4f10ca service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.619158 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3f2ef179-8475-4a74-a254-e0e806644ff1 req-f0549ee8-3321-4fa5-9131-f211fb4f10ca service nova] Creating event network-changed:47f1f980-2bd4-4fa7-875b-5b3c3da7445f for instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 on n-h1-841089-2 May 10 02:17:39.624275 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3f2ef179-8475-4a74-a254-e0e806644ff1 req-f0549ee8-3321-4fa5-9131-f211fb4f10ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045119 May 10 02:17:39.625278 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 963/1878] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:17:39.655208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:39.657034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:39.664141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.664809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.665930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.666543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.706883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59f79d1d-ac4c-4441-a850-147a4ac75168 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056122 May 10 02:17:39.707725 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 964/1879] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:39 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:39.750160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:39.750913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:39.757991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.758891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.759726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:39.760265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:39.883246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:39.891046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee81ee4b-3bf8-463e-977d-cc0e6a0fc74d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.314722 May 10 02:17:39.892908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 916/1880] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:39 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:40.025046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:40.033383 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cdce432-26ca-45b8-bdc6-378452b3ccf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.287396 May 10 02:17:40.034290 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 965/1881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:39 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:40.135379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:40.136000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:40.144207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.145135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.146218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.146920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.231153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:40.232223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:40.259601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.260221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.261237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.261801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.443512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:40.458801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7ea5835-4ec4-438b-b3b8-8ac9c589a2d4 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1472 microversion: 2.1 time: 0.326140 May 10 02:17:40.460586 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 917/1882] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:40 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:40.472592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:40.473865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:40.481853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.482535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.483729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.484394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.620058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:40.632209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c78d1e9c-2278-468a-826c-57597112df80 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.405150 May 10 02:17:40.644235 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 966/1883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:40 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:40.652904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:40.654580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:40.663448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.665263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.666575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.667226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.907127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:40.916927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:40.918844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:40.920469 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac008faa-6681-42f7-a000-884698f43f23 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.458379 May 10 02:17:40.921294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 918/1884] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:40 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:40.926407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:40.927970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:40.935426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.936392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.937781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.938351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.974871 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-915faca5-b090-4378-a17f-451d63f52fa7 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052247 May 10 02:17:40.978259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 919/1885] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:40 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:40.983146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:40.983990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:40.991904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.992559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:40.993555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:40.994162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.002732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:41.013480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a17eeb7-e8cf-4b22-9dff-09dfc4b11801 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.367165 May 10 02:17:41.016616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 967/1886] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:40 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:41.054566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:41.055465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:41.063986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.064589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.065707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.069610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.325620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:41.333517 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6214c6f7-3729-439a-ada0-214e998ca7d4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.354023 May 10 02:17:41.343224 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 920/1887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:40 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:41.384391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:41.395616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2a13eff-a966-4186-8e50-84b8b5ed01c4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.349012 May 10 02:17:41.396390 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 968/1888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:41 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:41.479710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:41.480503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:41.489140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.489962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.491690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.492338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.612167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:41.626025 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b99b3c0-503e-40ec-9a14-3a4bbc34ad15 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 200 len: 1430 microversion: 2.1 time: 0.151701 May 10 02:17:41.633846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 921/1889] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:41 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 1430 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:41.652241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-441c955a-8bfc-46ba-9807-ba452ccacb01 req-91f96f3d-82ee-438e-b51b-cd0abdc5dac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9abf345-a804-4182-b3d9-629a74655e94", "name": "network-vif-deleted", "tag": "8482d275-6998-47a8-b8c1-d3cc029ed00f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:41.653322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:41.654021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:41.662312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.663263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.663683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-441c955a-8bfc-46ba-9807-ba452ccacb01 req-91f96f3d-82ee-438e-b51b-cd0abdc5dac8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.664471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-441c955a-8bfc-46ba-9807-ba452ccacb01 req-91f96f3d-82ee-438e-b51b-cd0abdc5dac8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.664866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.665413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.696768 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-441c955a-8bfc-46ba-9807-ba452ccacb01 req-91f96f3d-82ee-438e-b51b-cd0abdc5dac8 service nova] Creating event network-vif-deleted:8482d275-6998-47a8-b8c1-d3cc029ed00f for instance e9abf345-a804-4182-b3d9-629a74655e94 on n-h2-841089-2 May 10 02:17:41.705986 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-441c955a-8bfc-46ba-9807-ba452ccacb01 req-91f96f3d-82ee-438e-b51b-cd0abdc5dac8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062893 May 10 02:17:41.707393 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 969/1890] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:41.855531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:41.865922 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c1bf6b4e-90b7-49d8-9ae7-263f3042d596 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.217891 May 10 02:17:41.867240 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 922/1891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:41 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:41.946210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:41.948662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:41.962713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.963642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.964449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:41.964894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:41.990525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:41.992784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.001819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.002660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.004581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.005572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.151793 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-027ab87d-0d0e-4232-9b06-e4b951eddc1d tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164874 May 10 02:17:42.163495 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 923/1892] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:41 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:42.170039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.171603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.181959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.183255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.184805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.185615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.208341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:42.221319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:42.226935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:42.228978 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44a7415f-2901-43aa-ba9e-70853ae5d329 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.288844 May 10 02:17:42.230897 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 970/1893] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:41 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:42.354851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.357357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.367962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.368671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.370219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.370930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.403580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:42.413123 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d51b7b82-ff25-40f5-b785-06d96afb1452 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.247521 May 10 02:17:42.416696 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 924/1894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:42 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:42.434186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.435175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.443231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.444021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.445081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.445713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.730049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:42.737701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c42574c-ea67-432e-8aae-d6a525c3e246 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.389930 May 10 02:17:42.738395 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 971/1895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:42 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:42.744440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.745313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: e9abf345-a804-4182-b3d9-629a74655e94] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.752170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.752725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.753597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.754201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.768710 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] HTTP exception thrown: Instance e9abf345-a804-4182-b3d9-629a74655e94 could not be found. May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Request method failure captured: May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 HTTP/1.1 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq4OwaWdIPlraD1K08zson3SFjhMgRLmn9x1XgSMpmCae1nSEojlJ4vxMFW_y0Tfb8AhjFsePvgJF6gfPfFwuFa0Cqw0CpOKXlkqMkOIeT0N7vnZZniNLr7rsiGe2QUUJIkEzQ92NCFqXtd--xZiWlpdZkRGCZYlOjFeDVE08IC-w4 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5165ac7eab8e4c9f882bc2b4f9b3be3d May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListImageFiltersTestJSON-540100518 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5165ac7eab8e4c9f882bc2b4f9b3be3d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5165ac7eab8e4c9f882bc2b4f9b3be3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5165ac7eab8e4c9f882bc2b4f9b3be3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5165ac7eab8e4c9f882bc2b4f9b3be3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListImageFiltersTestJSON-540100518 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5165ac7eab8e4c9f882bc2b4f9b3be3d May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-540100518 May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListImageFiltersTestJSON-540100518-project May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1331ab40bf914278a9263a566496752a May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListImageFiltersTestJSON-540100518-project May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance e9abf345-a804-4182-b3d9-629a74655e94 could not be found. May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e9abf345-a804-4182-b3d9-629a74655e94'} May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9abf345-a804-4182-b3d9-629a74655e94 could not be found. May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9abf345-a804-4182-b3d9-629a74655e94 could not be found. May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:42.770622 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9abf345-a804-4182-b3d9-629a74655e94 could not be found. May 10 02:17:42.776343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:42.777937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Returning 404 to user: Instance e9abf345-a804-4182-b3d9-629a74655e94 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:42.779018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-04d84cea-8da8-40de-a857-774bdb46cb45 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94" status: 404 len: 111 microversion: 2.1 time: 0.039351 May 10 02:17:42.779804 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 972/1896] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:42 2022] GET /compute/v2.1/servers/e9abf345-a804-4182-b3d9-629a74655e94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:17:42.788473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.789279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.795974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.796723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.797736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.798381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.824527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:17:42.843270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:42.855583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3aa305fc-dd04-4d82-ade8-96dd1be53418 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.436568 May 10 02:17:42.857036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 925/1897] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:42 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:42.885947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.887364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.895791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.896744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.898423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.899242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.924514 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78b52580-c398-4a65-a786-e6489673acda tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 204 len: 0 microversion: 2.1 time: 0.139872 May 10 02:17:42.928406 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 973/1898] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:17:42 2022] DELETE /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:17:42.935382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:42.936899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:42.945861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.946706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:42.947828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:42.948493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.199883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:43.209100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f446d96-6149-4602-baab-3de7ca21e1da tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.329016 May 10 02:17:43.212934 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 926/1899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:42 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:43.217627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:43.221870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:43.223783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:43.228491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.229650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.230537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.230993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.235051 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1e45fe4f-e322-43d2-b680-ec14ff3ca6ba tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1472 microversion: 2.1 time: 0.305314 May 10 02:17:43.235955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 974/1900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:42 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:43.249793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:43.250672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:43.258373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.259177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.261127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.261842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.270440 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0fed2ed8-b536-4a50-b88b-0cd4b72e65ac tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058977 May 10 02:17:43.271355 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 927/1901] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:43 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:43.434592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:43.435546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:43.442490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.443053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.444040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.444647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.837104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:43.845859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:43.847797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:43.848485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:43.849779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a01ac051-5b6c-4fba-8eca-73ee8c9a34f7 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.604173 May 10 02:17:43.851120 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 975/1902] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:43 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:17:43.856499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:43.857397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:43.864670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.865299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.868566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.869314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.870802 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-81928b0e-8300-40b2-b88d-00d528aa630e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.439843 May 10 02:17:43.871714 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 928/1903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:43 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:43.880569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:43.881485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:43.891131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.892415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:43.894071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:43.895122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.208453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:44.216695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:44.217862 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e34da563-99ce-43bc-910d-f358402de64f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.364851 May 10 02:17:44.228196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adff1368-0e07-449c-ace0-27c98a0f6ed8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.355298 May 10 02:17:44.229786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 976/1904] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:43 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:44.235107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:44.235889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:44.239877 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 929/1905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:43 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:44.242980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.243492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.244283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.244725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.254212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:44.254926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:44.262833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.263849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.264731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.265247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.556199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:44.564517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35402175-f042-4949-8005-4d929f250264 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.333108 May 10 02:17:44.565109 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 977/1906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:44 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:44.567746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:44.570961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:44.571986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:44.578128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.578588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.579897 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c066c238-3677-4c80-ab2a-3d9faf8da904 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1472 microversion: 2.1 time: 0.330724 May 10 02:17:44.580190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.581031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.581481 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 930/1907] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:44 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:44.613631 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ad56515-ff21-4819-830d-73a912dd2f3f tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047470 May 10 02:17:44.614430 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 978/1908] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:44 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:44.868846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:44.869379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:44.876606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.877065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.877865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.878309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.889569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:44.891646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:44.902681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.903331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:44.904211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:44.905409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.137908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:45.146267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:45.148111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:45.149450 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f25ee00b-3baa-454e-ba2d-672fd3282f60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.284848 May 10 02:17:45.155004 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 931/1909] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:44 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:45.174251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:45.182858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-462d1d22-021a-4b58-b991-13a01a278a93 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.298475 May 10 02:17:45.183624 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 979/1910] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:44 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:45.238621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:45.239596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:45.247282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:45.248837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.248975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:45.249771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.251101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.252194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.258612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.259347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.260212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.260771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.593477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:45.605061 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-95b9fd46-e49f-4cd7-bee7-9d9d0182f859 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.371694 May 10 02:17:45.605862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 932/1911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:45 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:45.611829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:45.612536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:45.628556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:45.638753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbcbd476-3f2d-469e-be60-edd71c0ccd10 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.392813 May 10 02:17:45.639694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 980/1912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:45 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:45.658373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.659203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.663263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.665269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:45.665984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.670290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:45.685653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.686638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:45.688713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:45.689607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.018692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:46.022376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:46.033166 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4ab1642-fe33-4ee4-8e21-d4d54fb242e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1472 microversion: 2.1 time: 0.377136 May 10 02:17:46.042223 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90cd7dc3-76f2-477c-bac9-866172a494c9 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.435493 May 10 02:17:46.051124 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 933/1913] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:45 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:46.051350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 981/1914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:45 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1472 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:46.058910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:46.064486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:46.078319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.081874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.083676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.084184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.168601 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-35f99567-fcdd-4a20-92db-c5317e82b332 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123966 May 10 02:17:46.168816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:46.172195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:46.172322 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 934/1915] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:46 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:46.179007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.181046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.182183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.183191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.204147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:46.205628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:46.223833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.224285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.229647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.230201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.634400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:46.663330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:46.665184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:46.670848 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3482929a-46c1-4f36-8e15-b69f72d10cc9 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.506139 May 10 02:17:46.672098 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 982/1916] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:46 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:46.680056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:46.680674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:46.702515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.704820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.706904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.708165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.783618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:46.792242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a19a423c-eb20-469a-b1ac-33edc8d971bf tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.594673 May 10 02:17:46.796343 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 935/1917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:46 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:46.807252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:46.808080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:46.823861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.824705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:46.825634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:46.829100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.205127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:47.214083 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7441b27a-6e36-4687-82f7-8c12d54cf1f6 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.416363 May 10 02:17:47.219524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 936/1918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:46 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:47.223873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:47.234130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b6a0227f-a159-4b17-a963-da58b97c0bb4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.559973 May 10 02:17:47.235342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b7b6ec12-5688-4ebb-b87f-cea5ba5945c8 req-9ea882ff-2e40-4c86-a9dd-7c081a41dfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9434c01b-1f40-4741-af78-75d469874c9e", "name": "network-vif-deleted", "tag": "0b76b120-e6d6-4f65-b865-fee58e4135ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:47.236050 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 983/1919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:46 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:47.242793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:47.244783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:47.250445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b7b6ec12-5688-4ebb-b87f-cea5ba5945c8 req-9ea882ff-2e40-4c86-a9dd-7c081a41dfdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.251224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b7b6ec12-5688-4ebb-b87f-cea5ba5945c8 req-9ea882ff-2e40-4c86-a9dd-7c081a41dfdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.255306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.257586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.258548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.259332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.266071 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b7b6ec12-5688-4ebb-b87f-cea5ba5945c8 req-9ea882ff-2e40-4c86-a9dd-7c081a41dfdd service nova] Creating event network-vif-deleted:0b76b120-e6d6-4f65-b865-fee58e4135ca for instance 9434c01b-1f40-4741-af78-75d469874c9e on n-h1-841089-2 May 10 02:17:47.272003 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b7b6ec12-5688-4ebb-b87f-cea5ba5945c8 req-9ea882ff-2e40-4c86-a9dd-7c081a41dfdd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041257 May 10 02:17:47.275823 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 937/1920] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:47.282149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:47.282862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:47.290776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.291283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.292072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.292512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.342341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.343637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.345530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lazy-loading 'fault' on Instance uuid 9434c01b-1f40-4741-af78-75d469874c9e {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:17:47.484717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ab40bf914278a9263a566496752a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5165ac7eab8e4c9f882bc2b4f9b3be3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:47.496222 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f10a455-0fb9-464c-ab50-fc21a5d989e6 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 200 len: 1307 microversion: 2.1 time: 0.256401 May 10 02:17:47.498784 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 984/1921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:47 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:47.528262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:47.529560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:47.556889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.566737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.569189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.570394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.673861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:47.689395 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5a449051-ff5f-43f2-8abc-df32718f544f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.406657 May 10 02:17:47.690868 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 938/1922] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:47 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:47.693235 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c2a7fc0d-f87a-498c-9292-dacf1f5e40af tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.193001 May 10 02:17:47.694730 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 985/1923] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:17:47 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:17:47.700558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:47.701232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:47.715997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.716528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.717507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.718111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.817819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:47.818487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:47.829711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.830317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:47.832358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:47.834284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.007879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:48.021257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:48.024453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:48.027783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-604c55f9-70ce-46ac-bb03-85a1f97fac20 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.334982 May 10 02:17:48.028556 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 939/1924] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:47 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:48.111432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:48.122424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0be0af6b-1e67-447c-aa5f-c91adf0482e2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.308379 May 10 02:17:48.124179 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 986/1925] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:47 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:48.236210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:48.236903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:48.252937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.253571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.255212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.256084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.309808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1354082488", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:48.393115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] validate_networks() for [('396f955d-b347-44d4-9154-00402eef4750', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:17:48.556260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:48.569602 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d14ffa5-7846-48c1-8db0-48e55e2d2511 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.337585 May 10 02:17:48.570204 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 987/1926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:48 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:48.574941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:48.575728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:48.589166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.589903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.590891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.591530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.865992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:48.874357 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff27e7d8-0039-41df-aec1-721b10419ca1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.303122 May 10 02:17:48.885639 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 988/1927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:48 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:48.890714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:48.891594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] [instance: 9434c01b-1f40-4741-af78-75d469874c9e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:48.898483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.899216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.900259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.901201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.921928 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] HTTP exception thrown: Instance 9434c01b-1f40-4741-af78-75d469874c9e could not be found. May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Request method failure captured: May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e HTTP/1.1 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecq4OwaWdIPlraD1K08zson3SFjhMgRLmn9x1XgSMpmCae1nSEojlJ4vxMFW_y0Tfb8AhjFsePvgJF6gfPfFwuFa0Cqw0CpOKXlkqMkOIeT0N7vnZZniNLr7rsiGe2QUUJIkEzQ92NCFqXtd--xZiWlpdZkRGCZYlOjFeDVE08IC-w4 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5165ac7eab8e4c9f882bc2b4f9b3be3d May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListImageFiltersTestJSON-540100518 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5165ac7eab8e4c9f882bc2b4f9b3be3d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5165ac7eab8e4c9f882bc2b4f9b3be3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5165ac7eab8e4c9f882bc2b4f9b3be3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5165ac7eab8e4c9f882bc2b4f9b3be3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListImageFiltersTestJSON-540100518 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5165ac7eab8e4c9f882bc2b4f9b3be3d May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-540100518 May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListImageFiltersTestJSON-540100518-project May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1331ab40bf914278a9263a566496752a May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListImageFiltersTestJSON-540100518-project May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 9434c01b-1f40-4741-af78-75d469874c9e could not be found. May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '9434c01b-1f40-4741-af78-75d469874c9e'} May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9434c01b-1f40-4741-af78-75d469874c9e could not be found. May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9434c01b-1f40-4741-af78-75d469874c9e could not be found. May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:48.928979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9434c01b-1f40-4741-af78-75d469874c9e could not be found. May 10 02:17:48.933370 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:17:48.935305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Returning 404 to user: Instance 9434c01b-1f40-4741-af78-75d469874c9e could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:48.937946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-113d6e05-12d6-44bd-9cc6-5c4517093b95 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e" status: 404 len: 111 microversion: 2.1 time: 0.051013 May 10 02:17:48.939096 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 989/1928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:48 2022] GET /compute/v2.1/servers/9434c01b-1f40-4741-af78-75d469874c9e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:17:48.944719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:48.945609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:48.952215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.952962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:48.953974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:48.954626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.049576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:17:49.050158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:17:49.050746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:17:49.051321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:17:49.051895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:17:49.083817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.084843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.085678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.086176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.107958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Getting quotas for project 623992f8bb85465c9e6b5e9c46a331b0. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:17:49.113209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Getting quotas for user de52b2a3f88d4c609b880101713c32bd and project 623992f8bb85465c9e6b5e9c46a331b0. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:17:49.125263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:17:49.127680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:17:49.185603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:49.197030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7168900-41b4-4641-ad7c-6cb60a4aa8e1 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.256678 May 10 02:17:49.198024 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 990/1929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:48 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:49.199751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f6f7ce6-d942-4528-b639-829cdc9387c3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.155765 May 10 02:17:49.205467 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 940/1930] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:17:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:17:49.211322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:49.211954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:49.215734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56e330bb-0e85-4f6a-954e-11ebcad264d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d370b8280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:49.227943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.228406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.229203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.229652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.498032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:49.511189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:49.517667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:49.518981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4851fb3e-bd6b-4975-a03f-e0dbc4d29fe3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.317596 May 10 02:17:49.519804 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 941/1931] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:49 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:49.534341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:49.535168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:49.541431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.542216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.543270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.543915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.842410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:49.855346 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ecaa7449-d648-4f69-ae03-28c76ee96cb5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.332464 May 10 02:17:49.867136 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 942/1932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:49 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:49.877841 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56e330bb-0e85-4f6a-954e-11ebcad264d0 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/images/929e997f-9272-428e-bb03-48ec717cd582" status: 204 len: 0 microversion: 2.1 time: 0.672937 May 10 02:17:49.878423 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 991/1933] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:49 2022] DELETE /compute/v2.1/images/929e997f-9272-428e-bb03-48ec717cd582 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:49.879724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc818dbd-ca82-4522-ac60-b663fa8a69ac tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:49.880517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc818dbd-ca82-4522-ac60-b663fa8a69ac tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:49.886163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:49.887025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:49.899338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.900550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.904235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:49.905072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:49.953319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fc818dbd-ca82-4522-ac60-b663fa8a69ac tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:49.960745 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc818dbd-ca82-4522-ac60-b663fa8a69ac tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1223 microversion: 2.1 time: 0.088414 May 10 02:17:49.961976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 943/1934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:49 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:49.977043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6654c42-1965-4297-98b2-249df7747f75 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d3741c4c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.189909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:50.220922 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-adccc9b1-2237-4b4e-a03f-55d29174edf5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.333861 May 10 02:17:50.224736 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 992/1935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:49 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:50.249170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.250254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:50.272733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.276878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.278299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.278726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.385979 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6654c42-1965-4297-98b2-249df7747f75 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/images/0502edc6-0adc-462f-bd59-2d21e8bf197e" status: 204 len: 0 microversion: 2.1 time: 0.413341 May 10 02:17:50.386559 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 944/1936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:49 2022] DELETE /compute/v2.1/images/0502edc6-0adc-462f-bd59-2d21e8bf197e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:50.396953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.398038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:50.414411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.414888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.415781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.416235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.586443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:50.594823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-487fa1f4-a061-40f5-a87a-8d56cc230a91 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.368853 May 10 02:17:50.595442 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 993/1937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:50 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:50.600923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ea65d53-e5c7-4f3f-84b0-14c89104d203 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] Calling method '.version_select at 0x7f3d376793a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.659689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:50.668300 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96c732d2-80a5-4d31-9def-7ebfd49af422 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.277518 May 10 02:17:50.668985 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 945/1938] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:50 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:50.673597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.674219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:50.682289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.683173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.684540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.685045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.839525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:50.850643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:50.852479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:50.853904 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5832cbe-5647-49dc-8fff-d61f7b55b021 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.184110 May 10 02:17:50.854644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 946/1939] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:50 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:50.859510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "277c70ae-ba5b-495a-9f6a-e544c3ba7560"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:50.860789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:50.867426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.867890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.868944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.870038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.878989 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ea65d53-e5c7-4f3f-84b0-14c89104d203 tempest-ListImageFiltersTestJSON-540100518 tempest-ListImageFiltersTestJSON-540100518-project] 10.222.0.52 "DELETE /compute/v2.1/images/60822800-905b-47b3-8c8f-8eb607eef708" status: 204 len: 0 microversion: 2.1 time: 0.282266 May 10 02:17:50.879839 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 994/1940] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:50 2022] DELETE /compute/v2.1/images/60822800-905b-47b3-8c8f-8eb607eef708 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:17:50.902571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.908092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:50.922656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.924437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.925096 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] HTTP exception thrown: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. May 10 02:17:50.926358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Request method failure captured: May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: request: PUT /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/1e15e121-385d-4070-97d6-e1c1543ffa1b HTTP/1.1 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 74 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecr8JGVMHh9HseC7IhTXkynENNGpeqKF1hcYVQ0D_JhkPE0GfgEa3nEMj28t8wiP38OjSKPvAi8Q_qLNvIizSHAd3zvuuIaQp2iSrHdiaO30nsHS4TbzgAC8BcyV5feYRvilFYiCJk3gvXmq16hiFr7KikY5o4Hr9EnTh-GSq5vhWjY May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ddf69af366a94465afaabaec20b37f92 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesAdminNegativeTest-39409459 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ddf69af366a94465afaabaec20b37f92", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ddf69af366a94465afaabaec20b37f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ddf69af366a94465afaabaec20b37f92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ddf69af366a94465afaabaec20b37f92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesAdminNegativeTest-39409459 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ddf69af366a94465afaabaec20b37f92 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-39409459 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesAdminNegativeTest-39409459-project-admin May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 12ce5eaca9cc4023a2c110065ea86c15 May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesAdminNegativeTest-39409459-project-admin May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: {"volumeAttachment": {"volumeId": "277c70ae-ba5b-495a-9f6a-e544c3ba7560"}} May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: exception: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '012100fc-18a3-4765-8725-adadb1fd6e30', 'id': '1e15e121-385d-4070-97d6-e1c1543ffa1b', 'body': {'volumeAttachment': {'volumeId': '277c70ae-ba5b-495a-9f6a-e544c3ba7560'}}} May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. (HTTP 404) (Request-ID: req-2f7d2003-5dc6-4abb-b110-bf292a4ded56) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:17:50.927688 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] Returning 404 to user: Volume 1e15e121-385d-4070-97d6-e1c1543ffa1b could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eada0f72-1e4f-4479-9032-025e5a1f9aa5 tempest-VolumesAdminNegativeTest-39409459 tempest-VolumesAdminNegativeTest-39409459-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/1e15e121-385d-4070-97d6-e1c1543ffa1b" status: 404 len: 109 microversion: 2.1 time: 0.073894 May 10 02:17:50.933168 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 947/1941] 10.222.0.52 () {60 vars in 1432 bytes} [Tue May 10 02:17:50 2022] PUT /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30/os-volume_attachments/1e15e121-385d-4070-97d6-e1c1543ffa1b => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:17:50.939400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:50.988875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:50.991647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:51.005553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.008099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.010529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.011668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.258486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:51.266198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9b40a87-b891-45ef-8105-4c565473d830 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1283 microversion: 2.1 time: 0.292160 May 10 02:17:51.275525 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 948/1942] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:50 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1283 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:51.288715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:51.289408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:51.309777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.310237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.311026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.313917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.501681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:51.512110 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3b7c579-3465-401e-b49b-d4810d3b88a7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.631147 May 10 02:17:51.514947 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 995/1943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:50 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:51.615638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:51.616253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:51.616995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:51.629609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.633252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-477cc6fa-ee0c-4237-9a24-80cd46956226 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.356205 May 10 02:17:51.633401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.634244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.634701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.642597 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 949/1944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:51 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:51.685620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:51.687408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:51.699374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.700054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:51.702336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:51.704913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:52.154865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:52.159821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:52.167770 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d336145-5131-45a0-8b86-9c9fb7ce2c50 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.486163 May 10 02:17:52.167998 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-447a4be9-304d-4175-a4e9-1782c065b105 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.558465 May 10 02:17:52.180731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 996/1945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:51 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:52.181141 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 950/1946] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:51 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:52.194520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:52.198756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:52.217128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:52.222262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:52.223934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:52.224653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:52.284620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:52.285467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:52.294650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:52.296014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:52.297886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:52.299713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:52.799765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:52.809230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f09ac08-2b41-407e-ae2b-f47da32ba0b1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1281 microversion: 2.1 time: 0.529294 May 10 02:17:52.814603 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 951/1947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:52 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1281 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:52.820166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:52.820803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:52.838672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:52.839270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:52.840134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:52.840580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.004931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:53.021342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:53.025481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:53.027873 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f39e5d8-65c6-4dc1-871f-d48b7fce5213 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.846016 May 10 02:17:53.028972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 997/1948] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:52 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:53.036515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:53.037928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:53.047582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:53.049622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.051477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:53.052623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.091759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:53.115627 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3802f521-ae25-4079-ae32-b305236c21ab tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.290646 May 10 02:17:53.125844 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 952/1949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:52 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:53.423226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d97dc4f5-f10b-4f7a-84dd-eed28f001753 tempest-ListImagesTestJSON-162458400 tempest-ListImagesTestJSON-162458400-project] Calling method '.version_select at 0x7f3d37450310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:53.483329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d97dc4f5-f10b-4f7a-84dd-eed28f001753 tempest-ListImagesTestJSON-162458400 tempest-ListImagesTestJSON-162458400-project] 10.222.0.52 "GET /compute/v2.1/images/193324a5-9e6a-4320-a184-bbef949b550f" status: 200 len: 784 microversion: 2.1 time: 0.356035 May 10 02:17:53.483964 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 953/1950] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:17:53 2022] GET /compute/v2.1/images/193324a5-9e6a-4320-a184-bbef949b550f => generated 784 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:53.497376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:53.497998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:53.508857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:53.509645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.510726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:53.511499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.566898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:53.575423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3d920af8-da76-4eea-b468-0592dcbbfd20 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.543911 May 10 02:17:53.584792 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 998/1951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:53 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:53.586302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:53.586984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:53.605866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:53.606332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.607207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:53.607844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:53.866743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:53.879941 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08fb3b14-4124-4456-bd80-ab0d1bea659f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.392019 May 10 02:17:53.881909 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 954/1952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:53 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:53.900620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6adbbdbb-4347-4772-b5bd-5c5c799bd01c tempest-ListImagesTestJSON-162458400 tempest-ListImagesTestJSON-162458400-project] Calling method '.version_select at 0x7f3d37016670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:53.975730 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6adbbdbb-4347-4772-b5bd-5c5c799bd01c tempest-ListImagesTestJSON-162458400 tempest-ListImagesTestJSON-162458400-project] 10.222.0.52 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.090662 May 10 02:17:53.978076 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 955/1953] 10.222.0.52 () {58 vars in 1121 bytes} [Tue May 10 02:17:53 2022] GET /compute/v2.1/images => generated 445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:53.989247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:53.993237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:54.005415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:54.007787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:54.009004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:54.011812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:54.088340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:54.104601 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e249561-dec5-47b0-9bf1-34a82a5e9e66 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.516133 May 10 02:17:54.106317 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 999/1954] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:53 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:54.119102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cbe954fa-6241-4d1a-b4c8-18dda675a79e tempest-ListImagesTestJSON-162458400 tempest-ListImagesTestJSON-162458400-project] Calling method '.version_select at 0x7f3d374a3160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:54.236940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cbe954fa-6241-4d1a-b4c8-18dda675a79e tempest-ListImagesTestJSON-162458400 tempest-ListImagesTestJSON-162458400-project] 10.222.0.52 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.128101 May 10 02:17:54.238363 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1000/1955] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:17:54 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:54.258347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:54.260537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:54.276829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:54.281504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:54.283586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:54.285257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:54.558784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:54.572976 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eecb4832-7948-4592-832a-eff891516d3b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 0.587683 May 10 02:17:54.573916 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 956/1956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:53 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:54.581573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:54.589371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:54.607655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:54.609774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:54.618579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:54.619598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:54.984970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:54.997015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:54.999007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:55.000457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2706be5-8363-4d25-9191-24cf84674925 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.752307 May 10 02:17:55.015208 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1001/1957] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:54 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:55.046083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:55.052235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:55.054705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:55.064884 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2fd760a3-905f-4435-a7de-5f4e93eddb86 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.488399 May 10 02:17:55.065491 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 957/1958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:54 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:55.069673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.074942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.076533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.077679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.083976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:55.084910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:55.105647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.121951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.127335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.128049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.487552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:55.530840 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28565435-4f69-4cb6-a69f-a9ab26fde1d3 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.450423 May 10 02:17:55.534913 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 958/1959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:55 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:55.548368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:55.551756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:55.573910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.574367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.576830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.578869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.653155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:55.668491 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ebee772-9471-4f5f-a076-e8cd3ae50c9c tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.651495 May 10 02:17:55.673528 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1002/1960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:55 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:55.690776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:55.691715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:55.718540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.731964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:55.733086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:55.734403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.166894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:56.180683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:56.183106 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5385f262-f959-43ec-af06-a0ad72155515 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 0.507973 May 10 02:17:56.191189 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1003/1961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:55 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:56.198249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f01c2b0-42fd-4c70-9ae4-2ba1522b6b22 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.659039 May 10 02:17:56.206404 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 959/1962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:55 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:56.212790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:56.213420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:56.216360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:56.222809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:56.235644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.237036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.237292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.242584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.243490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.245554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.248439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.250186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.602383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:56.610886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5eb5ca4c-ccef-46ad-9e09-347e408399b9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.402765 May 10 02:17:56.615768 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 960/1963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:56 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:56.628505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d4293f5d-dcbf-4cb5-8eca-eafc17fcfda4 req-bec5cff3-6fe2-4e5a-8d87-abdad1876270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:17:56.653571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d4293f5d-dcbf-4cb5-8eca-eafc17fcfda4 req-bec5cff3-6fe2-4e5a-8d87-abdad1876270 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.655581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d4293f5d-dcbf-4cb5-8eca-eafc17fcfda4 req-bec5cff3-6fe2-4e5a-8d87-abdad1876270 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.664750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:56.693623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:56.695602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:56.697454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3dec4362-7e02-4663-bc8e-59c8853cea22 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.504828 May 10 02:17:56.698343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1004/1964] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:56 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:56.707399 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d4293f5d-dcbf-4cb5-8eca-eafc17fcfda4 req-bec5cff3-6fe2-4e5a-8d87-abdad1876270 service nova] Creating event network-changed:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:17:56.737172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:56.744448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:56.751387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d4293f5d-dcbf-4cb5-8eca-eafc17fcfda4 req-bec5cff3-6fe2-4e5a-8d87-abdad1876270 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128948 May 10 02:17:56.752644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 961/1965] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:17:56.761851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:56.766218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.767158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.768536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.769163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.777050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:56.786174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.791975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:56.793206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:56.793885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.193287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:57.202390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-190b9b6a-650f-4113-b02b-3e64755bf578 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.498466 May 10 02:17:57.202997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1005/1966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:56 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:57.221576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:57.227623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:57.228320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:57.233817 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f1a45082-e839-48c2-bde7-59baf1b02213 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.479493 May 10 02:17:57.234442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.234910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.235716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.236372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.247790 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 962/1967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:56 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:57.256108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:57.257388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:57.266820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.268137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.269861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.277442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.480043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:57.491159 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a066bcd4-fae3-4466-bf9a-01b8a263f159 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 0.279271 May 10 02:17:57.491848 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1006/1968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:57 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:57.632308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:57.633379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:57.640108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.640945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.641993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.642942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.861042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:57.868977 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b26bb85-8e8d-44b0-905d-0e6b1ae32176 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.619882 May 10 02:17:57.869776 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 963/1969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:57 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:57.891333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:57.892449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:57.898861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.899687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:57.900688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:57.901593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.055280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:58.072948 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38832c27-bf5c-4155-94a5-33e63e8df9f3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.445009 May 10 02:17:58.079199 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1007/1970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:57 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:17:58.172211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:58.185015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:58.187780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:58.196977 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba4e0dce-7ebd-43de-b4bf-11bdbb45cfd0 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.325240 May 10 02:17:58.199535 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 964/1971] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:57 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:17:58.229021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:58.229636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:58.241386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.242149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.248438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.249152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.265979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:58.267162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:58.289977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.290756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.292443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.293326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.623968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:58.633694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b1a8303c-e347-41e8-90a8-69fa575998ec tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.409602 May 10 02:17:58.634343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1008/1972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:58 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:58.645207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:58.645842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:58.675313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.675778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.676612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.677066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.900320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:58.912633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8337471c-c223-4087-a38b-11da71575bf2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.654943 May 10 02:17:58.917702 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 965/1973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:58 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:58.947371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:58.947990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:58.962448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.962892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:58.964125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:58.964873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:59.130314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:59.140125 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed664f99-14a5-48e7-9761-da3909f7fe35 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 0.500283 May 10 02:17:59.146849 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1009/1974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:58 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:59.163197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:59.167812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:59.188670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:59.189129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:59.189922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:59.190365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:59.593705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:59.607647 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9edad688-84c0-4458-942e-54349d81911a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.686327 May 10 02:17:59.611518 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 966/1975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:58 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:59.619269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:59.619910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:59.654582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:59.654582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:59.654582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:59.655104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:59.722743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:17:59.734092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b75ad0b9-dddf-45c7-9d77-ce46d76a4524 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.583890 May 10 02:17:59.738059 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1010/1976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:59 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:17:59.745344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:17:59.752673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:17:59.765048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:59.765684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:17:59.766623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:17:59.768887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:01.083848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:01.097230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:01.110028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:01.111533 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-328ccb8d-306c-458b-8171-757070c97f0c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 1.499048 May 10 02:18:01.112306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 967/1977] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:17:59 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:01.136989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:01.137622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:01.164428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:01.164875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:01.167836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:01.169680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:01.489328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:01.504112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7aab3b06-08f7-4492-b08e-f30821fceb59 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 1.764739 May 10 02:18:01.528794 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1011/1978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:17:59 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:01.548428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:01.558091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:01.572874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:01.573756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:01.576364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:01.577092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:02.600230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:02.625317 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a3ba7fb-73b7-4cea-abec-e2c9af5e52b7 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 1.508254 May 10 02:18:02.626317 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 968/1979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:01 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:02.640167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:02.668372 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b93b043a-926f-4274-87a4-f2e7f09ebea1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 1.132913 May 10 02:18:02.670894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1012/1980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:01 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:02.672734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:02.673598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:02.707439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:02.710224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:02.715704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:02.717166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:02.718173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:02.719585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:02.732972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:02.735854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:02.738740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:02.739429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:03.367202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:03.378178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78c701f7-31fa-450b-9bbe-45a502c843e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.705878 May 10 02:18:03.381354 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1013/1981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:02 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:03.388703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:03.389539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a573a5c8-74c5-453b-b6da-d0ad1c0537e7 req-50dc8c28-598c-4700-87f4-4262f826d26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c903ce72-ce77-47a6-bf37-8712418785a7", "name": "network-vif-unplugged", "status": "completed", "tag": "c1d64c5c-eb66-43af-990e-ab90cb339c0b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:03.398592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a573a5c8-74c5-453b-b6da-d0ad1c0537e7 req-50dc8c28-598c-4700-87f4-4262f826d26b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:03.399559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a573a5c8-74c5-453b-b6da-d0ad1c0537e7 req-50dc8c28-598c-4700-87f4-4262f826d26b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:03.404250 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1d9ff8c-4e2f-43f4-ada9-ac3d16f2e3ca tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.771750 May 10 02:18:03.405737 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 969/1982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:02 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:03.416404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:03.420558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:03.434591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:03.435828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:03.440139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:03.441250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:03.442479 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a573a5c8-74c5-453b-b6da-d0ad1c0537e7 req-50dc8c28-598c-4700-87f4-4262f826d26b service nova] Creating event network-vif-unplugged:c1d64c5c-eb66-43af-990e-ab90cb339c0b for instance c903ce72-ce77-47a6-bf37-8712418785a7 on n-h2-841089-2 May 10 02:18:03.456756 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a573a5c8-74c5-453b-b6da-d0ad1c0537e7 req-50dc8c28-598c-4700-87f4-4262f826d26b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072899 May 10 02:18:03.457641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1014/1983] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:03.475974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1705e7e7-9b2f-478c-a737-b1369aefac29 req-4f77e2ae-102f-4f7a-9094-70baa71770cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "name": "network-vif-plugged", "status": "completed", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:03.485326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1705e7e7-9b2f-478c-a737-b1369aefac29 req-4f77e2ae-102f-4f7a-9094-70baa71770cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:03.489326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1705e7e7-9b2f-478c-a737-b1369aefac29 req-4f77e2ae-102f-4f7a-9094-70baa71770cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:03.513356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1705e7e7-9b2f-478c-a737-b1369aefac29 req-4f77e2ae-102f-4f7a-9094-70baa71770cc service nova] Creating event network-vif-plugged:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:18:03.525015 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1705e7e7-9b2f-478c-a737-b1369aefac29 req-4f77e2ae-102f-4f7a-9094-70baa71770cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065759 May 10 02:18:03.532068 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1015/1984] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:03.544156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:03.545335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:03.558750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:03.559810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:03.562920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:03.563746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.016823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:04.031783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:04.053465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:04.060410 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-358fd157-efa8-4da5-b2e6-a1ecbb87d0c4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.653274 May 10 02:18:04.061869 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 970/1985] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:03 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:04.068545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:04.070025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:04.083381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.085393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.086384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.087167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.246727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:04.254544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a77eb9e5-b6ed-4b5f-a181-1518cf2691f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.720920 May 10 02:18:04.266567 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1016/1986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:03 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:04.271889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:04.272884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:04.289675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.290409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.291507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.292216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.613631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:04.626276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4dfa49f-aa5c-4b3f-a05d-f0bc49b59bc2 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.562480 May 10 02:18:04.628697 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 971/1987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:04 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:04.644151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:04.647489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:04.659631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.662679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.663712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.665571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.751037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:04.765610 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a78ff0ff-d9d7-44d8-9e9a-a7b3d250b307 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 0.497217 May 10 02:18:04.766358 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1017/1988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:04 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:04.778312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:04.779206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:04.790467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.791269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.792877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:04.793492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:04.994217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:05.001816 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a19e1c8-d934-47fd-b93f-c675d792710d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1506 microversion: 2.1 time: 0.369262 May 10 02:18:05.010119 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 972/1989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:04 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:05.083344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:05.085113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:05.118700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.119214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.120072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.120523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.163587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:05.179504 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1004d4d0-bd06-47c1-abb8-38306f4ce26b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1519 microversion: 2.1 time: 0.406512 May 10 02:18:05.183898 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1018/1990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:04 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:05.285156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:05.285858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:05.294991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.295473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.296276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.296728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.337941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:05.347315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:05.359790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:05.361065 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d8e75fd7-2078-4b21-bc3a-4955a280952d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1488 microversion: 2.25 time: 0.286345 May 10 02:18:05.372522 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 973/1991] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:05 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1488 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:18:05.638426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-08f8c4d4-c3ad-4ba9-8f04-ca4919c9b229 req-b7d02498-cb42-479d-a4f3-78db1ca0b2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c903ce72-ce77-47a6-bf37-8712418785a7", "tag": "c1d64c5c-eb66-43af-990e-ab90cb339c0b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:05.638627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:05.648489 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-585ced7c-4240-47e0-9611-2c7bfc44503c tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.368013 May 10 02:18:05.653563 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1019/1992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:05 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:18:05.665387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:05.667957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-08f8c4d4-c3ad-4ba9-8f04-ca4919c9b229 req-b7d02498-cb42-479d-a4f3-78db1ca0b2a0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.668755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-08f8c4d4-c3ad-4ba9-8f04-ca4919c9b229 req-b7d02498-cb42-479d-a4f3-78db1ca0b2a0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.669052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:05.682831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.683531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.684551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.686403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.697408 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-08f8c4d4-c3ad-4ba9-8f04-ca4919c9b229 req-b7d02498-cb42-479d-a4f3-78db1ca0b2a0 service nova] Creating event network-changed:c1d64c5c-eb66-43af-990e-ab90cb339c0b for instance c903ce72-ce77-47a6-bf37-8712418785a7 on n-h2-841089-2 May 10 02:18:05.712142 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-08f8c4d4-c3ad-4ba9-8f04-ca4919c9b229 req-b7d02498-cb42-479d-a4f3-78db1ca0b2a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081972 May 10 02:18:05.712800 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 974/1993] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:18:05.788220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:05.788939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:05.813791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.814899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:05.816489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:05.817331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:06.193024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:06.202348 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-894df8e8-c1b7-4650-ac34-5e75dea2fccc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1323 microversion: 2.1 time: 0.419307 May 10 02:18:06.216314 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 975/1994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:05 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:06.241961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:06.243228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:06.278557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:06.279209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:06.286334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:06.287595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:06.310478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:06.320505 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-83b16a70-cd5b-4c6e-97fe-85c423629620 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.665319 May 10 02:18:06.321099 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1020/1995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:05 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:06.353601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:06.357188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:06.379084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:06.379763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:06.387678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:06.389746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:06.796095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:06.804420 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-390e5cdc-78ae-43a0-863c-440dfceadda1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1527 microversion: 2.1 time: 0.584357 May 10 02:18:06.805004 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 976/1996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:06 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1527 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:06.811527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:06.821423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:06.822708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:06.823002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-08af613d-10cf-46f6-8308-1337ba82a249 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1496 microversion: 2.1 time: 0.487082 May 10 02:18:06.836418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1021/1997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:06 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1496 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:06.838245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:06.839045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:06.840509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:06.842618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.024860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-809ebbee-f525-468a-a5fc-755b2f1ffae5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Action: 'create', calling method: .version_select at 0x7f3d367dca60>, body: {"keypair": {"name": "tempest-keypair-59391383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFKJPuiFRg+A+dLyUDZ2qn8RkAmmDWtklUR7cVUZ0vwm62rfuqoTaF/DVTU5OBFha5m0vOXTyQVRXnNc4FmSsj+NkNGJtKYVux57gFy9zbnM3lnsMsDuL2aw7gboQF47A=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:07.044627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-809ebbee-f525-468a-a5fc-755b2f1ffae5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Getting quotas for project 267f1f09372d477fb65afc5b2619b827. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:18:07.051014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-809ebbee-f525-468a-a5fc-755b2f1ffae5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Getting quotas for user a2170d84ea4e4697ba2dfd8ebb339b79 and project 267f1f09372d477fb65afc5b2619b827. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:18:07.058562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:07.069897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:07.076046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:07.078694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-809ebbee-f525-468a-a5fc-755b2f1ffae5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.240811 May 10 02:18:07.079721 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1022/1998] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:18:06 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:07.085444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:07.085814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:07.086553 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a34f154-3a63-4173-837e-4b3ec96c1746 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1478 microversion: 2.25 time: 0.273642 May 10 02:18:07.090428 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 977/1999] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:06 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1478 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:07.092609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.093069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.093872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.094705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.108171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:07.112838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:07.116063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:07.126175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.126791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.132342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.132957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.191276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:07.259218 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a13e2e1f-9157-4adf-8d56-71eab6a5fe9f tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 343 microversion: 2.1 time: 0.166945 May 10 02:18:07.263534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 978/2000] 10.222.0.52 () {58 vars in 1153 bytes} [Tue May 10 02:18:07 2022] GET /compute/v2.1/servers?status=shutoff => generated 343 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:07.275113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f46f39a5-ba88-4915-b522-e6d123c1693b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '.version_select at 0x7f3d3741c160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:07.281557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f46f39a5-ba88-4915-b522-e6d123c1693b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.282156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f46f39a5-ba88-4915-b522-e6d123c1693b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.314731 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f46f39a5-ba88-4915-b522-e6d123c1693b tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 5560 microversion: 2.25 time: 0.037946 May 10 02:18:07.315871 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 979/2001] 10.222.0.52 () {60 vars in 1183 bytes} [Tue May 10 02:18:07 2022] GET /compute/v2.1/os-migrations => generated 5560 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:07.325985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:07.326783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:07.337813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.346833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.347983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.348561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.504152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:07.523386 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d8988cfc-6143-4f5b-b6ee-031ad21cd59b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.435459 May 10 02:18:07.523386 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1023/2002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:07 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:07.525287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f82e5c15-c937-4434-a590-d6df3b60981c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:07.534359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f82e5c15-c937-4434-a590-d6df3b60981c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.535112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f82e5c15-c937-4434-a590-d6df3b60981c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.592789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f82e5c15-c937-4434-a590-d6df3b60981c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Going to try to start instance {{(pid=118716) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 02:18:07.671759 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f82e5c15-c937-4434-a590-d6df3b60981c tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "POST /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f/action" status: 202 len: 0 microversion: 2.1 time: 0.151497 May 10 02:18:07.677768 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1024/2003] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:18:07 2022] POST /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:18:07.690171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:07.691008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:07.693616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:07.705488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d8b85233-0fb4-468b-8476-8cfd5ce8f7ea tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1519 microversion: 2.1 time: 0.387330 May 10 02:18:07.707742 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 980/2004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:07 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1519 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:07.709554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.709886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.710756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.711243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.723958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:07.726330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:07.742864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.743954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:07.747837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:07.748439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.213802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:08.222850 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4134c4b-6e09-43f7-8be3-43bb18492cc4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.513723 May 10 02:18:08.227586 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 981/2005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:07 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:08.238741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:08.239809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:08.252788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.257839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.258930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.259620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.288034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] Lazy-loading 'services' on Instance uuid d79ad69c-a8de-4eba-ae8a-15cabb868a48 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:18:08.323125 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c3ed4e5-5632-415f-9361-2c5223f4dbb1 tempest-LiveAutoBlockMigrationV225Test-262315915 tempest-LiveAutoBlockMigrationV225Test-262315915-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1971 microversion: 2.25 time: 0.637177 May 10 02:18:08.324371 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1025/2006] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:07 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1971 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:08.329614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:08.335220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:08.343839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.344558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.345573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.346353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.389312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lazy-loading 'flavor' on Instance uuid 18ca81e4-8e73-426d-8a7e-845c21ab732f {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:18:08.606980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7afe07fe-b707-4757-9b74-d4e5e2dd2d30 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action" status: 200 len: 32 microversion: 2.1 time: 0.280986 May 10 02:18:08.609504 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1026/2007] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:18:08 2022] POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:18:08.625208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:08.628049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:08.649015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.660500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.661573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.671655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.703720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:08.721146 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f012467a-fa47-4df6-8f07-4bd3525582a5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1505 microversion: 2.1 time: 0.491600 May 10 02:18:08.729698 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 982/2008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:08 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:08.734694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:08.735515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:08.760305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.761182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.765316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:08.771934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:08.859170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:09.010859 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c6d43cc7-ff31-4907-8e11-de49807846e8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 204 len: 0 microversion: 2.25 time: 0.279797 May 10 02:18:09.012113 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 983/2009] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:18:08 2022] DELETE /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:18:09.024178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:09.025161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:09.049283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.049971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.050954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.051778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.253388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:09.265993 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d9fc85be-38ae-4448-be94-375fb45d62ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.653048 May 10 02:18:09.269070 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1027/2010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:08 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:09.278302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:09.279329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:09.301446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.305524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.307017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.307678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.498778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:09.514772 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f955435-75e4-4319-8a2b-f954a007c4de tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1475 microversion: 2.1 time: 0.495424 May 10 02:18:09.528231 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 984/2011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:09 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1475 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:09.528231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:09.528231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:09.547641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.548218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.549124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.549676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.628942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:09.824630 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-555075c4-7e20-4fab-b550-d16547eeb3c2 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "DELETE /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 204 len: 0 microversion: 2.1 time: 0.300973 May 10 02:18:09.827277 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 985/2012] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:09 2022] DELETE /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:09.837175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:09.839972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:09.840803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:09.847512 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6809b94b-bd42-41e9-8e08-af50823e7b14 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.575674 May 10 02:18:09.850879 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1028/2013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:09 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:09.858021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:09.860087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.860560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.861373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.861826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.863390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:09.879255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.881977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:09.883118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:09.883819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:10.509834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:10.523936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:10.529553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:10.536116 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-320fbc32-bf78-4f51-ad57-eeb341920a60 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1484 microversion: 2.25 time: 0.701878 May 10 02:18:10.540462 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 986/2014] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:09 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1484 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:10.554871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:10.555750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:10.568786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:10.570887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:10.572957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:10.574009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:10.694772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:10.708019 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d79d7ec-22be-4301-9548-406a0c3ee76e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.852094 May 10 02:18:10.712075 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1029/2015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:09 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:10.725354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:10.730534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:10.769577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:10.771846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:10.774638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:10.776085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:11.688945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:11.696484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-65960d18-648d-44fc-b48a-985b4dd795e6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1505 microversion: 2.1 time: 1.154607 May 10 02:18:11.697070 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 987/2016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:10 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1505 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:11.703586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:11.704202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:11.731564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:11.731951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:11.732756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:11.733204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:12.014811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a29970c06014c5b8d9e69b46e5fb958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c3161fa839460a96a5566df55f20d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:12.049359 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fa495dc-dc50-494f-9fb9-673a12aa1ce3 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 200 len: 1513 microversion: 2.1 time: 1.335043 May 10 02:18:12.050940 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1030/2017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:10 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 1513 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:12.078128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:12.082100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:12.094462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:12.098172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:12.100565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:12.103307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:14.138284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:14.148769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5c7d546-62c2-4973-860a-bb58494a3b34 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1474 microversion: 2.1 time: 2.096550 May 10 02:18:14.153281 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1031/2018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:12 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1474 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:14.162997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:14.165631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:14.192207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:14.194102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:14.195339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:14.197283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:14.500374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:14.517639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a27128a6-09bb-4821-8625-ad4e0b5a5809 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 2.819493 May 10 02:18:14.518242 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 988/2019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:11 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 2821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:14.533017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:14.533923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:14.552241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:14.559641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:14.560994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:14.561626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:14.824615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:14.850474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:14.856581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:14.865933 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-847e4533-5b4c-40fe-ac6c-a9cbfca8dc45 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1442 microversion: 2.25 time: 0.345881 May 10 02:18:14.879360 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 989/2020] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:14 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1442 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:14.889360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:14.890255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:14.899633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:14.900367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:14.901662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:14.902249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.150963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:15.166425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d32e005-e505-46bd-886c-072e42297ac1 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 1.011795 May 10 02:18:15.168772 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1032/2021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:14 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:15.187856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-157a9b35-be79-491e-b168-c7ea20c5b45d req-3d172ea8-1a72-4abf-8112-c58a7029f8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbaee6dd-516c-4d79-a64e-f315148ab080", "name": "network-vif-plugged", "status": "completed", "tag": "2b6e05e6-bd81-4a6b-a0b7-defb0654e450"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:15.201689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-157a9b35-be79-491e-b168-c7ea20c5b45d req-3d172ea8-1a72-4abf-8112-c58a7029f8fc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.209926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-157a9b35-be79-491e-b168-c7ea20c5b45d req-3d172ea8-1a72-4abf-8112-c58a7029f8fc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.217949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:15.228840 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ea91a8a-6374-443b-9298-80d8ba569ba8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.346526 May 10 02:18:15.233868 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 990/2022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:14 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:15.247588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:15.253282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:15.259148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-157a9b35-be79-491e-b168-c7ea20c5b45d req-3d172ea8-1a72-4abf-8112-c58a7029f8fc service nova] Creating event network-vif-plugged:2b6e05e6-bd81-4a6b-a0b7-defb0654e450 for instance dbaee6dd-516c-4d79-a64e-f315148ab080 on n-h2-841089-2 May 10 02:18:15.268893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.271665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.272817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.274098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-157a9b35-be79-491e-b168-c7ea20c5b45d req-3d172ea8-1a72-4abf-8112-c58a7029f8fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091151 May 10 02:18:15.274740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.276948 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1033/2023] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:15.287433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:15.290311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] [instance: 012100fc-18a3-4765-8725-adadb1fd6e30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:15.310970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.311736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.312716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.313355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.349997 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] HTTP exception thrown: Instance 012100fc-18a3-4765-8725-adadb1fd6e30 could not be found. May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Request method failure captured: May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 HTTP/1.1 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecr2iGI73CiXjNqydJV3BDb8vlSZ2bKwoO8EDkqeU-vABzFVuspP5Tn-rVWzI3V4HjoISBKrcUyyrLlpvuxZOLfHLeUYLxLRy-nEr_OOE4T_4ge6ipj06Cr5eJEplpDIoa84ngGnwTYPPr7uo7yRB5k2l5wK84W1PpQX6z35ja0ssBc May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 22c3161fa839460a96a5566df55f20d8 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesAdminNegativeTest-676342663 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22c3161fa839460a96a5566df55f20d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22c3161fa839460a96a5566df55f20d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22c3161fa839460a96a5566df55f20d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22c3161fa839460a96a5566df55f20d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesAdminNegativeTest-676342663 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 22c3161fa839460a96a5566df55f20d8 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-676342663 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesAdminNegativeTest-676342663-project May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 6a29970c06014c5b8d9e69b46e5fb958 May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesAdminNegativeTest-676342663-project May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 012100fc-18a3-4765-8725-adadb1fd6e30 could not be found. May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '012100fc-18a3-4765-8725-adadb1fd6e30'} May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012100fc-18a3-4765-8725-adadb1fd6e30 could not be found. May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012100fc-18a3-4765-8725-adadb1fd6e30 could not be found. May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:15.356076 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012100fc-18a3-4765-8725-adadb1fd6e30 could not be found. May 10 02:18:15.361521 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:15.363884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] Returning 404 to user: Instance 012100fc-18a3-4765-8725-adadb1fd6e30 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:15.366226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a0c0bd2-caf0-4438-a4fa-4f4eaf3c9259 tempest-VolumesAdminNegativeTest-676342663 tempest-VolumesAdminNegativeTest-676342663-project] 10.222.0.52 "GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30" status: 404 len: 111 microversion: 2.1 time: 0.083686 May 10 02:18:15.372102 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1034/2024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:15 2022] GET /compute/v2.1/servers/012100fc-18a3-4765-8725-adadb1fd6e30 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:15.382396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ffb71bea-f570-4cb7-a860-3051a4357590 req-f481e780-5dd9-4b64-a534-76955e87d838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012100fc-18a3-4765-8725-adadb1fd6e30", "name": "network-vif-deleted", "tag": "945b6d27-774a-438f-90b4-e5fb912b2a9e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:15.406142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ffb71bea-f570-4cb7-a860-3051a4357590 req-f481e780-5dd9-4b64-a534-76955e87d838 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.408209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ffb71bea-f570-4cb7-a860-3051a4357590 req-f481e780-5dd9-4b64-a534-76955e87d838 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.430394 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ffb71bea-f570-4cb7-a860-3051a4357590 req-f481e780-5dd9-4b64-a534-76955e87d838 service nova] Creating event network-vif-deleted:945b6d27-774a-438f-90b4-e5fb912b2a9e for instance 012100fc-18a3-4765-8725-adadb1fd6e30 on n-h2-841089-2 May 10 02:18:15.448635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ffb71bea-f570-4cb7-a860-3051a4357590 req-f481e780-5dd9-4b64-a534-76955e87d838 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075077 May 10 02:18:15.451472 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1035/2025] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:15.463992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:15.468950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:15.489469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.490505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.494009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.495020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.774614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:15.785625 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c0b3afa-61df-4a7b-b9d1-5a360921fc40 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1509 microversion: 2.1 time: 0.542045 May 10 02:18:15.786838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 991/2026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:15 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:15.801063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:15.802192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:15.828701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.832504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:15.835552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:15.838822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.431141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:16.440622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-638266a4-6d87-490c-a5c3-bcb10ec29f71 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.643733 May 10 02:18:16.441214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 992/2027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:15 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:16.470956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:16.475452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:16.481164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.servers [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Removing options 'limit' from query {{(pid=118717) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 10 02:18:16.486546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:16.488577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.490368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.491356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.491808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.493257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-182e0dfc-7d6b-4478-9ff4-1c681c6179ef tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.038264 May 10 02:18:16.493855 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 993/2028] 10.222.0.52 () {58 vars in 1139 bytes} [Tue May 10 02:18:16 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:18:16.510852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:16.511512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:16.533965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.534713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.535700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.536184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.563342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:16.571883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07d14a4e-b1b1-41e5-ac8f-4b5fbf9146aa tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1474 microversion: 2.1 time: 1.114993 May 10 02:18:16.579545 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1036/2029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:15 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1474 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:16.595985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:16.596626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:16.612728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.613194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.614003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.614994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.737973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:16.746903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:16.754056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:16.758574 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ce9d04af-9b3f-4c6e-8b72-0d9b283a4d77 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.261912 May 10 02:18:16.759671 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 994/2030] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:16 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:16.767425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:16.768446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:16.782586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.784565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:16.786295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:16.787636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:17.314906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:17.328269 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4c14a21-57c6-4b4a-9c51-2d938e66d87c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.747564 May 10 02:18:17.328855 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1037/2031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:16 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:17.335942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:17.337058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:17.346995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:17.352060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:17.353454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:17.356325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:17.561385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:17.570768 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eab40482-242d-41aa-8ea5-efcd1b3b0ab1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.808704 May 10 02:18:17.575744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 995/2032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:16 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:17.580806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:17.585597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:17.596496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:17.608952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:17.610276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:17.611677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.156515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:18.173605 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b80d636a-74a4-4f0a-b2cd-6cbf9700397b tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1509 microversion: 2.1 time: 0.837497 May 10 02:18:18.179767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:18.203950 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1038/2033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:17 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1509 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:18.210519 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67c847f1-ce29-4178-be30-9e677c4de0bc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.631168 May 10 02:18:18.212710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 996/2034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:17 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:18.215411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:18.220057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ad69c-a8de-4eba-ae8a-15cabb868a48", "name": "network-vif-deleted", "tag": "47f1f980-2bd4-4fa7-875b-5b3c3da7445f"}, {"server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "name": "network-vif-unplugged", "status": "completed", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}, {"name": "network-changed", "server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:18.221017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:18.238894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.240922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.262426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.264076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.276236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.282334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.318044 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Creating event network-vif-deleted:47f1f980-2bd4-4fa7-875b-5b3c3da7445f for instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 on n-h2-841089-2 May 10 02:18:18.318565 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Creating event network-vif-unplugged:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h2-841089-2 May 10 02:18:18.319087 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Creating event network-changed:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h2-841089-2 May 10 02:18:18.336807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:18:18.359726 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4be868c8-e655-4aa1-b1b1-d1acb8a3dc7b req-193b2a59-5aa4-4abb-8cf7-feaa398dda01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.143131 May 10 02:18:18.361013 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 997/2035] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:18.367167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:18.368155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:18.374563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.375334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.376330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.377119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.734080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:18.750067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:18.752650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:18.756700 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50d3b12b-52fd-4fd2-8246-d2f6357aeba3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.393803 May 10 02:18:18.757558 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 998/2036] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:18 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:18.771922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:18.772895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:18.783820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.784377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:18.785324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:18.785861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:19.597268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:19.617493 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71dd0463-cec6-4f1d-94e6-b1feda0ad0d1 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1474 microversion: 2.1 time: 1.409601 May 10 02:18:19.629133 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1039/2037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:18 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1474 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:19.640172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:19.641116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:19.661755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:19.662481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:19.663529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:19.664886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:20.216827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:20.226553 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-722bba7c-8f9a-473b-91bb-dd152cccce08 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2" status: 200 len: 1512 microversion: 2.1 time: 1.466646 May 10 02:18:20.236604 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 999/2038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:18 2022] GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 => generated 1512 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:20.242558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:20.250851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:20.258464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:20.264056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:20.265269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:20.265935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:20.642049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:20.645267 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88963da2-7220-4c22-b164-d3b7072fd1c2 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 1.012743 May 10 02:18:20.654517 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1040/2039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:19 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:20.670252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:20.670976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:20.684608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:20.685185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:20.686062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:20.689270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.184388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:21.192426 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2072285d-72fb-4d8d-b5d1-363c275e44e3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1390 microversion: 2.1 time: 0.953931 May 10 02:18:21.192920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1000/2040] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:20 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1390 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:21.210902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:21.220694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d52dcadc-6393-4313-b887-947b4af50c4d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.555223 May 10 02:18:21.221857 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1041/2041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:20 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:21.237922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:21.243633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:21.256869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.257730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.258770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.261106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.264207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:21.266597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:21.291338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.292234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.296875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.298973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.376587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:21.391380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:21.397004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:21.399399 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a248cbd-eb9c-4057-8fbf-1f93a38d6685 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.205540 May 10 02:18:21.402593 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1001/2042] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:21 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:21.407398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:21.408266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:21.423888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.430324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.433664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.434516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.854212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:21.866541 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa23f0e4-e010-42b3-b165-2a242f94f872 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1513 microversion: 2.1 time: 0.623091 May 10 02:18:21.878798 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1042/2043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:21 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1513 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:21.893845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:21.896252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:21.914367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.917777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:21.919831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:21.922861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:22.175739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:22.186029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-488d172f-d652-47a2-863c-ddec4078aa8b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1472 microversion: 2.1 time: 0.782084 May 10 02:18:22.189166 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1002/2044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:21 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1472 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:22.204241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:22.222387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:22.223385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:22.520820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:22.538198 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b60d5b02-99ef-4fe2-824d-2129fa81be32 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.656419 May 10 02:18:22.539508 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1043/2045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:21 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:22.552807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:22.553256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:22.554524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:22.554979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:22.561192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:22.563107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:22.579294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:22.588136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:22.589461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:22.590565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:22.756773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:22.923363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12a9564b-a923-4dc2-8d77-728a5b1ee4eb tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.732241 May 10 02:18:22.929641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1003/2046] 10.222.0.52 () {58 vars in 1153 bytes} [Tue May 10 02:18:22 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:22.946462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:22.947552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:22.964257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:22.965102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:22.966297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:22.967887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:23.392119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:23.407313 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-85b83d30-05d0-4054-80f0-db2841bb5ec3 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1380 microversion: 2.1 time: 0.858321 May 10 02:18:23.409943 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1044/2047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:22 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1380 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:23.427502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:23.432717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:23.452535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:23.455274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:23.457320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:23.459224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:23.506025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:23.523427 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18d1a52a-e85f-41b4-9ff7-9f178ce168db tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.591422 May 10 02:18:23.524039 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1004/2048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:22 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:23.528994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:23.541906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:23.553893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:23.555141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:23.564405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:23.571906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:23.740131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:23.757891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:23.762926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:23.769196 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07ca7387-c6ee-4fda-8dbb-6b1cf6010af1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.352955 May 10 02:18:23.773791 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1045/2049] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:23 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:23.787217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:23.789311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:23.803575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:23.806232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:23.807922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:23.814517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:24.319181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:24.344523 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6eb0e22f-6d56-420c-963a-3fce2da71598 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1509 microversion: 2.1 time: 0.819358 May 10 02:18:24.345145 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1005/2050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:23 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1509 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:24.359532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-81917329-59af-4807-91f2-0f2153da620f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '.version_select at 0x7f3d3664e0d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:24.362102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81917329-59af-4807-91f2-0f2153da620f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:24.362563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81917329-59af-4807-91f2-0f2153da620f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:24.390292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:24.408143 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7c868d1-361e-4001-9806-819fc39a5e7b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1469 microversion: 2.1 time: 0.632291 May 10 02:18:24.415364 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1046/2051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:23 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1469 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:24.440281 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-81917329-59af-4807-91f2-0f2153da620f tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 4661 microversion: 2.1 time: 0.093997 May 10 02:18:24.440671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:24.441630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:24.450976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1006/2052] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:18:24 2022] GET /compute/v2.1/os-migrations => generated 4661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:24.458779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:24.466158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:24.469443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:24.475877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:24.477011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:24.477633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:24.488774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:24.493722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:24.504202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:24.505019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:24.973788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:25.006527 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-af329604-3627-4312-96a9-bc8fd243550a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.571248 May 10 02:18:25.012873 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1047/2053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:24 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:25.040553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:25.041198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:25.052921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.053381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.054182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.054623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.106784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:25.120137 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75d012a8-7042-4da5-8911-c704270a47e8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2" status: 200 len: 1512 microversion: 2.1 time: 0.664999 May 10 02:18:25.135017 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1007/2054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:24 2022] GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 => generated 1512 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:25.140844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:25.142463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:25.152882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.153615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.154808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.155469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.348089 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-81176c43-db9c-4ecf-a680-fddae868749f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "POST /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17/action" status: 202 len: 0 microversion: 2.1 time: 0.332344 May 10 02:18:25.348984 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1048/2055] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:18:25 2022] POST /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:18:25.359416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:25.360148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:25.375371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.375832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.376642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.380882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.416165 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-503579a2-ddb9-428e-bdef-e5add5a08057 tempest-LiveMigrationTest-782670101 tempest-LiveMigrationTest-782670101-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1531 microversion: 2.1 time: 0.279477 May 10 02:18:25.420622 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1008/2056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:25 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1531 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:25.425722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:25.449055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:25.478450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.480720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.483125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.483755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.677244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:25.696506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:25.698107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:25.711258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b380f643-f26b-426d-9da3-89aa8138d9ad tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.287093 May 10 02:18:25.711884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1009/2057] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:25 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:25.733505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:25.737886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:25.758586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.761353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:25.764639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.768132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.770779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae63f440-ce3e-4587-9fd1-2ed687a2e572 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.420604 May 10 02:18:25.771345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.775122 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1049/2058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:25 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:25.807514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:25.809055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:25.845639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.846109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:25.846922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:25.847400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:26.531670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:26.543861 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8021a7d2-b3fb-4bda-8134-0d3579eddef4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.767459 May 10 02:18:26.550107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1050/2059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:25 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:26.575135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:26.583643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:26.603546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:26.604162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:26.605170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:26.605864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:26.614599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:26.649311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-79ce6ae0-ee20-4af0-bba9-773e23e10b72 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1513 microversion: 2.1 time: 0.924229 May 10 02:18:26.659721 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1010/2060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:25 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1513 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:26.682466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:26.685807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:26.702086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:26.713672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:26.715464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:26.720029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:26.726579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:26.888786 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3b5747e-ba98-4848-b487-155d2dddd4e1 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 204 len: 0 microversion: 2.1 time: 0.323310 May 10 02:18:26.896086 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1051/2061] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:26 2022] DELETE /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:26.906078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:26.923582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:26.924476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:26.963015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:26.970577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:26.974495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:26.976673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:27.042379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:27.137395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:27.152494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:27.152955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:27.612249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:27.631803 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d76bf8f-6524-4416-beb9-84768d591e4c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.967887 May 10 02:18:27.633104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1011/2062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:26 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:27.650599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:27.657220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:27.675226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:27.680371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:27.692791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:27.694923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:27.701906 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad595fdd-88c3-4d74-a4f6-dd9953058650 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.804374 May 10 02:18:27.702735 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1052/2063] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:18:26 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:27.708174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:27.708915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:27.743622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:27.748669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:27.749838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:27.750496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.011823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:28.030417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:28.040337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:28.043832 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e9d1f57-748c-4acf-a5f2-d4a480575bbf tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.407350 May 10 02:18:28.045054 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1012/2064] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:27 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:28.054268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:28.064116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:28.096868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:28.108083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.115441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:28.116552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.439671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:28.449263 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d10209db-bfc4-4795-a497-244dc4433ad6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.745447 May 10 02:18:28.461870 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1053/2065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:27 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:28.465372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:28.466120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:28.484969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:28.485430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.488064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:28.488837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.529306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:28.551736 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db4bdf77-e26f-44b6-8850-359a49de90d8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1386 microversion: 2.1 time: 0.502867 May 10 02:18:28.552769 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1013/2066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:28 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1386 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:28.560313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:28.577991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:28.581709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:28.903731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:28.904961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.905972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:28.906598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:28.988108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:29.190285 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0babe541-af83-4aa9-8b7e-0a2dfffc83c3 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.632053 May 10 02:18:29.194932 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1014/2067] 10.222.0.52 () {58 vars in 1149 bytes} [Tue May 10 02:18:28 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:29.209804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:29.210881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:29.223275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.224180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.225270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.225945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.230773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:29.260943 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-96fab75f-5a6a-45bb-a6d1-7258c34d6fd4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.809961 May 10 02:18:29.264481 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1054/2068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:28 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:29.278670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1d0aefeb-704d-4920-82ab-e65d1fd7f8f8 req-282703d2-1aae-46ec-9a02-2c645aaf3565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c903ce72-ce77-47a6-bf37-8712418785a7", "name": "network-vif-deleted", "tag": "c1d64c5c-eb66-43af-990e-ab90cb339c0b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:29.312331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1d0aefeb-704d-4920-82ab-e65d1fd7f8f8 req-282703d2-1aae-46ec-9a02-2c645aaf3565 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.316394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1d0aefeb-704d-4920-82ab-e65d1fd7f8f8 req-282703d2-1aae-46ec-9a02-2c645aaf3565 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.348711 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1d0aefeb-704d-4920-82ab-e65d1fd7f8f8 req-282703d2-1aae-46ec-9a02-2c645aaf3565 service nova] Creating event network-vif-deleted:c1d64c5c-eb66-43af-990e-ab90cb339c0b for instance c903ce72-ce77-47a6-bf37-8712418785a7 on n-h1-841089-2 May 10 02:18:29.359727 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1d0aefeb-704d-4920-82ab-e65d1fd7f8f8 req-282703d2-1aae-46ec-9a02-2c645aaf3565 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093641 May 10 02:18:29.361297 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1055/2069] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:29.368664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0c6d1182-3f2a-428e-be3f-e54cb21e1d24 req-4c27de77-f041-4a35-81e5-4a9ee0aeecce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "name": "network-vif-plugged", "status": "completed", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:29.385676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0c6d1182-3f2a-428e-be3f-e54cb21e1d24 req-4c27de77-f041-4a35-81e5-4a9ee0aeecce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.386265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0c6d1182-3f2a-428e-be3f-e54cb21e1d24 req-4c27de77-f041-4a35-81e5-4a9ee0aeecce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.408363 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0c6d1182-3f2a-428e-be3f-e54cb21e1d24 req-4c27de77-f041-4a35-81e5-4a9ee0aeecce service nova] Creating event network-vif-plugged:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h2-841089-2 May 10 02:18:29.418525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-0c6d1182-3f2a-428e-be3f-e54cb21e1d24 req-4c27de77-f041-4a35-81e5-4a9ee0aeecce service nova] Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:18:29.440454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0c6d1182-3f2a-428e-be3f-e54cb21e1d24 req-4c27de77-f041-4a35-81e5-4a9ee0aeecce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076589 May 10 02:18:29.441463 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1056/2070] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:29.459811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:29.463555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:29.481711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.482309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.483885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.485461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.513467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:29.523757 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db359bc5-eb82-4bf5-a947-84b0a36994ba tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.327284 May 10 02:18:29.529233 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1015/2071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:29 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:29.537031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:29.546370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:29.549664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:29.565120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.567337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.569175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.570570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.683425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:29.705691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:29.708913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:29.723995 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b23bfeb-61e8-4744-8e3f-a6b9ceb4ebdd tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.266006 May 10 02:18:29.734021 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1057/2072] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:29 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:29.734021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:29.734021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:29.744235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.744846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.745661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:29.746110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:29.891614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:30.023432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:30.034229 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44b0b345-83fb-47f1-aa3f-6b3c0aee48ea tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.307864 May 10 02:18:30.047459 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1058/2073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:29 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:30.067883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:30.068523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:30.087993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.088462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.089267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.089716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.258443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:30.265609 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07ec5a60-ab62-469e-94e9-c50485292186 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.216947 May 10 02:18:30.294005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1059/2074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:30 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:30.303739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:30.304381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:30.327207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.327747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.328579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.329078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.634361 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7593d98d-7f69-4ec8-b8d1-3edc1a3b1f8a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 1.103118 May 10 02:18:30.654975 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1016/2075] 10.222.0.52 () {58 vars in 1211 bytes} [Tue May 10 02:18:29 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:30.664113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:30.672059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a889de55-77ed-4a21-b3e3-9196314fdada tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.376778 May 10 02:18:30.675381 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1060/2076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:30 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:30.679513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:30.680144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:30.690916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:30.710100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.710559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.711419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.711887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.715875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:30.716389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:30.721944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.722403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.723280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:30.723729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:30.967371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:31.028381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.036681 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20d009a2-6464-4ccc-a17a-c9f068de3dad tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.380272 May 10 02:18:31.048817 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1017/2077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:30 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:31.055895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:31.056537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:31.077124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.077548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.078374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.078808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.166014 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bd9de70-fe9d-44db-8edb-b2c7618243ea tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.489521 May 10 02:18:31.166612 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1061/2078] 10.222.0.52 () {58 vars in 1195 bytes} [Tue May 10 02:18:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:31.193561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:31.194240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:31.218825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.219241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.220046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.220492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.244743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.254557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.256161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.257329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da2992a1-1bb6-4dc8-931a-c52536d7d0be tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.213958 May 10 02:18:31.257885 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1018/2079] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:31 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:31.321610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:31.338658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.341932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': 'ce-5846648', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:31.356095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.357609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.362325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.362910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.654091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.663268 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-072c65a0-9a48-4a71-8d15-234f9e8cd260 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.477397 May 10 02:18:31.668211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1062/2080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:31 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:31.686525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:31.687517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:31.709711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.714804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.717367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.718650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.796604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:31.860852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:31.869774 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf76e762-c42a-40ba-970a-e46e8702debc tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.198329 May 10 02:18:31.870569 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1063/2081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:31 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:31.898477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:31.898756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:31.907418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.907916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:31.908750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:31.909200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.069753 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a993e868-8bf0-4a7f-b6f1-ecc806917c8d tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?name=ce-5846648" status: 200 len: 343 microversion: 2.1 time: 0.808066 May 10 02:18:32.084160 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1019/2082] 10.222.0.52 () {58 vars in 1155 bytes} [Tue May 10 02:18:31 2022] GET /compute/v2.1/servers?name=ce-5846648 => generated 343 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:32.122864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:32.125288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:32.145690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.147336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.148339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.157450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.300387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.308871 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-789dec36-c73e-4894-a2a7-3eb032e12703 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.416251 May 10 02:18:32.322991 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1064/2083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:31 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:32.335041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:32.361067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.361811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:32.383300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.383757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.397896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.397896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.572058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.580193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a574b161-2e5d-433f-99a2-c943a274904c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.494738 May 10 02:18:32.580819 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1020/2084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:32 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:32.597597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:32.599406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:32.600296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:32.656278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.657035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.658762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.661741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.741300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7edf16fe-fcec-428b-ba01-c1cbe6d3e19e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.416799 May 10 02:18:32.745300 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1065/2085] 10.222.0.52 () {58 vars in 1153 bytes} [Tue May 10 02:18:32 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:32.754503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:32.756614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:32.771989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.772753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.773805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.774562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.862484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.873554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.898454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.900005 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e0941b8a-dde9-4042-b9e2-ecf792666531 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.318292 May 10 02:18:32.901029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1021/2086] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:32 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:32.907590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:32.923382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:32.924095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-584664', 'deleted': False, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:18:32.950238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.950702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:32.951556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:32.952008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.164721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:33.175223 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d39d9577-f075-4af2-b193-16095240eb55 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.428573 May 10 02:18:33.192160 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1066/2087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:32 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:33.198604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:33.208131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:33.220206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:18:33.230719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.234046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.238845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.243288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.373391 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-184bb32f-7d7b-4e5f-8634-d2178f7b7ac5 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-584664" status: 200 len: 343 microversion: 2.1 time: 0.470886 May 10 02:18:33.374601 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1022/2088] 10.222.0.52 () {58 vars in 1221 bytes} [Tue May 10 02:18:32 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-584664 => generated 343 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:33.384137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:33.387220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:33.408909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.419710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.420864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.421491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.461579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:33.483884 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-177f53af-a9dd-4488-af9a-ed332f3a6578 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.288141 May 10 02:18:33.486185 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1067/2089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:33 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:33.500427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:33.505232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:33.526656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.527432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.530404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.543758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.598204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:33.688522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:33.704786 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1997b6b1-b780-4c62-8277-2edd81fc28e2 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.327177 May 10 02:18:33.706990 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1023/2090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:33 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:33.718096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:33.728267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:33.748142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.748663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.750688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.751151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.849332 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae6ce52b-a694-47b7-b8e1-1e807220aa28 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 204 len: 0 microversion: 2.1 time: 0.360573 May 10 02:18:33.850239 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1068/2091] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:33 2022] DELETE /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:33.855719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2cb1dfd3-5beb-4cd2-ad13-81f0caac9923 req-f56dd179-cc84-4b63-8000-f3501264711b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "name": "network-vif-unplugged", "status": "completed", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:33.898683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2cb1dfd3-5beb-4cd2-ad13-81f0caac9923 req-f56dd179-cc84-4b63-8000-f3501264711b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:33.899203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2cb1dfd3-5beb-4cd2-ad13-81f0caac9923 req-f56dd179-cc84-4b63-8000-f3501264711b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:33.934232 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2cb1dfd3-5beb-4cd2-ad13-81f0caac9923 req-f56dd179-cc84-4b63-8000-f3501264711b service nova] Creating event network-vif-unplugged:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h1-841089-2 May 10 02:18:33.952910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-2cb1dfd3-5beb-4cd2-ad13-81f0caac9923 req-f56dd179-cc84-4b63-8000-f3501264711b service nova] Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:18:33.984707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2cb1dfd3-5beb-4cd2-ad13-81f0caac9923 req-f56dd179-cc84-4b63-8000-f3501264711b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132840 May 10 02:18:33.985931 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1069/2092] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:34.014810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:34.015577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:34.051642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.052248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.053668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.055381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.119734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.128321 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90f2e4fd-d17b-43bd-8941-f02ad3b4d3e8 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.419683 May 10 02:18:34.128957 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1024/2093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:33 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:34.140148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:34.140777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:34.170485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.170964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.171829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.172281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.382207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.396196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.459862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.461582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.462837 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5d099ac-1e7d-4670-a08d-c55bb2c1f8d4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.332923 May 10 02:18:34.469039 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1025/2094] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:34 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:34.493320 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0498529-973f-4256-a4c6-888c84be2f13 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1519 microversion: 2.1 time: 0.492923 May 10 02:18:34.496870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:34.497486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1070/2095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:33 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1519 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:34.497662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:34.503684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:34.511020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.511539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.512364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.512819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.515153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:34.532762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.533295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.534156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.536639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.719812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.737639 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-48c24205-e268-4d74-ac65-e370ba700286 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.234953 May 10 02:18:34.738865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1071/2096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:34 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:34.743713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:34.745652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:34.760403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.762405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.763707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:34.771881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:34.897958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:34.906748 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d56e5167-73af-404c-aa48-8895dd06c5cd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.421046 May 10 02:18:34.920208 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1026/2097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:34 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:35.145877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:35.146527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:35.165370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:35.165952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:35.166932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:35.167287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:35.702499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:35.716877 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b9bb7c1-70f4-446e-b2bf-71635ef90245 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.976606 May 10 02:18:35.718051 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1072/2098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:34 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:35.723509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:35.730723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:35.745173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:35.746112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:35.747186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:35.747839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:35.852796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:35.862394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:35.869245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:35.875448 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dcb49201-ad94-48fe-8149-29f9f84e9f9c tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.151823 May 10 02:18:35.876835 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1073/2099] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:35 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:35.881718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:35.882342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:35.897651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:35.905632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:35.906722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:35.907377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.241088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:36.249408 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e94adf86-2a5e-4f06-a8f4-943b8893c58c tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 1.108019 May 10 02:18:36.252587 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1027/2100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:35 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:18:36.264444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:36.265930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:36.279425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.280297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.281979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.282911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.326220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:36.334037 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e35fbbda-034c-4e3d-b3e1-58954664596a tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1519 microversion: 2.1 time: 0.456110 May 10 02:18:36.348658 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1074/2101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:35 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:36.360145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:36.360965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:36.372948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.373463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.374447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.374896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.468834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:36.481736 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8386dc54-ab75-40a2-8b0d-ec3c6c1d100e tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.226116 May 10 02:18:36.485207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1028/2102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:36 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:36.492849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0c3206cd-3598-4359-864c-9ccaab1fbdd3 req-15e19f62-8950-45e3-bff1-2f74f804b842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:36.522019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0c3206cd-3598-4359-864c-9ccaab1fbdd3 req-15e19f62-8950-45e3-bff1-2f74f804b842 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.522928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0c3206cd-3598-4359-864c-9ccaab1fbdd3 req-15e19f62-8950-45e3-bff1-2f74f804b842 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.552505 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0c3206cd-3598-4359-864c-9ccaab1fbdd3 req-15e19f62-8950-45e3-bff1-2f74f804b842 service nova] Creating event network-changed:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h1-841089-2 May 10 02:18:36.564934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-0c3206cd-3598-4359-864c-9ccaab1fbdd3 req-15e19f62-8950-45e3-bff1-2f74f804b842 service nova] Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:18:36.593298 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0c3206cd-3598-4359-864c-9ccaab1fbdd3 req-15e19f62-8950-45e3-bff1-2f74f804b842 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106591 May 10 02:18:36.595139 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1029/2103] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:36.740632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:36.741680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:36.757557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.759591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.760704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:36.768013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:36.790764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:36.799250 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-66db2bcc-12a8-4597-9813-3e21f3fd4b64 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.449411 May 10 02:18:36.814686 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1075/2104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:36 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:37.057855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-868205970", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "91ced21e-0978-43fa-9e67-62c398bf53c5"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:37.119906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:37.133081 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3398b9c9-3664-4ce4-8296-3739a2f78381 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 0.402451 May 10 02:18:37.143427 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1030/2105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:36 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:37.148441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:37.158444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:37.171674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] validate_networks() for [('91ced21e-0978-43fa-9e67-62c398bf53c5', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:18:37.172875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:37.174693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:37.179278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:37.180195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:37.318430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:37.334693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:37.336808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:37.338196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b45aa8fa-7e88-45b3-bf79-67f5fe59479a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1266 microversion: 2.25 time: 0.199485 May 10 02:18:37.341878 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1031/2106] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:37 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:37.348769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:37.364538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:37.370922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:37.371959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:37.373077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:37.373764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:37.777909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:37.787457 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e648b99-da73-4114-be00-a0d22001c5cf tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.444239 May 10 02:18:37.793609 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1032/2107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:37 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:37.805527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:37.806162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:37.822713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:37.823251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:37.824093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:37.829269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:37.964170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:37.977835 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4be918f0-3248-484d-8c62-12974f561818 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 200 len: 1477 microversion: 2.1 time: 0.182330 May 10 02:18:37.987042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1033/2108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:37 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 1477 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:37.994938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:37.997591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:38.006193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:18:38.007940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:18:38.009240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:18:38.009891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:18:38.010562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:18:38.014001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.014259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.016425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.016905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.023057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.023883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.034516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.035891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.060337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Getting quotas for project 541f66b5bd0241e2a470461daceb2f3e. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:18:38.066647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Getting quotas for user ff40ce43b5a14bfaa08e172d5d646758 and project 541f66b5bd0241e2a470461daceb2f3e. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:18:38.100530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:18:38.102860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:18:38.128143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:38.140396 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b3a6de6-1c75-4644-9f51-50ba4a7642a5 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.155984 May 10 02:18:38.150624 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1034/2109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:37 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:38.158562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:38.159473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:38.167286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.167794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.168781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.169230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.178444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a87b88d-eeca-46cb-a163-a078ea6aa604 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.357085 May 10 02:18:38.181382 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1076/2110] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:18:38.186256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-181be44d-993b-4502-a72a-bd89b59eb76f req-d923179b-80bc-426d-8e0a-0a5f7cd449a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe149f07-9f6d-4e73-b603-4ab1f3c25f3f", "name": "network-vif-deleted", "tag": "5277daba-8e22-46ef-a059-b95c0b10c1f1"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:38.198468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-181be44d-993b-4502-a72a-bd89b59eb76f req-d923179b-80bc-426d-8e0a-0a5f7cd449a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.199244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-181be44d-993b-4502-a72a-bd89b59eb76f req-d923179b-80bc-426d-8e0a-0a5f7cd449a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.216478 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-181be44d-993b-4502-a72a-bd89b59eb76f req-d923179b-80bc-426d-8e0a-0a5f7cd449a3 service nova] Creating event network-vif-deleted:5277daba-8e22-46ef-a059-b95c0b10c1f1 for instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f on n-h1-841089-2 May 10 02:18:38.229075 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-181be44d-993b-4502-a72a-bd89b59eb76f req-d923179b-80bc-426d-8e0a-0a5f7cd449a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046323 May 10 02:18:38.230332 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1077/2111] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:38.238203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:38.239194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:38.246777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.247502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.248460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:38.249081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:38.398976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:38.435473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-558b7602-ce4d-4de9-a5ac-3b575379fca2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1522 microversion: 2.1 time: 0.283136 May 10 02:18:38.438763 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1035/2112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:38 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:38.445519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbf340b2-bd9c-435c-bfbf-bf3790c91357 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:38.446157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbf340b2-bd9c-435c-bfbf-bf3790c91357 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:38.998690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbf340b2-bd9c-435c-bfbf-bf3790c91357 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:39.008991 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbf340b2-bd9c-435c-bfbf-bf3790c91357 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1223 microversion: 2.1 time: 0.568978 May 10 02:18:39.018838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1036/2113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:38 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1223 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:39.026422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:39.027349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:39.068258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.068573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.078873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.079628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.174119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.174616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.175174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lazy-loading 'fault' on Instance uuid d79ad69c-a8de-4eba-ae8a-15cabb868a48 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:18:39.370637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:39.384798 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0a22b84-ef07-4630-a4be-b617d79b7d41 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1468 microversion: 2.1 time: 1.152832 May 10 02:18:39.394651 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1078/2114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:38 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1468 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:39.407446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:39.408304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:39.422637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.424133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.427272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.435755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.712611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:39.723442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:39.726542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:39.729582 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61f1e7e2-6785-4d6b-90c7-ad954ef12032 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 200 len: 1194 microversion: 2.25 time: 0.716563 May 10 02:18:39.734405 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1037/2115] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:39 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 1194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:18:39.746936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:39.747846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: fe149f07-9f6d-4e73-b603-4ab1f3c25f3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:39.760014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.760777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.761750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.762389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.794914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] HTTP exception thrown: Instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f could not be found. May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Request method failure captured: May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f HTTP/1.1 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecsWYQAUO1ofEVfXSr27AOUNXRn-P331jUN8lH3wv8OXMamTRvLIpTycmYl21qyHAq-Yko-xECEF87791r1oTtnYM1pN7J-xOX-0Iux3I-ENLU9JeVxM0mKecx01klLY5ockJ4roQZW7ll9GdC2jmki89Y272C7c_WhhC-IJGb8bRq4 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e74bbc4e5bd7461280d19a1719f1e817 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e74bbc4e5bd7461280d19a1719f1e817", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e74bbc4e5bd7461280d19a1719f1e817 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ListServerFiltersTestJSON-297537100-project May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c2de0a50bc304f7aa3aec50df6d5f6a2 May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ListServerFiltersTestJSON-297537100-project May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f could not be found. May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fe149f07-9f6d-4e73-b603-4ab1f3c25f3f'} May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f could not be found. May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f could not be found. May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:39.796981 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f could not be found. May 10 02:18:39.802795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:39.804980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Returning 404 to user: Instance fe149f07-9f6d-4e73-b603-4ab1f3c25f3f could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:39.806020 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a8aac59-334c-415f-93d8-6812c3af6ec4 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f" status: 404 len: 111 microversion: 2.1 time: 0.070369 May 10 02:18:39.809235 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1038/2116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:39 2022] GET /compute/v2.1/servers/fe149f07-9f6d-4e73-b603-4ab1f3c25f3f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:39.819146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:39.821622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:39.847566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.848838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.850706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:39.851384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:39.971827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:39.983007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-595a9264-f828-4d7d-82a9-2c93685f1cf7 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1525 microversion: 2.1 time: 0.587029 May 10 02:18:39.983775 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1079/2117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:39 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1525 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:39.993940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:39.999911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:40.010733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.011502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.025502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.026485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.094021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:40.127678 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2c68bbc-7ad7-4260-844d-4840ddb275ad tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.313063 May 10 02:18:40.136845 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1039/2118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:39 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:40.147561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:40.148973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:40.155425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.170825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.172761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.173484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.223449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:40.344756 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c79b6a0-6ad7-4d9b-a160-ab36fca294f8 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2" status: 204 len: 0 microversion: 2.1 time: 0.206110 May 10 02:18:40.352085 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1040/2119] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:40 2022] DELETE /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:40.358847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:40.365367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:40.379916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.381973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.383678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.384130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.430228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:40.469452 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f37e5b7-679f-4a17-9434-dc5ee0815c18 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1504 microversion: 2.1 time: 0.479352 May 10 02:18:40.472138 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1080/2120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:39 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:40.484665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:40.489760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:40.501713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.507767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.508858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.509483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.642920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:40.653749 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-69216dff-5729-4b7a-a28c-5cf82a603f13 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1275 microversion: 2.1 time: 0.302797 May 10 02:18:40.664084 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1041/2121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:40 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:40.671305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:40.676713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:40.683625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.684576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:40.685675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:40.686412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:41.423988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:41.437183 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7586908d-c794-4618-94fe-f595bb283361 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2" status: 200 len: 1518 microversion: 2.1 time: 0.963672 May 10 02:18:41.446577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1081/2122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:40 2022] GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 => generated 1518 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:41.448325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:41.448974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: d79ad69c-a8de-4eba-ae8a-15cabb868a48] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:41.464768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:41.465247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:41.466072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:41.466527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:41.514369 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] HTTP exception thrown: Instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 could not be found. May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Request method failure captured: May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 HTTP/1.1 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecnN9UgZMce8gAF5DXMP-_YikgKvbiq2fpaaPaBwEnuA7A-BVOiHV1tGbIq_OO8o3MhjCDfI50QSJhuOVeVFHlBcs4q1Y7EacsdIUaXRPusUNgM5lLt5PebJzmT-8vYdC1GbwPjmr-gQZaAMKZB3ZI910dA9A-n8SrNFV5ln-Rz4fFA May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.25 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4769c530b40f4f60a8f28b291bcc5c31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b31e1f4aa1eb4cceb37e10f1b8f7b3f2 May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 could not be found. May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd79ad69c-a8de-4eba-ae8a-15cabb868a48'} May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 could not be found. May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 could not be found. May 10 02:18:41.522222 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 could not be found. May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Returning 404 to user: Instance d79ad69c-a8de-4eba-ae8a-15cabb868a48 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e949b308-a6fc-4b0e-a568-005b7fc2fa4a tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48" status: 404 len: 111 microversion: 2.25 time: 0.084676 May 10 02:18:41.528238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1082/2123] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:18:41 2022] GET /compute/v2.1/servers/d79ad69c-a8de-4eba-ae8a-15cabb868a48 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:18:41.537895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:41.538538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:41.555408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:41.555797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:41.556617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:41.557070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:42.353456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:42.361711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:42.398401 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1108b9be-5791-4f96-9163-4c52f60b73f0 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1461 microversion: 2.1 time: 1.726951 May 10 02:18:42.398945 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbe379d4-0d18-446e-81e0-582b91a798fb tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1505 microversion: 2.1 time: 0.867552 May 10 02:18:42.406598 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1042/2125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:40 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1461 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:42.407023 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1083/2125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:41 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1505 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:42.437159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:42.437843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:42.438592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:42.439423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:42.470106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:42.470646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:42.471524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:42.474447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:42.474938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:42.475800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:42.477609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:42.480381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:42.614481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:42.623869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7739ad41-532b-4419-8e7c-ff5c4081f1f0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.215347 May 10 02:18:42.625359 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1084/2126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:42 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:42.630780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:42.631774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:42.647148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:42.648799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:42.649795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:42.650827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.023361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:43.040610 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43dc7e08-2fec-44c9-b6bd-3aeb47094359 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1281 microversion: 2.1 time: 0.404507 May 10 02:18:43.050033 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1085/2127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:42 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1281 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:43.050033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e1f44a68-c076-4d7c-9d63-cdbdb234df0a req-e9609a28-5b01-46f6-b78a-7bc4ad0ab5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbaee6dd-516c-4d79-a64e-f315148ab080", "name": "network-vif-unplugged", "status": "completed", "tag": "2b6e05e6-bd81-4a6b-a0b7-defb0654e450"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:43.062727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e1f44a68-c076-4d7c-9d63-cdbdb234df0a req-e9609a28-5b01-46f6-b78a-7bc4ad0ab5a1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.064544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e1f44a68-c076-4d7c-9d63-cdbdb234df0a req-e9609a28-5b01-46f6-b78a-7bc4ad0ab5a1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.095395 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e1f44a68-c076-4d7c-9d63-cdbdb234df0a req-e9609a28-5b01-46f6-b78a-7bc4ad0ab5a1 service nova] Creating event network-vif-unplugged:2b6e05e6-bd81-4a6b-a0b7-defb0654e450 for instance dbaee6dd-516c-4d79-a64e-f315148ab080 on n-h2-841089-2 May 10 02:18:43.105076 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e1f44a68-c076-4d7c-9d63-cdbdb234df0a req-e9609a28-5b01-46f6-b78a-7bc4ad0ab5a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061760 May 10 02:18:43.105864 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1086/2128] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:43.182738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:43.193014 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e631ae2-0110-41ab-83b9-0622503e1b40 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1504 microversion: 2.1 time: 0.781328 May 10 02:18:43.193926 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1043/2129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:42 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1504 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:43.201762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ca82499-d660-480e-b819-924df4311c61 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'create', calling method: .version_select at 0x7f3d37534700>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-35945252", "description": "tempest-description-1234346147"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:43.359294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:43.360121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:43.371082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.371818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.372844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.373548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.596094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cc80c86-2b91-4a37-accf-47a763a23132 tempest-MigrationsAdminTest-1927221714 tempest-MigrationsAdminTest-1927221714-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1612 microversion: 2.1 time: 0.489183 May 10 02:18:43.600530 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1087/2130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:43 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1612 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:43.618138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:43.618138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: d4a780ec-ee5c-47ef-8d19-a3ea5b345af2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:43.636727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.637334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.638292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.639907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.641368 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ca82499-d660-480e-b819-924df4311c61 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.446068 May 10 02:18:43.642332 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1044/2131] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:18:43 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:43.652718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-34804e6b-cad4-43a8-8a5d-5dde96259c4e req-faf77ce0-9e9c-43d9-af74-1834bb056e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a780ec-ee5c-47ef-8d19-a3ea5b345af2", "name": "network-vif-deleted", "tag": "0d9c374f-57d1-4bde-9cc6-0dab263a8a93"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:43.663161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-34804e6b-cad4-43a8-8a5d-5dde96259c4e req-faf77ce0-9e9c-43d9-af74-1834bb056e9a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.664996 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] HTTP exception thrown: Instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 could not be found. May 10 02:18:43.665209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-34804e6b-cad4-43a8-8a5d-5dde96259c4e req-faf77ce0-9e9c-43d9-af74-1834bb056e9a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Request method failure captured: May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 HTTP/1.1 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecsWYQAUO1ofEVfXSr27AOUNXRn-P331jUN8lH3wv8OXMamTRvLIpTycmYl21qyHAq-Yko-xECEF87791r1oTtnYM1pN7J-xOX-0Iux3I-ENLU9JeVxM0mKecx01klLY5ockJ4roQZW7ll9GdC2jmki89Y272C7c_WhhC-IJGb8bRq4 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e74bbc4e5bd7461280d19a1719f1e817 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e74bbc4e5bd7461280d19a1719f1e817", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e74bbc4e5bd7461280d19a1719f1e817 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServerFiltersTestJSON-297537100-project May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c2de0a50bc304f7aa3aec50df6d5f6a2 May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServerFiltersTestJSON-297537100-project May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 could not be found. May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd4a780ec-ee5c-47ef-8d19-a3ea5b345af2'} May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 could not be found. May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 could not be found. May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:43.666945 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 could not be found. May 10 02:18:43.672343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:43.674461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Returning 404 to user: Instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:43.675245 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9092d825-522c-4f63-9906-2e92e6843419 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2" status: 404 len: 111 microversion: 2.1 time: 0.063399 May 10 02:18:43.679718 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1088/2132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:43 2022] GET /compute/v2.1/servers/d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:43.684755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:43.685357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:43.693548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.694299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.695353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.696025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.698271 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-34804e6b-cad4-43a8-8a5d-5dde96259c4e req-faf77ce0-9e9c-43d9-af74-1834bb056e9a service nova] Creating event network-vif-deleted:0d9c374f-57d1-4bde-9cc6-0dab263a8a93 for instance d4a780ec-ee5c-47ef-8d19-a3ea5b345af2 on n-h1-841089-2 May 10 02:18:43.713709 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-34804e6b-cad4-43a8-8a5d-5dde96259c4e req-faf77ce0-9e9c-43d9-af74-1834bb056e9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070043 May 10 02:18:43.717555 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1045/2133] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:43.729989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:43.734681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:43.735693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:43.745809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.751635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.752720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.753287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.831476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:43.841275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5924424d-ee52-4612-b6f8-51ec3abae794 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.119050 May 10 02:18:43.853564 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1046/2134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:43 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:43.860927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-35945252"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:43.862727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:43.872688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.873534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.875278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.876001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.878039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b27a34b-8df1-4864-8563-c5462e43f3f7 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 204 len: 0 microversion: 2.1 time: 0.196899 May 10 02:18:43.882722 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1089/2135] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:43 2022] DELETE /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:43.892609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:43.895454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:43.907709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.910405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:43.912139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:43.914382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:44.184420 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.network.security_group_api [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Adding security group ac528ded-8058-4f09-bb57-4d81cc786ee4 to port a4ef80af-8258-4acc-9ea2-01f766290a7b May 10 02:18:44.328357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:44.503421 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-df0d4cb7-4f13-435e-8b9e-163e65ee995e tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 204 len: 0 microversion: 2.1 time: 0.620490 May 10 02:18:44.505177 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1090/2136] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:43 2022] DELETE /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:44.510875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:44.511940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:44.520096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:44.527636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:44.528946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:44.529580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:44.838955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:44.875813 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-605d3158-d063-4c49-bfae-6e56bd69d0e9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 200 len: 1467 microversion: 2.1 time: 0.367218 May 10 02:18:44.876678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1091/2137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:44 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 1467 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:44.881414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:44.882045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:44.904980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:44.906375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:44.907922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:44.914884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.236510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:45.248241 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1ea635a-0ee9-4f69-881f-8a53173c97fc tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1323 microversion: 2.1 time: 0.370167 May 10 02:18:45.249935 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1092/2138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:44 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:45.260169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:45.260823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:45.289682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.290215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.291042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.291521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.369813 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d430da1-c1b1-453a-9cc4-af0e0254981e tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action" status: 202 len: 0 microversion: 2.1 time: 1.514875 May 10 02:18:45.371329 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1047/2139] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:18:43 2022] POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action => generated 0 bytes in 1517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:18:45.376504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:45.377503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:45.396726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.397473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.398479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.399155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.590968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:45.603336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c05feffb-3f71-4a04-93db-de1ce2d051e8 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 200 len: 1447 microversion: 2.1 time: 0.349750 May 10 02:18:45.604047 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1093/2140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:45 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 1447 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:45.615584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:45.628156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:45.640165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.640165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.640165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.640165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.817151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:45.831307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce6efc10-348b-45ad-87f6-06941940bc26 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.223039 May 10 02:18:45.834569 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1094/2141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:45 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:45.849288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d5713904-e688-47eb-b4fa-9e72803486bd req-9a0e97f0-0e2a-4254-b66c-5b0074eace4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "name": "network-vif-plugged", "status": "completed", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:45.863680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d5713904-e688-47eb-b4fa-9e72803486bd req-9a0e97f0-0e2a-4254-b66c-5b0074eace4c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.866566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d5713904-e688-47eb-b4fa-9e72803486bd req-9a0e97f0-0e2a-4254-b66c-5b0074eace4c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.898470 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d5713904-e688-47eb-b4fa-9e72803486bd req-9a0e97f0-0e2a-4254-b66c-5b0074eace4c service nova] Creating event network-vif-plugged:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h1-841089-2 May 10 02:18:45.916596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2de0a50bc304f7aa3aec50df6d5f6a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74bbc4e5bd7461280d19a1719f1e817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:45.927721 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d5713904-e688-47eb-b4fa-9e72803486bd req-9a0e97f0-0e2a-4254-b66c-5b0074eace4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073733 May 10 02:18:45.929042 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1095/2142] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:45.930938 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e6490fa-c5e9-47bc-95af-647680d65ba6 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 200 len: 1515 microversion: 2.1 time: 0.554935 May 10 02:18:45.931830 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1048/2143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:45 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 1515 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:45.942188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-42009eec-56bf-4751-aacd-6f4da0f9a143 req-49562816-616f-45ba-97db-1d0cbb3c513f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:45.942674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-35945252"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:45.943562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:45.953895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.962673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.965203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42009eec-56bf-4751-aacd-6f4da0f9a143 req-49562816-616f-45ba-97db-1d0cbb3c513f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.966350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:45.966798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.969390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42009eec-56bf-4751-aacd-6f4da0f9a143 req-49562816-616f-45ba-97db-1d0cbb3c513f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:45.993112 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-42009eec-56bf-4751-aacd-6f4da0f9a143 req-49562816-616f-45ba-97db-1d0cbb3c513f service nova] Creating event network-changed:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:18:46.003302 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-42009eec-56bf-4751-aacd-6f4da0f9a143 req-49562816-616f-45ba-97db-1d0cbb3c513f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065861 May 10 02:18:46.006544 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1049/2144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:46.015476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:46.016427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:46.028313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:46.030114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:46.031350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:46.032349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:46.086198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:46.093800 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Working on deleting snapshot 378e4202-c412-4ecb-a79f-bede03a71f4b from shelved instance... May 10 02:18:46.719298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.network.security_group_api [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Removing security group ac528ded-8058-4f09-bb57-4d81cc786ee4 from port a4ef80af-8258-4acc-9ea2-01f766290a7b May 10 02:18:47.003580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Doing local delete in cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=118717) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 10 02:18:47.004986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:47.007364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:47.010707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 10 02:18:47.028384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] deallocate_for_instance() {{(pid=118717) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 10 02:18:48.632409 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae19f258-ddbd-4f69-b88f-532cfce3efb3 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action" status: 202 len: 0 microversion: 2.1 time: 2.701715 May 10 02:18:48.637759 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1096/2145] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:18:45 2022] POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action => generated 0 bytes in 2708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:18:48.642625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:48.645940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: b5a8da9c-70e9-434d-bd70-f73e25fd6b17] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:48.653947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:48.654906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:48.655929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:48.656555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:48.686651 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] HTTP exception thrown: Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 could not be found. May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Request method failure captured: May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 HTTP/1.1 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABieco5d6TWjAL_13jDQ5MGO8v-3B0Z-aRwF6CjKsYsA8UDnIY9IsF_wLwweismeO7E09Gi7jRyr3RhLVgwizL0AcO5qMZqkJdgtnuUMUf9dHpgCpuqSAKEaytPgxZwyH2F2SDZ-AkbPzUPuIF44geB4QNOvY3-dM4UhT7SEjvir1MviiM May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a18dfccd5dbf4743a117c907b8a1b8fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-MigrationsAdminTest-1722730229 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-MigrationsAdminTest-1722730229-project May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: ea129546ff474fd0aa9c93c1bfaac5fd May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-MigrationsAdminTest-1722730229-project May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 could not be found. May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'b5a8da9c-70e9-434d-bd70-f73e25fd6b17'} May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 could not be found. May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 could not be found. May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:48.690228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 could not be found. May 10 02:18:48.699451 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:48.701633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Returning 404 to user: Instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:48.702772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dabb4779-131c-4544-90ad-747147302a2b tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17" status: 404 len: 111 microversion: 2.1 time: 0.063987 May 10 02:18:48.720043 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1097/2146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:48 2022] GET /compute/v2.1/servers/b5a8da9c-70e9-434d-bd70-f73e25fd6b17 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:48.730488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:48.732201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:48.754455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:48.758706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:48.759928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:48.762969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.104642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:49.124009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-019fc47c-99ea-4d89-8ad8-fc37a1667e84 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1323 microversion: 2.1 time: 0.402342 May 10 02:18:49.125602 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1098/2147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:48 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:49.146879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:49.148772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:49.162941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:49.163928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.165176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:49.165841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.313093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Updating instance_info_cache with network_info: [] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:18:49.317581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:49.332137 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c5af87e0-116d-4bc4-85dc-de68dd2adf16 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.204647 May 10 02:18:49.341848 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1099/2148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:49 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:49.347576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:49.348511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] [instance: 2ed2100f-bdfb-43dc-8068-e25ab97b403f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:49.355328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:49.356090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.357140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:49.357845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.376662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] HTTP exception thrown: Instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f could not be found. May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Request method failure captured: May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f HTTP/1.1 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecsWYQAUO1ofEVfXSr27AOUNXRn-P331jUN8lH3wv8OXMamTRvLIpTycmYl21qyHAq-Yko-xECEF87791r1oTtnYM1pN7J-xOX-0Iux3I-ENLU9JeVxM0mKecx01klLY5ockJ4roQZW7ll9GdC2jmki89Y272C7c_WhhC-IJGb8bRq4 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e74bbc4e5bd7461280d19a1719f1e817 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e74bbc4e5bd7461280d19a1719f1e817", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e74bbc4e5bd7461280d19a1719f1e817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e74bbc4e5bd7461280d19a1719f1e817 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-297537100 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServerFiltersTestJSON-297537100-project May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c2de0a50bc304f7aa3aec50df6d5f6a2 May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServerFiltersTestJSON-297537100-project May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f could not be found. May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '2ed2100f-bdfb-43dc-8068-e25ab97b403f'} May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f could not be found. May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f could not be found. May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:49.380442 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f could not be found. May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:49.384907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] Returning 404 to user: Instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:49.388206 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f415589f-43cf-4537-b353-5dd592ec6923 tempest-ListServerFiltersTestJSON-297537100 tempest-ListServerFiltersTestJSON-297537100-project] 10.222.0.52 "GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f" status: 404 len: 111 microversion: 2.1 time: 0.042528 May 10 02:18:49.392163 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1100/2149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:49 2022] GET /compute/v2.1/servers/2ed2100f-bdfb-43dc-8068-e25ab97b403f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:49.401622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-70824506-df64-451c-8abf-0f07fbbba762 req-c5ba631d-415a-48e8-86db-e6b246a79a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a8da9c-70e9-434d-bd70-f73e25fd6b17", "name": "network-vif-deleted", "tag": "04012843-9b1f-4de5-adb1-d217e00d288f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:49.418505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-70824506-df64-451c-8abf-0f07fbbba762 req-c5ba631d-415a-48e8-86db-e6b246a79a15 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:49.418906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-70824506-df64-451c-8abf-0f07fbbba762 req-c5ba631d-415a-48e8-86db-e6b246a79a15 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.454006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-70824506-df64-451c-8abf-0f07fbbba762 req-c5ba631d-415a-48e8-86db-e6b246a79a15 service nova] Creating event network-vif-deleted:04012843-9b1f-4de5-adb1-d217e00d288f for instance b5a8da9c-70e9-434d-bd70-f73e25fd6b17 on n-h1-841089-2 May 10 02:18:49.487594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-70824506-df64-451c-8abf-0f07fbbba762 req-c5ba631d-415a-48e8-86db-e6b246a79a15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094154 May 10 02:18:49.494082 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1101/2150] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:49.500956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-aba4aa3f-b99f-41b9-a958-80e5ad8be06d req-d4fda12d-57dc-4a4e-8b55-7264dece68da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:49.523476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-aba4aa3f-b99f-41b9-a958-80e5ad8be06d req-d4fda12d-57dc-4a4e-8b55-7264dece68da service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:49.524126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-aba4aa3f-b99f-41b9-a958-80e5ad8be06d req-d4fda12d-57dc-4a4e-8b55-7264dece68da service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:49.540795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-aba4aa3f-b99f-41b9-a958-80e5ad8be06d req-d4fda12d-57dc-4a4e-8b55-7264dece68da service nova] Creating event network-changed:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:18:49.547669 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-aba4aa3f-b99f-41b9-a958-80e5ad8be06d req-d4fda12d-57dc-4a4e-8b55-7264dece68da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051131 May 10 02:18:49.549428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1102/2151] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:49.564058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2da5776d-f529-4d45-bc84-487a303c0f8b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'create', calling method: .version_select at 0x7f3d367dc430>, body: {"pool": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:50.093132 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f00006a9-ae99-417f-b264-a3cc670d95af tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 204 len: 0 microversion: 2.1 time: 4.084141 May 10 02:18:50.099281 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1050/2152] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:46 2022] DELETE /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 0 bytes in 4089 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:50.108152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:50.108880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:50.125521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.126060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.126949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.127507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.185922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:50.363536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb9e4908-a830-4713-9aaa-f5437d0b2986 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "DELETE /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 204 len: 0 microversion: 2.1 time: 0.266055 May 10 02:18:50.364137 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1051/2153] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:50 2022] DELETE /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:50.369228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:50.370210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:50.381554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.382019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.382812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.383288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.420557 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 HTTP/1.1 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'dbaee6dd-516c-4d79-a64e-f315148ab080'} May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:50.422260 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46193ba5-f5f3-4cee-995b-1e2da3facd66 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 404 len: 111 microversion: 2.1 time: 0.058511 May 10 02:18:50.427337 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1052/2154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:50 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:50.449930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:50.450600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:50.457918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.458376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.459304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.459770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.898889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:50.915591 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1da1fd73-791b-424a-aad5-335d7fadc9dd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1323 microversion: 2.1 time: 0.485990 May 10 02:18:50.920214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1053/2155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:50 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:50.931378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:50.932358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:50.949975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.952864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:50.955269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:50.957222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:51.106076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:51.135415 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92f1d13b-f574-4f02-bde9-5ba0dde13233 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 200 len: 1183 microversion: 2.1 time: 0.213635 May 10 02:18:51.136494 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1054/2156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:50 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 1183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:51.151340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:51.151975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:51.160562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:51.161027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:51.161893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:51.162344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:51.400397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:51.412537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-03399807-7a0e-40fb-899c-3ae78a779ba9 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 200 len: 1535 microversion: 2.1 time: 0.263114 May 10 02:18:51.422026 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1055/2157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:51 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 1535 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:51.427014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-221277463", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:51.500605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:18:52.156898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2da5776d-f529-4d45-bc84-487a303c0f8b tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.605284 May 10 02:18:52.158106 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1103/2158] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:18:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:52.164377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1855213288", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0e21bf67-d53d-4fb0-9217-cb2e74446a52"}], "security_groups": [{"name": "tempest-securitygroup--244106733"}], "key_name": "tempest-keypair-59391383", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "bf70888c-9510-46d7-86ca-c0603ecbda2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:52.373836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] validate_networks() for [('0e21bf67-d53d-4fb0-9217-cb2e74446a52', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:18:52.470719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:18:52.471960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:18:52.473215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:18:52.473866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:18:52.474554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:18:52.504578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:52.506696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:52.509261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:52.512620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:52.546190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:18:52.553800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:18:52.570594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:18:52.574401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:18:52.652275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7794103f-bc28-4ee8-8358-d29ec46943c9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237064 May 10 02:18:52.664746 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1056/2159] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:18:52.671993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}, {"server_uuid": "2ed2100f-bdfb-43dc-8068-e25ab97b403f", "name": "network-vif-deleted", "tag": "b9017b41-7fbf-47c4-ba08-e41b333dbb52"}, {"server_uuid": "dbaee6dd-516c-4d79-a64e-f315148ab080", "name": "network-vif-deleted", "tag": "2b6e05e6-bd81-4a6b-a0b7-defb0654e450"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:52.709678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:52.712043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:52.756662 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] Creating event network-changed:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:18:52.758028 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] Creating event network-vif-deleted:b9017b41-7fbf-47c4-ba08-e41b333dbb52 for instance 2ed2100f-bdfb-43dc-8068-e25ab97b403f on n-h1-841089-2 May 10 02:18:52.758913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.server_external_events [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] Unable to find a host for instance dbaee6dd-516c-4d79-a64e-f315148ab080. Dropping event network-vif-deleted {{(pid=118717) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 02:18:52.770920 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-922b1893-4e55-4056-8165-ebed847cb97d req-d7e04979-fb1a-4b8f-9eaa-0f11bbdbb936 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 518 microversion: 2.1 time: 0.104106 May 10 02:18:52.773195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1057/2160] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 518 bytes in 107 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 02:18:52.780096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:52.783088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:52.793579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:52.794897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:52.795998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:52.800092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:53.784969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:53.792887 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec2149ea-0817-4ebd-8126-f32bd5bd2c63 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1323 microversion: 2.1 time: 1.018194 May 10 02:18:53.797089 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1058/2161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:52 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1323 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:53.801979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:53.803117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: c903ce72-ce77-47a6-bf37-8712418785a7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:53.811163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:53.812062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:53.813279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:53.814186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:53.834540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] HTTP exception thrown: Instance c903ce72-ce77-47a6-bf37-8712418785a7 could not be found. May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Request method failure captured: May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 HTTP/1.1 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecndgvy4itbFgDu14FoR3QbaA63jJahwVp22ih1Q4uqvqSIBgEYBKfInLI4fULHciDNNebO19i3twzuDkqmae5XMxejUj4C9QPGca4TBsUlKnnC5YhG9qdlKA0ZlHl7aRNrd0Tg_p9cIxua5XwfiwKDmVRcCT8p-DA6xChAH6vcl1Pk May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveMigrationTest-170870554 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d388f0dca2c4a5a933599c498cf3ae1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveMigrationTest-170870554 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveMigrationTest-170870554 May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveMigrationTest-170870554-project May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f3afba6df0eb454cbfa342f196e6727f May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveMigrationTest-170870554-project May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance c903ce72-ce77-47a6-bf37-8712418785a7 could not be found. May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'c903ce72-ce77-47a6-bf37-8712418785a7'} May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c903ce72-ce77-47a6-bf37-8712418785a7 could not be found. May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c903ce72-ce77-47a6-bf37-8712418785a7 could not be found. May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:53.836990 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:53.843468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:53.843468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:53.843468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:53.843468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:53.843468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c903ce72-ce77-47a6-bf37-8712418785a7 could not be found. May 10 02:18:53.843468 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:18:53.849119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Returning 404 to user: Instance c903ce72-ce77-47a6-bf37-8712418785a7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:53.851365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8703e706-592d-473c-83fd-3c8e8f4f3140 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7" status: 404 len: 111 microversion: 2.1 time: 0.053128 May 10 02:18:53.852554 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1059/2162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:53 2022] GET /compute/v2.1/servers/c903ce72-ce77-47a6-bf37-8712418785a7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:53.858881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.92"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:53.860239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:53.869142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:53.869923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:53.870923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:53.871623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:53.929210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Acquired lock "refresh_cache-18ca81e4-8e73-426d-8a7e-845c21ab732f" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:18:54.106014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Getting quotas for project 267f1f09372d477fb65afc5b2619b827. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:18:54.113671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Getting quotas for user a2170d84ea4e4697ba2dfd8ebb339b79 and project 267f1f09372d477fb65afc5b2619b827. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:18:54.133946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:18:54.134940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:18:54.136593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:18:54.137276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:18:54.138124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:18:54.152270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.153067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.154194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.155654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.180289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Getting quotas for project 267f1f09372d477fb65afc5b2619b827. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:18:54.187369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Getting quotas for user a2170d84ea4e4697ba2dfd8ebb339b79 and project 267f1f09372d477fb65afc5b2619b827. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:18:54.332328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:18:54.334641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf70888c-9510-46d7-86ca-c0603ecbda2f',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:18:54.579541 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad8a5259-e176-465c-8f49-9b2f535f7019 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.420025 May 10 02:18:54.583264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1104/2163] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:18:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:18:54.615998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8173aba3-d6d1-49af-99b1-df0a1334d9d8 req-12d9004d-4cb2-4d46-8945-e0f506e53406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "name": "network-vif-plugged", "status": "completed", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:54.636387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8173aba3-d6d1-49af-99b1-df0a1334d9d8 req-12d9004d-4cb2-4d46-8945-e0f506e53406 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.637263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8173aba3-d6d1-49af-99b1-df0a1334d9d8 req-12d9004d-4cb2-4d46-8945-e0f506e53406 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.657809 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8173aba3-d6d1-49af-99b1-df0a1334d9d8 req-12d9004d-4cb2-4d46-8945-e0f506e53406 service nova] Creating event network-vif-plugged:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:18:54.664943 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8173aba3-d6d1-49af-99b1-df0a1334d9d8 req-12d9004d-4cb2-4d46-8945-e0f506e53406 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078137 May 10 02:18:54.666579 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1105/2164] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:54.684463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:54.687742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 308bb117-80f8-4a8d-9ebb-2c8e14ba454d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:54.725567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.726290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.730878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.732325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.777298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] HTTP exception thrown: Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d could not be found. May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Request method failure captured: May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d HTTP/1.1 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABieco5d6TWjAL_13jDQ5MGO8v-3B0Z-aRwF6CjKsYsA8UDnIY9IsF_wLwweismeO7E09Gi7jRyr3RhLVgwizL0AcO5qMZqkJdgtnuUMUf9dHpgCpuqSAKEaytPgxZwyH2F2SDZ-AkbPzUPuIF44geB4QNOvY3-dM4UhT7SEjvir1MviiM May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a18dfccd5dbf4743a117c907b8a1b8fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-MigrationsAdminTest-1722730229 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-MigrationsAdminTest-1722730229-project May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: ea129546ff474fd0aa9c93c1bfaac5fd May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-MigrationsAdminTest-1722730229-project May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d could not be found. May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '308bb117-80f8-4a8d-9ebb-2c8e14ba454d'} May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d could not be found. May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d could not be found. May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:18:54.778997 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d could not be found. May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Returning 404 to user: Instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:18:54.785490 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39596398-99ab-4d7f-9300-45251de315c4 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d" status: 404 len: 111 microversion: 2.1 time: 0.111316 May 10 02:18:54.788868 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1106/2165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:54 2022] GET /compute/v2.1/servers/308bb117-80f8-4a8d-9ebb-2c8e14ba454d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:18:54.811299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:54.812073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:54.825681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.826138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.826947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:54.828963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:54.993710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:55.007706 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6849f02a-8f02-4136-95e6-33836a5d8ba9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1272 microversion: 2.1 time: 0.216363 May 10 02:18:55.008393 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1107/2166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:54 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:55.022056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4656b25c-f545-479d-92d9-814ac5871cf3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:55.022717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4656b25c-f545-479d-92d9-814ac5871cf3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:55.288126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4656b25c-f545-479d-92d9-814ac5871cf3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:55.305100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4656b25c-f545-479d-92d9-814ac5871cf3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1120 microversion: 2.1 time: 0.288591 May 10 02:18:55.307555 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1108/2167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:55 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1120 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:55.322203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:55.323179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:55.330987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:55.363454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:55.366565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:55.368419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:55.417685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:18:55.595986 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e37ffb05-bc9f-420e-84d6-b7bff9fdc04f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 204 len: 0 microversion: 2.1 time: 0.286063 May 10 02:18:55.601373 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1109/2168] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:18:55 2022] DELETE /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:18:55.616006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:55.617896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:55.637199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:55.642855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:55.647568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:55.648275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:56.005566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:56.016249 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4eeba079-b603-49e5-8b06-6f3583ab4f11 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1323 microversion: 2.1 time: 0.410241 May 10 02:18:56.017412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1110/2169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:55 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:56.026054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-588971b6-c735-4712-8a92-d725375fb03a req-c66b80f8-96d3-48ca-92d0-2842e96761b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bb117-80f8-4a8d-9ebb-2c8e14ba454d", "name": "network-vif-deleted", "tag": "5caeb2dc-f890-4cf8-8948-8897619b6b11"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:18:56.046506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-588971b6-c735-4712-8a92-d725375fb03a req-c66b80f8-96d3-48ca-92d0-2842e96761b6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:56.048152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-588971b6-c735-4712-8a92-d725375fb03a req-c66b80f8-96d3-48ca-92d0-2842e96761b6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:56.076179 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-588971b6-c735-4712-8a92-d725375fb03a req-c66b80f8-96d3-48ca-92d0-2842e96761b6 service nova] Creating event network-vif-deleted:5caeb2dc-f890-4cf8-8948-8897619b6b11 for instance 308bb117-80f8-4a8d-9ebb-2c8e14ba454d on n-h1-841089-2 May 10 02:18:56.082432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-588971b6-c735-4712-8a92-d725375fb03a req-c66b80f8-96d3-48ca-92d0-2842e96761b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063715 May 10 02:18:56.083737 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1111/2170] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:18:56.089738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:56.090790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:56.098140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:56.098925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:56.099983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:56.100688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:56.690807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:56.700532 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3145703b-5a4e-4c55-b373-ee7617f6098f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1467 microversion: 2.1 time: 0.615172 May 10 02:18:56.719266 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1112/2171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:56 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1467 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:56.729082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:56.729726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:56.763343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:56.765290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:56.768159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:56.769630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:57.475516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:57.483226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1499707-b796-4a40-8ff0-3de9de2ecaac tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1314 microversion: 2.1 time: 0.762721 May 10 02:18:57.495375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1113/2172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:56 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:57.523493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:57.524356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:57.541939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:57.542400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:57.543222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:57.543665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:58.615842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:18:58.627095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a1b280d-7c41-4a78-a980-741a6835e3b7 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1226 microversion: 2.1 time: 1.127283 May 10 02:18:58.644982 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1114/2173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:57 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1226 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:18:58.671698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:18:58.674576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:18:58.698127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:58.698611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:18:58.699435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:18:58.699888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:00.318890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:19:00.439666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:00.455467 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-77b43dcd-6b4c-4ed4-9b93-a8c1ed7cc0e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1519 microversion: 2.1 time: 1.792343 May 10 02:19:00.456318 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1115/2174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:18:58 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1519 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:00.461739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:00.497217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:00.521164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:00.521960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:00.522973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:00.531814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:00.627524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:00.635882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:00.645281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lazy-loading 'fault' on Instance uuid 8962c96e-b870-4700-bf38-f78601e5854e {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:01.103976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:01.111223 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6114d753-bcb8-457b-9b2c-4369afaf066d tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 200 len: 1302 microversion: 2.1 time: 0.653198 May 10 02:19:01.114758 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1116/2175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:00 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 1302 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:01.138233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:01.139206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:01.156809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:01.157428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:01.160832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:01.163636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:02.233373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:02.242800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e8f2c4e-bbf5-45e0-a05a-9b04363b3df9 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1314 microversion: 2.1 time: 1.125841 May 10 02:19:02.263468 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1117/2176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:01 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1314 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:02.282746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-19cedad5-2f86-40b0-bc4b-43d480f9ccb7 req-0581df56-de48-4897-afff-661e29e24e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8962c96e-b870-4700-bf38-f78601e5854e", "name": "network-vif-deleted", "tag": "845550c8-69e5-4cd3-91b8-30fd8a345295"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:02.297475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-19cedad5-2f86-40b0-bc4b-43d480f9ccb7 req-0581df56-de48-4897-afff-661e29e24e0e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:02.298317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-19cedad5-2f86-40b0-bc4b-43d480f9ccb7 req-0581df56-de48-4897-afff-661e29e24e0e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:02.312191 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-19cedad5-2f86-40b0-bc4b-43d480f9ccb7 req-0581df56-de48-4897-afff-661e29e24e0e service nova] Creating event network-vif-deleted:845550c8-69e5-4cd3-91b8-30fd8a345295 for instance 8962c96e-b870-4700-bf38-f78601e5854e on n-h1-841089-2 May 10 02:19:02.319667 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-19cedad5-2f86-40b0-bc4b-43d480f9ccb7 req-0581df56-de48-4897-afff-661e29e24e0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054534 May 10 02:19:02.325660 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1118/2177] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:02.332837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:02.334540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:02.349521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:02.350345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:02.351458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:02.352146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:02.652947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:02.669606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a939f293-cc6c-4395-a896-13c2e1b314a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1236 microversion: 2.1 time: 0.342368 May 10 02:19:02.670211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1119/2178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:02 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1236 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:02.675272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-66769c41-b230-4c61-aab7-b685336f643a req-4db53f14-d147-47df-81f2-086644442ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:02.707150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-66769c41-b230-4c61-aab7-b685336f643a req-4db53f14-d147-47df-81f2-086644442ce2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:02.707612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-66769c41-b230-4c61-aab7-b685336f643a req-4db53f14-d147-47df-81f2-086644442ce2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:02.746176 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-66769c41-b230-4c61-aab7-b685336f643a req-4db53f14-d147-47df-81f2-086644442ce2 service nova] Creating event network-changed:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:19:02.766114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-66769c41-b230-4c61-aab7-b685336f643a req-4db53f14-d147-47df-81f2-086644442ce2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094681 May 10 02:19:02.767834 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1120/2179] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:02.790688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fecf1f9f-ef1a-49af-9757-5d79eda58db1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'create', calling method: .version_select at 0x7f3d3742a430>, body: {"pool": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:05.140232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Updating instance_info_cache with network_info: [{"id": "a4ef80af-8258-4acc-9ea2-01f766290a7b", "address": "fa:16:3e:ec:22:fe", "network": {"id": "396f955d-b347-44d4-9154-00402eef4750", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1808949052-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "623992f8bb85465c9e6b5e9c46a331b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4ef80af-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:19:05.161766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Releasing lock "refresh_cache-18ca81e4-8e73-426d-8a7e-845c21ab732f" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:19:05.162657 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba2978ab-0892-48d8-be8a-76c7a99778bc tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action" status: 202 len: 0 microversion: 2.1 time: 11.308773 May 10 02:19:05.163900 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1060/2180] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:18:53 2022] POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action => generated 0 bytes in 11310 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:19:05.173411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:05.177123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 8962c96e-b870-4700-bf38-f78601e5854e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:05.205202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:05.206572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:05.208256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:05.209540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:05.258762 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] HTTP exception thrown: Instance 8962c96e-b870-4700-bf38-f78601e5854e could not be found. May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Request method failure captured: May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e HTTP/1.1 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieco5d6TWjAL_13jDQ5MGO8v-3B0Z-aRwF6CjKsYsA8UDnIY9IsF_wLwweismeO7E09Gi7jRyr3RhLVgwizL0AcO5qMZqkJdgtnuUMUf9dHpgCpuqSAKEaytPgxZwyH2F2SDZ-AkbPzUPuIF44geB4QNOvY3-dM4UhT7SEjvir1MviiM May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a18dfccd5dbf4743a117c907b8a1b8fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MigrationsAdminTest-1722730229 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MigrationsAdminTest-1722730229-project May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ea129546ff474fd0aa9c93c1bfaac5fd May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MigrationsAdminTest-1722730229-project May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 8962c96e-b870-4700-bf38-f78601e5854e could not be found. May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8962c96e-b870-4700-bf38-f78601e5854e'} May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8962c96e-b870-4700-bf38-f78601e5854e could not be found. May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8962c96e-b870-4700-bf38-f78601e5854e could not be found. May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:05.260716 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8962c96e-b870-4700-bf38-f78601e5854e could not be found. May 10 02:19:05.266262 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:05.274555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Returning 404 to user: Instance 8962c96e-b870-4700-bf38-f78601e5854e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:05.279588 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d212205-9162-4c48-99d7-004bee148217 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e" status: 404 len: 111 microversion: 2.1 time: 0.111643 May 10 02:19:05.283577 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1061/2181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:05 2022] GET /compute/v2.1/servers/8962c96e-b870-4700-bf38-f78601e5854e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:05.506233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1201646330", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:05.648062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] validate_networks() for [('e686f034-48ff-4ba8-8749-938ec7a47e83', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:19:08.832202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:19:08.834058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:19:08.834780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:19:08.835452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:19:08.836102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:19:08.851960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:08.853224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:08.857845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:08.859548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:08.937628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Getting quotas for project 32fe833856714629a13a779adad72d2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:19:08.946713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Getting quotas for user c787058dc32b484b945c1bd80d3b34ea and project 32fe833856714629a13a779adad72d2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:19:08.977504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:19:08.981498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:09.105998 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a7868984-bdf6-4b70-b5f3-9f73c8e7dac4 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.819428 May 10 02:19:09.114282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1062/2182] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:19:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:19:09.124717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:09.125518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:09.168992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:09.170268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:09.172198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:09.173899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:09.244191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:09.519350 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2926ddd7-1991-4ef2-9c35-4a47f05a0e06 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 204 len: 0 microversion: 2.25 time: 0.402556 May 10 02:19:09.520512 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1063/2183] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:19:09 2022] DELETE /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:19:09.538492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:09.557610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:09.570730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:09.571464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:09.572568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:09.584741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:10.013446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:10.029250 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c8c9762-0548-4d74-99bc-f5ea67c8699a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1314 microversion: 2.1 time: 0.506198 May 10 02:19:10.032059 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1064/2184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:09 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:10.042784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:10.044383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:10.079958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:10.085151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:10.087254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:10.089871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:11.120315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:11.136029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0653112d-c90f-43fc-b213-8e20a25925b2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1303 microversion: 2.1 time: 1.102617 May 10 02:19:11.136631 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1065/2185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:10 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1303 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:11.150904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3f726d82-a4de-40fa-9b67-3f05b193dc95 req-c09cd87f-88e0-4540-8efc-5c22ab9bb357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3bea11-a4b7-4250-9462-0b60a4b03e78", "tag": "a0b77caf-4576-429a-9475-28ce59d0335b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:11.162505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3f726d82-a4de-40fa-9b67-3f05b193dc95 req-c09cd87f-88e0-4540-8efc-5c22ab9bb357 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:11.163475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3f726d82-a4de-40fa-9b67-3f05b193dc95 req-c09cd87f-88e0-4540-8efc-5c22ab9bb357 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:11.178860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3f726d82-a4de-40fa-9b67-3f05b193dc95 req-c09cd87f-88e0-4540-8efc-5c22ab9bb357 service nova] Creating event network-changed:a0b77caf-4576-429a-9475-28ce59d0335b for instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 on n-h1-841089-2 May 10 02:19:11.184573 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3f726d82-a4de-40fa-9b67-3f05b193dc95 req-c09cd87f-88e0-4540-8efc-5c22ab9bb357 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037808 May 10 02:19:11.185474 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1066/2186] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:11.191771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.92"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:12.211226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:12.218774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.219493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.220493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.221687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.267418 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fecf1f9f-ef1a-49af-9757-5d79eda58db1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.480902 May 10 02:19:12.268700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1121/2187] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:19:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:12.273722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:12.274501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:12.290461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.293502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.302741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.303554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.354508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:12.499931 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-206ffe26-c6c2-4401-ad5a-297d924ef6ca tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 204 len: 0 microversion: 2.1 time: 0.229683 May 10 02:19:12.501862 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1122/2188] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:12 2022] DELETE /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:12.519427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:12.520273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:12.526921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.527467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.528276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.528933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.842531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:12.855039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-484b7dd9-f4d0-45a4-85c6-88e8bd2beed1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1272 microversion: 2.1 time: 0.350655 May 10 02:19:12.864877 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1123/2189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:12 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1272 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:12.865984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:12.866886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:12.894803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.895637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:12.897533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:12.898373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:13.323775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Acquired lock "refresh_cache-18ca81e4-8e73-426d-8a7e-845c21ab732f" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:19:13.459538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:13.473190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:13.475717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:13.477266 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-93fe7c8c-246a-4cc7-bb82-b2a0c8fe9bc1 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 200 len: 1564 microversion: 2.25 time: 0.620108 May 10 02:19:13.478503 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1124/2190] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:12 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 1564 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:13.484512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-624cc67d-311c-4c8a-a2d9-4b2bd7b757b4 req-a5524191-249d-49fc-aa7a-0ce8706102b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3bea11-a4b7-4250-9462-0b60a4b03e78", "name": "network-vif-plugged", "status": "completed", "tag": "a0b77caf-4576-429a-9475-28ce59d0335b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:13.498831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-624cc67d-311c-4c8a-a2d9-4b2bd7b757b4 req-a5524191-249d-49fc-aa7a-0ce8706102b2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:13.499769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-624cc67d-311c-4c8a-a2d9-4b2bd7b757b4 req-a5524191-249d-49fc-aa7a-0ce8706102b2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:13.522456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-624cc67d-311c-4c8a-a2d9-4b2bd7b757b4 req-a5524191-249d-49fc-aa7a-0ce8706102b2 service nova] Creating event network-vif-plugged:a0b77caf-4576-429a-9475-28ce59d0335b for instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 on n-h1-841089-2 May 10 02:19:13.534087 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-624cc67d-311c-4c8a-a2d9-4b2bd7b757b4 req-a5524191-249d-49fc-aa7a-0ce8706102b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050243 May 10 02:19:13.537345 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1125/2191] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:13.732309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:13.732309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:13.739438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:13.739914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:13.742014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:13.743145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:14.258426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:14.268830 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db2d162d-85f5-4d02-ae08-d92ebc6a76b6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1314 microversion: 2.1 time: 0.707826 May 10 02:19:14.279456 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1126/2192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:13 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:14.285458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:14.286390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:14.296589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:14.297513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:14.298974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:14.300404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:14.681560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:14.698365 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-015b4a5a-61ab-45af-8e36-d519571fa21d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1303 microversion: 2.1 time: 0.417250 May 10 02:19:14.708094 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1127/2193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:14 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1303 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:14.708094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-528088059", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "91ced21e-0978-43fa-9e67-62c398bf53c5"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:14.786064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] validate_networks() for [('91ced21e-0978-43fa-9e67-62c398bf53c5', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:19:15.975367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:19:16.415031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:19:16.416314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:19:16.417569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:19:16.419161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:19:16.420344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:19:16.442961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.443618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.444777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.445437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.473677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Getting quotas for project 541f66b5bd0241e2a470461daceb2f3e. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:19:16.479451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Getting quotas for user ff40ce43b5a14bfaa08e172d5d646758 and project 541f66b5bd0241e2a470461daceb2f3e. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:19:16.494402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:19:16.498177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:16.609562 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-50c2ee8c-3702-4b31-ab83-1abe5addaf3d tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908773 May 10 02:19:16.610716 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1128/2194] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:19:16.617608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:16.619392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:16.631802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.632461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.633366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.633919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.683494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.684033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.689625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lazy-loading 'fault' on Instance uuid 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:16.802419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea129546ff474fd0aa9c93c1bfaac5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18dfccd5dbf4743a117c907b8a1b8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:16.813082 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62541f3c-6378-4ad2-9e9a-4ab67c8c481f tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 200 len: 1302 microversion: 2.1 time: 0.201154 May 10 02:19:16.815741 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1129/2195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:16 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:16.840900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:16.841610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:16.858137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.862793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.863921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:16.864603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:16.910223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:17.048100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f8eebd17-d83a-46f7-a4de-f4f4547f5ae0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 204 len: 0 microversion: 2.1 time: 0.228520 May 10 02:19:17.050367 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1130/2196] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:16 2022] DELETE /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:17.065044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-406cf731-12ee-4392-8b3d-55ba5a4da139 req-6dc835ec-b24d-4641-9ae3-747528d4b152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c605f6e1-aa80-4e63-a3ce-708651656638", "tag": "38db6fc2-0d8b-40fd-a93b-a1af6598d52b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:17.076450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-406cf731-12ee-4392-8b3d-55ba5a4da139 req-6dc835ec-b24d-4641-9ae3-747528d4b152 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.077315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-406cf731-12ee-4392-8b3d-55ba5a4da139 req-6dc835ec-b24d-4641-9ae3-747528d4b152 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.092915 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-406cf731-12ee-4392-8b3d-55ba5a4da139 req-6dc835ec-b24d-4641-9ae3-747528d4b152 service nova] Creating event network-changed:38db6fc2-0d8b-40fd-a93b-a1af6598d52b for instance c605f6e1-aa80-4e63-a3ce-708651656638 on n-h1-841089-2 May 10 02:19:17.099628 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-406cf731-12ee-4392-8b3d-55ba5a4da139 req-6dc835ec-b24d-4641-9ae3-747528d4b152 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044850 May 10 02:19:17.101083 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1131/2197] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:17.107023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:17.108741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:17.118439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.119059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.120378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.121121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.405598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Updating instance_info_cache with network_info: [{"id": "a4ef80af-8258-4acc-9ea2-01f766290a7b", "address": "fa:16:3e:ec:22:fe", "network": {"id": "396f955d-b347-44d4-9154-00402eef4750", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1808949052-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "623992f8bb85465c9e6b5e9c46a331b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4ef80af-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:19:17.418494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Releasing lock "refresh_cache-18ca81e4-8e73-426d-8a7e-845c21ab732f" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:19:17.419861 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-222a4097-f7f7-47bd-98b0-8c63afb68239 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action" status: 202 len: 0 microversion: 2.1 time: 6.232595 May 10 02:19:17.421139 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1067/2198] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:11 2022] POST /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f/action => generated 0 bytes in 6234 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:19:17.429121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:17.430581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 2caaf280-a323-44ef-a538-116e02a6af60] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:17.439749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.440653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.442401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.443676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.464944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] HTTP exception thrown: Instance 2caaf280-a323-44ef-a538-116e02a6af60 could not be found. May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Request method failure captured: May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 HTTP/1.1 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnN9UgZMce8gAF5DXMP-_YikgKvbiq2fpaaPaBwEnuA7A-BVOiHV1tGbIq_OO8o3MhjCDfI50QSJhuOVeVFHlBcs4q1Y7EacsdIUaXRPusUNgM5lLt5PebJzmT-8vYdC1GbwPjmr-gQZaAMKZB3ZI910dA9A-n8SrNFV5ln-Rz4fFA May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.25 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4769c530b40f4f60a8f28b291bcc5c31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b31e1f4aa1eb4cceb37e10f1b8f7b3f2 May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2caaf280-a323-44ef-a538-116e02a6af60 could not be found. May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2caaf280-a323-44ef-a538-116e02a6af60'} May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2caaf280-a323-44ef-a538-116e02a6af60 could not be found. May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2caaf280-a323-44ef-a538-116e02a6af60 could not be found. May 10 02:19:17.468819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2caaf280-a323-44ef-a538-116e02a6af60 could not be found. May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Returning 404 to user: Instance 2caaf280-a323-44ef-a538-116e02a6af60 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:17.474676 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24aaedf8-b118-41c9-9872-4db243059812 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60" status: 404 len: 111 microversion: 2.25 time: 0.050686 May 10 02:19:17.479694 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1068/2199] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:17 2022] GET /compute/v2.1/servers/2caaf280-a323-44ef-a538-116e02a6af60 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:19:17.486977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:17.488149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:17.496293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.497195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.498332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.499002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.672857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:17.682479 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33153fbd-2236-4465-a4a3-eefa50a20110 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.580328 May 10 02:19:17.684516 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1132/2200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:17 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:17.688888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:17.689512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:17.696567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.697039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:17.697830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:17.698278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:18.058085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:18.066299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c421b47-8cb1-41fd-a5a1-abba5a87d97a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1501 microversion: 2.1 time: 0.590425 May 10 02:19:18.067180 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1069/2201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:17 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1501 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:18.072443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:18.073263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:18.080902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:18.081355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:18.082141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:18.082583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:18.230566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:18.239251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a535a0d5-ede8-4b0c-a9a3-290817c83969 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1281 microversion: 2.1 time: 0.170445 May 10 02:19:18.239986 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1070/2202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:18 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:18.254541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:18.255760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:18.263443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:18.264401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:18.265297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:18.265841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:18.365595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:18.373524 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1489b0d0-132b-4ad2-9a8c-4acb33352beb tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1303 microversion: 2.1 time: 0.688175 May 10 02:19:18.374241 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1133/2203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:17 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1303 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:18.387192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50f3c3e4-ec37-4bda-bbaf-ee7fa5e37437 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '.version_select at 0x7f3d379ed790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:19.231222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:19.239720 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4217e094-db28-49f7-babe-a74fe1b55749 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 200 len: 1500 microversion: 2.1 time: 0.998346 May 10 02:19:19.240600 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1071/2204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:18 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 1500 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:19.245682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:19.246374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:19.252926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.253472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:19.254331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.254967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:19.282808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:19.371417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6ecc398c-98e8-4618-ba8d-d44d8021154e tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "DELETE /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 204 len: 0 microversion: 2.25 time: 0.129006 May 10 02:19:19.376290 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1072/2205] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:19:19 2022] DELETE /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:19:19.389678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:19.390423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] [instance: 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:19.396668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.397132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:19.397929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.398497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:19.413425 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] HTTP exception thrown: Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 could not be found. May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Request method failure captured: May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 HTTP/1.1 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieco5d6TWjAL_13jDQ5MGO8v-3B0Z-aRwF6CjKsYsA8UDnIY9IsF_wLwweismeO7E09Gi7jRyr3RhLVgwizL0AcO5qMZqkJdgtnuUMUf9dHpgCpuqSAKEaytPgxZwyH2F2SDZ-AkbPzUPuIF44geB4QNOvY3-dM4UhT7SEjvir1MviiM May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a18dfccd5dbf4743a117c907b8a1b8fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a18dfccd5dbf4743a117c907b8a1b8fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MigrationsAdminTest-1722730229 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: a18dfccd5dbf4743a117c907b8a1b8fe May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MigrationsAdminTest-1722730229 May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MigrationsAdminTest-1722730229-project May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ea129546ff474fd0aa9c93c1bfaac5fd May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MigrationsAdminTest-1722730229-project May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 could not be found. May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374'} May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 could not be found. May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 could not be found. May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:19.415099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 could not be found. May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] Returning 404 to user: Instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82f85b0d-45c8-4a46-8b4f-7a72da75e932 tempest-MigrationsAdminTest-1722730229 tempest-MigrationsAdminTest-1722730229-project] 10.222.0.52 "GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374" status: 404 len: 111 microversion: 2.1 time: 0.037044 May 10 02:19:19.420710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1073/2206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:19 2022] GET /compute/v2.1/servers/5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:19.424390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29f52045-0390-4443-86a5-d8fad235318b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:19.431126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29f52045-0390-4443-86a5-d8fad235318b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.431948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29f52045-0390-4443-86a5-d8fad235318b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:19.496102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29f52045-0390-4443-86a5-d8fad235318b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:19:19.550776 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29f52045-0390-4443-86a5-d8fad235318b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78/action" status: 202 len: 0 microversion: 2.1 time: 0.132199 May 10 02:19:19.552011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1074/2207] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:19 2022] POST /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:19:19.558539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:19.559515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:19.567030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.567535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:19.568329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:19.569434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.021397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:20.029514 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-165c145d-92e1-4763-b024-6f7ba4a8e762 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.475774 May 10 02:19:20.030300 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1075/2208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:19 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:20.044940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2caaf280-a323-44ef-a538-116e02a6af60", "name": "network-vif-deleted", "tag": "ecb8fe6b-b852-4405-bdd4-46a18d504493"}, {"name": "network-changed", "server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}, {"server_uuid": "5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374", "name": "network-vif-deleted", "tag": "18ef4267-996b-41de-90f2-8e5bb5fa4902"}, {"name": "network-changed", "server_uuid": "7ef84007-a8d7-40a4-aaf9-04f704daef31", "tag": "6e0d474c-152e-41ed-821c-13055986f560"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:20.055742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.056188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.072276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Creating event network-vif-deleted:ecb8fe6b-b852-4405-bdd4-46a18d504493 for instance 2caaf280-a323-44ef-a538-116e02a6af60 on n-h2-841089-2 May 10 02:19:20.072821 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Creating event network-changed:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:19:20.073400 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Creating event network-vif-deleted:18ef4267-996b-41de-90f2-8e5bb5fa4902 for instance 5ba3ea49-9f6c-4cd8-94e6-dfdc90dc6374 on n-h2-841089-2 May 10 02:19:20.073968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] Creating event network-changed:6e0d474c-152e-41ed-821c-13055986f560 for instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 on n-h2-841089-2 May 10 02:19:20.084696 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9622c171-02c1-4e12-ad05-7e58185430fc req-92310a9a-0ef6-4e7a-a0ef-7a0ffc29bf08 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.043143 May 10 02:19:20.085366 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1076/2209] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:20.095264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:20.095264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:20.106614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.107624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.109008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.109490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.207168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:20.214919 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fb71d3e-7478-482e-bf7a-1a6ebe330bd1 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1281 microversion: 2.1 time: 0.127842 May 10 02:19:20.215796 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1077/2210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:20 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:20.229570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:20.230380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:20.237465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.239201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.240007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.240458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.471990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:20.486983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:20.488827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:20.490248 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23941d69-14fa-454e-9c2b-ebbe5ea656aa tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1550 microversion: 2.25 time: 0.264420 May 10 02:19:20.491363 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1078/2211] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:20 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1550 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:20.514187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:20.516373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:20.525293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.526443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.527463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.528195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.911123 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-50f3c3e4-ec37-4bda-bbaf-ee7fa5e37437 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/4fe29043-3de7-4256-9e57-12b6fd20b889" status: 202 len: 0 microversion: 2.1 time: 2.535282 May 10 02:19:20.915985 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1134/2212] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:19:18 2022] DELETE /compute/v2.1/os-floating-ips/4fe29043-3de7-4256-9e57-12b6fd20b889 => generated 0 bytes in 2541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:19:20.921367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:20.922032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:20.929843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.930305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:20.931347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:20.931817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:21.184467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:21.192102 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c68d036e-7e03-4b01-aad8-e15864d38562 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1291 microversion: 2.1 time: 0.698872 May 10 02:19:21.192690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1079/2213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:20 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1291 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:21.197798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:21.198802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 39ba2859-735c-49d1-94e0-48d745fcad0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:21.204862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:21.205869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:21.206659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:21.207125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:21.221853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] HTTP exception thrown: Instance 39ba2859-735c-49d1-94e0-48d745fcad0e could not be found. May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Request method failure captured: May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e HTTP/1.1 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecndgvy4itbFgDu14FoR3QbaA63jJahwVp22ih1Q4uqvqSIBgEYBKfInLI4fULHciDNNebO19i3twzuDkqmae5XMxejUj4C9QPGca4TBsUlKnnC5YhG9qdlKA0ZlHl7aRNrd0Tg_p9cIxua5XwfiwKDmVRcCT8p-DA6xChAH6vcl1Pk May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveMigrationTest-170870554 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d388f0dca2c4a5a933599c498cf3ae1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveMigrationTest-170870554 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveMigrationTest-170870554 May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveMigrationTest-170870554-project May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f3afba6df0eb454cbfa342f196e6727f May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveMigrationTest-170870554-project May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 39ba2859-735c-49d1-94e0-48d745fcad0e could not be found. May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '39ba2859-735c-49d1-94e0-48d745fcad0e'} May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ba2859-735c-49d1-94e0-48d745fcad0e could not be found. May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ba2859-735c-49d1-94e0-48d745fcad0e could not be found. May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:21.223630 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:21.228331 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:21.228331 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:21.228331 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:21.228331 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:21.228331 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ba2859-735c-49d1-94e0-48d745fcad0e could not be found. May 10 02:19:21.228331 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:21.230052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Returning 404 to user: Instance 39ba2859-735c-49d1-94e0-48d745fcad0e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:21.231585 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38248b1d-020c-4c1e-b34e-904306c3b796 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e" status: 404 len: 111 microversion: 2.1 time: 0.036938 May 10 02:19:21.232073 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1080/2214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:21 2022] GET /compute/v2.1/servers/39ba2859-735c-49d1-94e0-48d745fcad0e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:21.237063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51186ea4-57a7-4395-8405-fc0376e23f97 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '.version_select at 0x7f3d3703ef70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:21.487336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:21.501527 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6c85f36-6fa8-4aa1-9b64-5254594d9130 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.584093 May 10 02:19:21.504681 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1135/2215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:20 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:21.509933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:21.510868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:21.518937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:21.519456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:21.520332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:21.520785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.357322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:22.366273 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e88dad9a-b84e-4ffe-afb4-effdf8bd2382 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.860019 May 10 02:19:22.377901 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1136/2216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:21 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:22.383291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:22.384521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:22.391427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.392207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.393640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.394355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.595584 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51186ea4-57a7-4395-8405-fc0376e23f97 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ac528ded-8058-4f09-bb57-4d81cc786ee4" status: 202 len: 0 microversion: 2.1 time: 1.361992 May 10 02:19:22.599239 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1081/2217] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:19:21 2022] DELETE /compute/v2.1/os-security-groups/ac528ded-8058-4f09-bb57-4d81cc786ee4 => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:19:22.605279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:22.605931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:22.615955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.616420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.617218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.617654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.651855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:22.733898 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-408f6c87-3ff1-4970-b2a8-8670d6a4e007 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 204 len: 0 microversion: 2.1 time: 0.132314 May 10 02:19:22.738274 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1082/2218] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:22 2022] DELETE /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:22.747823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:22.748842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:22.756954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.759785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.760644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.761091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.895809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:22.904326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:22.905851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:22.907101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e58ee1e-03b1-440f-9807-f55c4a265c85 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1508 microversion: 2.25 time: 0.166386 May 10 02:19:22.916017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:22.917500 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1083/2219] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:22 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:22.933525 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98d43bb0-e878-4bbf-a124-8ad50952336b tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.554155 May 10 02:19:22.944752 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1137/2220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:22 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:22.947136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:22.947853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:22.958260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.958830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:22.959741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:22.960262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.078965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75471fb9-1716-4a9b-9d58-b130fe0275c5 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] Calling method '.version_select at 0x7f3d370b3dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:23.079899 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:23.079899 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:19:23.093491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75471fb9-1716-4a9b-9d58-b130fe0275c5 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.174785 May 10 02:19:23.101992 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1084/2221] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 02:19:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:23.107432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8a47164c-3c7d-47a0-95de-c666ced746e8 req-e43c5f18-82b2-43f2-af19-76822080271a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ba2859-735c-49d1-94e0-48d745fcad0e", "name": "network-vif-deleted", "tag": "a8ec29aa-bdf9-420a-b041-1bcced8ee65f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:23.118556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8a47164c-3c7d-47a0-95de-c666ced746e8 req-e43c5f18-82b2-43f2-af19-76822080271a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.119298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8a47164c-3c7d-47a0-95de-c666ced746e8 req-e43c5f18-82b2-43f2-af19-76822080271a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.133709 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8a47164c-3c7d-47a0-95de-c666ced746e8 req-e43c5f18-82b2-43f2-af19-76822080271a service nova] Creating event network-vif-deleted:a8ec29aa-bdf9-420a-b041-1bcced8ee65f for instance 39ba2859-735c-49d1-94e0-48d745fcad0e on n-h1-841089-2 May 10 02:19:23.139506 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8a47164c-3c7d-47a0-95de-c666ced746e8 req-e43c5f18-82b2-43f2-af19-76822080271a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 May 10 02:19:23.140694 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1085/2222] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:23.146388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:23.147300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:23.154644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.155190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.155977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.156418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.386525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:23.393930 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e771bcbd-8539-4f56-a9dd-464f9b1b750c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1291 microversion: 2.1 time: 0.456943 May 10 02:19:23.394496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1138/2223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:22 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1291 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:23.399154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:23.399859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:23.405841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.406300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.407102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.407552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.432669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:23.449130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:23.458024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-14846862-54c4-4ed9-98e1-ac448e4acbff tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.315958 May 10 02:19:23.458806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1086/2224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:23 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:23.473581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:23.475103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:23.481885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.482485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.483568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.484210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.535098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a2ff61c-8823-49ee-bc7e-db0668950ee6 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 204 len: 0 microversion: 2.1 time: 0.139157 May 10 02:19:23.540732 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1139/2225] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:23 2022] DELETE /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:23.558185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a314304a-dd17-4036-a166-7872c187b257 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] Action: 'update', calling method: .version_select at 0x7f3d3780f9d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:23.567441 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:23.567441 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:19:23.795380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:23.803412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89f86463-1722-4d66-9f6b-7d546fd8c302 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1484 microversion: 2.1 time: 0.333705 May 10 02:19:23.804449 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1087/2226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:23 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1484 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:23.809171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:23.810020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:23.816132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.816843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.817796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.818352 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a314304a-dd17-4036-a166-7872c187b257 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.274065 May 10 02:19:23.818513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.819198 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1140/2227] 10.222.0.52 () {60 vars in 1205 bytes} [Tue May 10 02:19:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:23.828088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:23.828818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:23.835338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.835799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:23.836596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:23.837047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.106117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.112690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.114084 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-78dcaf76-51c7-42e3-bed9-3ad9066f4e81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.308415 May 10 02:19:24.114859 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1088/2228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:23 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:24.119673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adec287f-e11f-4804-bf7a-10e74d122d07 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] Calling method '.version_select at 0x7f3d3703eee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:24.120838 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:24.120838 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:19:24.131433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa4f9870-da62-4cd0-b587-cfd370127fef tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1511 microversion: 2.1 time: 0.307019 May 10 02:19:24.138012 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adec287f-e11f-4804-bf7a-10e74d122d07 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021790 May 10 02:19:24.139000 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1089/2229] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 02:19:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:24.142971 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1141/2230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:23 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:24.146074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:24.146946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:24.148295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:24.149105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:24.154552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.155408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.156476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.156633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.157224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.157799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.158770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.159256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.198622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.199526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.200218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lazy-loading 'fault' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:24.306942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.317094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.318544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.319927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f26bce5-79be-46bf-91bd-8fe6b1fbc7a3 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1352 microversion: 2.25 time: 0.179605 May 10 02:19:24.320494 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1090/2231] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:24 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:24.325607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e4c9d78-94f7-4bbf-895d-fa3bdbdb05c9 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] Action: 'update', calling method: .version_select at 0x7f3d37014ee0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:24.327811 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:24.327811 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:19:24.405765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.415228 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e86744e6-5329-4379-862d-7105c37dae18 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.270769 May 10 02:19:24.416142 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1142/2232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:24 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:24.421420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b938523d-f932-4a83-af69-db572ede5fa1 req-4853be54-008b-4261-a67f-7fb2e436a9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c605f6e1-aa80-4e63-a3ce-708651656638", "name": "network-vif-plugged", "status": "completed", "tag": "38db6fc2-0d8b-40fd-a93b-a1af6598d52b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:24.430385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b938523d-f932-4a83-af69-db572ede5fa1 req-4853be54-008b-4261-a67f-7fb2e436a9d6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.430875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b938523d-f932-4a83-af69-db572ede5fa1 req-4853be54-008b-4261-a67f-7fb2e436a9d6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.444811 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b938523d-f932-4a83-af69-db572ede5fa1 req-4853be54-008b-4261-a67f-7fb2e436a9d6 service nova] Creating event network-vif-plugged:38db6fc2-0d8b-40fd-a93b-a1af6598d52b for instance c605f6e1-aa80-4e63-a3ce-708651656638 on n-h1-841089-2 May 10 02:19:24.449657 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e4c9d78-94f7-4bbf-895d-fa3bdbdb05c9 tempest-QuotaClassesAdminTestJSON-2059855219 tempest-QuotaClassesAdminTestJSON-2059855219-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.127729 May 10 02:19:24.450534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1091/2233] 10.222.0.52 () {60 vars in 1205 bytes} [Tue May 10 02:19:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:24.450818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b938523d-f932-4a83-af69-db572ede5fa1 req-4853be54-008b-4261-a67f-7fb2e436a9d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 May 10 02:19:24.451672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1143/2234] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:24.461409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:24.462113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:24.468609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.470190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.470190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.472573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.480302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:24.481377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:24.498021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.499185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.500749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.501599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.759342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.767253 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-842307d2-d133-4fed-896f-baddce1a66a8 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1291 microversion: 2.1 time: 0.315653 May 10 02:19:24.777178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.780054 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cd9f1b3c-a23c-4923-8385-86e38754485b tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.308141 May 10 02:19:24.780647 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1144/2235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:24 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:24.780935 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1092/2236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:24 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1291 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:24.820456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:24.821136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:24.827489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.827954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.828750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:24.829203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:24.899818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:24.907790 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2c8ed85-220c-4309-bfbf-c9bcd23e117f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1442 microversion: 2.1 time: 0.091192 May 10 02:19:24.908375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1145/2237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:24 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1442 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:25.131686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:25.132154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:25.138233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.138689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.139519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.139988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.148884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:25.149822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:25.157208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.158947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.160067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.160771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.333376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:25.345732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7752b61-3b5c-48aa-95c9-77787fdcf60f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.218591 May 10 02:19:25.347738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1093/2238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:25 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:25.355078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41eee814-bd80-402e-b5a7-fe4f529f7070", "name": "network-vif-deleted", "tag": "66c5b609-ea59-45fc-bd4c-971f08a42a91"}, {"name": "network-changed", "server_uuid": "17e7dde4-4cf8-4320-815a-d9e1dd004d6d", "tag": "ef9abbee-e432-4880-a975-797ca53e281e"}, {"server_uuid": "766bfcd2-c5c1-4a25-a548-6c3481c683de", "name": "network-vif-deleted", "tag": "46d63a95-70a5-4cc0-b972-ba14f2023740"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:25.362301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:25.365782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.366332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.370085 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b7b398e-dbcc-40fb-bba7-5e96d487ef2a tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1511 microversion: 2.1 time: 0.224949 May 10 02:19:25.370680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1146/2239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:25 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:19:25.385027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:25.385658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:25.387347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] Creating event network-vif-deleted:66c5b609-ea59-45fc-bd4c-971f08a42a91 for instance 41eee814-bd80-402e-b5a7-fe4f529f7070 on n-h2-841089-2 May 10 02:19:25.387917 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] Creating event network-changed:ef9abbee-e432-4880-a975-797ca53e281e for instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d on n-h2-841089-2 May 10 02:19:25.388480 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] Creating event network-vif-deleted:46d63a95-70a5-4cc0-b972-ba14f2023740 for instance 766bfcd2-c5c1-4a25-a548-6c3481c683de on n-h2-841089-2 May 10 02:19:25.392090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.392558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.394046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.394719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.397281 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-eb7ccf7a-7a31-4feb-9abb-63f4ac2bad42 req-ca1e6b82-dab2-4703-937f-49efbd384f7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.046171 May 10 02:19:25.398037 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1094/2240] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:25.426769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.427408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.428099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lazy-loading 'fault' on Instance uuid 41eee814-bd80-402e-b5a7-fe4f529f7070 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:25.434328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:25.435494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:25.442989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.443615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.444745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.445262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.472528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:25.481622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:25.483205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:25.484403 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1432d520-861d-4b7a-a7a1-cba45cfd1539 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 200 len: 1352 microversion: 2.25 time: 0.103352 May 10 02:19:25.484971 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1147/2241] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:25 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:25.610766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:25.619764 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98ec3548-c326-4f44-bb06-91eb5738df82 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.190365 May 10 02:19:25.620567 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1095/2242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:25 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:19:25.783798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:25.784424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:25.794606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.795096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.795901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.796354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.798442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:25.799802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:25.813070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.814305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:25.818284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:25.819437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.083967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:26.091964 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5544cf63-b0de-4077-b9ba-b009966109d3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1291 microversion: 2.1 time: 0.312035 May 10 02:19:26.092705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1148/2243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:25 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1291 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:26.100636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:26.101562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:26.109139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.109611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.110399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.110875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.115177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:26.122767 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-06caf0dd-fe63-4c87-a25c-09a1df132e6a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.329028 May 10 02:19:26.123654 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1096/2244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:25 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:26.143217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.143675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.144128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lazy-loading 'fault' on Instance uuid 766bfcd2-c5c1-4a25-a548-6c3481c683de {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:26.185780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:26.193769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-785763f4-fda9-4ecc-82dc-5383186d257f tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 200 len: 1300 microversion: 2.1 time: 0.100181 May 10 02:19:26.202769 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1149/2245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:26 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:26.365647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:26.366020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:26.381905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.382777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.383709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.384360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.389434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:26.390317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:26.402826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.403419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:26.404335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:26.405360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.191030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:27.198434 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-85156b79-27a2-41f4-b4d8-ddb4320da96f tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1511 microversion: 2.1 time: 0.815065 May 10 02:19:27.199023 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1150/2246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:26 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1511 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:19:27.203977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7d3b3518-79b2-48ef-a610-2c59477bd934 req-919a8585-3c62-40c8-9724-9686a82b5c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef84007-a8d7-40a4-aaf9-04f704daef31", "name": "network-vif-plugged", "status": "completed", "tag": "6e0d474c-152e-41ed-821c-13055986f560"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:27.205164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:27.212836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7d3b3518-79b2-48ef-a610-2c59477bd934 req-919a8585-3c62-40c8-9724-9686a82b5c47 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.213299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7d3b3518-79b2-48ef-a610-2c59477bd934 req-919a8585-3c62-40c8-9724-9686a82b5c47 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.215659 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-447a119d-7593-4565-b491-1f5cdd0cc051 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.854324 May 10 02:19:27.216497 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1097/2247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:26 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:27.221521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.222211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 41eee814-bd80-402e-b5a7-fe4f529f7070] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.228224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.228769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.229680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.230383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.234371 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7d3b3518-79b2-48ef-a610-2c59477bd934 req-919a8585-3c62-40c8-9724-9686a82b5c47 service nova] Creating event network-vif-plugged:6e0d474c-152e-41ed-821c-13055986f560 for instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 on n-h2-841089-2 May 10 02:19:27.240893 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7d3b3518-79b2-48ef-a610-2c59477bd934 req-919a8585-3c62-40c8-9724-9686a82b5c47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039947 May 10 02:19:27.241956 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1151/2248] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:27.248952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.249340 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] HTTP exception thrown: Instance 41eee814-bd80-402e-b5a7-fe4f529f7070 could not be found. May 10 02:19:27.249895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Request method failure captured: May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 HTTP/1.1 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnN9UgZMce8gAF5DXMP-_YikgKvbiq2fpaaPaBwEnuA7A-BVOiHV1tGbIq_OO8o3MhjCDfI50QSJhuOVeVFHlBcs4q1Y7EacsdIUaXRPusUNgM5lLt5PebJzmT-8vYdC1GbwPjmr-gQZaAMKZB3ZI910dA9A-n8SrNFV5ln-Rz4fFA May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.25 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4769c530b40f4f60a8f28b291bcc5c31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b31e1f4aa1eb4cceb37e10f1b8f7b3f2 May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 41eee814-bd80-402e-b5a7-fe4f529f7070 could not be found. May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '41eee814-bd80-402e-b5a7-fe4f529f7070'} May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41eee814-bd80-402e-b5a7-fe4f529f7070 could not be found. May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41eee814-bd80-402e-b5a7-fe4f529f7070 could not be found. May 10 02:19:27.251802 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41eee814-bd80-402e-b5a7-fe4f529f7070 could not be found. May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Returning 404 to user: Instance 41eee814-bd80-402e-b5a7-fe4f529f7070 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12e3f223-6cd6-4e41-9991-094855676ff4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070" status: 404 len: 111 microversion: 2.25 time: 0.036870 May 10 02:19:27.257323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1098/2249] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/servers/41eee814-bd80-402e-b5a7-fe4f529f7070 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:19:27.262930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.263802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.265208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.265765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.394271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-742e9063-4e95-43a9-9c47-407409e81b96 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.395642 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:27.395642 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:19:27.396889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-742e9063-4e95-43a9-9c47-407409e81b96 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.397345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-742e9063-4e95-43a9-9c47-407409e81b96 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.398276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-742e9063-4e95-43a9-9c47-407409e81b96 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.398872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-742e9063-4e95-43a9-9c47-407409e81b96 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.424897 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-742e9063-4e95-43a9-9c47-407409e81b96 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.168688 May 10 02:19:27.425485 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1099/2250] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:27.431608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.431608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.436716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.437174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.437971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.438406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.623385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:27.631592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c80e9e95-89fb-415c-a229-15cf5e29f23c tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.387619 May 10 02:19:27.632539 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1152/2251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:27.637653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.638308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.646943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.647430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.648263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.648710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.745188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:27.753934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-52d5599d-1c8e-4d16-b630-5325db543eed tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1482 microversion: 2.1 time: 0.327390 May 10 02:19:27.754443 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1100/2252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1482 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:27.769180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.769808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: 766bfcd2-c5c1-4a25-a548-6c3481c683de] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.777523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.778089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.778759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.779961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.795024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] HTTP exception thrown: Instance 766bfcd2-c5c1-4a25-a548-6c3481c683de could not be found. May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Request method failure captured: May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de HTTP/1.1 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecndgvy4itbFgDu14FoR3QbaA63jJahwVp22ih1Q4uqvqSIBgEYBKfInLI4fULHciDNNebO19i3twzuDkqmae5XMxejUj4C9QPGca4TBsUlKnnC5YhG9qdlKA0ZlHl7aRNrd0Tg_p9cIxua5XwfiwKDmVRcCT8p-DA6xChAH6vcl1Pk May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveMigrationTest-170870554 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d388f0dca2c4a5a933599c498cf3ae1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveMigrationTest-170870554 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveMigrationTest-170870554 May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveMigrationTest-170870554-project May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f3afba6df0eb454cbfa342f196e6727f May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveMigrationTest-170870554-project May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 766bfcd2-c5c1-4a25-a548-6c3481c683de could not be found. May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '766bfcd2-c5c1-4a25-a548-6c3481c683de'} May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766bfcd2-c5c1-4a25-a548-6c3481c683de could not be found. May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766bfcd2-c5c1-4a25-a548-6c3481c683de could not be found. May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.796585 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766bfcd2-c5c1-4a25-a548-6c3481c683de could not be found. May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Returning 404 to user: Instance 766bfcd2-c5c1-4a25-a548-6c3481c683de could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:27.802143 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-35130797-97db-4f65-b297-bfdc098090a4 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de" status: 404 len: 111 microversion: 2.1 time: 0.042613 May 10 02:19:27.802719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1101/2253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/servers/766bfcd2-c5c1-4a25-a548-6c3481c683de => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:27.806810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.807331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.815501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.815927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.816719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.817873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.844735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:27.902223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:27.910319 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8bae6814-4674-4172-967b-d8047827a6d5 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.276591 May 10 02:19:27.910879 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1153/2254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:27.915399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c18bb111-1c2f-4102-af91-d452d11f924f tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.917037 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:27.917037 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:19:27.918705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c18bb111-1c2f-4102-af91-d452d11f924f tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.919399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c18bb111-1c2f-4102-af91-d452d11f924f tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.920979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c18bb111-1c2f-4102-af91-d452d11f924f tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.921437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c18bb111-1c2f-4102-af91-d452d11f924f tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.926042 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3fc1edfd-264b-482f-8b40-90fe72b3aab4 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "DELETE /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 204 len: 0 microversion: 2.25 time: 0.122365 May 10 02:19:27.926768 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1102/2255] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:19:27 2022] DELETE /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:19:27.933785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.934376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.940380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.940830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.941638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.942076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.947698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c18bb111-1c2f-4102-af91-d452d11f924f tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.035580 May 10 02:19:27.948293 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1154/2256] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:27.952724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:27.954566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:27.960112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.960660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.961458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:27.961913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:27.987414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:28.021619 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5455608c-7c38-42ee-9858-69785693801a tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093278 May 10 02:19:28.022265 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1103/2257] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:19:27 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:28.029210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a906539f-1814-40fb-9d63-0b8d1d10d1f5 req-bc7ba264-9d8a-4bfa-b3ae-9333b0e055e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ca81e4-8e73-426d-8a7e-845c21ab732f", "name": "network-vif-deleted", "tag": "a4ef80af-8258-4acc-9ea2-01f766290a7b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:28.038035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a906539f-1814-40fb-9d63-0b8d1d10d1f5 req-bc7ba264-9d8a-4bfa-b3ae-9333b0e055e7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.038558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a906539f-1814-40fb-9d63-0b8d1d10d1f5 req-bc7ba264-9d8a-4bfa-b3ae-9333b0e055e7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.051396 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a906539f-1814-40fb-9d63-0b8d1d10d1f5 req-bc7ba264-9d8a-4bfa-b3ae-9333b0e055e7 service nova] Creating event network-vif-deleted:a4ef80af-8258-4acc-9ea2-01f766290a7b for instance 18ca81e4-8e73-426d-8a7e-845c21ab732f on n-h2-841089-2 May 10 02:19:28.056547 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a906539f-1814-40fb-9d63-0b8d1d10d1f5 req-bc7ba264-9d8a-4bfa-b3ae-9333b0e055e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032288 May 10 02:19:28.057849 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1104/2258] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:28.064089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.065340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:28.073721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.074258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.075106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.075558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.079772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89bec0ea-80bc-4cd2-9881-f13bf0c7a0d0 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 204 len: 0 microversion: 2.1 time: 0.130076 May 10 02:19:28.080543 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1155/2259] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:27 2022] DELETE /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:28.086792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2ef92c6-e323-4020-866a-94445575c93b tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.088130 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:28.088130 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:19:28.089602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2ef92c6-e323-4020-866a-94445575c93b tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.091402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2ef92c6-e323-4020-866a-94445575c93b tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.092326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2ef92c6-e323-4020-866a-94445575c93b tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.092785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2ef92c6-e323-4020-866a-94445575c93b tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.116913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2ef92c6-e323-4020-866a-94445575c93b tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.035155 May 10 02:19:28.117834 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1156/2260] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:28.126703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.128093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:28.135255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.135728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.136567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.137021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.264891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.274329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.281276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.283364 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-644585ca-e956-4617-ac08-73739a99cd5d tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1564 microversion: 2.25 time: 0.223908 May 10 02:19:28.296384 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1105/2261] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1564 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:28.301971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a4c999a-9483-44d8-8c06-11cc1789f7be tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.303375 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:28.303375 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:19:28.304584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a4c999a-9483-44d8-8c06-11cc1789f7be tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.305035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a4c999a-9483-44d8-8c06-11cc1789f7be tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.306334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a4c999a-9483-44d8-8c06-11cc1789f7be tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.306782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a4c999a-9483-44d8-8c06-11cc1789f7be tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.312440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.323879 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e832a605-fe5d-4dfd-8594-fd0330f61040 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1498 microversion: 2.1 time: 0.204808 May 10 02:19:28.324484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1157/2262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:28.329486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.330402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:28.338010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.338754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.338930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a4c999a-9483-44d8-8c06-11cc1789f7be tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-841089-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.041036 May 10 02:19:28.339590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.339746 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1106/2263] 10.222.0.52 () {58 vars in 1193 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/os-services?host=n-d-841089-2&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:19:28.340407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.347266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.348055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:28.354050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.354514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.355335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.355785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.425341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de52b2a3f88d4c609b880101713c32bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623992f8bb85465c9e6b5e9c46a331b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.433296 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1d82aab-eb67-41f4-b544-f363c5f44191 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 200 len: 1469 microversion: 2.1 time: 0.107528 May 10 02:19:28.433877 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1158/2264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 1469 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:28.453808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c2d310c-4334-4e6b-b7bb-c3428562c139 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.456027 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:28.456027 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:19:28.457666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c2d310c-4334-4e6b-b7bb-c3428562c139 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.458888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c2d310c-4334-4e6b-b7bb-c3428562c139 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.460784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c2d310c-4334-4e6b-b7bb-c3428562c139 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.461330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c2d310c-4334-4e6b-b7bb-c3428562c139 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.493625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c2d310c-4334-4e6b-b7bb-c3428562c139 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043966 May 10 02:19:28.494472 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1159/2265] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:28.505114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ea5a086-049f-44ec-8d14-e78428f6af07 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.506714 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:28.506714 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:19:28.508300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ea5a086-049f-44ec-8d14-e78428f6af07 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.508767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ea5a086-049f-44ec-8d14-e78428f6af07 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.509734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ea5a086-049f-44ec-8d14-e78428f6af07 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.510182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ea5a086-049f-44ec-8d14-e78428f6af07 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.533867 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ea5a086-049f-44ec-8d14-e78428f6af07 tempest-ServicesAdminNegativeTestJSON-1918251268 tempest-ServicesAdminNegativeTestJSON-1918251268-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.032264 May 10 02:19:28.534390 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1160/2266] 10.222.0.52 () {58 vars in 1197 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:19:28.691754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.699980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc692fc7-f6dd-45b0-a64f-9e17737a1f73 tempest-ServicesAdminNegativeTestJSON-1126034125 tempest-ServicesAdminNegativeTestJSON-1126034125-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.701508 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:19:28.701508 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:19:28.702810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc692fc7-f6dd-45b0-a64f-9e17737a1f73 tempest-ServicesAdminNegativeTestJSON-1126034125 tempest-ServicesAdminNegativeTestJSON-1126034125-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '16c603c40006415ea2a58e495d0e528b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9628bd2a3d044d10b8b395c7d92c3830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:28.703238 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5403a26b-ceef-48d4-9fb2-a4cdfcc0e3c6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1314 microversion: 2.1 time: 0.362293 May 10 02:19:28.704011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1107/2267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc692fc7-f6dd-45b0-a64f-9e17737a1f73 tempest-ServicesAdminNegativeTestJSON-1126034125 tempest-ServicesAdminNegativeTestJSON-1126034125-project] Request method failure captured: May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-services HTTP/1.1 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecuumqizbsmNPcy67exI0S3WMjtiPcNAV7z1dDX5IL3jHGcG9HXay_ku2F_9DzugOKi0b2hFf8oB_Hu2OrM9StjcWnq44059ULstcymjL6Avnz6ty0-TPGo4U-gLjsZARBa-XaKVH9Ur1eTIauBIQZ9U2qk640Odn7cEfcOB5mp_SjI May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 9628bd2a3d044d10b8b395c7d92c3830 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1126034125 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9628bd2a3d044d10b8b395c7d92c3830", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9628bd2a3d044d10b8b395c7d92c3830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9628bd2a3d044d10b8b395c7d92c3830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9628bd2a3d044d10b8b395c7d92c3830"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1126034125 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 9628bd2a3d044d10b8b395c7d92c3830 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1126034125 May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServicesAdminNegativeTestJSON-1126034125-project May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 16c603c40006415ea2a58e495d0e528b May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1126034125-project May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.enforce( May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 10 02:19:28.706188 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc692fc7-f6dd-45b0-a64f-9e17737a1f73 tempest-ServicesAdminNegativeTestJSON-1126034125 tempest-ServicesAdminNegativeTestJSON-1126034125-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc692fc7-f6dd-45b0-a64f-9e17737a1f73 tempest-ServicesAdminNegativeTestJSON-1126034125 tempest-ServicesAdminNegativeTestJSON-1126034125-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.164368 May 10 02:19:28.710979 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1161/2268] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/os-services => generated 112 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:28.726632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.728127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:28.737782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.738536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.741001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.741669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.928678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:28.929478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:28.936700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.937279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:28.938187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:28.939174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.231843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:29.240099 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0f6fe4d-85ce-4a4e-b765-cb30d11b44e9 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.534436 May 10 02:19:29.240933 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1108/2269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:29.255759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:29.256388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:29.263673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.264419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.265755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.266436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.427883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:29.441963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94e1c4ce-707e-469a-ab3d-15ac2bc1d94f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.517982 May 10 02:19:29.442676 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1162/2270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:28 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:19:29.450699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-68e22c4f-4f88-41e7-9321-d5e337514de1 req-374e1b25-7bfe-4993-a523-9eb801f29312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c605f6e1-aa80-4e63-a3ce-708651656638", "tag": "38db6fc2-0d8b-40fd-a93b-a1af6598d52b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:29.463744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-68e22c4f-4f88-41e7-9321-d5e337514de1 req-374e1b25-7bfe-4993-a523-9eb801f29312 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.469387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-68e22c4f-4f88-41e7-9321-d5e337514de1 req-374e1b25-7bfe-4993-a523-9eb801f29312 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.498136 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-68e22c4f-4f88-41e7-9321-d5e337514de1 req-374e1b25-7bfe-4993-a523-9eb801f29312 service nova] Creating event network-changed:38db6fc2-0d8b-40fd-a93b-a1af6598d52b for instance c605f6e1-aa80-4e63-a3ce-708651656638 on n-h1-841089-2 May 10 02:19:29.510416 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-68e22c4f-4f88-41e7-9321-d5e337514de1 req-374e1b25-7bfe-4993-a523-9eb801f29312 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062038 May 10 02:19:29.511444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1163/2271] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:29.527754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:29.528944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:29.542336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.543326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.545159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.546723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.884390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:29.903380 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d407f9df-ef47-4caf-a3c3-8fb7680a37d0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1482 microversion: 2.1 time: 0.651841 May 10 02:19:29.909784 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1109/2272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:29 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1482 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:29.915818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:29.919238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:29.937712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.938497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:29.940246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:29.945727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.225834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:30.235747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:30.242010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:30.246209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8633aeb-9986-4222-a5e8-1c87bdda0668 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1564 microversion: 2.25 time: 0.730302 May 10 02:19:30.256870 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1164/2273] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:29 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1564 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:30.262503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:30.263463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] [instance: 18ca81e4-8e73-426d-8a7e-845c21ab732f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:30.270951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:30.271727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.272706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:30.273331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.291940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] HTTP exception thrown: Instance 18ca81e4-8e73-426d-8a7e-845c21ab732f could not be found. May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Request method failure captured: May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f HTTP/1.1 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiectLalvI5ZSslWG-vi5fSQmkW0Ck9jmFXt2pUXFsRuacPVEefaZ2mpJkaHqRARGBdND5hyUs3QPGrYHLODD5tfb7RFn4n4AsotmLx7df-Y-aqwU4lhswaP5AcbWxWe1G1FcKduGNH3cNw-yEM0Ku0OMSEwh59BW--VhejoKu_bq1lJ4 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 623992f8bb85465c9e6b5e9c46a331b0 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1351784535 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_623992f8bb85465c9e6b5e9c46a331b0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/623992f8bb85465c9e6b5e9c46a331b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/623992f8bb85465c9e6b5e9c46a331b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/623992f8bb85465c9e6b5e9c46a331b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1351784535 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 623992f8bb85465c9e6b5e9c46a331b0 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1351784535 May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerRescueTestJSONUnderV235-1351784535-project May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: de52b2a3f88d4c609b880101713c32bd May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1351784535-project May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 18ca81e4-8e73-426d-8a7e-845c21ab732f could not be found. May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '18ca81e4-8e73-426d-8a7e-845c21ab732f'} May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ca81e4-8e73-426d-8a7e-845c21ab732f could not be found. May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ca81e4-8e73-426d-8a7e-845c21ab732f could not be found. May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:30.295113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ca81e4-8e73-426d-8a7e-845c21ab732f could not be found. May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] Returning 404 to user: Instance 18ca81e4-8e73-426d-8a7e-845c21ab732f could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:30.300698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-af748f57-640b-4ec1-9494-421f89e18b86 tempest-ServerRescueTestJSONUnderV235-1351784535 tempest-ServerRescueTestJSONUnderV235-1351784535-project] 10.222.0.52 "GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f" status: 404 len: 111 microversion: 2.1 time: 0.038440 May 10 02:19:30.301679 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1165/2274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:30 2022] GET /compute/v2.1/servers/18ca81e4-8e73-426d-8a7e-845c21ab732f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:30.306576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:30.307264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:30.313383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:30.313836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.315176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:30.315654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.491006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3afba6df0eb454cbfa342f196e6727f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d388f0dca2c4a5a933599c498cf3ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:30.501864 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b203491-57d7-4b91-9515-d874b58ac940 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 200 len: 1498 microversion: 2.1 time: 0.588695 May 10 02:19:30.517088 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1110/2275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:29 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 1498 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:30.531904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:30.534976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:30.546942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:30.549621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.550608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:30.557258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:30.856174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:30.903859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e479ad9-df25-45c4-bfa2-6b78c9b42ca5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1501 microversion: 2.1 time: 0.599281 May 10 02:19:30.919369 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1166/2276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:30 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1501 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:30.937818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-952d5f66-656a-4c5a-b33c-6c0e7287888d req-71841db4-212f-4691-8098-73d31e44e360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d0f290-23eb-448e-b203-33508b893b70", "name": "network-vif-deleted", "tag": "3ee55356-a9bc-4bdf-844d-cc33b7229733"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:30.987562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:30.999275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e57428a2-2cbf-4e7d-891b-72898d6ebd4e tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.479988 May 10 02:19:31.009694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-952d5f66-656a-4c5a-b33c-6c0e7287888d req-71841db4-212f-4691-8098-73d31e44e360 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.010054 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1111/2277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:30 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:31.010889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-952d5f66-656a-4c5a-b33c-6c0e7287888d req-71841db4-212f-4691-8098-73d31e44e360 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.018440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:31.019060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:31.041395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.041850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.042645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.043102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.045582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-952d5f66-656a-4c5a-b33c-6c0e7287888d req-71841db4-212f-4691-8098-73d31e44e360 service nova] Creating event network-vif-deleted:3ee55356-a9bc-4bdf-844d-cc33b7229733 for instance 72d0f290-23eb-448e-b203-33508b893b70 on n-h1-841089-2 May 10 02:19:31.068408 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-952d5f66-656a-4c5a-b33c-6c0e7287888d req-71841db4-212f-4691-8098-73d31e44e360 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144477 May 10 02:19:31.069169 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1167/2278] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:31.079092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:31.080743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:31.090668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.091602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.092801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.094180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.125550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lazy-loading 'flavor' on Instance uuid 7ef84007-a8d7-40a4-aaf9-04f704daef31 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:31.270417 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54e8caf0-4ff4-4e5f-8d8c-70de5a536764 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "POST /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31/action" status: 200 len: 32 microversion: 2.1 time: 0.196431 May 10 02:19:31.271229 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1168/2279] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:31 2022] POST /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:19:31.293124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:31.294308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:31.308450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.309020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.310439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.311187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.320871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:31.332707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a1bab95-cc0f-4508-85b0-518bccd55c5a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.318725 May 10 02:19:31.333347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1112/2280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:31 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:31.352814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:31.355748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:31.373611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.374376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.375503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.375952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.385864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.388217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.388217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lazy-loading 'fault' on Instance uuid 72d0f290-23eb-448e-b203-33508b893b70 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:31.506921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:31.516636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:31.518690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b31e1f4aa1eb4cceb37e10f1b8f7b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4769c530b40f4f60a8f28b291bcc5c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:31.519918 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a6e3de9d-7cf9-4afe-9b37-160a96a4ca67 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 200 len: 1352 microversion: 2.25 time: 0.236387 May 10 02:19:31.520479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1169/2281] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:31 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 1352 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:19:31.537168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:31.537809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] [instance: e97ad790-f1eb-49d6-b1c9-249fa0d34af8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:31.543937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.544495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.545356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:31.545876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:31.566953 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] HTTP exception thrown: Instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 could not be found. May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Request method failure captured: May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 HTTP/1.1 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecndgvy4itbFgDu14FoR3QbaA63jJahwVp22ih1Q4uqvqSIBgEYBKfInLI4fULHciDNNebO19i3twzuDkqmae5XMxejUj4C9QPGca4TBsUlKnnC5YhG9qdlKA0ZlHl7aRNrd0Tg_p9cIxua5XwfiwKDmVRcCT8p-DA6xChAH6vcl1Pk May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-LiveMigrationTest-170870554 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d388f0dca2c4a5a933599c498cf3ae1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d388f0dca2c4a5a933599c498cf3ae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-LiveMigrationTest-170870554 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1d388f0dca2c4a5a933599c498cf3ae1 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-LiveMigrationTest-170870554 May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-LiveMigrationTest-170870554-project May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f3afba6df0eb454cbfa342f196e6727f May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-LiveMigrationTest-170870554-project May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 could not be found. May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e97ad790-f1eb-49d6-b1c9-249fa0d34af8'} May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 could not be found. May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 could not be found. May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:31.569444 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:31.574387 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:31.574387 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:31.574387 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:31.574387 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:31.574387 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 could not be found. May 10 02:19:31.574387 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:31.576060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] Returning 404 to user: Instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:31.577046 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9516448-3d04-43c0-94f3-c38c9c3066c8 tempest-LiveMigrationTest-170870554 tempest-LiveMigrationTest-170870554-project] 10.222.0.52 "GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8" status: 404 len: 111 microversion: 2.1 time: 0.044901 May 10 02:19:31.578193 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1170/2282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:31 2022] GET /compute/v2.1/servers/e97ad790-f1eb-49d6-b1c9-249fa0d34af8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:31.697453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:31.711999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe228b6f-8c16-4626-a0e6-9d0467bc5863 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.373392 May 10 02:19:31.715905 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1113/2283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:31 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:32.019002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.019758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:32.028531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.029345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.030493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.031182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.201089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:32.211474 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94cc2845-4a52-4db5-9f37-78511748de81 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.196318 May 10 02:19:32.212548 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1171/2284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:32 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:32.352145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.353267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:32.363523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.365263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.366508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.367354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.389155 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6527f73f-f8c7-4947-91dd-6e83c59c8ddc tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] 10.222.0.52 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.127442 May 10 02:19:32.395415 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1114/2285] 10.222.0.52 () {58 vars in 1127 bytes} [Tue May 10 02:19:32 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 02:19:32.402104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de91f81e-8a21-439a-86ee-ff808d64a609 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Calling method '.version_select at 0x7f3d36e8c790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.433734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-de91f81e-8a21-439a-86ee-ff808d64a609 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] HTTP exception thrown: Image not found. May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de91f81e-8a21-439a-86ee-ff808d64a609 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Request method failure captured: May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu0s2-h3OPmuT_pGacSD-lSjt1xKbr_iFegyfuDnR2jvwBevtCKGIEm-sA7AoIyUHxpqhFsDo1s3V-IUlAzCohd8GCwYIDiUwSgpuxvftaoF1gjihwcOWETCRstW9WSX-zsIU2xP0Cc3oG9ZwYY_dAjrAiLTQA-ckSbutZhL6PrA1Y May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_50da6006944d4338acf689a8d231e6d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 9bc24cc0768840f2beada95c4e5935f1 May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '-1'} May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.435581 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de91f81e-8a21-439a-86ee-ff808d64a609 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:32.441049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de91f81e-8a21-439a-86ee-ff808d64a609 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] 10.222.0.52 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.040355 May 10 02:19:32.446164 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1115/2286] 10.222.0.52 () {58 vars in 1133 bytes} [Tue May 10 02:19:32 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:19:32.449414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a76647a0-a159-4601-b761-f8a098e7f52d req-ce7b23d3-bbf8-45fc-bb29-9ae2c68d537e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e7dde4-4cf8-4320-815a-d9e1dd004d6d", "name": "network-vif-plugged", "status": "completed", "tag": "ef9abbee-e432-4880-a975-797ca53e281e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:32.458076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a76647a0-a159-4601-b761-f8a098e7f52d req-ce7b23d3-bbf8-45fc-bb29-9ae2c68d537e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.458542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a76647a0-a159-4601-b761-f8a098e7f52d req-ce7b23d3-bbf8-45fc-bb29-9ae2c68d537e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.469528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a76647a0-a159-4601-b761-f8a098e7f52d req-ce7b23d3-bbf8-45fc-bb29-9ae2c68d537e service nova] Creating event network-vif-plugged:ef9abbee-e432-4880-a975-797ca53e281e for instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d on n-h2-841089-2 May 10 02:19:32.475182 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a76647a0-a159-4601-b761-f8a098e7f52d req-ce7b23d3-bbf8-45fc-bb29-9ae2c68d537e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 May 10 02:19:32.478228 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1116/2287] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:32.489162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61fefc2c-7a74-4db9-b857-22a711f97918 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Calling method '.version_select at 0x7f3d36ffdd30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.522832 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-61fefc2c-7a74-4db9-b857-22a711f97918 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] HTTP exception thrown: Image not found. May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61fefc2c-7a74-4db9-b857-22a711f97918 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Request method failure captured: May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/images/92bac48e-598a-4da3-955d-002eeac0582j HTTP/1.1 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu0s2-h3OPmuT_pGacSD-lSjt1xKbr_iFegyfuDnR2jvwBevtCKGIEm-sA7AoIyUHxpqhFsDo1s3V-IUlAzCohd8GCwYIDiUwSgpuxvftaoF1gjihwcOWETCRstW9WSX-zsIU2xP0Cc3oG9ZwYY_dAjrAiLTQA-ckSbutZhL6PrA1Y May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_50da6006944d4338acf689a8d231e6d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 9bc24cc0768840f2beada95c4e5935f1 May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '92bac48e-598a-4da3-955d-002eeac0582j'} May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 92bac48e-598a-4da3-955d-002eeac0582j to delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92bac48e-598a-4da3-955d-002eeac0582j could not be found. May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.530889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61fefc2c-7a74-4db9-b857-22a711f97918 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:32.538517 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61fefc2c-7a74-4db9-b857-22a711f97918 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] 10.222.0.52 "DELETE /compute/v2.1/images/92bac48e-598a-4da3-955d-002eeac0582j" status: 404 len: 62 microversion: 2.1 time: 0.051795 May 10 02:19:32.541117 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1117/2288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:32 2022] DELETE /compute/v2.1/images/92bac48e-598a-4da3-955d-002eeac0582j => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:19:32.548290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.550668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] [instance: 72d0f290-23eb-448e-b203-33508b893b70] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:32.553670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:32.558601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.559084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.559896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.560431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.566216 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-612b0c03-fa3e-4681-9a0d-ef750e7b57e6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.218996 May 10 02:19:32.567050 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1172/2289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:32 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:32.576880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91003fb2-fa70-4d7d-9430-8b5d61b9a4e0 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Calling method '.version_select at 0x7f3d37262430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.577345 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] HTTP exception thrown: Instance 72d0f290-23eb-448e-b203-33508b893b70 could not be found. May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Request method failure captured: May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 HTTP/1.1 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecnN9UgZMce8gAF5DXMP-_YikgKvbiq2fpaaPaBwEnuA7A-BVOiHV1tGbIq_OO8o3MhjCDfI50QSJhuOVeVFHlBcs4q1Y7EacsdIUaXRPusUNgM5lLt5PebJzmT-8vYdC1GbwPjmr-gQZaAMKZB3ZI910dA9A-n8SrNFV5ln-Rz4fFA May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.25 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4769c530b40f4f60a8f28b291bcc5c31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4769c530b40f4f60a8f28b291bcc5c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 4769c530b40f4f60a8f28b291bcc5c31 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-928442400 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b31e1f4aa1eb4cceb37e10f1b8f7b3f2 May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-928442400-project May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 72d0f290-23eb-448e-b203-33508b893b70 could not be found. May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '72d0f290-23eb-448e-b203-33508b893b70'} May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d0f290-23eb-448e-b203-33508b893b70 could not be found. May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d0f290-23eb-448e-b203-33508b893b70 could not be found. May 10 02:19:32.578964 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d0f290-23eb-448e-b203-33508b893b70 could not be found. May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] Returning 404 to user: Instance 72d0f290-23eb-448e-b203-33508b893b70 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf7af294-6903-4604-8813-bfbfb4176bb8 tempest-LiveAutoBlockMigrationV225Test-928442400 tempest-LiveAutoBlockMigrationV225Test-928442400-project] 10.222.0.52 "GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70" status: 404 len: 111 microversion: 2.25 time: 0.038399 May 10 02:19:32.584740 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1118/2290] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:19:32 2022] GET /compute/v2.1/servers/72d0f290-23eb-448e-b203-33508b893b70 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:19:32.597383 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-91003fb2-fa70-4d7d-9430-8b5d61b9a4e0 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] HTTP exception thrown: Image not found. May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91003fb2-fa70-4d7d-9430-8b5d61b9a4e0 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Request method failure captured: May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/0cf7cf20-9969-4849-a71c-86a60e81185b1 HTTP/1.1 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu0s2-h3OPmuT_pGacSD-lSjt1xKbr_iFegyfuDnR2jvwBevtCKGIEm-sA7AoIyUHxpqhFsDo1s3V-IUlAzCohd8GCwYIDiUwSgpuxvftaoF1gjihwcOWETCRstW9WSX-zsIU2xP0Cc3oG9ZwYY_dAjrAiLTQA-ckSbutZhL6PrA1Y May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_50da6006944d4338acf689a8d231e6d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 9bc24cc0768840f2beada95c4e5935f1 May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '0cf7cf20-9969-4849-a71c-86a60e81185b1'} May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0cf7cf20-9969-4849-a71c-86a60e81185b1 to delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0cf7cf20-9969-4849-a71c-86a60e81185b1 could not be found. May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.599308 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91003fb2-fa70-4d7d-9430-8b5d61b9a4e0 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91003fb2-fa70-4d7d-9430-8b5d61b9a4e0 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] 10.222.0.52 "DELETE /compute/v2.1/images/0cf7cf20-9969-4849-a71c-86a60e81185b1" status: 404 len: 62 microversion: 2.1 time: 0.032553 May 10 02:19:32.604036 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1173/2291] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:32 2022] DELETE /compute/v2.1/images/0cf7cf20-9969-4849-a71c-86a60e81185b1 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:19:32.613745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f9479ffa-9542-449b-9cda-8a63c8237997 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Calling method '.version_select at 0x7f3d37a25160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.646447 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f9479ffa-9542-449b-9cda-8a63c8237997 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] HTTP exception thrown: Image not found. May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f9479ffa-9542-449b-9cda-8a63c8237997 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Request method failure captured: May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/images/tempest-invalid-1211872324 HTTP/1.1 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu0s2-h3OPmuT_pGacSD-lSjt1xKbr_iFegyfuDnR2jvwBevtCKGIEm-sA7AoIyUHxpqhFsDo1s3V-IUlAzCohd8GCwYIDiUwSgpuxvftaoF1gjihwcOWETCRstW9WSX-zsIU2xP0Cc3oG9ZwYY_dAjrAiLTQA-ckSbutZhL6PrA1Y May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_50da6006944d4338acf689a8d231e6d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 9bc24cc0768840f2beada95c4e5935f1 May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'tempest-invalid-1211872324'} May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1211872324 to delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1211872324 could not be found. May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.649491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f9479ffa-9542-449b-9cda-8a63c8237997 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:32.654607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f9479ffa-9542-449b-9cda-8a63c8237997 tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] 10.222.0.52 "DELETE /compute/v2.1/images/tempest-invalid-1211872324" status: 404 len: 62 microversion: 2.1 time: 0.043251 May 10 02:19:32.660308 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1119/2292] 10.222.0.52 () {58 vars in 1205 bytes} [Tue May 10 02:19:32 2022] DELETE /compute/v2.1/images/tempest-invalid-1211872324 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:19:32.665449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42e2de2a-4c89-4649-8481-0d4a1886794c tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Calling method '.version_select at 0x7f3d374e5ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.692734 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-42e2de2a-4c89-4649-8481-0d4a1886794c tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] HTTP exception thrown: Image not found. May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42e2de2a-4c89-4649-8481-0d4a1886794c tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Request method failure captured: May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/91bf0a95-4875-4f55-b919-6e1834e216ae HTTP/1.1 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu0s2-h3OPmuT_pGacSD-lSjt1xKbr_iFegyfuDnR2jvwBevtCKGIEm-sA7AoIyUHxpqhFsDo1s3V-IUlAzCohd8GCwYIDiUwSgpuxvftaoF1gjihwcOWETCRstW9WSX-zsIU2xP0Cc3oG9ZwYY_dAjrAiLTQA-ckSbutZhL6PrA1Y May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_50da6006944d4338acf689a8d231e6d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/50da6006944d4338acf689a8d231e6d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 50da6006944d4338acf689a8d231e6d9 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 9bc24cc0768840f2beada95c4e5935f1 May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2027571445-project May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '91bf0a95-4875-4f55-b919-6e1834e216ae'} May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 91bf0a95-4875-4f55-b919-6e1834e216ae to delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91bf0a95-4875-4f55-b919-6e1834e216ae could not be found. May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.694776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:19:32.700218 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:32.704743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42e2de2a-4c89-4649-8481-0d4a1886794c tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:32.704743 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42e2de2a-4c89-4649-8481-0d4a1886794c tempest-ImagesDeleteNegativeTestJSON-2027571445 tempest-ImagesDeleteNegativeTestJSON-2027571445-project] 10.222.0.52 "DELETE /compute/v2.1/images/91bf0a95-4875-4f55-b919-6e1834e216ae" status: 404 len: 62 microversion: 2.1 time: 0.043905 May 10 02:19:32.704743 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1174/2293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:32 2022] DELETE /compute/v2.1/images/91bf0a95-4875-4f55-b919-6e1834e216ae => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 02:19:32.746384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:32.746891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:32.767479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.767971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:32.774964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:32.778390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:33.091231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1843186f-e566-48ba-859e-1c2938f04046 req-edfe671a-c8aa-43ac-b203-3e1034343ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97ad790-f1eb-49d6-b1c9-249fa0d34af8", "name": "network-vif-deleted", "tag": "8ec5090a-4fb8-4b2b-b9cc-58d3443773c7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:33.100355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:33.108717 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8fd69014-87fd-40cc-8ade-3da4160904f1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.377673 May 10 02:19:33.109343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1843186f-e566-48ba-859e-1c2938f04046 req-edfe671a-c8aa-43ac-b203-3e1034343ba0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:33.109989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1843186f-e566-48ba-859e-1c2938f04046 req-edfe671a-c8aa-43ac-b203-3e1034343ba0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:33.110948 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1120/2294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:32 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:33.131272 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1843186f-e566-48ba-859e-1c2938f04046 req-edfe671a-c8aa-43ac-b203-3e1034343ba0 service nova] Creating event network-vif-deleted:8ec5090a-4fb8-4b2b-b9cc-58d3443773c7 for instance e97ad790-f1eb-49d6-b1c9-249fa0d34af8 on n-h1-841089-2 May 10 02:19:33.136350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1843186f-e566-48ba-859e-1c2938f04046 req-edfe671a-c8aa-43ac-b203-3e1034343ba0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049827 May 10 02:19:33.136956 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1175/2295] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:33.228621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:33.229248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:33.235278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:33.235741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:33.236946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:33.237612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:33.539088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:33.551184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77227027-bf85-4088-847c-58b382450c99 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1323 microversion: 2.1 time: 0.325753 May 10 02:19:33.552749 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1121/2296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:33 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:33.586319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:33.587261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:33.599240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:33.599987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:33.600963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:33.601575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:33.860122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:33.873085 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ef3e7fb-cc11-4550-985e-38efeace7b21 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.292178 May 10 02:19:33.874897 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1176/2297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:33 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:34.137724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:34.139368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:34.148501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.149269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.150248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.151307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.448897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:34.463404 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-795330d4-b074-4341-8f12-152c3ffdae91 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.337380 May 10 02:19:34.467850 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1122/2298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:34 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:34.568126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:34.568768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:34.577648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.578123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.578942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.583551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.887106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:34.892913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:34.895015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:34.907927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.908899 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-578d0136-1426-434d-9376-0f1af3279201 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 200 len: 1520 microversion: 2.1 time: 0.343653 May 10 02:19:34.920954 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1177/2299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:34 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:34.921200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.921200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.921200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.935904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.158"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:34.943455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:34.964826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.965349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:34.966200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:34.966656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:35.019989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Acquired lock "refresh_cache-dbfc2296-e134-4be7-9aea-ba45093b0479" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:19:35.231023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:35.239794 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b22bd2a5-dc99-463a-b556-9bcff583e9fd tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.352396 May 10 02:19:35.240373 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1123/2300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:34 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:35.486389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:35.487708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:35.496889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:35.497981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:35.499434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:35.500112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:35.883936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:35.894525 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a2f4d63-8064-42db-a3ea-5152e0b8d9d9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.413237 May 10 02:19:35.897057 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1124/2301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:35 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:36.256693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:36.257317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:36.263757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:36.264446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:36.265441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:36.265886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:36.672325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:36.680811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6199d64-1e8c-41b0-a49b-85614e7dff1f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.428545 May 10 02:19:36.691799 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1125/2302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:36 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:36.913085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:36.914609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:36.924286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:36.924816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:36.928706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:36.929174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:37.421030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:37.439183 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ddd76a8-2e44-4e07-9de8-d3c4c99ecece tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.531127 May 10 02:19:37.441051 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1126/2303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:36 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:37.528373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Building network info cache for instance {{(pid=118716) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:19:37.743878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1450074574", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "41909e4c-3e71-44a8-8d50-bf89201a3fa8"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:37.832688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] validate_networks() for [('41909e4c-3e71-44a8-8d50-bf89201a3fa8', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:19:38.502106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:19:38.504672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:19:38.505554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:19:38.506201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:19:38.507339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:19:38.526739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:38.527784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:38.528956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:38.531889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:38.537378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Updating instance_info_cache with network_info: [{"id": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3", "address": "fa:16:3e:c0:06:94", "network": {"id": "91ced21e-0978-43fa-9e67-62c398bf53c5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1770760677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "541f66b5bd0241e2a470461daceb2f3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap37a6a1e6-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118716) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:19:38.554941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Releasing lock "refresh_cache-dbfc2296-e134-4be7-9aea-ba45093b0479" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:19:38.556389 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4e517c3-5ee1-4691-8298-e6fb2d3e61c5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action" status: 202 len: 0 microversion: 2.1 time: 3.633169 May 10 02:19:38.557091 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1178/2304] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:34 2022] POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action => generated 0 bytes in 3635 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:19:38.562819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c9a2280b-b171-442e-85b0-9199682d927e req-9951e0e8-39df-46fd-ac1a-bc1232ecedc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:38.567652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Getting quotas for project 15052a9541b64a4fa757b625688a96a4. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:19:38.572823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c9a2280b-b171-442e-85b0-9199682d927e req-9951e0e8-39df-46fd-ac1a-bc1232ecedc6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:38.573286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c9a2280b-b171-442e-85b0-9199682d927e req-9951e0e8-39df-46fd-ac1a-bc1232ecedc6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:38.576376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Getting quotas for user 5a707e3b6d02448f89471f1d919f8cb4 and project 15052a9541b64a4fa757b625688a96a4. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:19:38.585529 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c9a2280b-b171-442e-85b0-9199682d927e req-9951e0e8-39df-46fd-ac1a-bc1232ecedc6 service nova] Creating event network-changed:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:19:38.590960 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c9a2280b-b171-442e-85b0-9199682d927e req-9951e0e8-39df-46fd-ac1a-bc1232ecedc6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032506 May 10 02:19:38.594517 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1179/2305] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:38.605827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:38.606562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:38.620133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Going to run 3 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:19:38.622740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:38.625353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:38.627607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:38.628508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:38.628968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:38.701021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=6f75e266-c9e6-4bc2-9192-da7ec93a669a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:38.749674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:38.882985 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cad74cda-0415-4421-859b-44dd69dee7af tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440432 May 10 02:19:38.884699 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1127/2306] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:19:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:19:39.073364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:39.084589 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-692aab0a-452c-4e71-b5fa-19c6ca9773c6 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.486635 May 10 02:19:39.094873 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1180/2307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:38 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:39.107818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:39.110993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:39.133363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:39.133943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:39.134854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:39.135389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:39.417351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b7c43e0b-8c8b-4433-ac09-4bae6a7d0770 tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] Calling method '.version_select at 0x7f3d370cd820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:39.494753 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b7c43e0b-8c8b-4433-ac09-4bae6a7d0770 tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.608704 May 10 02:19:39.495466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1128/2308] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:19:38 2022] GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd/defaults => generated 371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:39.518295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.158"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:39.518926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:39.522116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:39.526707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05fa7a8b-e60c-4eae-871b-e2ec49153d18 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.428023 May 10 02:19:39.527311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1181/2309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:39 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:39.540241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:39.541416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:39.543383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:39.544613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:39.546388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:39.553306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:39.554327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:19:39.577687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:39.578149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:39.580813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:39.581468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:39.604060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Acquired lock "refresh_cache-17e7dde4-4cf8-4320-815a-d9e1dd004d6d" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:19:39.610525 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e3a902de-fe7c-4b87-962e-126ebae505f1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.069860 May 10 02:19:39.612955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1182/2310] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:19:39 2022] GET /compute/v2.1/servers => generated 1018 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:39.700247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-603017646", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:39.781564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:19:40.214884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:19:40.215444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:19:40.216030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:19:40.216564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:19:40.217084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:19:40.229173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:40.229916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:40.231233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:40.232043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:40.255840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Getting quotas for project e246c06835984f16b407d8df3f03b49b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:19:40.263753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Getting quotas for user 7bc85ca1ad9241249b810f85fc8c76f0 and project e246c06835984f16b407d8df3f03b49b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:19:40.281086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:19:40.284487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:40.334552 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-084e7a9b-4f3f-4e5b-afd4-bc16fcee0634 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720267 May 10 02:19:40.335227 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1183/2311] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:19:40.346730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f294bf2e-93b0-4346-8dcb-79ebfb7b4ac5 tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] Calling method '.version_select at 0x7f3d3729f1f0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:40.444981 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f294bf2e-93b0-4346-8dcb-79ebfb7b4ac5 tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd" status: 200 len: 371 microversion: 2.1 time: 0.103248 May 10 02:19:40.445577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1184/2312] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:19:40 2022] GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:40.450838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:40.452832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:40.459713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:40.460168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:40.460957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:40.461399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:40.561561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:40.569477 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61e26773-484c-4925-9e5c-5fcf3e4417f8 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 200 len: 1275 microversion: 2.1 time: 0.122719 May 10 02:19:40.570273 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1185/2313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:40 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:40.659648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-918617a0-ad51-4aed-a498-8e8e6d931a9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d37449040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2105242122", "description": "tempest-description-1597206893"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:41.050779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-918617a0-ad51-4aed-a498-8e8e6d931a9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.470630 May 10 02:19:41.051454 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1186/2314] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:19:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:41.062886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:41.063803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:41.083967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:41.084428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:41.085222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:41.085666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:41.479585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:41.488298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-13d1e5d8-39ed-436c-9996-64e053b31051 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.429394 May 10 02:19:41.488883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1187/2315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:41 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:41.493535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:41.494152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:41.500289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:41.500748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:41.501554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:41.503325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:41.584849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:41.592531 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76f411f7-6afc-498f-a097-2e0e3fb6ea48 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1270 microversion: 2.1 time: 0.102653 May 10 02:19:41.593256 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1188/2316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:41 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:41.607646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19c45523-5ad2-4d88-918c-eae4611b3775 tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] Calling method '.version_select at 0x7f3d375c1160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:41.689150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19c45523-5ad2-4d88-918c-eae4611b3775 tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.085274 May 10 02:19:41.690293 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1189/2317] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:19:41 2022] GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd/defaults => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:41.695766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:41.697379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:41.706068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:41.707226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:41.708243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:41.708899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:42.554152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:42.561580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ab56d24-80fa-4e63-b719-894dd8d11cfc tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.870096 May 10 02:19:42.562496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1190/2318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:41 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:42.568983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01465095-3213-47d1-840a-c74d40edbe1b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d3729fee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-909870690", "description": "tempest-description-1764281935"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:43.176430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01465095-3213-47d1-840a-c74d40edbe1b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.612583 May 10 02:19:43.179642 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1191/2319] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:19:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:43.185604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:43.186989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:43.223117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:43.225741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:43.228175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:43.233005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:43.840599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:43.865508 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5876c89-4f56-4d2a-9a7c-5b5f4e3ccb19 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 200 len: 1323 microversion: 2.1 time: 0.683849 May 10 02:19:43.866968 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1192/2320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:43 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:43.883609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7ae9585-1091-466d-a889-8593d13ad79c tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] Calling method '.version_select at 0x7f3d372123a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:43.968144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7ae9585-1091-466d-a889-8593d13ad79c tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd" status: 200 len: 371 microversion: 2.1 time: 0.094617 May 10 02:19:43.969462 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1193/2321] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 02:19:43 2022] GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:43.974586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:43.975680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:43.983468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:43.984416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:43.985492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:43.986289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:44.446177 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.network.neutron [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] re-assign floating IP 172.25.8.158 from instance dbfc2296-e134-4be7-9aea-ba45093b0479 May 10 02:19:44.518201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:44.531472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cbea430c-e745-4df9-be0c-b166292a2d58 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1511 microversion: 2.1 time: 0.560645 May 10 02:19:44.531962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:19:44.533482 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1194/2322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:43 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:44.552641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:44.554949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:44.569183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:44.570692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:44.572696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:44.573696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:45.041684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:45.049563 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62c2408b-0ff5-42d5-8700-4884f8c2e092 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1276 microversion: 2.1 time: 0.504105 May 10 02:19:45.050154 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1195/2323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:44 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1276 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:45.055425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-190835678", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "35a3ce9e-e80c-4229-9d98-b7abc78aacd8"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:45.130395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] validate_networks() for [('35a3ce9e-e80c-4229-9d98-b7abc78aacd8', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:19:46.581757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:19:46.582338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:19:46.582795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:19:46.583591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:19:46.584097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:19:46.592830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:46.593413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:46.594350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:46.595473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:46.612630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Getting quotas for project 5fd11a5b99914f159cd7844490e3bf7b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:19:46.617700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Getting quotas for user 45f2c2d3102f4f7caf7d578e0091aca5 and project 5fd11a5b99914f159cd7844490e3bf7b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:19:46.633222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:19:46.635720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:46.684345 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fe168f29-d106-4e9f-acca-c5756214143d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632722 May 10 02:19:46.689951 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1196/2324] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:19:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:19:46.690286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Updating instance_info_cache with network_info: [{"id": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3", "address": "fa:16:3e:c0:06:94", "network": {"id": "91ced21e-0978-43fa-9e67-62c398bf53c5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1770760677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "541f66b5bd0241e2a470461daceb2f3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap37a6a1e6-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:19:46.690768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:46.691702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:46.698235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:46.698881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:46.699811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:46.700368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:46.711701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:19:47.246107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:47.255323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c86b5484-0a30-4279-99b7-2fb51d97dbb9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.569051 May 10 02:19:47.256289 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1197/2325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:46 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:47.260977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3d736225-0b8c-4586-8677-a2178ab0502d req-73db4c35-cf26-47d9-8b30-0d369eb3d96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f568bb-c288-49aa-a0a8-db86a6eed24d", "tag": "32a77d2b-3d12-4cfe-8404-9a4d9dbd7bfd"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:47.271157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3d736225-0b8c-4586-8677-a2178ab0502d req-73db4c35-cf26-47d9-8b30-0d369eb3d96d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:47.271640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3d736225-0b8c-4586-8677-a2178ab0502d req-73db4c35-cf26-47d9-8b30-0d369eb3d96d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:47.283449 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3d736225-0b8c-4586-8677-a2178ab0502d req-73db4c35-cf26-47d9-8b30-0d369eb3d96d service nova] Creating event network-changed:32a77d2b-3d12-4cfe-8404-9a4d9dbd7bfd for instance 56f568bb-c288-49aa-a0a8-db86a6eed24d on n-h1-841089-2 May 10 02:19:47.288842 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3d736225-0b8c-4586-8677-a2178ab0502d req-73db4c35-cf26-47d9-8b30-0d369eb3d96d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 May 10 02:19:47.289993 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1198/2326] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:47.295199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0d9aa49-845c-41d3-853f-314b751f7dbd tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] Calling method '.version_select at 0x7f3d37262280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:47.378408 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0d9aa49-845c-41d3-853f-314b751f7dbd tempest-QuotasTestJSON-68339702 tempest-QuotasTestJSON-68339702-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd?user_id=ab5335afc5f6406e9d77b69c422b59c4" status: 200 len: 371 microversion: 2.1 time: 0.086806 May 10 02:19:47.379479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1199/2327] 10.222.0.52 () {58 vars in 1322 bytes} [Tue May 10 02:19:47 2022] GET /compute/v2.1/os-quota-sets/592211efd9b84cd5bf5780f2091dbadd?user_id=ab5335afc5f6406e9d77b69c422b59c4 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:47.392529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d99328ae-bf79-4c5e-a1f1-b38e25b2aa5e req-89ba003e-5f26-42f2-8d3a-82c6a00d09b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:47.412606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d99328ae-bf79-4c5e-a1f1-b38e25b2aa5e req-89ba003e-5f26-42f2-8d3a-82c6a00d09b7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:47.413083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d99328ae-bf79-4c5e-a1f1-b38e25b2aa5e req-89ba003e-5f26-42f2-8d3a-82c6a00d09b7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:47.429970 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d99328ae-bf79-4c5e-a1f1-b38e25b2aa5e req-89ba003e-5f26-42f2-8d3a-82c6a00d09b7 service nova] Creating event network-changed:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:19:47.442209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d99328ae-bf79-4c5e-a1f1-b38e25b2aa5e req-89ba003e-5f26-42f2-8d3a-82c6a00d09b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061424 May 10 02:19:47.444604 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1200/2328] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:47.464378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:47.465099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:47.495283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:47.495734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:47.504439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:47.507617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:48.574297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:48.584513 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f6a8c959-fff3-476f-8f58-cd051a365b12 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 200 len: 1323 microversion: 2.1 time: 1.135949 May 10 02:19:48.585279 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1201/2329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:47 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 1323 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:48.590119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:48.591266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:48.598334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:48.599105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:48.599988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:48.600503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.209288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:49.229726 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3b1978c-398b-49bb-8649-fe5243eee267 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1488 microversion: 2.1 time: 0.643089 May 10 02:19:49.231265 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1202/2330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:48 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1488 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:49.239220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:49.240209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:49.248908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.249483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.251042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.251934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.789733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Updating instance_info_cache with network_info: [{"id": "ef9abbee-e432-4880-a975-797ca53e281e", "address": "fa:16:3e:72:d8:db", "network": {"id": "91ced21e-0978-43fa-9e67-62c398bf53c5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1770760677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "541f66b5bd0241e2a470461daceb2f3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapef9abbee-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:19:49.804150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Releasing lock "refresh_cache-17e7dde4-4cf8-4320-815a-d9e1dd004d6d" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:19:49.805214 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbe9c2d4-3267-4405-bcfd-b02fee1cc4fd tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d/action" status: 202 len: 0 microversion: 2.1 time: 10.292060 May 10 02:19:49.806293 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1129/2331] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:39 2022] POST /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d/action => generated 0 bytes in 10310 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:19:49.812368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:49.812991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:49.820580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.820835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.822069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.822669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.924685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:49.932123 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58f3b6af-1b1a-4f48-acb2-6829c9aafe60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.699828 May 10 02:19:49.932699 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1203/2332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:49 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:49.937356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:49.937997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:49.944638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.945092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.945878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.946320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.971220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:49.979718 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f0ad6ac2-e306-48bc-962c-9a783721fd46 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1273 microversion: 2.1 time: 0.171710 May 10 02:19:49.980406 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1130/2333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:49 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:49.984880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:49.985451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:49.991735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.992481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:49.993472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:49.994116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:50.021606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:50.099441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-309d6e2d-089a-44be-84ea-dc73712aa357 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 204 len: 0 microversion: 2.1 time: 0.117623 May 10 02:19:50.100467 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1131/2334] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:49 2022] DELETE /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:50.106140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:50.106847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:50.113447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:50.114090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:50.115193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:50.115645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:50.364809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:50.373290 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fbababc6-f30c-4340-9486-18f04cbc7fc1 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.439294 May 10 02:19:50.373886 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1204/2335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:49 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:50.522098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-27ad8916-a763-4efd-a4ce-fe10fae7c573 tempest-ComputeTenantNetworksTest-1198426453 tempest-ComputeTenantNetworksTest-1198426453-project] Calling method '.version_select at 0x7f3d374e5790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:50.882078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:50.890272 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40d8130a-9f94-4933-8c21-48317bb564f9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 200 len: 1323 microversion: 2.1 time: 0.788517 May 10 02:19:50.890865 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1132/2336] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:50 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 1323 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:50.905110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.158"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:51.092096 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-27ad8916-a763-4efd-a4ce-fe10fae7c573 tempest-ComputeTenantNetworksTest-1198426453 tempest-ComputeTenantNetworksTest-1198426453-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.716892 May 10 02:19:51.092896 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1205/2337] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:19:50 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:51.098064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e7dde4-4cf8-4320-815a-d9e1dd004d6d", "tag": "ef9abbee-e432-4880-a975-797ca53e281e"}, {"name": "network-changed", "server_uuid": "f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d", "tag": "de5f2874-7f72-4a6a-b50d-6dabb6304413"}, {"name": "network-changed", "server_uuid": "6f75e266-c9e6-4bc2-9192-da7ec93a669a", "tag": "7c707886-3d86-4a1a-b6ca-f18f0e945295"}, {"name": "network-changed", "server_uuid": "7b89457c-1e9c-4b0d-b982-65ed44dc593d", "tag": "70f2dd2b-4770-4b78-b7d0-30a2cc4eae3c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:51.110347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.110809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.126115 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Creating event network-changed:ef9abbee-e432-4880-a975-797ca53e281e for instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d on n-h2-841089-2 May 10 02:19:51.126637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Creating event network-changed:de5f2874-7f72-4a6a-b50d-6dabb6304413 for instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d on n-h2-841089-2 May 10 02:19:51.127175 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Creating event network-changed:7c707886-3d86-4a1a-b6ca-f18f0e945295 for instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a on n-h1-841089-2 May 10 02:19:51.127686 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] Creating event network-changed:70f2dd2b-4770-4b78-b7d0-30a2cc4eae3c for instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d on n-h1-841089-2 May 10 02:19:51.138747 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b2c914f5-cf83-4e6c-a4a3-499089d69bc0 req-7f1b6b23-5ee7-4eb4-b7bb-aad15145a554 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.044826 May 10 02:19:51.139407 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1206/2338] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:51.144872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:51.145583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:51.152123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.152589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.153589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.154292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.400715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:51.407424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.408287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.409096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.409685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.831852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:51.845605 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae9f5941-5835-45a0-ae4a-4774d013321d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1494 microversion: 2.1 time: 0.704632 May 10 02:19:51.846305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1207/2339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:51 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1494 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:51.851714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-816fe93a-a94a-4c45-8ca7-edf87f66950e req-eee25429-635f-4006-bfb4-3bfd5b99629b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f568bb-c288-49aa-a0a8-db86a6eed24d", "name": "network-vif-plugged", "status": "completed", "tag": "32a77d2b-3d12-4cfe-8404-9a4d9dbd7bfd"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:51.862334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-816fe93a-a94a-4c45-8ca7-edf87f66950e req-eee25429-635f-4006-bfb4-3bfd5b99629b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.863310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-816fe93a-a94a-4c45-8ca7-edf87f66950e req-eee25429-635f-4006-bfb4-3bfd5b99629b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.878209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-816fe93a-a94a-4c45-8ca7-edf87f66950e req-eee25429-635f-4006-bfb4-3bfd5b99629b service nova] Creating event network-vif-plugged:32a77d2b-3d12-4cfe-8404-9a4d9dbd7bfd for instance 56f568bb-c288-49aa-a0a8-db86a6eed24d on n-h1-841089-2 May 10 02:19:51.884010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-816fe93a-a94a-4c45-8ca7-edf87f66950e req-eee25429-635f-4006-bfb4-3bfd5b99629b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035815 May 10 02:19:51.885194 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1208/2340] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:51.892274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:51.893323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:51.900500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.901563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:51.902708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:51.903424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:52.114639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] HTTP exception thrown: Floating IP 172.25.8.158 is not associated with instance dbfc2296-e134-4be7-9aea-ba45093b0479. May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Request method failure captured: May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action HTTP/1.1 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 49 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiect8YJLj2HXun9jLSuc7L4IkAcAiSThROLrTRgB09xq3RUEhMyUVIEOqnXsOeNdIw35RlUkBq3D7XQOfcWsLG5JKQk-rg7nCFmNsJAXYDB2VhEObSkaCwfVqyQxGRTd2J7Mec62PiqtcyWqGjOWXJ4R966Ur6Fe_vgZnAm0Am9faAP4 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_541f66b5bd0241e2a470461daceb2f3e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ff40ce43b5a14bfaa08e172d5d646758 May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: {"removeFloatingIp": {"address": "172.25.8.158"}} May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: exception: Floating IP 172.25.8.158 is not associated with instance dbfc2296-e134-4be7-9aea-ba45093b0479. May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'dbfc2296-e134-4be7-9aea-ba45093b0479', 'body': {'removeFloatingIp': {'address': '172.25.8.158'}}} May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.158 is not associated with instance dbfc2296-e134-4be7-9aea-ba45093b0479. May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.158 is not associated with instance dbfc2296-e134-4be7-9aea-ba45093b0479. May 10 02:19:52.116217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:19:52.122016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Returning 409 to user: Floating IP 172.25.8.158 is not associated with instance dbfc2296-e134-4be7-9aea-ba45093b0479. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:52.122016 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-740d7c8b-6bcb-4341-b753-8ef2c6d65103 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action" status: 409 len: 146 microversion: 2.1 time: 1.217327 May 10 02:19:52.122016 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1133/2341] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:50 2022] POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action => generated 146 bytes in 1227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:19:52.123151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:52.123774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:52.130007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:52.130533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:52.131366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:52.131804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:52.337877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:52.352237 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae20ca87-0656-43cd-86ac-c8ab5268f0bc tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.464949 May 10 02:19:52.353205 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1209/2342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:51 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:52.367993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-332b7f25-daf8-4fe1-a7f6-85ffe735bed2 tempest-ComputeTenantNetworksTest-1198426453 tempest-ComputeTenantNetworksTest-1198426453-project] Calling method '.version_select at 0x7f3d372373a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:53.004666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-332b7f25-daf8-4fe1-a7f6-85ffe735bed2 tempest-ComputeTenantNetworksTest-1198426453 tempest-ComputeTenantNetworksTest-1198426453-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks/8ead3b25-bf74-4473-a32b-0a339f628f0d" status: 200 len: 140 microversion: 2.1 time: 0.649731 May 10 02:19:53.005345 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1210/2343] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:19:52 2022] GET /compute/v2.1/os-tenant-networks/8ead3b25-bf74-4473-a32b-0a339f628f0d => generated 140 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:53.010155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:53.010848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:53.024504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.024960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.025827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.026450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.035335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:53.043045 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-751a7910-eb28-4ae8-812e-21d17c2d8001 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1315 microversion: 2.1 time: 0.923806 May 10 02:19:53.055283 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1134/2344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:52 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:53.060407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:53.061027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:53.074680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.075146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.075936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.076371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.459585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:53.467429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ebca5dc-9f36-4314-9af8-64ae27df17ff tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.460756 May 10 02:19:53.468661 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1211/2345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:53 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:53.479007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8b8eb470-0257-4cda-b3ce-3bcffad2e886 req-82233b1b-bbaf-40f5-821d-8abb8949eb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3bea11-a4b7-4250-9462-0b60a4b03e78", "name": "network-vif-deleted", "tag": "a0b77caf-4576-429a-9475-28ce59d0335b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:53.490260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b8eb470-0257-4cda-b3ce-3bcffad2e886 req-82233b1b-bbaf-40f5-821d-8abb8949eb17 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.490718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b8eb470-0257-4cda-b3ce-3bcffad2e886 req-82233b1b-bbaf-40f5-821d-8abb8949eb17 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.494484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:53.503963 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ad49bada-3078-4726-939f-95140554f8e7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 200 len: 1323 microversion: 2.1 time: 0.447244 May 10 02:19:53.505358 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1135/2346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:53 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:53.510086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.158"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:53.512140 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8b8eb470-0257-4cda-b3ce-3bcffad2e886 req-82233b1b-bbaf-40f5-821d-8abb8949eb17 service nova] Creating event network-vif-deleted:a0b77caf-4576-429a-9475-28ce59d0335b for instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 on n-h1-841089-2 May 10 02:19:53.517567 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8b8eb470-0257-4cda-b3ce-3bcffad2e886 req-82233b1b-bbaf-40f5-821d-8abb8949eb17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047396 May 10 02:19:53.518637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1212/2347] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:53.525454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:53.526634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:53.533890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.534173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.534967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.535438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.568944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.569406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.569874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lazy-loading 'fault' on Instance uuid 1c3bea11-a4b7-4250-9462-0b60a4b03e78 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:19:53.707183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:53.714464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd41cbe0-8669-4f8d-a54f-5876149c6f47 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 200 len: 1304 microversion: 2.1 time: 0.194677 May 10 02:19:53.715038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1213/2348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:53 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:53.719498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:53.720114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:53.726474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.726930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.727739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.728179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.932376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:53.938392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.939020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:53.939822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:53.940260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:54.166023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:54.173756 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-30f23441-b481-4304-917d-a994a9ff3182 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.457687 May 10 02:19:54.174585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1214/2349] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:53 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:54.179429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:54.180039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:54.186230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:54.186934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:54.187932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:54.188550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:54.614212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Acquired lock "refresh_cache-17e7dde4-4cf8-4320-815a-d9e1dd004d6d" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:19:54.648255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:54.660774 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-97368df7-057d-4d97-8493-c2ac75096b40 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1315 microversion: 2.1 time: 0.484858 May 10 02:19:54.661680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1215/2350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:54 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:54.670483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-24d360dc-c7c9-4755-b858-b7f9a1dcb42f req-680c5779-63c4-4076-b06f-d99a4cdc6164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc074c9c-7a50-4f31-92da-cd52a1034f16", "tag": "04943d83-a529-4e19-a5a3-a9fc0b2d1ce7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:54.681058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-24d360dc-c7c9-4755-b858-b7f9a1dcb42f req-680c5779-63c4-4076-b06f-d99a4cdc6164 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:54.681927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-24d360dc-c7c9-4755-b858-b7f9a1dcb42f req-680c5779-63c4-4076-b06f-d99a4cdc6164 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:54.700741 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-24d360dc-c7c9-4755-b858-b7f9a1dcb42f req-680c5779-63c4-4076-b06f-d99a4cdc6164 service nova] Creating event network-changed:04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 for instance fc074c9c-7a50-4f31-92da-cd52a1034f16 on n-h2-841089-2 May 10 02:19:54.710913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-24d360dc-c7c9-4755-b858-b7f9a1dcb42f req-680c5779-63c4-4076-b06f-d99a4cdc6164 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044881 May 10 02:19:54.720715 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1216/2351] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:54.746401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:54.747199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:54.758576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:54.759154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:54.760401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:54.761175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.490322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:55.500901 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa506f54-d462-4475-aa27-ecd02701e555 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.777904 May 10 02:19:55.501878 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1217/2352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:54 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:55.509275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:55.510301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:55.517819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.519537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.520869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.521574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.861929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:55.873929 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44135257-1c2c-4527-b332-60d29f77b594 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 200 len: 1515 microversion: 2.1 time: 0.370629 May 10 02:19:55.874537 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1218/2353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:55 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:55.892491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-95d001cd-23c0-4d6a-96ef-21a8b1c314f4 req-6f6867f3-a5b8-4276-9556-baf62ddefe3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d", "name": "network-vif-plugged", "status": "completed", "tag": "de5f2874-7f72-4a6a-b50d-6dabb6304413"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:55.901841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-95d001cd-23c0-4d6a-96ef-21a8b1c314f4 req-6f6867f3-a5b8-4276-9556-baf62ddefe3a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.902380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-95d001cd-23c0-4d6a-96ef-21a8b1c314f4 req-6f6867f3-a5b8-4276-9556-baf62ddefe3a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.916161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-95d001cd-23c0-4d6a-96ef-21a8b1c314f4 req-6f6867f3-a5b8-4276-9556-baf62ddefe3a service nova] Creating event network-vif-plugged:de5f2874-7f72-4a6a-b50d-6dabb6304413 for instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d on n-h2-841089-2 May 10 02:19:55.923693 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-95d001cd-23c0-4d6a-96ef-21a8b1c314f4 req-6f6867f3-a5b8-4276-9556-baf62ddefe3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 May 10 02:19:55.924577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1219/2354] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:55.930668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:55.931672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:55.939721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.941333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.942554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.943134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.959262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 HTTP/1.1 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1c3bea11-a4b7-4250-9462-0b60a4b03e78'} May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:19:55.961345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-288a2935-1a27-433c-b912-86d3e77707dc tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 404 len: 111 microversion: 2.1 time: 0.037346 May 10 02:19:55.966729 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1220/2355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:55 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:19:55.985388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:55.986186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:55.992955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.993427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:55.994432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:55.994886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:56.258475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:56.273698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a59224cf-c832-4bbe-9b8f-2cf6c561c6dd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.293841 May 10 02:19:56.275103 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1221/2356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:55 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:56.280234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:56.281058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:56.286921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:19:56.288534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:56.289186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:56.290198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:56.290872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:56.578475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:56.598390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1576870-2635-4d78-b98e-12073e932df9 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1315 microversion: 2.1 time: 0.313896 May 10 02:19:56.605692 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1222/2357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:56 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:56.616749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:56.620424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:56.633089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:56.634233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:56.635301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:56.636161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:56.932271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:56.940860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-172dd784-24d2-4664-ab43-f09e54ffb613 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 200 len: 1323 microversion: 2.1 time: 0.334003 May 10 02:19:56.941486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1223/2358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:56 2022] GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:56.972251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1661127790", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a62f3681-19aa-463a-a353-ba6237a01ec4"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:57.036763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] validate_networks() for [('a62f3681-19aa-463a-a353-ba6237a01ec4', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:19:57.729484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Updating instance_info_cache with network_info: [{"id": "ef9abbee-e432-4880-a975-797ca53e281e", "address": "fa:16:3e:72:d8:db", "network": {"id": "91ced21e-0978-43fa-9e67-62c398bf53c5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1770760677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "541f66b5bd0241e2a470461daceb2f3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapef9abbee-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:19:57.745200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Releasing lock "refresh_cache-17e7dde4-4cf8-4320-815a-d9e1dd004d6d" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:19:57.746013 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50d954fa-1a84-4a56-811d-c67d929c5a50 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d/action" status: 202 len: 0 microversion: 2.1 time: 4.239688 May 10 02:19:57.746638 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1136/2359] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:53 2022] POST /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d/action => generated 0 bytes in 4241 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:19:57.756473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:57.760586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:57.770609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:57.771097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:57.771910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:57.772361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:57.853202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:19:57.853798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:19:57.854297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:19:57.854742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:19:57.855409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:19:57.869530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:57.871474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:57.875191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:57.875963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:57.917474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:19:57.928896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Getting quotas for user c59edfa0cdbc46bc8a7c253228023559 and project 09c96e69d8a240199a06b0433fb88a4e. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:19:57.948405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:19:57.955612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:19:58.037546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38c9c0a1-b1cc-43d1-a1ff-b14b0bc13ac7 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082709 May 10 02:19:58.040655 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1224/2360] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:19:58.050809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-cb8f49c6-10ff-4d82-9a98-75a144163a2d req-68d2e412-dc2d-4a67-8548-1ded4f01a9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e7dde4-4cf8-4320-815a-d9e1dd004d6d", "tag": "ef9abbee-e432-4880-a975-797ca53e281e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:58.080770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cb8f49c6-10ff-4d82-9a98-75a144163a2d req-68d2e412-dc2d-4a67-8548-1ded4f01a9cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.097577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cb8f49c6-10ff-4d82-9a98-75a144163a2d req-68d2e412-dc2d-4a67-8548-1ded4f01a9cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.134775 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-cb8f49c6-10ff-4d82-9a98-75a144163a2d req-68d2e412-dc2d-4a67-8548-1ded4f01a9cc service nova] Creating event network-changed:ef9abbee-e432-4880-a975-797ca53e281e for instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d on n-h2-841089-2 May 10 02:19:58.141951 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-cb8f49c6-10ff-4d82-9a98-75a144163a2d req-68d2e412-dc2d-4a67-8548-1ded4f01a9cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099676 May 10 02:19:58.142870 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1225/2361] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:58.154424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:58.155417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:58.163324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.164023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.166374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.167840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.220400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:58.229758 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-35213704-ac7e-42fd-8b91-fd58456323e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.480655 May 10 02:19:58.240312 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1137/2362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:57 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:58.256644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:58.257234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:58.282320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.282810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.287116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.287600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.406865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:58.418077 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06497608-9aab-4be5-b1c0-3d53bff62c1c tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.272403 May 10 02:19:58.431023 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1226/2363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:58 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:58.437059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:58.438162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:58.447525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.448296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.449286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.449963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.491031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:19:58.662947 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c7e0222-9cc5-47d8-b3f5-a8f5619d04d5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 204 len: 0 microversion: 2.1 time: 0.229165 May 10 02:19:58.664117 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1227/2364] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:19:58 2022] DELETE /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:19:58.676554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:58.677778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:58.687692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.688248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.689157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.689822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.716392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:58.731429 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4242115b-29a1-40f4-8f8b-b2b7acd3e382 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1315 microversion: 2.1 time: 0.485436 May 10 02:19:58.732393 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1138/2365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:58 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:58.746256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1a415f38-93fa-474f-86cf-8638ff3bf5f8 req-1639e243-df01-446c-b27c-496d9f0a9300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f75e266-c9e6-4bc2-9192-da7ec93a669a", "name": "network-vif-plugged", "status": "completed", "tag": "7c707886-3d86-4a1a-b6ca-f18f0e945295"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:58.770118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1a415f38-93fa-474f-86cf-8638ff3bf5f8 req-1639e243-df01-446c-b27c-496d9f0a9300 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.775371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1a415f38-93fa-474f-86cf-8638ff3bf5f8 req-1639e243-df01-446c-b27c-496d9f0a9300 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.804831 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1a415f38-93fa-474f-86cf-8638ff3bf5f8 req-1639e243-df01-446c-b27c-496d9f0a9300 service nova] Creating event network-vif-plugged:7c707886-3d86-4a1a-b6ca-f18f0e945295 for instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a on n-h1-841089-2 May 10 02:19:58.811121 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1a415f38-93fa-474f-86cf-8638ff3bf5f8 req-1639e243-df01-446c-b27c-496d9f0a9300 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077130 May 10 02:19:58.812185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1139/2366] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:19:58.818755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:58.820064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:58.828321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.829003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.830290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:58.831672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:58.975650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:58.988791 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3477731b-7847-4af7-a745-ad7aa9d124c1 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1219 microversion: 2.1 time: 0.174943 May 10 02:19:58.992743 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1140/2367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:58 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:58.997770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.158"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:19:59.010871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:59.027998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:59.028462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:59.029291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:59.029727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:59.074435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:59.087305 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db0d546e-42c1-4211-a124-cfd24e9f2cf9 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 200 len: 1323 microversion: 2.1 time: 0.419920 May 10 02:19:59.088651 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1228/2368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:58 2022] GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:19:59.128436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Acquired lock "refresh_cache-dbfc2296-e134-4be7-9aea-ba45093b0479" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:19:59.250969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:59.253226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:59.260693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:59.261530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:59.262570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:59.263573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:59.581498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:19:59.593587 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01168f02-7eb4-4adb-9578-177c0cf7d598 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.349156 May 10 02:19:59.594549 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1229/2369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:59 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:19:59.601939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:19:59.604970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:19:59.616004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:59.616473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:19:59.617289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:19:59.617742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:00.042949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:00.055299 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17f006ff-cb70-4d2e-adc0-929015a162cd tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.455483 May 10 02:20:00.056286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1230/2370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:19:59 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:00.062607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:00.063264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:00.092540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:00.096994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:00.099362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:00.102921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:01.071833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:01.080087 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-73581b64-37ea-4786-8246-b30d9b5d441c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1315 microversion: 2.1 time: 1.022673 May 10 02:20:01.090468 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1231/2371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:00 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:01.095727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:01.097144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:01.104032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:01.104773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:01.105784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:01.106442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:01.297093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:01.310670 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ec1fddb-f515-4805-82cc-76ac0be84783 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1273 microversion: 2.1 time: 0.218504 May 10 02:20:01.313527 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1232/2372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:01 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:01.321339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:01.322193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:01.334480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:01.335330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:01.336623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:01.337075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:02.659781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:02.672364 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9111c84-fd90-4935-9d78-e68df20decf0 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 200 len: 1516 microversion: 2.1 time: 1.357481 May 10 02:20:02.685125 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1233/2373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:01 2022] GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 1516 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:02.693822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:02.699935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:02.721763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:02.722257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:02.723173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:02.723631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:03.215600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:03.238375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7154ef3-cd7b-4825-83b6-cc05d0f880b0 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.551806 May 10 02:20:03.244720 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1234/2374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:02 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:03.254391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a5835e8a-7695-49e4-b9f9-9512ea289e3a req-9f1f055e-6eca-46d6-8581-adfc4dd5df18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b89457c-1e9c-4b0d-b982-65ed44dc593d", "name": "network-vif-plugged", "status": "completed", "tag": "70f2dd2b-4770-4b78-b7d0-30a2cc4eae3c"}, {"server_uuid": "fc074c9c-7a50-4f31-92da-cd52a1034f16", "name": "network-vif-plugged", "status": "completed", "tag": "04943d83-a529-4e19-a5a3-a9fc0b2d1ce7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:03.266425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a5835e8a-7695-49e4-b9f9-9512ea289e3a req-9f1f055e-6eca-46d6-8581-adfc4dd5df18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:03.267467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a5835e8a-7695-49e4-b9f9-9512ea289e3a req-9f1f055e-6eca-46d6-8581-adfc4dd5df18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:03.307859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Building network info cache for instance {{(pid=118717) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:20:03.308511 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a5835e8a-7695-49e4-b9f9-9512ea289e3a req-9f1f055e-6eca-46d6-8581-adfc4dd5df18 service nova] Creating event network-vif-plugged:70f2dd2b-4770-4b78-b7d0-30a2cc4eae3c for instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d on n-h1-841089-2 May 10 02:20:03.308625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a5835e8a-7695-49e4-b9f9-9512ea289e3a req-9f1f055e-6eca-46d6-8581-adfc4dd5df18 service nova] Creating event network-vif-plugged:04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 for instance fc074c9c-7a50-4f31-92da-cd52a1034f16 on n-h2-841089-2 May 10 02:20:03.343427 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a5835e8a-7695-49e4-b9f9-9512ea289e3a req-9f1f055e-6eca-46d6-8581-adfc4dd5df18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096738 May 10 02:20:03.344057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1235/2375] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:03.361798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:03.376151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:03.399934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:03.400667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:03.408420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:03.409664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:04.019040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:04.027589 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8c76ffaa-aedb-4747-a697-01f2f633ef81 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.676078 May 10 02:20:04.031790 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1236/2376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:03 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:04.037398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:04.044186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:04.058886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:04.059681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:04.060680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:04.061307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:04.449698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:04.464499 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-defbcb04-86dd-404d-95cb-9a26a9a46943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1315 microversion: 2.1 time: 0.430893 May 10 02:20:04.467947 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1237/2377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:04 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:04.482094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:04.483179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:04.491015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:04.491767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:04.492936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:04.493560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.285842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Updating instance_info_cache with network_info: [{"id": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3", "address": "fa:16:3e:c0:06:94", "network": {"id": "91ced21e-0978-43fa-9e67-62c398bf53c5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1770760677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "541f66b5bd0241e2a470461daceb2f3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap37a6a1e6-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:20:05.308065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Releasing lock "refresh_cache-dbfc2296-e134-4be7-9aea-ba45093b0479" {{(pid=118717) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:20:05.309010 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07d94837-73e4-4b8c-9861-7abe8d7606a6 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action" status: 202 len: 0 microversion: 2.1 time: 6.315072 May 10 02:20:05.309678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1141/2378] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:19:58 2022] POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action => generated 0 bytes in 6316 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:20:05.324511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:05.326625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:05.347458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:05.356737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.358640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.360131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.361440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25cb2a7a-80ab-49a4-921f-51b169fc5e6f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1315 microversion: 2.1 time: 0.892249 May 10 02:20:05.362205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.374734 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1238/2379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:04 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:05.385252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-798407d8-b7cc-4143-ae6b-b032253f68cf req-e5f29edb-023e-402e-a6d7-b2d15197fed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e7dde4-4cf8-4320-815a-d9e1dd004d6d", "name": "network-vif-deleted", "tag": "ef9abbee-e432-4880-a975-797ca53e281e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:05.406766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-798407d8-b7cc-4143-ae6b-b032253f68cf req-e5f29edb-023e-402e-a6d7-b2d15197fed0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.408496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-798407d8-b7cc-4143-ae6b-b032253f68cf req-e5f29edb-023e-402e-a6d7-b2d15197fed0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.440253 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-798407d8-b7cc-4143-ae6b-b032253f68cf req-e5f29edb-023e-402e-a6d7-b2d15197fed0 service nova] Creating event network-vif-deleted:ef9abbee-e432-4880-a975-797ca53e281e for instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d on n-h2-841089-2 May 10 02:20:05.451997 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-798407d8-b7cc-4143-ae6b-b032253f68cf req-e5f29edb-023e-402e-a6d7-b2d15197fed0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075493 May 10 02:20:05.452642 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1239/2380] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:05.474333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b533cdd6-ab41-4d8e-80a4-65ebe1de0ca4 req-383bd0c1-880b-465b-91fd-52ab264b2988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3e5af1-33f5-4589-a613-b97ac6b975d4", "tag": "596f2604-055d-4cee-82d5-b6a1bd0b53d9"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:05.484618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b533cdd6-ab41-4d8e-80a4-65ebe1de0ca4 req-383bd0c1-880b-465b-91fd-52ab264b2988 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.485055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b533cdd6-ab41-4d8e-80a4-65ebe1de0ca4 req-383bd0c1-880b-465b-91fd-52ab264b2988 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.502715 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b533cdd6-ab41-4d8e-80a4-65ebe1de0ca4 req-383bd0c1-880b-465b-91fd-52ab264b2988 service nova] Creating event network-changed:596f2604-055d-4cee-82d5-b6a1bd0b53d9 for instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 on n-h1-841089-2 May 10 02:20:05.510134 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b533cdd6-ab41-4d8e-80a4-65ebe1de0ca4 req-383bd0c1-880b-465b-91fd-52ab264b2988 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054854 May 10 02:20:05.511731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1240/2381] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:05.673847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:05.692049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18b587f8-2ef6-42bf-935a-7d3db068f0cc tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a" status: 200 len: 1515 microversion: 2.1 time: 0.378336 May 10 02:20:05.692686 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1142/2382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:05 2022] GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:05.715379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:05.716191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:05.728547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.729009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.729814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.730261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.834418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02cd92e3-7143-4cd5-a5c0-f1b4f02d1544 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'create', calling method: .version_select at 0x7f3d371e0670>, body: {"keypair": {"name": "tempest-keypair-2072034563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk8oHR1iLpirTRGXtX3HBw1VKHY7ydBPWYiLq65vQxkQ5oAtFzfwTK8OV54pIN/qpFUgmvVGJWk21AkTG+d1j83ps7pm+/9Q1NscuyytPL1/WFYpOxQecOo69djZseoHw=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:05.883240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-02cd92e3-7143-4cd5-a5c0-f1b4f02d1544 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for project 049d7523d65a466e9129bdd3842b3002. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:05.893829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-02cd92e3-7143-4cd5-a5c0-f1b4f02d1544 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for user 1b4983326cda4029b72134cf8f2ee832 and project 049d7523d65a466e9129bdd3842b3002. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:05.957713 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02cd92e3-7143-4cd5-a5c0-f1b4f02d1544 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.436945 May 10 02:20:05.960680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1241/2383] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:20:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 448 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:20:05.967257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:05.973486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:05.983987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.984751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:05.986120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:05.986782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.034790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:06.044164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-636bd56e-6c9c-41f3-b379-fe679d52622e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1507 microversion: 2.1 time: 0.350401 May 10 02:20:06.044734 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1143/2384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:05 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:06.057986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-151f7306-9369-4578-95b0-a4308fe71bff tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '.version_select at 0x7f3d37afd820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:06.420168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:06.433189 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-939572fb-6ad8-46ee-9ce4-2079241dfe53 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1318 microversion: 2.1 time: 0.468192 May 10 02:20:06.438038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1242/2385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:05 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:06.445386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:06.446378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:06.455019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:06.456490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.457518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:06.458353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.490508 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-151f7306-9369-4578-95b0-a4308fe71bff tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/a630caee-c828-43b4-8a7e-5b4e2227b912" status: 200 len: 184 microversion: 2.1 time: 0.438918 May 10 02:20:06.491713 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1144/2386] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:20:06 2022] GET /compute/v2.1/os-floating-ips/a630caee-c828-43b4-8a7e-5b4e2227b912 => generated 184 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:06.498153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:06.499506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:06.507976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:06.509391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.510846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:06.511607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.552301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:06.705458 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71de4587-042a-442b-9011-dc2f2725b5c1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a" status: 204 len: 0 microversion: 2.1 time: 0.212030 May 10 02:20:06.708195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1145/2387] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:06 2022] DELETE /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:06.720004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:06.731626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:06.739297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:06.740018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.740626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:06.741096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:06.765732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:06.777684 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-40363feb-b7a3-435a-974d-641d2a11ac08 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1502 microversion: 2.1 time: 0.338463 May 10 02:20:06.778901 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1243/2388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:06 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1502 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:06.784747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.158"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:07.123597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:07.131103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:07.134079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:07.135187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:07.136385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:07.137662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:07.139167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d08f453d-3155-4b21-bbf7-47cc98a8115c tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1315 microversion: 2.1 time: 0.426185 May 10 02:20:07.139773 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1146/2389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:06 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:07.144883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:07.145502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:07.168173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:07.168173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:07.168744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:07.169423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:07.601585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Acquired lock "refresh_cache-dbfc2296-e134-4be7-9aea-ba45093b0479" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 02:20:07.607390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:07.616900 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5fc8d893-ddc2-43e9-adba-c73d66fc7b2e tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a" status: 200 len: 1521 microversion: 2.1 time: 0.476055 May 10 02:20:07.618206 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1147/2390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:07 2022] GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:07.636979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2105242122"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:07.638052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:07.646382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:07.647376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:07.648918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:07.649627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:07.913323 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.network.security_group_api [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Adding security group b7025f5e-cccd-4323-845f-f556bb539f33 to port 04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 May 10 02:20:08.825970 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-939bbaba-bc7e-475d-9825-1d1414bd039f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16/action" status: 202 len: 0 microversion: 2.1 time: 1.193298 May 10 02:20:08.832215 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1148/2391] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:07 2022] POST /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16/action => generated 0 bytes in 1200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:08.839245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:08.844181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:08.845458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Searching by: {'deleted': False, 'project_id': '267f1f09372d477fb65afc5b2619b827'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:08.852567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:08.853032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:08.854052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:08.855429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:08.892027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:20:08.923497 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cf00f35-2f21-428d-a8e8-c743c143802b tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.089442 May 10 02:20:08.924095 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1149/2392] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:20:08 2022] GET /compute/v2.1/servers => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:08.930504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:08.931396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:08.939273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:08.940225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:08.941350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:08.941818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:09.042837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Building network info cache for instance {{(pid=118716) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 10 02:20:09.268756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:09.276858 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-27a78b43-ea5a-4334-acd5-b3306daaace6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1487 microversion: 2.1 time: 0.351101 May 10 02:20:09.289286 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1150/2393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:08 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1487 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:09.297651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:09.297651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:09.315424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:09.316904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:09.317942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:09.318597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:09.577124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:09.587392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-336a59b4-4195-4a4d-a1bb-36a28658db2b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1467 microversion: 2.1 time: 0.292800 May 10 02:20:09.599775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1151/2394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:09 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:09.605903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-21cee568-6681-46fd-809a-e64f635e2322 req-d38da8e6-209b-4478-b5d8-d03e9bea47d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:09.616116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21cee568-6681-46fd-809a-e64f635e2322 req-d38da8e6-209b-4478-b5d8-d03e9bea47d6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:09.616821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21cee568-6681-46fd-809a-e64f635e2322 req-d38da8e6-209b-4478-b5d8-d03e9bea47d6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:09.635466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-21cee568-6681-46fd-809a-e64f635e2322 req-d38da8e6-209b-4478-b5d8-d03e9bea47d6 service nova] Creating event network-changed:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:20:09.640533 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-21cee568-6681-46fd-809a-e64f635e2322 req-d38da8e6-209b-4478-b5d8-d03e9bea47d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039169 May 10 02:20:09.641149 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1152/2395] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:09.658840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-710010681", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47646f85-70a4-465a-9fdf-3faefd756bbd"}], "security_groups": [{"name": "tempest-securitygroup--2095682279"}], "key_name": "tempest-keypair-2072034563", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:10.184248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] validate_networks() for [('47646f85-70a4-465a-9fdf-3faefd756bbd', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:10.445507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Updating instance_info_cache with network_info: [{"id": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3", "address": "fa:16:3e:c0:06:94", "network": {"id": "91ced21e-0978-43fa-9e67-62c398bf53c5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1770760677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "541f66b5bd0241e2a470461daceb2f3e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap37a6a1e6-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=118716) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:20:10.466443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Releasing lock "refresh_cache-dbfc2296-e134-4be7-9aea-ba45093b0479" {{(pid=118716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 02:20:10.467500 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-30bddf02-4f58-47b3-ba69-199cf6799bd5 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action" status: 202 len: 0 microversion: 2.1 time: 3.687409 May 10 02:20:10.469001 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1244/2396] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:06 2022] POST /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479/action => generated 0 bytes in 3689 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 10 02:20:10.475317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:10.476251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:10.485060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:10.485765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:10.486787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:10.487464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:10.778021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:10.786083 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2581d795-8f5c-408e-a634-4e67718f2b45 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1315 microversion: 2.1 time: 0.315646 May 10 02:20:10.786659 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1245/2397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:10 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:10.791439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:10.792046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:10.799097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:10.800401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:10.801390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:10.803315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:10.817454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] HTTP exception thrown: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a HTTP/1.1 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f75e266-c9e6-4bc2-9192-da7ec93a669a'} May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:10.819191 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 404 to user: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-50334f3e-8252-473f-b458-9170bb9c6665 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a" status: 404 len: 111 microversion: 2.1 time: 0.032717 May 10 02:20:10.824375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1246/2398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:10 2022] GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:10.829897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-909870690"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:10.830489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:10.836315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:10.837525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:10.838448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:10.838898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.003428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:11.003958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:11.004492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:11.004949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:11.005367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:11.014324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.014775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.015608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.016047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.037857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for project 049d7523d65a466e9129bdd3842b3002. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:11.043123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for user 1b4983326cda4029b72134cf8f2ee832 and project 049d7523d65a466e9129bdd3842b3002. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:11.051986 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.network.security_group_api [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Adding security group 1133c9d0-dc36-45c8-85ee-f1f972f84a3f to port 04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 May 10 02:20:11.056010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:11.058698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:11.106393 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6475ea70-dde8-4452-9da3-55f7704fb5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.461210 May 10 02:20:11.108664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1153/2399] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:20:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:20:11.111492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:11.114828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:11.115686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Searching by: {'deleted': False, 'project_id': '267f1f09372d477fb65afc5b2619b827'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:11.120866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.121313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.122112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.123306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.155778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:20:11.193280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:11.199644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.200247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.389052 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23513515-50d2-4fae-85db-161da74b3994 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.280910 May 10 02:20:11.389652 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1154/2400] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:20:11 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:11.394739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1512710912", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:11.449456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] validate_networks() for [('e686f034-48ff-4ba8-8749-938ec7a47e83', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:11.602596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69a46b3a-0f07-4d89-bff2-0712c917686f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16/action" status: 202 len: 0 microversion: 2.1 time: 0.780418 May 10 02:20:11.606338 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1247/2401] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:10 2022] POST /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:11.769596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1212077095", "block_migration": true, "disk_over_commit": false}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:11.771557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:11.780172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.781158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.782311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.783954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.813943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lazy-loading 'flavor' on Instance uuid 7b89457c-1e9c-4b0d-b982-65ed44dc593d {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:11.828295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Going to try to live migrate instance to tempest-host-1212077095 {{(pid=118716) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:20:11.835948 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] HTTP exception thrown: Compute host tempest-host-1212077095 could not be found. May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Request method failure captured: May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d/action HTTP/1.1 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 107 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu6D6VX3JoEeIeTLGt8ktXvGhVKTQDhg0POo6lqYTY84pYPE1Rb85kZ4LXek14rOSJddOhhN3SZ_-jhphaObFO7SNqC5AIlukA0kVysk78qAdDV6wAWI85uPuOASpgdMIAJoazKYZLi2mZYztCeWZiJKE862nSVrwDggMnnu2yfFWc May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 479db68d7bc84aae948a2b6b85f3639e May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-LiveMigrationNegativeTest-897768772 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_479db68d7bc84aae948a2b6b85f3639e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/479db68d7bc84aae948a2b6b85f3639e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/479db68d7bc84aae948a2b6b85f3639e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/479db68d7bc84aae948a2b6b85f3639e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-LiveMigrationNegativeTest-897768772 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 479db68d7bc84aae948a2b6b85f3639e May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-897768772 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-LiveMigrationNegativeTest-897768772-project-admin May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1cdf8223ce5446a68078dc15a79df4c5 May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-LiveMigrationNegativeTest-897768772-project-admin May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: {"os-migrateLive": {"host": "tempest-host-1212077095", "block_migration": true, "disk_over_commit": false}} May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: exception: Compute host tempest-host-1212077095 could not be found. May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '7b89457c-1e9c-4b0d-b982-65ed44dc593d', 'body': {'os-migrateLive': {'host': 'tempest-host-1212077095', 'block_migration': True, 'disk_over_commit': False}}} May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 10 02:20:11.840411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1212077095 could not be found. May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1212077095 could not be found. May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1212077095 could not be found. May 10 02:20:11.844918 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.849094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Returning 400 to user: Compute host tempest-host-1212077095 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:11.850185 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1996e12-8913-41bf-a782-34f6ad9ffa1a tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d/action" status: 400 len: 100 microversion: 2.1 time: 0.242853 May 10 02:20:11.850792 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1248/2402] 10.222.0.52 () {60 vars in 1278 bytes} [Tue May 10 02:20:11 2022] POST /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d/action => generated 100 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:11.856025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-162cf88d-b756-4cbd-be2f-58c41053928f req-5beeac12-c76a-476b-88c0-6f65fdd7870b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3e5af1-33f5-4589-a613-b97ac6b975d4", "name": "network-vif-plugged", "status": "completed", "tag": "596f2604-055d-4cee-82d5-b6a1bd0b53d9"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:11.868806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-162cf88d-b756-4cbd-be2f-58c41053928f req-5beeac12-c76a-476b-88c0-6f65fdd7870b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.869254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-162cf88d-b756-4cbd-be2f-58c41053928f req-5beeac12-c76a-476b-88c0-6f65fdd7870b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.881171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-162cf88d-b756-4cbd-be2f-58c41053928f req-5beeac12-c76a-476b-88c0-6f65fdd7870b service nova] Creating event network-vif-plugged:596f2604-055d-4cee-82d5-b6a1bd0b53d9 for instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 on n-h1-841089-2 May 10 02:20:11.890879 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-162cf88d-b756-4cbd-be2f-58c41053928f req-5beeac12-c76a-476b-88c0-6f65fdd7870b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036397 May 10 02:20:11.892216 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1249/2403] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:11.899843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:11.900698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:11.908808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.909323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.910342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.910977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.926002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] HTTP exception thrown: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Request method failure captured: May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d HTTP/1.1 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiect8YJLj2HXun9jLSuc7L4IkAcAiSThROLrTRgB09xq3RUEhMyUVIEOqnXsOeNdIw35RlUkBq3D7XQOfcWsLG5JKQk-rg7nCFmNsJAXYDB2VhEObSkaCwfVqyQxGRTd2J7Mec62PiqtcyWqGjOWXJ4R966Ur6Fe_vgZnAm0Am9faAP4 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_541f66b5bd0241e2a470461daceb2f3e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: ff40ce43b5a14bfaa08e172d5d646758 May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '17e7dde4-4cf8-4320-815a-d9e1dd004d6d'} May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:11.928701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:11.933884 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:11.935492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Returning 404 to user: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:11.936656 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e75693e-bd50-450a-bbb9-61cc51b68243 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 404 len: 111 microversion: 2.1 time: 0.043095 May 10 02:20:11.940913 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1250/2404] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:11 2022] DELETE /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:11.946347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:11.951377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:11.953066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:11.961870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.962514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:11.963928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:11.964468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.056398 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-473bffa3-1f6f-4dd5-b96b-305317b06ee5 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.114930 May 10 02:20:12.057068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:12.057828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:12.058211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1251/2405] 10.222.0.52 () {58 vars in 1229 bytes} [Tue May 10 02:20:11 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:12.059235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:12.059850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:12.060464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:12.063420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.064358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.074047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.074509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.075081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.075615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.075758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.076087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.076594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.077111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.095727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Getting quotas for project 32fe833856714629a13a779adad72d2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:12.101811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Getting quotas for user c787058dc32b484b945c1bd80d3b34ea and project 32fe833856714629a13a779adad72d2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:12.114163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:12.116441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:12.145262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:12.154171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:12.155740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:12.156880 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46dfac2b-2eb4-40e0-befe-2f2e38f2a30a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1333 microversion: 2.20 time: 0.097630 May 10 02:20:12.157458 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1252/2406] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:12.162211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d91d076c-4041-4b96-8fc5-02a1d996d0a2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.170488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c2295ecd-409f-4efb-ae06-6c645211a6de tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.779612 May 10 02:20:12.170885 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d91d076c-4041-4b96-8fc5-02a1d996d0a2 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012266 May 10 02:20:12.171348 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1155/2407] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:20:12.171765 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1253/2408] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:12.177129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc074c9c-7a50-4f31-92da-cd52a1034f16", "tag": "04943d83-a529-4e19-a5a3-a9fc0b2d1ce7"}, {"name": "network-changed", "server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}, {"server_uuid": "6f75e266-c9e6-4bc2-9192-da7ec93a669a", "name": "network-vif-deleted", "tag": "7c707886-3d86-4a1a-b6ca-f18f0e945295"}, {"name": "network-changed", "server_uuid": "fc074c9c-7a50-4f31-92da-cd52a1034f16", "tag": "04943d83-a529-4e19-a5a3-a9fc0b2d1ce7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:12.177757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.178501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.185587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.186513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.187275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.187738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.187919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.188518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.203833 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Creating event network-changed:04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 for instance fc074c9c-7a50-4f31-92da-cd52a1034f16 on n-h2-841089-2 May 10 02:20:12.204256 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Creating event network-changed:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:20:12.206505 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Creating event network-vif-deleted:7c707886-3d86-4a1a-b6ca-f18f0e945295 for instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a on n-h1-841089-2 May 10 02:20:12.207469 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] Creating event network-changed:04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 for instance fc074c9c-7a50-4f31-92da-cd52a1034f16 on n-h2-841089-2 May 10 02:20:12.220186 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-492489a5-a08b-448a-9e0c-52372ffe1466 req-c9a0cb1c-79ed-43ca-adc5-511fde24026c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.046401 May 10 02:20:12.221256 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1254/2409] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:12.226845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.227840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.235262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.236631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.237844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.238616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.623209 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a78aef8c-bd97-464e-bb4b-872f924b046e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.450256 May 10 02:20:12.623870 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1156/2410] 10.222.0.52 () {58 vars in 1292 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16/os-security-groups => generated 1158 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:12.630956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.631920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.636459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:12.644196 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-672def79-4d52-4ff4-b743-e65c57ea723f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1315 microversion: 2.1 time: 0.421765 May 10 02:20:12.644791 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1255/2411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:12.651310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.652450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.653033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.653491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: 17e7dde4-4cf8-4320-815a-d9e1dd004d6d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.654014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.654962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.660537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.661003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.661803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.662242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.677512 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] HTTP exception thrown: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Request method failure captured: May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d HTTP/1.1 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiect8YJLj2HXun9jLSuc7L4IkAcAiSThROLrTRgB09xq3RUEhMyUVIEOqnXsOeNdIw35RlUkBq3D7XQOfcWsLG5JKQk-rg7nCFmNsJAXYDB2VhEObSkaCwfVqyQxGRTd2J7Mec62PiqtcyWqGjOWXJ4R966Ur6Fe_vgZnAm0Am9faAP4 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_541f66b5bd0241e2a470461daceb2f3e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: ff40ce43b5a14bfaa08e172d5d646758 May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '17e7dde4-4cf8-4320-815a-d9e1dd004d6d'} May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.679514 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. May 10 02:20:12.684806 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.686278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Returning 404 to user: Instance 17e7dde4-4cf8-4320-815a-d9e1dd004d6d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:12.687177 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e367f96-2e68-4f16-9984-34a58d8603c7 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d" status: 404 len: 111 microversion: 2.1 time: 0.039293 May 10 02:20:12.687745 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1256/2412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers/17e7dde4-4cf8-4320-815a-d9e1dd004d6d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:12.693390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6274ec7-b0f9-4b40-a005-4f98a8315fdb tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6274ec7-b0f9-4b40-a005-4f98a8315fdb tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance[0]: May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '2011/01/01' May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 10 02:20:12.695968 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6274ec7-b0f9-4b40-a005-4f98a8315fdb tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a6274ec7-b0f9-4b40-a005-4f98a8315fdb tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.008379 May 10 02:20:12.701751 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1257/2413] 10.222.0.52 () {58 vars in 1181 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:12.705171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.705801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.715963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.716424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.717213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.717660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.860778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:12.868970 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9069faf0-fb29-49d1-b56d-724c6f8d48df tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1218 microversion: 2.1 time: 0.169721 May 10 02:20:12.869677 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1258/2414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:12.874448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:12.874979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:12.882128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.882724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.883632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:12.884213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:12.921489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:13.020520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a8718db-8e97-4ebf-966c-75cd85fbe233 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 204 len: 0 microversion: 2.1 time: 0.149166 May 10 02:20:13.021761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:13.022352 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1259/2415] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:12 2022] DELETE /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:13.028155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3fbb377-fcac-41f5-8fa0-5164d8707d0a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d37194b80>, body: {"security_group": {"name": " tempest-securitygroup -1479185843 ", "description": "tempest-description-663368820"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:13.036425 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6225962-2899-462c-b99e-64df572bef85 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1467 microversion: 2.1 time: 0.411088 May 10 02:20:13.037185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1157/2416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:12 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1467 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:13.042679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03e3ffeb-6bc8-4241-92eb-b5ed74b6fe06 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '.version_select at 0x7f3d36d67310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:13.927923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3fbb377-fcac-41f5-8fa0-5164d8707d0a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.904205 May 10 02:20:13.934177 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1260/2417] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:20:13 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:13.934177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:13.936546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:13.937323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:13.943786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:13.944247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:13.945062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:13.945515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:13.970521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:20:14.000532 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acc6c6b2-06b3-4bb3-af15-73fbd6abd890 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.070759 May 10 02:20:14.001132 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1261/2418] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:20:13 2022] GET /compute/v2.1/servers => generated 683 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:14.011157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:14.011901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:14.017849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:14.018843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:14.019652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:14.020101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:14.433612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:14.443225 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3fbe47f1-13df-4f38-84b0-50e5c901682f tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1606 microversion: 2.1 time: 0.440581 May 10 02:20:14.444078 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1262/2419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:14 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1606 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:14.457492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1288760735", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:14.507443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:15.296252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:15.297580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:15.298077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:15.298651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:15.299138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:15.309620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:15.310726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:15.311589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:15.312240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:15.333189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Getting quotas for project e246c06835984f16b407d8df3f03b49b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:15.342085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Getting quotas for user 7bc85ca1ad9241249b810f85fc8c76f0 and project e246c06835984f16b407d8df3f03b49b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:15.363685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:15.367213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:15.435438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a485866-4292-45c8-babc-c157a91ef4e3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981401 May 10 02:20:15.437114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1263/2420] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:20:15.442273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:15.442964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:15.450196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:15.450809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:15.452008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:15.452143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:15.650383 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-03e3ffeb-6bc8-4241-92eb-b5ed74b6fe06 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/a630caee-c828-43b4-8a7e-5b4e2227b912" status: 202 len: 0 microversion: 2.1 time: 2.611600 May 10 02:20:15.651104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1158/2421] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:20:13 2022] DELETE /compute/v2.1/os-floating-ips/a630caee-c828-43b4-8a7e-5b4e2227b912 => generated 0 bytes in 2613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:15.659465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:15.660244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:15.679777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:15.681801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:15.685192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:15.686416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:15.992917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:16.007817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:16.009709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:16.011611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a41f15a8-3f5d-4854-ab15-105fc04961c6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.573420 May 10 02:20:16.017738 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1264/2422] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:15 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:16.029701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:16.030345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:16.039688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:16.040313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:16.041699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:16.042167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:16.245608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:16.255875 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9a089ee0-25b3-4907-b852-e1fb7eb32f76 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1501 microversion: 2.1 time: 0.602519 May 10 02:20:16.267271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1159/2423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:15 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1501 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:16.286827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a086261b-b617-4bb2-828a-b91b81ac42f1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36e8c670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:16.976294 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a086261b-b617-4bb2-828a-b91b81ac42f1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131" status: 200 len: 223 microversion: 2.1 time: 0.695792 May 10 02:20:16.977049 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1160/2424] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:20:16 2022] GET /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131 => generated 223 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:16.981942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:16.986046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:16.986486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.servers [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Removing options 'limit' from query {{(pid=118717) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 10 02:20:16.987776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:16.992895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:16.993465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:16.994289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:16.994723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.019757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:20:17.049056 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1d114cec-e2a2-4369-b627-12aed03a2e62 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.070707 May 10 02:20:17.049824 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1161/2425] 10.222.0.52 () {58 vars in 1143 bytes} [Tue May 10 02:20:16 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:17.055555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:17.055555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:17.061131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.061705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.062592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.063044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.070235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:17.078276 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-174b7cab-f5cb-4b78-8179-c29cfa745573 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1314 microversion: 2.1 time: 1.058401 May 10 02:20:17.079787 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1265/2426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:16 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:17.095304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:17.096156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:17.103090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.103655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.104502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.105014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.218249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:17.227357 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04eca3ad-1e3f-472b-a427-35a67b37455e tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1277 microversion: 2.1 time: 0.176374 May 10 02:20:17.227951 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1162/2427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:17 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:17.233243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:17.233957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:17.241770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.242229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.243259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.243709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.274055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:17.371360 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8bb311f-74bc-442d-bd74-f96999911b57 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 204 len: 0 microversion: 2.1 time: 0.141813 May 10 02:20:17.372060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1163/2428] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:17 2022] DELETE /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:17.377964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:17.378658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:17.385433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.385969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.386836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.387495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.415269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lazy-loading 'flavor' on Instance uuid 1f3e5af1-33f5-4589-a613-b97ac6b975d4 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:17.482149 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77d0b978-bab4-4110-ba75-1682ba9708c2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "POST /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4/action" status: 202 len: 0 microversion: 2.1 time: 0.108628 May 10 02:20:17.485622 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1164/2429] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:17 2022] POST /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:17.488063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-42e954fe-d977-45ba-95a8-202a39100d83 req-a253518b-0d9e-4b63-8e26-d3ddd7c1616b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f1fc9f-2151-4704-9c5b-288d3f334feb", "tag": "85cfb217-b5a3-4a30-9e60-b226c9e86a51"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:17.496043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42e954fe-d977-45ba-95a8-202a39100d83 req-a253518b-0d9e-4b63-8e26-d3ddd7c1616b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.496489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42e954fe-d977-45ba-95a8-202a39100d83 req-a253518b-0d9e-4b63-8e26-d3ddd7c1616b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.508032 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-42e954fe-d977-45ba-95a8-202a39100d83 req-a253518b-0d9e-4b63-8e26-d3ddd7c1616b service nova] Creating event network-changed:85cfb217-b5a3-4a30-9e60-b226c9e86a51 for instance 04f1fc9f-2151-4704-9c5b-288d3f334feb on n-h1-841089-2 May 10 02:20:17.512914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-42e954fe-d977-45ba-95a8-202a39100d83 req-a253518b-0d9e-4b63-8e26-d3ddd7c1616b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028679 May 10 02:20:17.513636 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1165/2430] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:17.519214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6db2467-e13b-4171-a6d2-5a26784f4df1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d370da040>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:17.553919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:17.561393 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c105d7aa-693c-45a0-9551-32895ea90c22 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1606 microversion: 2.1 time: 0.469962 May 10 02:20:17.561972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1266/2431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:17 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1606 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:17.576259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:17.577107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:17.583770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.584232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:17.585016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:17.585480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:18.030070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:18.038389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:18.039941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:18.041331 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7d662fb-5b22-465e-8c01-ebe5fa98abe9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.476643 May 10 02:20:18.042444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1267/2432] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:17 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:18.058423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab561760-3b88-41e2-a126-94cd05edda24 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab561760-3b88-41e2-a126-94cd05edda24 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance[0]: May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '-1' May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 10 02:20:18.061504 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 10 02:20:18.067783 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.070354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab561760-3b88-41e2-a126-94cd05edda24 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:18.071242 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab561760-3b88-41e2-a126-94cd05edda24 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.027608 May 10 02:20:18.072098 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1268/2433] 10.222.0.52 () {58 vars in 1141 bytes} [Tue May 10 02:20:18 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:18.077621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:18.078462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:18.087900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:18.088373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:18.089363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:18.091784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:18.439335 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6db2467-e13b-4171-a6d2-5a26784f4df1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131" status: 202 len: 0 microversion: 2.1 time: 0.924488 May 10 02:20:18.443292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1166/2434] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:20:17 2022] DELETE /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131 => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:18.448191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:18.448845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:18.467039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:18.467519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:18.468309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:18.468749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:18.712662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:18.722518 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e23a1ec1-2ea3-4df0-8af4-e1448f1280fe tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1525 microversion: 2.1 time: 0.648265 May 10 02:20:18.723433 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1269/2435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:18 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1525 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:18.729044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8c523b87-8a91-4fe9-beed-0099e431136c tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8c523b87-8a91-4fe9-beed-0099e431136c tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: action_args: {} May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance[0]: May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'testing' May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 10 02:20:18.732638 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:18.738951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8c523b87-8a91-4fe9-beed-0099e431136c tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:18.740387 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8c523b87-8a91-4fe9-beed-0099e431136c tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013060 May 10 02:20:18.743356 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1270/2436] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:20:18 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:18.748844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:18.749466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:18.757449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:18.758046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:18.758839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:18.759323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.058287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:19.066785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e0517c6-24c1-44f0-85ac-8f30ae59f961 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1492 microversion: 2.1 time: 0.622272 May 10 02:20:19.071191 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1167/2437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:18 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1492 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:19.086749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3a9604a1-4f8b-4092-909a-9698cafbd07f req-c30a6de5-1d24-440c-9299-e0f7704013f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:19.107707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3a9604a1-4f8b-4092-909a-9698cafbd07f req-c30a6de5-1d24-440c-9299-e0f7704013f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.108274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3a9604a1-4f8b-4092-909a-9698cafbd07f req-c30a6de5-1d24-440c-9299-e0f7704013f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.128006 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3a9604a1-4f8b-4092-909a-9698cafbd07f req-c30a6de5-1d24-440c-9299-e0f7704013f9 service nova] Creating event network-changed:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h2-841089-2 May 10 02:20:19.144882 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3a9604a1-4f8b-4092-909a-9698cafbd07f req-c30a6de5-1d24-440c-9299-e0f7704013f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061670 May 10 02:20:19.145952 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1168/2438] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:19.151035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:19.162121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:19.169000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.170012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.171368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.183759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.260395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:19.269138 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef3b1bf9-ba08-471b-8a0d-098bb6a01622 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1314 microversion: 2.1 time: 0.524921 May 10 02:20:19.269712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1271/2439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:18 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:19.283835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d370eac10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:19.289052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:19.300820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cafb9bdc-842b-4578-b06c-80fd110b08a4 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1277 microversion: 2.1 time: 0.153576 May 10 02:20:19.303559 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1169/2440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:19 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:19.312923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:19.321120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:19.331338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.331932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.332840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.334970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.459550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:20:19.460154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group f80c551f-3759-4e01-8a47-dab63e5f0131 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:20:19.460714 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.460714 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131 HTTP/1.1 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f80c551f-3759-4e01-8a47-dab63e5f0131'} May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:20:19.465354 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] May 10 02:20:19.470707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:19.475917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:20:19.475917 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-2412fe1d-11b9-4046-b09a-1fd4b3d6cd05'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:19.477094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-68aef12a-2825-4c3f-a004-7454cb003b5c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131" status: 404 len: 194 microversion: 2.1 time: 0.202742 May 10 02:20:19.483500 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1272/2441] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:20:19 2022] GET /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131 => generated 194 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:19.497510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52bf455c-8160-4a9e-9828-8a6a2bb3f945 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:19.518219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52bf455c-8160-4a9e-9828-8a6a2bb3f945 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:19.518876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52bf455c-8160-4a9e-9828-8a6a2bb3f945 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:19.530786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:19.538787 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb6c4288-0091-43e5-8ec1-dfefb87e295d tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.233571 May 10 02:20:19.542018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1170/2442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:19 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:19.555333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:19.556130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:19.575337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.578017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.580098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.587490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.591955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.servers [None req-52bf455c-8160-4a9e-9828-8a6a2bb3f945 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Flavor 'non_existing_flavor' could not be found {{(pid=118716) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 10 02:20:19.598957 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52bf455c-8160-4a9e-9828-8a6a2bb3f945 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.107073 May 10 02:20:19.599643 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1273/2443] 10.222.0.52 () {58 vars in 1177 bytes} [Tue May 10 02:20:19 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:19.620994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:19.621526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:19.641213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.648561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.652131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:19.652725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:19.709097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:19.937071 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57a5cca4-6dbc-4ad5-b20b-a0ae4621a567 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 204 len: 0 microversion: 2.1 time: 0.335509 May 10 02:20:19.946289 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1274/2444] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:19 2022] DELETE /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:19.958753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-66b811d8-d84f-4eeb-9634-15057bb17ee4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d374e5790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1329303960", "description": "tempest-description-1984588238"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:20.044009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.052569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.054431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.055840 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2d3f942-39a6-40f6-ab81-8835e3ef6600 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.512793 May 10 02:20:20.056584 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1171/2445] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:19 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:20.061207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:20.065200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.066196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:20.079318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.080050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.082257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.082888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.216199 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47fb89b0-40ef-42ff-9400-4588a493b297 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.157680 May 10 02:20:20.218826 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1172/2446] 10.222.0.52 () {58 vars in 1173 bytes} [Tue May 10 02:20:20 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:20.237474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e5f41bc5-f84f-4e56-b17f-c39e5ce53f9e req-c67194d4-0217-400f-95f0-1f2fbbcdba62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfc2296-e134-4be7-9aea-ba45093b0479", "name": "network-vif-deleted", "tag": "37a6a1e6-87bb-4c20-828b-7f83cae55dc3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:20.246503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e5f41bc5-f84f-4e56-b17f-c39e5ce53f9e req-c67194d4-0217-400f-95f0-1f2fbbcdba62 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.247277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e5f41bc5-f84f-4e56-b17f-c39e5ce53f9e req-c67194d4-0217-400f-95f0-1f2fbbcdba62 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.266650 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e5f41bc5-f84f-4e56-b17f-c39e5ce53f9e req-c67194d4-0217-400f-95f0-1f2fbbcdba62 service nova] Creating event network-vif-deleted:37a6a1e6-87bb-4c20-828b-7f83cae55dc3 for instance dbfc2296-e134-4be7-9aea-ba45093b0479 on n-h2-841089-2 May 10 02:20:20.290748 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e5f41bc5-f84f-4e56-b17f-c39e5ce53f9e req-c67194d4-0217-400f-95f0-1f2fbbcdba62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070084 May 10 02:20:20.292420 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1173/2447] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:20.303595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:20.304652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:20.315159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.316443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.319290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.320232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.335738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-66b811d8-d84f-4eeb-9634-15057bb17ee4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.384343 May 10 02:20:20.336365 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1275/2448] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:20:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:20.349456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:20.350880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:20.365367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.366104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.367085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.368196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.368991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.369698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lazy-loading 'fault' on Instance uuid dbfc2296-e134-4be7-9aea-ba45093b0479 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:20.372659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.478079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff40ce43b5a14bfaa08e172d5d646758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541f66b5bd0241e2a470461daceb2f3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.487148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-caec32bc-eac3-4aa0-a963-55ff310a31f3 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 200 len: 1313 microversion: 2.1 time: 0.193099 May 10 02:20:20.488227 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1174/2449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:20 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:20.501944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:20.511034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.512783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:20.525906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.526526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.528375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.529090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.650704 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-79becb5e-95d9-4ddb-8739-fdce1e942ae3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.160873 May 10 02:20:20.659922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1175/2450] 10.222.0.52 () {58 vars in 1183 bytes} [Tue May 10 02:20:20 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:20.665935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:20.666853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:20.675729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.677127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.678260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.679214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.689333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:20.702044 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3276a02c-0a21-4b3a-85f6-7df27600898d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1498 microversion: 2.1 time: 0.363946 May 10 02:20:20.702823 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1276/2451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:20 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1498 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:20.713424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:20.715461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:20.725615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.728584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:20.731414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:20.736434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:21.252946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:21.260542 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a2c26ec-55eb-4713-a92f-901d45be8035 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1314 microversion: 2.1 time: 0.598948 May 10 02:20:21.269641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1176/2452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:20 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:21.269641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46389c53-dd41-4ec5-9a51-d9a9dee3dc39 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d36d675e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1939795888", "description": "tempest-description-577628341"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:21.278583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:21.288887 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-998ecc53-4756-4017-bdf8-a505b9a80ce3 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1319 microversion: 2.1 time: 0.580398 May 10 02:20:21.301180 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1277/2453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:20 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:21.309150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:21.309960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:21.316264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:21.316729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:21.317525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:21.318016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:21.475729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:21.484074 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-048ca1db-1257-4810-ac57-edbc7b609f69 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.181742 May 10 02:20:21.485057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1278/2454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:21 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:21.491497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:21.495486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:21.496660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:21.502224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:21.502743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:21.503722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:21.504351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:21.533628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:20:21.571943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:21.579370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:21.579879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.066226 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46389c53-dd41-4ec5-9a51-d9a9dee3dc39 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.803318 May 10 02:20:22.066906 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1177/2455] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:20:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:22.072094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:22.073786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:22.081664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.082123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.082913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.083695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.122413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e36d90c-791f-44d2-a0af-5f6320e44bd6 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.635694 May 10 02:20:22.123163 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1279/2456] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:20:21 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:22.131156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-29b8c3f2-f5fa-4fd9-a3ba-0c48a2b00d25 req-dca1e9e0-93d6-4685-ba76-6fb1ca411536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c605f6e1-aa80-4e63-a3ce-708651656638", "name": "network-vif-deleted", "tag": "38db6fc2-0d8b-40fd-a93b-a1af6598d52b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:22.141979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-29b8c3f2-f5fa-4fd9-a3ba-0c48a2b00d25 req-dca1e9e0-93d6-4685-ba76-6fb1ca411536 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.142437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-29b8c3f2-f5fa-4fd9-a3ba-0c48a2b00d25 req-dca1e9e0-93d6-4685-ba76-6fb1ca411536 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.154887 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-29b8c3f2-f5fa-4fd9-a3ba-0c48a2b00d25 req-dca1e9e0-93d6-4685-ba76-6fb1ca411536 service nova] Creating event network-vif-deleted:38db6fc2-0d8b-40fd-a93b-a1af6598d52b for instance c605f6e1-aa80-4e63-a3ce-708651656638 on n-h1-841089-2 May 10 02:20:22.160918 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-29b8c3f2-f5fa-4fd9-a3ba-0c48a2b00d25 req-dca1e9e0-93d6-4685-ba76-6fb1ca411536 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 May 10 02:20:22.161468 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1280/2457] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:22.170446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:22.171184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] [instance: dbfc2296-e134-4be7-9aea-ba45093b0479] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:22.177309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.177763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.178537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.178975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.195061 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] HTTP exception thrown: Instance dbfc2296-e134-4be7-9aea-ba45093b0479 could not be found. May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Request method failure captured: May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 HTTP/1.1 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiect8YJLj2HXun9jLSuc7L4IkAcAiSThROLrTRgB09xq3RUEhMyUVIEOqnXsOeNdIw35RlUkBq3D7XQOfcWsLG5JKQk-rg7nCFmNsJAXYDB2VhEObSkaCwfVqyQxGRTd2J7Mec62PiqtcyWqGjOWXJ4R966Ur6Fe_vgZnAm0Am9faAP4 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_541f66b5bd0241e2a470461daceb2f3e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/541f66b5bd0241e2a470461daceb2f3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 541f66b5bd0241e2a470461daceb2f3e May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-395352193 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: ff40ce43b5a14bfaa08e172d5d646758 May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-395352193-project May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance dbfc2296-e134-4be7-9aea-ba45093b0479 could not be found. May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'dbfc2296-e134-4be7-9aea-ba45093b0479'} May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfc2296-e134-4be7-9aea-ba45093b0479 could not be found. May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfc2296-e134-4be7-9aea-ba45093b0479 could not be found. May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:22.197027 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfc2296-e134-4be7-9aea-ba45093b0479 could not be found. May 10 02:20:22.201597 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:22.203792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] Returning 404 to user: Instance dbfc2296-e134-4be7-9aea-ba45093b0479 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:22.204665 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-adccc971-cdaa-418a-bb71-8838291dbb49 tempest-FloatingIPsAssociationTestJSON-395352193 tempest-FloatingIPsAssociationTestJSON-395352193-project] 10.222.0.52 "GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479" status: 404 len: 111 microversion: 2.1 time: 0.041968 May 10 02:20:22.205240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1281/2458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:22 2022] GET /compute/v2.1/servers/dbfc2296-e134-4be7-9aea-ba45093b0479 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:22.225828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:22.227867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:22.236262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.237378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.239375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.239902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.488130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:22.499962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:22.506989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:22.508231 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45a9a40e-5080-45f3-ac12-00efb74e12d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.439675 May 10 02:20:22.519464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1178/2459] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:22 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:22.524477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e49fc23-4e34-4e7d-811c-fa2769cb566d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d37486310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-212204003", "description": "tempest-description-1823115298"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:22.725438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59edfa0cdbc46bc8a7c253228023559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c96e69d8a240199a06b0433fb88a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:22.744804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49e57ce7-2229-4c45-9cf2-702674337c7d tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 200 len: 1498 microversion: 2.1 time: 0.537644 May 10 02:20:22.756885 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1282/2460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:22 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 1498 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:22.762900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3365641e-9ef0-42d3-9bc4-69c5bdaebfe2 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:22.770480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3365641e-9ef0-42d3-9bc4-69c5bdaebfe2 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:22.772919 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3365641e-9ef0-42d3-9bc4-69c5bdaebfe2 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014058 May 10 02:20:22.774806 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1283/2461] 10.222.0.52 () {58 vars in 1177 bytes} [Tue May 10 02:20:22 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:22.784825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:22.791113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:22.801547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.802094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:22.802951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:22.803535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.365727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:23.379792 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e49fc23-4e34-4e7d-811c-fa2769cb566d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.858948 May 10 02:20:23.381108 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1179/2462] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:20:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:23.386360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:23.390114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-856e2333-9131-401f-a10c-dad2fd52d438 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1314 microversion: 2.1 time: 0.613758 May 10 02:20:23.390626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:23.391029 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1284/2463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:22 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:23.396935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:23.397750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:23.404602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.405452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.406646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.407314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.411705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.423094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.424058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.431197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.577602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:23.588103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-545d2770-ea98-4e2f-8535-7659de3ac700 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.194023 May 10 02:20:23.603912 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1285/2464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:23 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:23.610916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f55aed8d-d662-4f59-8f73-2fcc33437a75 req-6860b96f-3819-4766-86df-61a56ab76ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f1fc9f-2151-4704-9c5b-288d3f334feb", "name": "network-vif-plugged", "status": "completed", "tag": "85cfb217-b5a3-4a30-9e60-b226c9e86a51"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:23.621651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f55aed8d-d662-4f59-8f73-2fcc33437a75 req-6860b96f-3819-4766-86df-61a56ab76ff6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.622445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f55aed8d-d662-4f59-8f73-2fcc33437a75 req-6860b96f-3819-4766-86df-61a56ab76ff6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.651112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f55aed8d-d662-4f59-8f73-2fcc33437a75 req-6860b96f-3819-4766-86df-61a56ab76ff6 service nova] Creating event network-vif-plugged:85cfb217-b5a3-4a30-9e60-b226c9e86a51 for instance 04f1fc9f-2151-4704-9c5b-288d3f334feb on n-h1-841089-2 May 10 02:20:23.656793 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f55aed8d-d662-4f59-8f73-2fcc33437a75 req-6860b96f-3819-4766-86df-61a56ab76ff6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051229 May 10 02:20:23.658003 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1286/2465] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:23.664944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:23.668789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:23.670087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Searching by: {'deleted': False, 'project_id': '15052a9541b64a4fa757b625688a96a4'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:20:23.676261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.677132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.678127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.678568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.709029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:20:23.741514 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-922c78e2-e9d9-4fc0-bd25-a19a3a6b7e90 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.081328 May 10 02:20:23.748936 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1287/2466] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:20:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:23.754023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d02ef273-74b3-49c1-ae08-75569b79f5c2 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36f945e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:23.922456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:23.931244 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a531b22c-0f9a-448c-a007-cb7460ae19c1 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1319 microversion: 2.1 time: 0.548622 May 10 02:20:23.931831 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1180/2467] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:23 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:23.953196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:23.956501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:23.970871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.981319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:23.982966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:23.983698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.243175 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d02ef273-74b3-49c1-ae08-75569b79f5c2 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.492809 May 10 02:20:24.244010 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1288/2468] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:20:23 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:24.248484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.249098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.260085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:24.269758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:24.272055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:24.273412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ea371691-afce-4b01-b023-1fbb95391879 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.329334 May 10 02:20:24.274260 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1181/2469] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:23 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:24.276538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.277274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.278084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.278536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.282023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.282839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.289832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.290552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.292137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.292756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.300725 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] HTTP exception thrown: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a HTTP/1.1 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f75e266-c9e6-4bc2-9192-da7ec93a669a'} May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:24.309446 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:24.315471 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.320046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 404 to user: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:24.324497 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.325666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b75d2a67-8c44-4252-8528-f1b6f2891704 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a" status: 404 len: 111 microversion: 2.1 time: 0.080905 May 10 02:20:24.326426 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1289/2470] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:24 2022] DELETE /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 HTTP/1.1 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1f3e5af1-33f5-4589-a613-b97ac6b975d4'} May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:24.333181 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.339938 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:24.343891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3b0162a1-2973-4b05-b904-e551d1b6b58d req-0e5a1ce8-ff3e-4f77-af0e-df2f52bd0859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5480167e-075b-40f8-b0fa-ebb978adfd90", "tag": "0e5392ab-e325-4e75-b2f9-4bcc197a8995"}, {"server_uuid": "1f3e5af1-33f5-4589-a613-b97ac6b975d4", "name": "network-vif-deleted", "tag": "596f2604-055d-4cee-82d5-b6a1bd0b53d9"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:24.344849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:24.346033 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2074222e-f025-4ae3-8c84-f8ebffd930f4 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 404 len: 111 microversion: 2.1 time: 0.070668 May 10 02:20:24.347438 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1182/2471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:24 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:24.362817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d09ba5c2-85cb-485c-8c84-aa13d70c9ff0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36686310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.375181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3b0162a1-2973-4b05-b904-e551d1b6b58d req-0e5a1ce8-ff3e-4f77-af0e-df2f52bd0859 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.375936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3b0162a1-2973-4b05-b904-e551d1b6b58d req-0e5a1ce8-ff3e-4f77-af0e-df2f52bd0859 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.392443 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3b0162a1-2973-4b05-b904-e551d1b6b58d req-0e5a1ce8-ff3e-4f77-af0e-df2f52bd0859 service nova] Creating event network-changed:0e5392ab-e325-4e75-b2f9-4bcc197a8995 for instance 5480167e-075b-40f8-b0fa-ebb978adfd90 on n-h2-841089-2 May 10 02:20:24.394894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3b0162a1-2973-4b05-b904-e551d1b6b58d req-0e5a1ce8-ff3e-4f77-af0e-df2f52bd0859 service nova] Creating event network-vif-deleted:596f2604-055d-4cee-82d5-b6a1bd0b53d9 for instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 on n-h1-841089-2 May 10 02:20:24.404351 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3b0162a1-2973-4b05-b904-e551d1b6b58d req-0e5a1ce8-ff3e-4f77-af0e-df2f52bd0859 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075147 May 10 02:20:24.405177 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1290/2472] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:24.411380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.413348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.420972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.421648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.423659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.424822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.484319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:24.618149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2da72cc-6871-43a2-b6a6-c28ab0c38818 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 204 len: 0 microversion: 2.1 time: 0.210313 May 10 02:20:24.619896 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1291/2473] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:24 2022] DELETE /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:24.650554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.651402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.660318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.661034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.663248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.663907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.686666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 HTTP/1.1 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1f3e5af1-33f5-4589-a613-b97ac6b975d4'} May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:24.690121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:24.696143 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:24.698789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:24.699976 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-48e5bc6d-857f-42bb-9433-3c91f8457496 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 404 len: 111 microversion: 2.1 time: 0.077563 May 10 02:20:24.704646 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1292/2474] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:24 2022] DELETE /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:24.712484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.713376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.723020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.723925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.724341 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d09ba5c2-85cb-485c-8c84-aa13d70c9ff0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965" status: 202 len: 0 microversion: 2.1 time: 0.373010 May 10 02:20:24.728766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1183/2475] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:20:24 2022] DELETE /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:24.731413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.732134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.732270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.732903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.747755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.749593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.750768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.751678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.899909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:24.911546 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6de8c43-c9d5-4e79-8205-9dd69d05f73c tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.184710 May 10 02:20:24.913665 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1184/2476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:24 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:24.923334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.927640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:24.938642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.939129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.942329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:24.942789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:24.973531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:24.982006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01da8c8e-dc81-496c-8efa-79a3ec85e40a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1314 microversion: 2.1 time: 0.275401 May 10 02:20:24.985811 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1293/2477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:24 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:24.994140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:24.997622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1f3e5af1-33f5-4589-a613-b97ac6b975d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.004012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:25.010137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.010824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.012541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.013004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.041753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 HTTP/1.1 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1f3e5af1-33f5-4589-a613-b97ac6b975d4'} May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.043368 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 1f3e5af1-33f5-4589-a613-b97ac6b975d4 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.049113 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e3da426-36ed-4ab3-8d19-59634fbebb2e tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4" status: 404 len: 111 microversion: 2.1 time: 0.057113 May 10 02:20:25.051918 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1294/2478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:24 2022] GET /compute/v2.1/servers/1f3e5af1-33f5-4589-a613-b97ac6b975d4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.056630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36fdcb80>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.129785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:20:25.131217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:20:25.132072 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.132072 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965 HTTP/1.1 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '390aa755-40ad-4fcb-bca9-c0e9b8939965'} May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:20:25.134001 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-30b69df1-3cb0-449d-be82-8d9dca385b88'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e54e7d16-23ff-464a-acfd-eb0c11a93435 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965" status: 404 len: 194 microversion: 2.1 time: 0.082673 May 10 02:20:25.139836 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1295/2479] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.145835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.145987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.162166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.162635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.163468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.163921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.186955 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1385feb-ef06-4ab4-b1e7-da7f2bbc5f5a tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "DELETE /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 204 len: 0 microversion: 2.1 time: 0.268822 May 10 02:20:25.187612 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1185/2480] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:24 2022] DELETE /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:25.197176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.197770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.203774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.205245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.206899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.207548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.225212 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 HTTP/1.1 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1c3bea11-a4b7-4250-9462-0b60a4b03e78'} May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:25.229871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.234392 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:25.236233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.237652 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5b77b66-ba28-474c-b1c9-7dcea9ddf15a tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 404 len: 111 microversion: 2.1 time: 0.045404 May 10 02:20:25.238230 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1186/2481] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:25 2022] DELETE /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.246555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e89ecffa-6cfc-4b85-b0fc-97a0801bd091 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d366733a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.376098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:25.396508 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39c9ca69-0bbd-4175-b11c-f878a6600442 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1319 microversion: 2.1 time: 0.258838 May 10 02:20:25.403804 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1296/2482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:25.414557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.415464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 6f75e266-c9e6-4bc2-9192-da7ec93a669a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.423101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.423794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.424806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.425891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.443530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] HTTP exception thrown: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a HTTP/1.1 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f75e266-c9e6-4bc2-9192-da7ec93a669a'} May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.445362 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. May 10 02:20:25.450715 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.452556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 404 to user: Instance 6f75e266-c9e6-4bc2-9192-da7ec93a669a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.453600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4cd46d3b-79a1-46c8-a127-e632eb8843d3 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a" status: 404 len: 111 microversion: 2.1 time: 0.044497 May 10 02:20:25.457755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1297/2483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/6f75e266-c9e6-4bc2-9192-da7ec93a669a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.463104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.463790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 1c3bea11-a4b7-4250-9462-0b60a4b03e78] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.469945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.470404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.471936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.472389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.486300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 HTTP/1.1 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1c3bea11-a4b7-4250-9462-0b60a4b03e78'} May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.488017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 1c3bea11-a4b7-4250-9462-0b60a4b03e78 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.493160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c9b4344-ae53-40b4-8b66-dc1059781d54 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78" status: 404 len: 111 microversion: 2.1 time: 0.030760 May 10 02:20:25.493988 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1298/2484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/1c3bea11-a4b7-4250-9462-0b60a4b03e78 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.498291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.498917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.505017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.505481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.506266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.506908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.530520 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e89ecffa-6cfc-4b85-b0fc-97a0801bd091 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505" status: 202 len: 0 microversion: 2.1 time: 0.289037 May 10 02:20:25.531319 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1187/2485] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:20:25 2022] DELETE /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:25.546039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.547405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.561606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.563715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.564765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.566007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.873346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:25.882730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:25.884293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:25.885398 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ece712a-6230-4074-a42c-1aad4a6d80a2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.391124 May 10 02:20:25.885957 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1299/2486] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:25.891434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.892193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.898632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.899104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.899888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.900326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.918789 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 HTTP/1.1 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'dbaee6dd-516c-4d79-a64e-f315148ab080'} May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:25.920556 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-456315eb-a465-4b26-b1ea-067d04dbb982 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 404 len: 111 microversion: 2.1 time: 0.034631 May 10 02:20:25.926411 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1300/2487] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:25 2022] DELETE /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.929771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d370d0700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.934802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:25.943515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2da9ea25-e992-43ce-809a-b73ca0b215e1 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 200 len: 1522 microversion: 2.1 time: 0.408082 May 10 02:20:25.944254 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1188/2488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:25.949315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3711c539-1822-4db2-ade6-e7292ca03462 req-63fcbc9f-5b05-43a2-8f5c-a12e730c94c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "name": "network-vif-plugged", "status": "completed", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:25.957713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3711c539-1822-4db2-ade6-e7292ca03462 req-63fcbc9f-5b05-43a2-8f5c-a12e730c94c7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:25.958656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3711c539-1822-4db2-ade6-e7292ca03462 req-63fcbc9f-5b05-43a2-8f5c-a12e730c94c7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:25.966636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:20:25.967409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:20:25.968076 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.968076 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505 HTTP/1.1 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '02ee3016-2aeb-48c7-a9a8-684b8ac4b505'} May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:20:25.970952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-1f858487-6601-429a-9faa-4b133d520cde'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:25.977985 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ce2c36e-a1d5-4d92-9f8a-5e947dead4ab tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505" status: 404 len: 194 microversion: 2.1 time: 0.051303 May 10 02:20:25.981518 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1301/2489] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:25.983674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3711c539-1822-4db2-ade6-e7292ca03462 req-63fcbc9f-5b05-43a2-8f5c-a12e730c94c7 service nova] Creating event network-vif-plugged:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h2-841089-2 May 10 02:20:25.986716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:25.988819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:25.989788 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3711c539-1822-4db2-ade6-e7292ca03462 req-63fcbc9f-5b05-43a2-8f5c-a12e730c94c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044215 May 10 02:20:25.994351 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1189/2490] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:25.999886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:26.000714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.000989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: dbaee6dd-516c-4d79-a64e-f315148ab080] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:26.001883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.002767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.003391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.008307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.009184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.011596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.012250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.029718 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 HTTP/1.1 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'dbaee6dd-516c-4d79-a64e-f315148ab080'} May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:26.032000 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance dbaee6dd-516c-4d79-a64e-f315148ab080 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:26.037743 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9397c464-a7e8-46a9-a290-d93af4acb74f tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080" status: 404 len: 111 microversion: 2.1 time: 0.041029 May 10 02:20:26.040009 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1190/2491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/dbaee6dd-516c-4d79-a64e-f315148ab080 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:26.045985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1f634cbd-a446-4bea-bba9-59d3e078b52d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36ffd430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:26.119986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:26.135302 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bb0c9eaa-bce0-4943-a963-59a0a5aad4b3 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.152588 May 10 02:20:26.136649 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1302/2492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:25 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:26.142914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:26.144412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:26.151761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.152846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.153793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.154350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.356514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:26.368676 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ef88585-ce60-4cbb-a764-7bbb7482f206 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1314 microversion: 2.1 time: 0.230633 May 10 02:20:26.369276 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1303/2493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:26 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:26.373914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:26.374659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:26.383190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.383910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.384887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.385507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.401708 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 HTTP/1.1 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '022bee10-c911-4367-97fb-620b97d46616'} May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:26.404549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:26.409579 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:26.411583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:26.413529 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-95a74b02-8406-4ffc-a388-a71b79435375 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 404 len: 111 microversion: 2.1 time: 0.042496 May 10 02:20:26.414808 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1304/2494] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:26 2022] DELETE /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:26.421236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:26.422329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:26.429739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.430438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:26.431714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:26.432564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.214574 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1f634cbd-a446-4bea-bba9-59d3e078b52d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6" status: 202 len: 0 microversion: 2.1 time: 1.173458 May 10 02:20:27.215195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1191/2495] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:20:26 2022] DELETE /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6 => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:27.220083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:27.220697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 022bee10-c911-4367-97fb-620b97d46616] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:27.232625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.233005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.233780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.234213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.255185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 HTTP/1.1 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '022bee10-c911-4367-97fb-620b97d46616'} May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:27.259903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. May 10 02:20:27.267489 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:27.281046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 022bee10-c911-4367-97fb-620b97d46616 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:27.281046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3b38dc6b-7dcb-47cc-aa95-34aa323b2bd2 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616" status: 404 len: 111 microversion: 2.1 time: 0.062681 May 10 02:20:27.285567 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1192/2496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:27 2022] GET /compute/v2.1/servers/022bee10-c911-4367-97fb-620b97d46616 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:27.299107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:27.299951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:27.313717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.314174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.315010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.315477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.356532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:27.369480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f386a85-52e5-4096-a6c7-7214e0c9074b tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1319 microversion: 2.1 time: 0.952749 May 10 02:20:27.373731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1305/2497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:26 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1319 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:27.378801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:27.394359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:27.400826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.402507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.403545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.406060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.726123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:27.734399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:27.741381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:27.742768 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c084f33a-e2a3-4921-a94d-73ac360e99a0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.454027 May 10 02:20:27.743560 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1193/2498] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:27 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:27.755714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:27.756350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:27.774682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.775161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.776339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:27.776830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a707e3b6d02448f89471f1d919f8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15052a9541b64a4fa757b625688a96a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:27.778506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:27.798488 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69c7a555-ad19-49f6-a393-4fe8f80151ed tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 200 len: 1522 microversion: 2.1 time: 0.423362 May 10 02:20:27.803200 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1306/2499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:27 2022] GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:27.834176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d371e0280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:27.972841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:20:27.973453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group d7509495-2d20-4712-b521-9bc0d7b79ff6 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:20:27.973983 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.973983 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6 HTTP/1.1 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd7509495-2d20-4712-b521-9bc0d7b79ff6'} May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:20:27.975956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] May 10 02:20:27.981940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:27.989766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:27.990226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:20:27.990226 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-d8f50a4d-0642-4973-bf0a-7531ee05de14'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:27.990226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cb39785a-0ef9-47f0-b4f0-c8c28a5b8278 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6" status: 404 len: 194 microversion: 2.1 time: 0.171541 May 10 02:20:27.990226 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1307/2500] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:20:27 2022] GET /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6 => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:27.990226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:27.990226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:28.004936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.005407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.007407 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-73aff717-fed5-43ac-bce1-2a4eae3e57a0 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.252033 May 10 02:20:28.008178 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1194/2501] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:27 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:28.017343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.017343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.033480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:28.037650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:28.039811 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb HTTP/1.1 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb'} May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:28.042425 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:28.048929 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed913a9c-6fce-45b4-9a8d-7e348f997640 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 404 len: 111 microversion: 2.1 time: 0.068991 May 10 02:20:28.054612 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1308/2502] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:27 2022] DELETE /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:28.062837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.066163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.067688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.069530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.078659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f055afe8-2b08-4fd6-9742-3b8e58aa8435 req-94db9f69-e84e-4392-99d9-370d7aeccd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d", "name": "network-vif-deleted", "tag": "de5f2874-7f72-4a6a-b50d-6dabb6304413"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:28.118375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f055afe8-2b08-4fd6-9742-3b8e58aa8435 req-94db9f69-e84e-4392-99d9-370d7aeccd0a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.118849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f055afe8-2b08-4fd6-9742-3b8e58aa8435 req-94db9f69-e84e-4392-99d9-370d7aeccd0a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.143919 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f055afe8-2b08-4fd6-9742-3b8e58aa8435 req-94db9f69-e84e-4392-99d9-370d7aeccd0a service nova] Creating event network-vif-deleted:de5f2874-7f72-4a6a-b50d-6dabb6304413 for instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d on n-h2-841089-2 May 10 02:20:28.156424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f055afe8-2b08-4fd6-9742-3b8e58aa8435 req-94db9f69-e84e-4392-99d9-370d7aeccd0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101490 May 10 02:20:28.159193 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1309/2503] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:28.172276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b385e0f0-eb27-41d0-8e31-6a31a9b68a05 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d37187430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:28.368155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:28.383380 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18dc6c9d-dd81-4a2e-9588-e32d2ae066ba tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1500 microversion: 2.1 time: 0.359454 May 10 02:20:28.403486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1195/2504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:28 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1500 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:28.411118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:28.412821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:28.420522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.421350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.422528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.423287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.441889 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb HTTP/1.1 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb'} May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:28.443931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. May 10 02:20:28.450575 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:28.453441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:28.454526 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c47e7246-b739-4bd7-81d0-7febe62d4c00 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb" status: 404 len: 111 microversion: 2.1 time: 0.049751 May 10 02:20:28.478195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1196/2505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:28 2022] GET /compute/v2.1/servers/b6c6ebb2-3853-4ff2-b7c4-1d87c974cfbb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:28.484380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:28.485005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:28.509034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.509500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.514686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.515447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.934981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:28.937944 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b385e0f0-eb27-41d0-8e31-6a31a9b68a05 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.773936 May 10 02:20:28.938968 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1310/2506] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 02:20:28 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:28.944331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:28.946088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:28.952232 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41b8af8c-8108-4851-a28a-5b2940b977f8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1319 microversion: 2.1 time: 0.475295 May 10 02:20:28.953285 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1197/2507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:28 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:28.966641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:28.967378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:28.972633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.973106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.977157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.977739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.982212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.982669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:28.984997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:28.985459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.056459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lazy-loading 'flavor' on Instance uuid 04f1fc9f-2151-4704-9c5b-288d3f334feb {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:29.200102 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89cd0079-499d-4a46-bbef-38ecc6645370 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "POST /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb/action" status: 200 len: 32 microversion: 2.1 time: 0.259625 May 10 02:20:29.201069 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1311/2508] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:28 2022] POST /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:29.206851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d6d7f3c1-bb7e-494c-86e4-4a292494297b req-59e8bf97-aed8-4aa0-9801-3a19763dcf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f568bb-c288-49aa-a0a8-db86a6eed24d", "name": "network-vif-deleted", "tag": "32a77d2b-3d12-4cfe-8404-9a4d9dbd7bfd"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:29.215201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d6d7f3c1-bb7e-494c-86e4-4a292494297b req-59e8bf97-aed8-4aa0-9801-3a19763dcf91 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.215659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d6d7f3c1-bb7e-494c-86e4-4a292494297b req-59e8bf97-aed8-4aa0-9801-3a19763dcf91 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.228781 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d6d7f3c1-bb7e-494c-86e4-4a292494297b req-59e8bf97-aed8-4aa0-9801-3a19763dcf91 service nova] Creating event network-vif-deleted:32a77d2b-3d12-4cfe-8404-9a4d9dbd7bfd for instance 56f568bb-c288-49aa-a0a8-db86a6eed24d on n-h1-841089-2 May 10 02:20:29.234682 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d6d7f3c1-bb7e-494c-86e4-4a292494297b req-59e8bf97-aed8-4aa0-9801-3a19763dcf91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031544 May 10 02:20:29.235899 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1312/2509] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:29.242803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:29.243985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:29.251916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.256269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.257354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.262335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.288751 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] HTTP exception thrown: Instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d could not be found. May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d HTTP/1.1 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d could not be found. May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d'} May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d could not be found. May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d could not be found. May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:29.290873 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d could not be found. May 10 02:20:29.295571 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:29.298271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 404 to user: Instance f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:29.300127 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7028c1d3-801d-41a0-a593-c9d17fe38e75 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d" status: 404 len: 111 microversion: 2.1 time: 0.061717 May 10 02:20:29.301268 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1313/2510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:29 2022] GET /compute/v2.1/servers/f332dfdc-7fb3-46c9-aa4b-a2a5aeeb960d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:29.306934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-cf1d51d5-ed1a-4c0b-8868-bf34c7c87fb1 req-fb42be0d-7b09-4cb6-ae3e-9afaedac5933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5480167e-075b-40f8-b0fa-ebb978adfd90", "name": "network-vif-plugged", "status": "completed", "tag": "0e5392ab-e325-4e75-b2f9-4bcc197a8995"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:29.318015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cf1d51d5-ed1a-4c0b-8868-bf34c7c87fb1 req-fb42be0d-7b09-4cb6-ae3e-9afaedac5933 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.318591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cf1d51d5-ed1a-4c0b-8868-bf34c7c87fb1 req-fb42be0d-7b09-4cb6-ae3e-9afaedac5933 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.331419 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-cf1d51d5-ed1a-4c0b-8868-bf34c7c87fb1 req-fb42be0d-7b09-4cb6-ae3e-9afaedac5933 service nova] Creating event network-vif-plugged:0e5392ab-e325-4e75-b2f9-4bcc197a8995 for instance 5480167e-075b-40f8-b0fa-ebb978adfd90 on n-h2-841089-2 May 10 02:20:29.337546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-cf1d51d5-ed1a-4c0b-8868-bf34c7c87fb1 req-fb42be0d-7b09-4cb6-ae3e-9afaedac5933 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034583 May 10 02:20:29.342932 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1314/2511] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:29.349406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce490c5b-30d3-4c7e-b642-b145ad56f5ca tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d3703dc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1383618763", "description": "tempest-description-39801165"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:29.384069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:29.399336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:29.400903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:29.407367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b613979d-3c23-4cdd-9b4c-a5ef43ffa3e1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1407 microversion: 2.20 time: 0.452885 May 10 02:20:29.407990 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1198/2512] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:28 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:29.434955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:29.435974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:29.444737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.445425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.446783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.447436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.597270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:29.609051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fdc53607-8cf9-4f49-977e-35c6cf90ab01 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.186413 May 10 02:20:29.627200 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1199/2513] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:29 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:29.627448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:29.628035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:29.638359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.639010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.639863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:29.640310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:29.989092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce490c5b-30d3-4c7e-b642-b145ad56f5ca tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.643492 May 10 02:20:29.991719 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1315/2514] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:20:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:30.014866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:30.017439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] [instance: 56f568bb-c288-49aa-a0a8-db86a6eed24d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:30.023912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:30.048151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.050166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.053367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.055575 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-554f54e3-788a-42e2-8f89-e003f9fa8366 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.431889 May 10 02:20:30.057027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.060489 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1200/2515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:29 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:30.079659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:30.081509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:30.100042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.100449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.101953 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] HTTP exception thrown: Instance 56f568bb-c288-49aa-a0a8-db86a6eed24d could not be found. May 10 02:20:30.103543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Request method failure captured: May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d HTTP/1.1 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu4pesvOrqtQKKHPtJ3zVQ1-fidBsbjKHYnfLnj6YJYpx04-cNnrld5SetPPVbAXNBvUmjfUZPkkIvYlSV0UACob5thy9FVbkvLvpXwaIcA3oiyTE__Bo9GGGSKOY0EDYW8kNqqMwhOJpTjQh6DIwgn0aq5RYdix1nkHt4hjAmEIGE May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15052a9541b64a4fa757b625688a96a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15052a9541b64a4fa757b625688a96a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15052a9541b64a4fa757b625688a96a4 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2094451470 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 5a707e3b6d02448f89471f1d919f8cb4 May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ListServersNegativeTestJSON-2094451470-project May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 56f568bb-c288-49aa-a0a8-db86a6eed24d could not be found. May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '56f568bb-c288-49aa-a0a8-db86a6eed24d'} May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f568bb-c288-49aa-a0a8-db86a6eed24d could not be found. May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f568bb-c288-49aa-a0a8-db86a6eed24d could not be found. May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:30.105594 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f568bb-c288-49aa-a0a8-db86a6eed24d could not be found. May 10 02:20:30.111192 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:30.112535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.115581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] Returning 404 to user: Instance 56f568bb-c288-49aa-a0a8-db86a6eed24d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:30.118858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-170510ac-033a-4fbd-8998-9a9a8ab3b6b7 tempest-ListServersNegativeTestJSON-2094451470 tempest-ListServersNegativeTestJSON-2094451470-project] 10.222.0.52 "GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d" status: 404 len: 111 microversion: 2.1 time: 0.123406 May 10 02:20:30.119635 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1316/2516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:29 2022] GET /compute/v2.1/servers/56f568bb-c288-49aa-a0a8-db86a6eed24d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:30.134251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-257b2c35-8f80-458b-ac8f-909d901f08d0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d3704e430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1370439761", "description": "tempest-description-1108858740"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:30.532048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:30.544409 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4cbfcbd-8a29-44ac-9816-dedb28de7c60 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1319 microversion: 2.1 time: 0.477840 May 10 02:20:30.545290 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1201/2517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:30 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:30.554665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:30.554665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:30.571406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.571846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.572644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.573089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.836519 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-257b2c35-8f80-458b-ac8f-909d901f08d0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.712251 May 10 02:20:30.837941 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1317/2518] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:20:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:30.859902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:30.860604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:30.883770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.885532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:30.887593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:30.893141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:31.098541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:31.112821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:31.114882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:31.120409 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-86a762e8-57e4-4db2-8dd6-386f095dda2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1599 microversion: 2.20 time: 0.572283 May 10 02:20:31.121569 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1202/2519] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:20:30 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1599 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:20:31.126268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:31.133660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:31.145134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:31.145852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:31.146857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:31.156182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:31.158086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2170d84ea4e4697ba2dfd8ebb339b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267f1f09372d477fb65afc5b2619b827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:31.170027 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-34ab135c-8cdf-463c-8369-e2cb473d07e5 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 200 len: 1251 microversion: 2.1 time: 0.330633 May 10 02:20:31.171885 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1318/2520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:30 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 1251 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:31.186625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-401223929", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "35a3ce9e-e80c-4229-9d98-b7abc78aacd8"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:31.269069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] validate_networks() for [('35a3ce9e-e80c-4229-9d98-b7abc78aacd8', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:31.590780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:31.599325 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96ae84cd-e575-4729-9002-4e813a14ff61 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.476542 May 10 02:20:31.603752 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1203/2521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:31 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:31.618175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:31.618682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:31.631320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:31.631815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:31.632625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:31.633106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:31.853633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bc451285-d592-4999-a958-2b71cf725f35 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.248573 May 10 02:20:31.854612 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1204/2522] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:20:31 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:20:31.859497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:31.860520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:31.868371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:31.869006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:31.869971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:31.870565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.182085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:32.193894 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c601afc4-4b31-4c0c-adc6-850c674cd03a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1469 microversion: 2.1 time: 0.338170 May 10 02:20:32.198766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1205/2523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:31 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:32.203956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:32.205514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] [instance: c605f6e1-aa80-4e63-a3ce-708651656638] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:32.220917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.221805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.224216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.225533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.242718 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] HTTP exception thrown: Instance c605f6e1-aa80-4e63-a3ce-708651656638 could not be found. May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Request method failure captured: May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 HTTP/1.1 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiectelnL_dBj-Xc8zYJ6gnwggUtlkycZh-kdkK60CTxjT7sF6QAY5MV_1-OkIOkp3ocOeLHvW0w_W4tSHRvczsOVUer7tR-lljveQQ5oDDCVhSDKsG8hZzKiPhUuFJ_dNnwP8ETPqxeXMRoIwFmZbvlyH2tDUwly3G-6Cz_xBzaMuM88 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 267f1f09372d477fb65afc5b2619b827 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestBootFromVolume-56164693 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_267f1f09372d477fb65afc5b2619b827", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/267f1f09372d477fb65afc5b2619b827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/267f1f09372d477fb65afc5b2619b827"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/267f1f09372d477fb65afc5b2619b827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestBootFromVolume-56164693 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 267f1f09372d477fb65afc5b2619b827 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestBootFromVolume-56164693 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestBootFromVolume-56164693-project May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: a2170d84ea4e4697ba2dfd8ebb339b79 May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestBootFromVolume-56164693-project May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance c605f6e1-aa80-4e63-a3ce-708651656638 could not be found. May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'c605f6e1-aa80-4e63-a3ce-708651656638'} May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c605f6e1-aa80-4e63-a3ce-708651656638 could not be found. May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c605f6e1-aa80-4e63-a3ce-708651656638 could not be found. May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:32.245087 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c605f6e1-aa80-4e63-a3ce-708651656638 could not be found. May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Returning 404 to user: Instance c605f6e1-aa80-4e63-a3ce-708651656638 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d463d3ad-3cf2-4f3a-9d29-d097a567d789 tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638" status: 404 len: 111 microversion: 2.1 time: 0.046829 May 10 02:20:32.251653 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1206/2524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:32 2022] GET /compute/v2.1/servers/c605f6e1-aa80-4e63-a3ce-708651656638 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:32.255693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:32.255693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:32.261383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.261848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.262647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.263314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.291363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:32.292412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:32.293104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:32.293778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:32.294653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:32.305592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lazy-loading 'flavor' on Instance uuid 5480167e-075b-40f8-b0fa-ebb978adfd90 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:32.310576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.314486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.316113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.316674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.355560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Getting quotas for project 5fd11a5b99914f159cd7844490e3bf7b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:32.372683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Getting quotas for user 45f2c2d3102f4f7caf7d578e0091aca5 and project 5fd11a5b99914f159cd7844490e3bf7b. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:32.393448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:32.398671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:32.438865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-685403a6-1426-4b82-b700-278538f562b6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90/action" status: 202 len: 0 microversion: 2.1 time: 0.189364 May 10 02:20:32.445754 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1207/2525] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:32 2022] POST /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:32.458448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02aa054a-f9e6-4828-8572-f713834bface tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] Calling method '.version_select at 0x7f3d366dd1f0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:32.489086 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02aa054a-f9e6-4828-8572-f713834bface tempest-ServersTestBootFromVolume-56164693 tempest-ServersTestBootFromVolume-56164693-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59391383" status: 202 len: 0 microversion: 2.1 time: 0.037781 May 10 02:20:32.489783 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1208/2526] 10.222.0.52 () {58 vars in 1214 bytes} [Tue May 10 02:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59391383 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:32.494663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:32.498824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:32.509531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.510760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.512511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.513289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.514875 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19cbf27d-4127-449c-9714-edb8918824ff tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340145 May 10 02:20:32.517321 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1319/2527] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:20:32.530496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-941ef94d-ba32-48ab-867a-dc75ca43553f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:32.532558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-941ef94d-ba32-48ab-867a-dc75ca43553f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:32.667879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-941ef94d-ba32-48ab-867a-dc75ca43553f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:32.678002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-941ef94d-ba32-48ab-867a-dc75ca43553f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1215 microversion: 2.1 time: 0.152268 May 10 02:20:32.679785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1320/2528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:32 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:32.696073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:32.698911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:32.727998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.748087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:32.750707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:32.754410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:33.021976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:33.035595 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-866ddd96-2e35-4cec-9d54-49d42dc73ca2 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1477 microversion: 2.1 time: 0.544311 May 10 02:20:33.036861 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1209/2529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:32 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1477 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:33.383368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:33.396241 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3dd14e1e-803b-48ed-b617-13d34f714f98 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.712475 May 10 02:20:33.397101 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1321/2530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:32 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:33.701053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:33.702561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:33.734483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:33.736441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:33.738932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:33.739654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:33.949283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:33.969455 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-97e53fec-928f-418e-b15c-ca5b3b1d77cd tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1211 microversion: 2.1 time: 0.277466 May 10 02:20:33.969976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1210/2531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:33 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1211 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:34.054310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:34.055304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:34.066499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:34.069565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:34.073111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:34.073879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:34.571455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-646628bc-e93d-4a94-9b46-660a24451f88 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1163595002", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:34.574010 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-646628bc-e93d-4a94-9b46-660a24451f88 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] HTTP exception thrown: min_count must be <= max_count May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-646628bc-e93d-4a94-9b46-660a24451f88 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Request method failure captured: May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 184 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecvxRGvEFyrTHqwXsB1suivXAcVmWksJRrqOWqcjQ5paF8HGQ5DVikp-uLUw1tJOkBRhFeEhk-0fG2TCijNZeIzAZJdsPpoixKmUzpyQhJQvyxSqRm3inddh68iOY3rqCAY2EsS2V3_rfYuKluT-gYjMY00JsrfZGmmpg2jNS8M8_Rc May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5c03ef15a1d4ffd8ecde45314432ecc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: e7fa1d6047a3481ba3ea1c452e3d758f May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1163595002", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: exception: min_count must be <= max_count May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1163595002', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 10 02:20:34.575590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:34.592116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-646628bc-e93d-4a94-9b46-660a24451f88 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Returning 400 to user: min_count must be <= max_count {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:34.592116 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-646628bc-e93d-4a94-9b46-660a24451f88 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.343576 May 10 02:20:34.592116 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1211/2532] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:34 2022] POST /compute/v2.1/servers => generated 74 bytes in 345 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 10 02:20:34.592116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:34.592116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:34.604911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:34.605379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:34.609152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:34.609615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.026951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:35.039799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d12422e6-6bf2-4422-97bd-cd23bf2ebf4a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.459506 May 10 02:20:35.043109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1212/2533] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:34 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:35.053876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:35.056203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ccdbc031-65c7-486c-9952-14286d286c71 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1144304413", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "max_count": 0}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ccdbc031-65c7-486c-9952-14286d286c71 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Request method failure captured: May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 168 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecvxRGvEFyrTHqwXsB1suivXAcVmWksJRrqOWqcjQ5paF8HGQ5DVikp-uLUw1tJOkBRhFeEhk-0fG2TCijNZeIzAZJdsPpoixKmUzpyQhJQvyxSqRm3inddh68iOY3rqCAY2EsS2V3_rfYuKluT-gYjMY00JsrfZGmmpg2jNS8M8_Rc May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5c03ef15a1d4ffd8ecde45314432ecc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: e7fa1d6047a3481ba3ea1c452e3d758f May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1144304413", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "max_count": 0}} May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1144304413', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'max_count': 0}}} May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 0 May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:20:35.060685 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 10 02:20:35.074455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.079375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d47deeb-5ef7-4aae-ba68-1efd99a92650 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1460 microversion: 2.1 time: 1.013525 May 10 02:20:35.079375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1322/2534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:34 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1460 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:35.079375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:35.079375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:35.082942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ccdbc031-65c7-486c-9952-14286d286c71 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:35.084510 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ccdbc031-65c7-486c-9952-14286d286c71 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.039429 May 10 02:20:35.085377 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1213/2535] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:35.088444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.088912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.089771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.090352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.093511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:35.094702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:35.104537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.105434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.107972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.108742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.229473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:35.236907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e752c4b-7532-490a-9a8a-6f14718d784d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1273 microversion: 2.1 time: 0.168381 May 10 02:20:35.247890 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1323/2536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:35 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:35.253049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b6fdafa-fec6-4438-a917-c9958615fcec tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-395838418", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "max_count": 2.5}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b6fdafa-fec6-4438-a917-c9958615fcec tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Request method failure captured: May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 169 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvxRGvEFyrTHqwXsB1suivXAcVmWksJRrqOWqcjQ5paF8HGQ5DVikp-uLUw1tJOkBRhFeEhk-0fG2TCijNZeIzAZJdsPpoixKmUzpyQhJQvyxSqRm3inddh68iOY3rqCAY2EsS2V3_rfYuKluT-gYjMY00JsrfZGmmpg2jNS8M8_Rc May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5c03ef15a1d4ffd8ecde45314432ecc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: e7fa1d6047a3481ba3ea1c452e3d758f May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-395838418", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "max_count": 2.5}} May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-395838418', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'max_count': 2.5}}} May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 2.5 May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:20:35.255987 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 10 02:20:35.262631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.265343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b6fdafa-fec6-4438-a917-c9958615fcec tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:35.276229 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b6fdafa-fec6-4438-a917-c9958615fcec tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026964 May 10 02:20:35.277659 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1324/2537] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:35.358365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b213899-acfe-4186-8e63-09e4b78ff906 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-895327729", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 0}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b213899-acfe-4186-8e63-09e4b78ff906 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Request method failure captured: May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 167 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvxRGvEFyrTHqwXsB1suivXAcVmWksJRrqOWqcjQ5paF8HGQ5DVikp-uLUw1tJOkBRhFeEhk-0fG2TCijNZeIzAZJdsPpoixKmUzpyQhJQvyxSqRm3inddh68iOY3rqCAY2EsS2V3_rfYuKluT-gYjMY00JsrfZGmmpg2jNS8M8_Rc May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5c03ef15a1d4ffd8ecde45314432ecc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: e7fa1d6047a3481ba3ea1c452e3d758f May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-895327729", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 0}} May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-895327729', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'min_count': 0}}} May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 0 May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:20:35.361257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b213899-acfe-4186-8e63-09e4b78ff906 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:35.368058 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2b213899-acfe-4186-8e63-09e4b78ff906 tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011164 May 10 02:20:35.372901 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1325/2538] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:20:35.452796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4175e8e2-f113-48fb-8f89-c3a2ce4b7ebe tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-444813506", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 2.5}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4175e8e2-f113-48fb-8f89-c3a2ce4b7ebe tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Request method failure captured: May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 169 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvxRGvEFyrTHqwXsB1suivXAcVmWksJRrqOWqcjQ5paF8HGQ5DVikp-uLUw1tJOkBRhFeEhk-0fG2TCijNZeIzAZJdsPpoixKmUzpyQhJQvyxSqRm3inddh68iOY3rqCAY2EsS2V3_rfYuKluT-gYjMY00JsrfZGmmpg2jNS8M8_Rc May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c5c03ef15a1d4ffd8ecde45314432ecc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c5c03ef15a1d4ffd8ecde45314432ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: c5c03ef15a1d4ffd8ecde45314432ecc May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-619751699 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: e7fa1d6047a3481ba3ea1c452e3d758f May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-619751699-project May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-444813506", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 2.5}} May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-444813506', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'min_count': 2.5}}} May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 2.5 May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:20:35.456393 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 10 02:20:35.461036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:20:35.473867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4175e8e2-f113-48fb-8f89-c3a2ce4b7ebe tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:35.475046 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4175e8e2-f113-48fb-8f89-c3a2ce4b7ebe tempest-MultipleCreateNegativeTestJSON-619751699 tempest-MultipleCreateNegativeTestJSON-619751699-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026860 May 10 02:20:35.476258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1326/2539] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:35.576166 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d19f0783-18a5-4634-8f21-920bbd353833 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1611 microversion: 2.1 time: 0.489414 May 10 02:20:35.579304 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1214/2540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:35 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1611 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:35.596300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ab0ccc1-8097-4f1f-9ce7-731ef26cfeb6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:35.598030 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:20:35.598030 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:20:35.599374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ab0ccc1-8097-4f1f-9ce7-731ef26cfeb6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.599956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ab0ccc1-8097-4f1f-9ce7-731ef26cfeb6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.601791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ab0ccc1-8097-4f1f-9ce7-731ef26cfeb6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.602261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ab0ccc1-8097-4f1f-9ce7-731ef26cfeb6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.678878 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ab0ccc1-8097-4f1f-9ce7-731ef26cfeb6 tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086843 May 10 02:20:35.682659 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1327/2541] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:20:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:35.698840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-841089-2", "block_migration": true, "disk_over_commit": false}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:35.700016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:35.721045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.721553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.722364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.722812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.794853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Lazy-loading 'flavor' on Instance uuid 5480167e-075b-40f8-b0fa-ebb978adfd90 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:35.846423 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5480167e-075b-40f8-b0fa-ebb978adfd90 while it is in vm_state suspended May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Request method failure captured: May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90/action HTTP/1.1 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 97 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu6D6VX3JoEeIeTLGt8ktXvGhVKTQDhg0POo6lqYTY84pYPE1Rb85kZ4LXek14rOSJddOhhN3SZ_-jhphaObFO7SNqC5AIlukA0kVysk78qAdDV6wAWI85uPuOASpgdMIAJoazKYZLi2mZYztCeWZiJKE862nSVrwDggMnnu2yfFWc May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 479db68d7bc84aae948a2b6b85f3639e May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveMigrationNegativeTest-897768772 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_479db68d7bc84aae948a2b6b85f3639e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/479db68d7bc84aae948a2b6b85f3639e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/479db68d7bc84aae948a2b6b85f3639e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/479db68d7bc84aae948a2b6b85f3639e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveMigrationNegativeTest-897768772 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 479db68d7bc84aae948a2b6b85f3639e May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-897768772 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveMigrationNegativeTest-897768772-project-admin May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1cdf8223ce5446a68078dc15a79df4c5 May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveMigrationNegativeTest-897768772-project-admin May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: {"os-migrateLive": {"host": "n-h1-841089-2", "block_migration": true, "disk_over_commit": false}} May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'os-migrateLive' instance 5480167e-075b-40f8-b0fa-ebb978adfd90 while it is in vm_state suspended May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5480167e-075b-40f8-b0fa-ebb978adfd90', 'body': {'os-migrateLive': {'host': 'n-h1-841089-2', 'block_migration': True, 'disk_over_commit': False}}} May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 in vm_state suspended. Cannot live_migrate while the instance is in this state. May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.848497 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5480167e-075b-40f8-b0fa-ebb978adfd90 while it is in vm_state suspended May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5480167e-075b-40f8-b0fa-ebb978adfd90 while it is in vm_state suspended May 10 02:20:35.853245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:35.864516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5480167e-075b-40f8-b0fa-ebb978adfd90 while it is in vm_state suspended {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:35.865828 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44644afb-623f-4dfb-ba2e-ff287a1add6c tempest-LiveMigrationNegativeTest-897768772 tempest-LiveMigrationNegativeTest-897768772-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90/action" status: 409 len: 155 microversion: 2.1 time: 0.176467 May 10 02:20:35.867360 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1215/2542] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:35 2022] POST /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90/action => generated 155 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:20:35.878662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:35.879359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:35.889919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.890379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.891217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.891668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.940598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ae73a0b3-b02e-49c9-9f46-c8dd9cb2b42c req-20a39206-d77b-401b-b0fd-190936d6dec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:35.956498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ae73a0b3-b02e-49c9-9f46-c8dd9cb2b42c req-20a39206-d77b-401b-b0fd-190936d6dec4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:35.959741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ae73a0b3-b02e-49c9-9f46-c8dd9cb2b42c req-20a39206-d77b-401b-b0fd-190936d6dec4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:35.959910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:35.990472 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ae73a0b3-b02e-49c9-9f46-c8dd9cb2b42c req-20a39206-d77b-401b-b0fd-190936d6dec4 service nova] Creating event network-changed:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h2-841089-2 May 10 02:20:36.014628 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ae73a0b3-b02e-49c9-9f46-c8dd9cb2b42c req-20a39206-d77b-401b-b0fd-190936d6dec4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088555 May 10 02:20:36.015825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1216/2543] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:20:36.058404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:36.059294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:36.073324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:36.073953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:36.074844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:36.075436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:36.168018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d74b353-607f-424c-85b0-bd1017204951 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 204 len: 0 microversion: 2.1 time: 0.292331 May 10 02:20:36.173678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1328/2544] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:35 2022] DELETE /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:36.187555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:36.188558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:36.201768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:36.208272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:36.210673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:36.211858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:37.104332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:37.118238 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e0c1bff7-c5d1-4c4b-a427-240c292cec82 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 1.059162 May 10 02:20:37.119261 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1217/2545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:36 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:37.132324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:37.134793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:37.154939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:37.157199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:37.160335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:37.161013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:37.326585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:37.339374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3261284-c1d1-4568-a69d-910697e1e350 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1273 microversion: 2.1 time: 0.218963 May 10 02:20:37.340213 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1218/2546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:37 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:37.372847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:37.385858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a7de63d-7db4-4a5f-86a7-c6c4bc7901eb tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1466 microversion: 2.1 time: 1.204198 May 10 02:20:37.386469 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1329/2547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:36 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1466 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:38.141033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:38.141660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:38.160093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:38.160571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:38.161390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:38.161838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:38.356253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:38.357041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:38.378157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:38.378838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:38.379760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:38.380214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:38.741177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:38.751722 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56013199-a1f4-4e8c-81d1-00714fa74872 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.615449 May 10 02:20:38.754214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1219/2548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:38 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:38.764112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:38.766892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:38.781179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:38.785730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:38.786961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:38.787692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:40.955316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:40.969772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69c7f82d-5df0-48af-b6a7-3c9d6a9ad964 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 2.615852 May 10 02:20:40.971501 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1330/2549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:38 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:40.988994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:40.989929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:41.003676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.013782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.015163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.019756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.020750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:41.044993 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4fa4aa7d-654e-406f-b6db-f91227281c62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1466 microversion: 2.1 time: 2.288980 May 10 02:20:41.064755 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1220/2550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:38 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1466 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:41.084093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:41.087136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:41.117621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.119988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.125552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.126752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.178586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 HTTP/1.1 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '9509d8d2-b9af-4154-a5e7-e0a9815ea577'} May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:41.194692 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:41.202223 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4051db8e-3a86-4ac5-8226-6598f5f611ca tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 404 len: 111 microversion: 2.1 time: 0.131276 May 10 02:20:41.207366 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1221/2551] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:41 2022] DELETE /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:41.219349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:41.220023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: 9509d8d2-b9af-4154-a5e7-e0a9815ea577] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:41.254471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.263428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.264428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.264896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.293288 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 HTTP/1.1 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '9509d8d2-b9af-4154-a5e7-e0a9815ea577'} May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.296729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. May 10 02:20:41.302844 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.305294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance 9509d8d2-b9af-4154-a5e7-e0a9815ea577 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:41.317125 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7c3d4533-5eac-4d61-b91f-92986a9c2963 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577" status: 404 len: 111 microversion: 2.1 time: 0.107976 May 10 02:20:41.317864 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1222/2552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:41 2022] GET /compute/v2.1/servers/9509d8d2-b9af-4154-a5e7-e0a9815ea577 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:41.329332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:41.330086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:41.342136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.343121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.344126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.347279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.370443 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 HTTP/1.1 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f5790707-188a-437e-b169-112129b41399'} May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:41.373380 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.378704 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.381044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance f5790707-188a-437e-b169-112129b41399 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:41.382154 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa981326-24b0-4d25-896c-dc1816fab1c3 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 404 len: 111 microversion: 2.1 time: 0.058177 May 10 02:20:41.386212 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1223/2553] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:41 2022] DELETE /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:41.394753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:41.396021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] [instance: f5790707-188a-437e-b169-112129b41399] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:41.405264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.406097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.408062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.409308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.425662 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] HTTP exception thrown: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Request method failure captured: May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 HTTP/1.1 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecpyKJqUjJjxBKHTIrvn2JO3Lj8fsvlrgPdBTnE_lYXEk7ilr7h2hbIwASuHRWtF28ksNyWrfAFACCOE-9-pJuSh-7VF_ipahFRQqdB5xjbw9ccE9jT7IRvPU25xS1HeAbJHuZuiqvXmFdiyYdWGAXeingl5v6M-kU7WvfkJwZW5vDA May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09c96e69d8a240199a06b0433fb88a4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09c96e69d8a240199a06b0433fb88a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 09c96e69d8a240199a06b0433fb88a4e May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2066727245 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c59edfa0cdbc46bc8a7c253228023559 May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-2066727245-project May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f5790707-188a-437e-b169-112129b41399'} May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:41.427502 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5790707-188a-437e-b169-112129b41399 could not be found. May 10 02:20:41.433011 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:41.434513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] Returning 404 to user: Instance f5790707-188a-437e-b169-112129b41399 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:41.435646 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3359728c-a234-4252-9e4f-8dd9488c2e37 tempest-DeleteServersTestJSON-2066727245 tempest-DeleteServersTestJSON-2066727245-project] 10.222.0.52 "GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399" status: 404 len: 111 microversion: 2.1 time: 0.048235 May 10 02:20:41.440065 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1224/2554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:41 2022] GET /compute/v2.1/servers/f5790707-188a-437e-b169-112129b41399 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:41.553833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-5a234f8c-eaca-4193-b345-aedbd8d5395c req-b762fcb4-dc96-4e0d-8d3e-13bf1affd6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5480167e-075b-40f8-b0fa-ebb978adfd90", "name": "network-vif-deleted", "tag": "0e5392ab-e325-4e75-b2f9-4bcc197a8995"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:41.581059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5a234f8c-eaca-4193-b345-aedbd8d5395c req-b762fcb4-dc96-4e0d-8d3e-13bf1affd6ec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:41.581515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5a234f8c-eaca-4193-b345-aedbd8d5395c req-b762fcb4-dc96-4e0d-8d3e-13bf1affd6ec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:41.626293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-5a234f8c-eaca-4193-b345-aedbd8d5395c req-b762fcb4-dc96-4e0d-8d3e-13bf1affd6ec service nova] Creating event network-vif-deleted:0e5392ab-e325-4e75-b2f9-4bcc197a8995 for instance 5480167e-075b-40f8-b0fa-ebb978adfd90 on n-h2-841089-2 May 10 02:20:41.637010 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-5a234f8c-eaca-4193-b345-aedbd8d5395c req-b762fcb4-dc96-4e0d-8d3e-13bf1affd6ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093836 May 10 02:20:41.638669 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1225/2555] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:41.972235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:41.984658 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7794774e-042a-4fdb-a556-949eb88c52c9 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 1.010374 May 10 02:20:41.986588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1331/2556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:40 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:41.988338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:41.989172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:41.998507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:42.003132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:42.022991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:42.026126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:42.066535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:42.067265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:42.079143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:42.079846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:42.082535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:42.083449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:42.147953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:42.149446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:42.151541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lazy-loading 'fault' on Instance uuid 5480167e-075b-40f8-b0fa-ebb978adfd90 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:42.386160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:42.421033 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-047d0a52-8671-48ab-941c-3551455b9002 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 200 len: 1309 microversion: 2.1 time: 0.359322 May 10 02:20:42.432782 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1332/2557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:42 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 1309 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:42.756093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:42.766439 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5ed09183-0bf6-4a96-ad97-c117c3fa8e15 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.781163 May 10 02:20:42.775268 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1226/2558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:41 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:43.004254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:43.006703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:43.020310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.021232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.023796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.026488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.438364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:43.439094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 5480167e-075b-40f8-b0fa-ebb978adfd90] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:43.453345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.457342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.458476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.459205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.494334 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] HTTP exception thrown: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 could not be found. May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Request method failure captured: May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 HTTP/1.1 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu6qGlrRslFON1GIvoP8USgska2U0VXW7A9eUTHxdkhtzXIr662QzSvoM5UIduUzraQOUiWlvkmlr8H4jBtRMoJCgAPniI98Gmww58qdE8j-f9B05G8hJWmOBvgLM2UDBqhNk60LTYUhgtsUomiASUZZqygXyIgbonbzrwcn-K_eTc May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e246c06835984f16b407d8df3f03b49b May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveMigrationNegativeTest-667532680 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e246c06835984f16b407d8df3f03b49b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e246c06835984f16b407d8df3f03b49b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e246c06835984f16b407d8df3f03b49b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e246c06835984f16b407d8df3f03b49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveMigrationNegativeTest-667532680 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e246c06835984f16b407d8df3f03b49b May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-667532680 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveMigrationNegativeTest-667532680-project May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 7bc85ca1ad9241249b810f85fc8c76f0 May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveMigrationNegativeTest-667532680-project May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 could not be found. May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5480167e-075b-40f8-b0fa-ebb978adfd90'} May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 could not be found. May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 could not be found. May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:43.499401 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 could not be found. May 10 02:20:43.505879 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:43.507305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Returning 404 to user: Instance 5480167e-075b-40f8-b0fa-ebb978adfd90 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:43.513478 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f5d0e47-ccc0-4a52-9a22-9f65eaab65f0 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90" status: 404 len: 111 microversion: 2.1 time: 0.079210 May 10 02:20:43.514364 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1227/2559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:43 2022] GET /compute/v2.1/servers/5480167e-075b-40f8-b0fa-ebb978adfd90 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:20:43.523702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:43.524565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:43.532295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.533060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.534110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.534962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.582253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:20:43.785859 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e978f40c-5e98-4cb8-b1c9-de167f5fad2a tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 204 len: 0 microversion: 2.1 time: 0.266226 May 10 02:20:43.786538 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1228/2560] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:20:43 2022] DELETE /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:20:43.796696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:43.797725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:43.805463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.806202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.807253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.807956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.882612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:43.893486 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53fdb3d5-b7ae-4636-9f54-dee181a99fa5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.895416 May 10 02:20:43.894358 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1333/2561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:42 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:43.904428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:43.905362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:43.921634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.922502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:43.923626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:43.924909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:44.566168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:44.577889 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-86ddba12-38ff-4e9a-8b87-17c5fe416ac0 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.787744 May 10 02:20:44.578678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1229/2562] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:43 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:44.597654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3fc4ed2a-2fd7-4a11-bf48-95a4b889494b req-095457f0-e8b4-42ab-8769-32038a1e874f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee8eecd-3d75-4867-889a-05da5e8755ca", "tag": "0628eb83-1eea-4c13-8e62-e5ca779664ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:44.638034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3fc4ed2a-2fd7-4a11-bf48-95a4b889494b req-095457f0-e8b4-42ab-8769-32038a1e874f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:44.639700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3fc4ed2a-2fd7-4a11-bf48-95a4b889494b req-095457f0-e8b4-42ab-8769-32038a1e874f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:44.669592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3fc4ed2a-2fd7-4a11-bf48-95a4b889494b req-095457f0-e8b4-42ab-8769-32038a1e874f service nova] Creating event network-changed:0628eb83-1eea-4c13-8e62-e5ca779664ca for instance 0ee8eecd-3d75-4867-889a-05da5e8755ca on n-h1-841089-2 May 10 02:20:44.678318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:44.682706 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3fc4ed2a-2fd7-4a11-bf48-95a4b889494b req-095457f0-e8b4-42ab-8769-32038a1e874f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101371 May 10 02:20:44.683352 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1230/2563] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:44.688515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-742a7035-bd97-42a7-85fd-13de9b811b62 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1473 microversion: 2.1 time: 0.792843 May 10 02:20:44.692653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1334/2564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:43 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1473 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:44.911720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:44.912795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:44.922040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:44.926844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:44.929476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:44.930341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:45.045492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1723573042", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "d8171a12-ce61-4e32-9145-86bcc5ef67e6"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:45.134337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] validate_networks() for [('d8171a12-ce61-4e32-9145-86bcc5ef67e6', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:45.490210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:45.497774 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-992e4f6f-762f-4722-b598-a19cae328101 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.590757 May 10 02:20:45.511426 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1335/2565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:44 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:45.595950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:45.596731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:45.616626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:45.617190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:45.618001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:45.618460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.093184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:46.108279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bcea6b16-99ed-4441-94d1-2f18fe243129 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.510963 May 10 02:20:46.109003 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1336/2566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:45 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:46.279916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:46.286997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:46.287892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:46.288522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:46.289172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:46.304251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.306792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.307870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.310810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.356706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Getting quotas for project 22be97e937874f77bfe9b8eae4635798. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:46.367018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Getting quotas for user 9c69fc8630e34fb1ad2d028016aa2a25 and project 22be97e937874f77bfe9b8eae4635798. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:46.397655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:46.407305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:46.504372 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-668f538e-5d38-4d31-8967-2eb4d687829c tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.819426 May 10 02:20:46.507358 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1231/2567] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:20:46.521115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:46.522132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:46.539550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.540389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.541549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.542213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.614073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.617794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.619138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lazy-loading 'fault' on Instance uuid 7b89457c-1e9c-4b0d-b982-65ed44dc593d {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:20:46.757083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bc85ca1ad9241249b810f85fc8c76f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246c06835984f16b407d8df3f03b49b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:46.768736 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f790e49-d28d-4db0-a303-5748b2b06037 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 200 len: 1308 microversion: 2.1 time: 0.256112 May 10 02:20:46.772295 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1232/2568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:46 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 1308 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:46.773896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2bc863d5-4397-4a53-929a-d514e8d8d0e7 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Calling method '.version_select at 0x7f3d36f06e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:46.788523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0ee52dd9-c0a1-4bbb-90e5-e2fdb62d28ba req-ee79f9bb-0655-48b1-8c09-266d20e3a5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b89457c-1e9c-4b0d-b982-65ed44dc593d", "name": "network-vif-deleted", "tag": "70f2dd2b-4770-4b78-b7d0-30a2cc4eae3c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:46.810809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0ee52dd9-c0a1-4bbb-90e5-e2fdb62d28ba req-ee79f9bb-0655-48b1-8c09-266d20e3a5a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.812638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0ee52dd9-c0a1-4bbb-90e5-e2fdb62d28ba req-ee79f9bb-0655-48b1-8c09-266d20e3a5a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.852172 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0ee52dd9-c0a1-4bbb-90e5-e2fdb62d28ba req-ee79f9bb-0655-48b1-8c09-266d20e3a5a3 service nova] Creating event network-vif-deleted:70f2dd2b-4770-4b78-b7d0-30a2cc4eae3c for instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d on n-h1-841089-2 May 10 02:20:46.864069 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0ee52dd9-c0a1-4bbb-90e5-e2fdb62d28ba req-ee79f9bb-0655-48b1-8c09-266d20e3a5a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083190 May 10 02:20:46.875469 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1233/2569] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:46.886284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:46.889672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:46.908619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.912627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:46.914615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:46.916537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:47.690974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2bc863d5-4397-4a53-929a-d514e8d8d0e7 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.579399 May 10 02:20:47.691600 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1337/2570] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:20:46 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:20:47.703622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:47.704667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:47.714327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:47.714746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:47.715693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:47.716343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:47.809318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:47.824129 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbe4ac76-27c7-4c18-9687-3944611804d8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1269 microversion: 2.1 time: 0.131222 May 10 02:20:47.826080 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1338/2571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:47 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:47.840617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:47.846420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:47.863154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:47.863616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:47.866999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:47.869785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:47.914594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:47.923165 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-434f8832-3dcd-44c0-ae4e-c665ddc18cb5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 1.042760 May 10 02:20:47.923774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1234/2572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:46 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:47.941391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d358f7d8-416c-41a3-b72c-16df511205d3 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Action: 'create', calling method: .version_select at 0x7f3d366bc430>, body: {"pool": "non_exist_pool"} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:48.038493 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d358f7d8-416c-41a3-b72c-16df511205d3 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] HTTP exception thrown: Floating IP pool not found. May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d358f7d8-416c-41a3-b72c-16df511205d3 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Request method failure captured: May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 26 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecv9Gidzo4RelQPZGuMdZJCNQ_g8iCgIyykcP87Eiv48p7NdFT3HXQiHsx1bhz8GIJsJpqqkqYC08MK5s2jrDdS0N7ENrJLjt0VLsHTBTnk9MLdl_587WL1al-DbkxO3Bub_c0Ov6jG-dSr2r7vVi7-cIMiAZiHGcWTGd0-ykD-xzPU May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: fc895b894f3d4dbab90c0182b66b4737 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-400308367 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc895b894f3d4dbab90c0182b66b4737", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc895b894f3d4dbab90c0182b66b4737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc895b894f3d4dbab90c0182b66b4737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc895b894f3d4dbab90c0182b66b4737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-400308367 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: fc895b894f3d4dbab90c0182b66b4737 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-400308367 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FloatingIPsNegativeTestJSON-400308367-project May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 8bec0bca5dbe45aeae86cf041eb14067 May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-400308367-project May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: {"pool": "non_exist_pool"} May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: exception: Floating IP pool not found. May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'pool': 'non_exist_pool'}} May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2957, in allocate_floating_ip May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2947, in _get_floating_ip_pool_id_by_name_or_id May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:48.040617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:48.043811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 10 02:20:48.043811 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.045819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d358f7d8-416c-41a3-b72c-16df511205d3 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Returning 404 to user: Floating IP pool not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:48.046967 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d358f7d8-416c-41a3-b72c-16df511205d3 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.109939 May 10 02:20:48.048306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1235/2573] 10.222.0.52 () {60 vars in 1169 bytes} [Tue May 10 02:20:47 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:20:48.056072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:48.066360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] [instance: 7b89457c-1e9c-4b0d-b982-65ed44dc593d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:48.074431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:48.078176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:48.079241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:48.083608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:48.102811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] HTTP exception thrown: Instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d could not be found. May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Request method failure captured: May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d HTTP/1.1 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu6qGlrRslFON1GIvoP8USgska2U0VXW7A9eUTHxdkhtzXIr662QzSvoM5UIduUzraQOUiWlvkmlr8H4jBtRMoJCgAPniI98Gmww58qdE8j-f9B05G8hJWmOBvgLM2UDBqhNk60LTYUhgtsUomiASUZZqygXyIgbonbzrwcn-K_eTc May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e246c06835984f16b407d8df3f03b49b May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-LiveMigrationNegativeTest-667532680 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e246c06835984f16b407d8df3f03b49b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e246c06835984f16b407d8df3f03b49b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e246c06835984f16b407d8df3f03b49b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e246c06835984f16b407d8df3f03b49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-LiveMigrationNegativeTest-667532680 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e246c06835984f16b407d8df3f03b49b May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-667532680 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-LiveMigrationNegativeTest-667532680-project May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 7bc85ca1ad9241249b810f85fc8c76f0 May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-LiveMigrationNegativeTest-667532680-project May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d could not be found. May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '7b89457c-1e9c-4b0d-b982-65ed44dc593d'} May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d could not be found. May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d could not be found. May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.104729 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d could not be found. May 10 02:20:48.107689 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.112328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] Returning 404 to user: Instance 7b89457c-1e9c-4b0d-b982-65ed44dc593d could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:48.113434 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f33b8020-8272-4a15-a45d-904ea24a28b8 tempest-LiveMigrationNegativeTest-667532680 tempest-LiveMigrationNegativeTest-667532680-project] 10.222.0.52 "GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d" status: 404 len: 111 microversion: 2.1 time: 0.063942 May 10 02:20:48.114233 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1236/2574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:48 2022] GET /compute/v2.1/servers/7b89457c-1e9c-4b0d-b982-65ed44dc593d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:48.120134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c1871ee-1faa-4215-a9c1-550ce98ce702 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Calling method '.version_select at 0x7f3d365513a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:48.217377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-5c1871ee-1faa-4215-a9c1-550ce98ce702 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35c00b98-8dc7-4ac3-890f-835c6fa2c69c could not be found", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:20:48.218076 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5c1871ee-1faa-4215-a9c1-550ce98ce702 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] HTTP exception thrown: Floating IP not found for ID 35c00b98-8dc7-4ac3-890f-835c6fa2c69c May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c1871ee-1faa-4215-a9c1-550ce98ce702 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Request method failure captured: May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-floating-ips/35c00b98-8dc7-4ac3-890f-835c6fa2c69c HTTP/1.1 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecv9Gidzo4RelQPZGuMdZJCNQ_g8iCgIyykcP87Eiv48p7NdFT3HXQiHsx1bhz8GIJsJpqqkqYC08MK5s2jrDdS0N7ENrJLjt0VLsHTBTnk9MLdl_587WL1al-DbkxO3Bub_c0Ov6jG-dSr2r7vVi7-cIMiAZiHGcWTGd0-ykD-xzPU May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: fc895b894f3d4dbab90c0182b66b4737 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-400308367 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc895b894f3d4dbab90c0182b66b4737", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc895b894f3d4dbab90c0182b66b4737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc895b894f3d4dbab90c0182b66b4737"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc895b894f3d4dbab90c0182b66b4737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-400308367 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: fc895b894f3d4dbab90c0182b66b4737 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-400308367 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FloatingIPsNegativeTestJSON-400308367-project May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 8bec0bca5dbe45aeae86cf041eb14067 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-400308367-project May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: exception: Floating IP not found for ID 35c00b98-8dc7-4ac3-890f-835c6fa2c69c May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '35c00b98-8dc7-4ac3-890f-835c6fa2c69c'} May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35c00b98-8dc7-4ac3-890f-835c6fa2c69c could not be found May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fc76ace-3ebf-40ea-aada-7d39b92c252f'] May 10 02:20:48.221708 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35c00b98-8dc7-4ac3-890f-835c6fa2c69c. May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35c00b98-8dc7-4ac3-890f-835c6fa2c69c May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35c00b98-8dc7-4ac3-890f-835c6fa2c69c May 10 02:20:48.226882 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:48.238243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c1871ee-1faa-4215-a9c1-550ce98ce702 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] Returning 404 to user: Floating IP not found for ID 35c00b98-8dc7-4ac3-890f-835c6fa2c69c {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:48.239479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c1871ee-1faa-4215-a9c1-550ce98ce702 tempest-FloatingIPsNegativeTestJSON-400308367 tempest-FloatingIPsNegativeTestJSON-400308367-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/35c00b98-8dc7-4ac3-890f-835c6fa2c69c" status: 404 len: 111 microversion: 2.1 time: 0.123637 May 10 02:20:48.244745 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1237/2575] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:20:48 2022] DELETE /compute/v2.1/os-floating-ips/35c00b98-8dc7-4ac3-890f-835c6fa2c69c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:20:48.277001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:48.301394 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9b8d074f-2825-455c-91a6-e0c83a642199 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.469221 May 10 02:20:48.303785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1339/2576] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:47 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:48.844178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:48.844801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:48.866164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:48.866662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:48.868797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:48.869333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:48.942274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:48.942770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:48.957933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:48.958571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:48.968454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:48.968913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:49.145657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:49.157548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f3bcfb8c-261c-4a01-8f07-8c7e44f9fa80 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1269 microversion: 2.1 time: 0.319052 May 10 02:20:49.159557 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1238/2577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:48 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1269 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:49.327926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:49.328877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:49.340031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:49.341391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:49.342435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:49.343203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:49.825499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:49.843330 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8870e559-1265-48fb-9b71-dc5cfaebf3e5 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.900976 May 10 02:20:49.852501 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1340/2578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:48 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:49.982723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:49.990717 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-763156ea-08b8-4507-a543-af2df110ff9d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.672166 May 10 02:20:49.993064 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1239/2579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:49 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:50.182449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:50.184140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:50.208081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:50.216932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:50.219461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:50.227298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:50.526661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:50.541515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f125416a-1df7-4c53-a427-f44668773b79 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1275 microversion: 2.1 time: 0.363997 May 10 02:20:50.554293 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1341/2580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:50 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1275 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:50.875796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:50.877225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:50.891146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:50.894892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:50.899713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:50.900506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:51.009422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:51.010395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:51.022455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:51.023340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:51.024417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:51.025129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:51.650821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:51.657162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:51.684209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4f67e74d-0c0d-448a-9fcd-c5eabef4b82c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.672829 May 10 02:20:51.687706 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42edded5-0072-4e1e-9995-9be918a19596 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.820032 May 10 02:20:51.687931 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1342/2581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:51 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:51.690977 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1240/2582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:50 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:51.698854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:51.699584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:51.714704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:51.715550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:51.718138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:51.721005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:52.360246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:52.375345 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5b934f30-8d4a-4289-bac2-92e3b7cdcfe4 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.686119 May 10 02:20:52.376555 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1343/2583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:51 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:52.714839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:52.716775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:52.722948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:52.726704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:52.727597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:52.729850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:52.730314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:52.735627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:52.757630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:52.758953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:52.761786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:52.763547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:53.740972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:53.754882 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a9f120e-d645-4f84-a460-feafbee3759a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 1.043736 May 10 02:20:53.755500 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1241/2584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:52 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:53.774350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:53.782630 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b051eb5-953b-408b-8464-bdc96e33e834 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 1.071385 May 10 02:20:53.783253 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1344/2585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:52 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:53.800656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fa5aba30-81fe-42a0-a184-06ea2b5da419 req-2572e037-6055-4f65-ad87-4acae44494db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee8eecd-3d75-4867-889a-05da5e8755ca", "name": "network-vif-plugged", "status": "completed", "tag": "0628eb83-1eea-4c13-8e62-e5ca779664ca"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:53.817915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fa5aba30-81fe-42a0-a184-06ea2b5da419 req-2572e037-6055-4f65-ad87-4acae44494db service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:53.823812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fa5aba30-81fe-42a0-a184-06ea2b5da419 req-2572e037-6055-4f65-ad87-4acae44494db service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:53.864994 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fa5aba30-81fe-42a0-a184-06ea2b5da419 req-2572e037-6055-4f65-ad87-4acae44494db service nova] Creating event network-vif-plugged:0628eb83-1eea-4c13-8e62-e5ca779664ca for instance 0ee8eecd-3d75-4867-889a-05da5e8755ca on n-h1-841089-2 May 10 02:20:53.874423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fa5aba30-81fe-42a0-a184-06ea2b5da419 req-2572e037-6055-4f65-ad87-4acae44494db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084450 May 10 02:20:53.878588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1345/2586] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:53.889630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:53.890503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:53.900297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:53.901407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:53.902358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:53.903258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:53.935356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5372b9f9-115f-48d2-9cf4-1ad353d2f5bb tempest-NetworksTest-2028609421 tempest-NetworksTest-2028609421-project-admin] Calling method '.version_select at 0x7f3d36686940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:54.551580 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5372b9f9-115f-48d2-9cf4-1ad353d2f5bb tempest-NetworksTest-2028609421 tempest-NetworksTest-2028609421-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 7437 microversion: 2.1 time: 0.794684 May 10 02:20:54.552182 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1242/2587] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:20:53 2022] GET /compute/v2.1/os-networks => generated 7437 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:54.560112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72a39700-91f1-4eca-b790-d9e5d0360f9c tempest-NetworksTest-2028609421 tempest-NetworksTest-2028609421-project-admin] Calling method '.version_select at 0x7f3d3664edc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:54.596988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:54.604789 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-102cf252-faa7-4eed-8553-448bd403aa86 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.724644 May 10 02:20:54.605564 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1346/2588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:53 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:54.771653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:54.772311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:54.784359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:54.784359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:54.784359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:54.784359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:54.944466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72a39700-91f1-4eca-b790-d9e5d0360f9c tempest-NetworksTest-2028609421 tempest-NetworksTest-2028609421-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks/d7850721-b379-4b74-b269-d31e4717b7b9" status: 200 len: 652 microversion: 2.1 time: 0.387813 May 10 02:20:54.945947 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1243/2589] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:20:54 2022] GET /compute/v2.1/os-networks/d7850721-b379-4b74-b269-d31e4717b7b9 => generated 652 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:20:54.955495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:54.956321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:54.963136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:54.963609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:54.964392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:54.964999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:55.231651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:55.245582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-848ba269-b099-49db-a83a-6260f34a69e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1315 microversion: 2.1 time: 0.472990 May 10 02:20:55.255168 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1347/2590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:54 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:55.255168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae97537c-e745-4ec9-9f6f-7f6f7939aee3 tempest-NetworksTest-2028609421 tempest-NetworksTest-2028609421-project-admin] Calling method '.version_select at 0x7f3d36f06e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:55.385024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:55.396744 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-384113b8-c6ab-4754-8ade-4b9a17b1a468 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.449584 May 10 02:20:55.410949 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1244/2591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:54 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:55.558203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-5f03cfac-ff43-4b5c-98a0-31955d8d9a1c req-a39bf60e-e5ad-4d0d-a213-6eef09be694e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471d18d9-30f1-4ca1-af0e-41a0bf95beed", "tag": "12d59ff3-e839-4529-b220-b93722f8747b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:55.579230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5f03cfac-ff43-4b5c-98a0-31955d8d9a1c req-a39bf60e-e5ad-4d0d-a213-6eef09be694e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:55.579569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5f03cfac-ff43-4b5c-98a0-31955d8d9a1c req-a39bf60e-e5ad-4d0d-a213-6eef09be694e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:55.591043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-5f03cfac-ff43-4b5c-98a0-31955d8d9a1c req-a39bf60e-e5ad-4d0d-a213-6eef09be694e service nova] Creating event network-changed:12d59ff3-e839-4529-b220-b93722f8747b for instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed on n-h1-841089-2 May 10 02:20:55.599930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-5f03cfac-ff43-4b5c-98a0-31955d8d9a1c req-a39bf60e-e5ad-4d0d-a213-6eef09be694e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045231 May 10 02:20:55.600887 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1245/2592] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:20:55.613440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae97537c-e745-4ec9-9f6f-7f6f7939aee3 tempest-NetworksTest-2028609421 tempest-NetworksTest-2028609421-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 6749 microversion: 2.1 time: 0.365511 May 10 02:20:55.614213 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1348/2593] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:20:55 2022] GET /compute/v2.1/os-networks => generated 6749 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:55.631365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:55.638306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:55.653561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:55.654471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:55.655338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:55.656138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:55.810595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1013461241", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "bfa6e650-d94d-4136-8719-4f6b07e31b2a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:55.880437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] validate_networks() for [('bfa6e650-d94d-4136-8719-4f6b07e31b2a', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:55.991830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:55.999835 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-317fa77e-875d-4a34-aedc-eb8549d254c8 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.374750 May 10 02:20:56.004504 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1349/2594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:55 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:56.262334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:56.263387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:56.271937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.272716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.273760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.274443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.364334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:56.364782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:56.365235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:56.365650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:56.366073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:56.384987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.385476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.386330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.389089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.419802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Getting quotas for project aff68662ee834e1bbdfc9274d2ba5491. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:56.427631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Getting quotas for user 3ad7286e0a784f24986aa051cbd29cd0 and project aff68662ee834e1bbdfc9274d2ba5491. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:56.443689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:56.446930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:56.458263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:56.469871 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8e64ddb6-020f-45cf-972a-9c71abe66299 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1503 microversion: 2.1 time: 0.211143 May 10 02:20:56.470488 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1350/2595] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:56 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:20:56.498604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:56.499814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:56.524150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.525858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.528546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.529025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.580271 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4682bf8-4e84-4858-857b-c8d5e35c5884 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974835 May 10 02:20:56.581220 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1246/2596] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:20:56.599979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1383618763"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:56.601811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:56.624464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.625284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:56.626466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:56.627132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:57.242205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.network.security_group_api [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Adding security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 to port 0628eb83-1eea-4c13-8e62-e5ca779664ca May 10 02:20:57.316875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:57.331941 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aea59353-f122-4aac-ac1d-e617efbd952a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.845018 May 10 02:20:57.332544 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1351/2597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:56 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:57.337130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:57.337801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:57.353896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:57.354360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:57.355186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:57.361021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:57.512713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:57.520676 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-23efadc5-2dfa-454e-84e0-379cdf74c7a5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1224 microversion: 2.1 time: 0.187044 May 10 02:20:57.538086 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1352/2598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:57 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:57.544402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:57.545178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:57.552481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:57.553159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:57.554154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:57.554800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:57.918192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:57.930411 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc42ea15-5afa-4c2d-9135-37683ee4c440 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.390552 May 10 02:20:57.930950 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1353/2599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:57 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:58.131354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd4a7583-ba89-48e7-9a6c-db6704925960 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca/action" status: 202 len: 0 microversion: 2.1 time: 1.548795 May 10 02:20:58.134914 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1247/2600] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:56 2022] POST /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca/action => generated 0 bytes in 1550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:58.140343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-256836f3-3396-4272-868e-f2ac79ac376d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d361bd4c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:58.375569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-256836f3-3396-4272-868e-f2ac79ac376d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use.", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:20:58.376483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-256836f3-3396-4272-868e-f2ac79ac376d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.376483 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-256836f3-3396-4272-868e-f2ac79ac376d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8 HTTP/1.1 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: exception: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2daf552a-5e54-495c-b7a6-a8c0222ea2f8'} May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:20:58.378738 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-256836f3-3396-4272-868e-f2ac79ac376d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 400 to user: Security Group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 in use. May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-36763c73-1a9c-4c5c-87c6-41ec1a7332e4'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-256836f3-3396-4272-868e-f2ac79ac376d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8" status: 400 len: 185 microversion: 2.1 time: 0.244632 May 10 02:20:58.381894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1248/2601] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:20:58 2022] DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8 => generated 185 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:20:58.389752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ea2927d8-fde4-4ea6-ba61-7fb6fd2a4520 req-d2dfb310-91c5-4f36-a6e3-863f9affe675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee8eecd-3d75-4867-889a-05da5e8755ca", "tag": "0628eb83-1eea-4c13-8e62-e5ca779664ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:58.406892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ea2927d8-fde4-4ea6-ba61-7fb6fd2a4520 req-d2dfb310-91c5-4f36-a6e3-863f9affe675 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:58.407242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ea2927d8-fde4-4ea6-ba61-7fb6fd2a4520 req-d2dfb310-91c5-4f36-a6e3-863f9affe675 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:58.437017 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ea2927d8-fde4-4ea6-ba61-7fb6fd2a4520 req-d2dfb310-91c5-4f36-a6e3-863f9affe675 service nova] Creating event network-changed:0628eb83-1eea-4c13-8e62-e5ca779664ca for instance 0ee8eecd-3d75-4867-889a-05da5e8755ca on n-h1-841089-2 May 10 02:20:58.447966 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ea2927d8-fde4-4ea6-ba61-7fb6fd2a4520 req-d2dfb310-91c5-4f36-a6e3-863f9affe675 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062043 May 10 02:20:58.449075 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1249/2602] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:20:58.457961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:58.466483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:58.473667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1766845054", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "f68d8830-2b07-4e10-861f-42f50aa74911"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:58.489710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:58.490170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:58.490968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:58.494506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:58.575524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] validate_networks() for [('f68d8830-2b07-4e10-861f-42f50aa74911', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:20:59.123115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:59.134633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a7c9468b-8716-4c81-8646-e04fcea631b2 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1486 microversion: 2.1 time: 0.683945 May 10 02:20:59.136109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1250/2603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:58 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1486 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:59.147588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:59.152809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:59.162946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.166657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.167832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.168509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.324367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0671384e-2fab-4fed-b0ff-8a8f4a968a25 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca/action" status: 202 len: 0 microversion: 2.1 time: 0.186192 May 10 02:20:59.325173 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1251/2604] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:59 2022] POST /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:20:59.347880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:59.356131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:59.373167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.373878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.375409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.376196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.515835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:59.525446 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-073163c8-1d64-4acb-bf64-7920b71e4c0b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1286 microversion: 2.1 time: 0.195800 May 10 02:20:59.526033 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1252/2605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:59 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:59.539627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:20:59.540243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:59.559338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.559802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.560590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.561013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.861544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:20:59.862092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:20:59.862672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:20:59.863119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:20:59.863547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:20:59.875202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.875896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.876913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.877538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.898228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:20:59.905727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for user 81137d6fb1bc4f75a706134b0c13ce63 and project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:20:59.906567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:20:59.919353 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de973748-171f-4e01-a2e5-1ba53f26bf11 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.381770 May 10 02:20:59.922655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:20:59.926601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:20:59.931771 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1253/2606] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:20:59 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:20:59.939029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:20:59.943200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:20:59.958517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.960308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:20:59.963282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:20:59.963873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.041008 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1ac269e3-f9d9-495d-a1ab-4e87247434f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.102839 May 10 02:21:00.056315 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1354/2607] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:21:00.075880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:00.077015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:00.098914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.099411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.100205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.100816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.118715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-31469e68-295b-4bbb-a48d-112836b34158 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "POST /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb/action" status: 202 len: 0 microversion: 2.1 time: 0.183211 May 10 02:21:00.119609 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1254/2608] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:20:59 2022] POST /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:00.135978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c130b07a-f8c1-4d4c-bfd6-af6eaf4414f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:00.140297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c130b07a-f8c1-4d4c-bfd6-af6eaf4414f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:00.311197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c130b07a-f8c1-4d4c-bfd6-af6eaf4414f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:00.325559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c130b07a-f8c1-4d4c-bfd6-af6eaf4414f8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1208 microversion: 2.1 time: 0.201978 May 10 02:21:00.326150 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1255/2609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:00 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1208 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:00.341743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:00.346088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:00.355518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.356057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.357377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.371600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.709540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:00.720252 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6839a463-2e84-43a9-b27d-4d5476def322 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1574 microversion: 2.1 time: 0.662244 May 10 02:21:00.721231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1355/2610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:00 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1574 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:00.742680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:00.752998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:00.765763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.766244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.767403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.768064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.819941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:00.827934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a93d2646-30a7-42ab-b6f3-159123361f5c tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1494 microversion: 2.1 time: 0.495471 May 10 02:21:00.839960 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1256/2611] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:00 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1494 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:00.936376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:00.937354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:00.944730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.945500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:00.946576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:00.947287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:01.267573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:01.276214 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55317379-2eda-4979-a689-e9226c555476 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.553890 May 10 02:21:01.294512 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1356/2612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:00 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:01.314370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:01.322469 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e471e332-b76f-47d3-a231-1208afb07988 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.389841 May 10 02:21:01.324338 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1257/2613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:00 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:01.343225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:01.343862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:01.357678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:01.358152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:01.363098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:01.363578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:01.533223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:01.546834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2e13f86-3de1-48ae-813c-62850b59baae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1260 microversion: 2.1 time: 0.207584 May 10 02:21:01.548943 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1357/2614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:01 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:01.606545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1203137973", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:01.658213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:01.739546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:01.740398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:01.748021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:01.748755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:01.750006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:01.750650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.113959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:02.128250 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ca35d51-227f-4991-92b2-76db466db273 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1574 microversion: 2.1 time: 0.393814 May 10 02:21:02.129762 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1358/2615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:01 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1574 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:02.134748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:02.135654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:02.144146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:02.148560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.149866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:02.151646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.171572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:02.172005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:02.172486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:02.172905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:02.173686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:02.188601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:02.189063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.189906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:02.190354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.227875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:02.233840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:02.246910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:02.249072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:02.314864 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8dd73fd-f582-4279-a3de-e6fc0bf73883 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893603 May 10 02:21:02.317278 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1258/2616] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:21:02.324346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:02.324974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:02.354876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:02.355518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.358063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:02.358519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:02.492663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:02.503928 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-97977999-29d4-4b40-9ea3-0127049a5f46 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1494 microversion: 2.1 time: 0.372895 May 10 02:21:02.509916 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1359/2617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:02 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1494 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:02.530362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86fdee66-2cd8-42fd-a2b2-7c649a40a0de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:02.531518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-86fdee66-2cd8-42fd-a2b2-7c649a40a0de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:03.098905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-86fdee66-2cd8-42fd-a2b2-7c649a40a0de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:03.111187 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86fdee66-2cd8-42fd-a2b2-7c649a40a0de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1217 microversion: 2.1 time: 0.599878 May 10 02:21:03.123302 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1360/2618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:02 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1217 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:03.130362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:03.131343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:03.138394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.138856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.141672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.142582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.255388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:03.264948 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-970c345e-65d3-4b83-aa93-b3ee7edb7fa8 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.946568 May 10 02:21:03.265809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1259/2619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:02 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:03.396300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:03.431988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-794e1f31-915b-4842-9f11-8b57882c524f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Action: 'create', calling method: .version_select at 0x7f3d36686a60>, body: {"keypair": {"name": "tempest-keypair-1898453497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwtfVbRHBxraR2QvpcQR0PvH5emedMV3zNFISD1Z/AxXjNNtoAFq7z/pkGUzzX51woJSRT99t++nvHXtg+KG/lO5nvHy3atVyo9/pubACPFhQamTGnblTf8Id6OWF6gkQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:03.439736 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ef45e9f-4a2a-49f1-b377-17c95357384b tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.312201 May 10 02:21:03.442633 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1361/2620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:03 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:03.459215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:03.460374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:03.473876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-794e1f31-915b-4842-9f11-8b57882c524f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Getting quotas for project bddc907860574bf4973e53c83feafecd. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:03.476496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.479001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.480246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.482146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.500911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-794e1f31-915b-4842-9f11-8b57882c524f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Getting quotas for user 59d4842db6fb424788c7c7e38ee8e474 and project bddc907860574bf4973e53c83feafecd. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:03.552328 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-794e1f31-915b-4842-9f11-8b57882c524f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.285153 May 10 02:21:03.553233 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1260/2621] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:21:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:03.562477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-32c4a1e8-4e89-4b25-ac1d-a915b5b6308c req-9fa656bc-94f0-4cd4-b53b-b84a3000381a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471d18d9-30f1-4ca1-af0e-41a0bf95beed", "name": "network-vif-plugged", "status": "completed", "tag": "12d59ff3-e839-4529-b220-b93722f8747b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:03.591128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-32c4a1e8-4e89-4b25-ac1d-a915b5b6308c req-9fa656bc-94f0-4cd4-b53b-b84a3000381a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.594257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-32c4a1e8-4e89-4b25-ac1d-a915b5b6308c req-9fa656bc-94f0-4cd4-b53b-b84a3000381a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.624863 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-32c4a1e8-4e89-4b25-ac1d-a915b5b6308c req-9fa656bc-94f0-4cd4-b53b-b84a3000381a service nova] Creating event network-vif-plugged:12d59ff3-e839-4529-b220-b93722f8747b for instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed on n-h1-841089-2 May 10 02:21:03.642859 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-32c4a1e8-4e89-4b25-ac1d-a915b5b6308c req-9fa656bc-94f0-4cd4-b53b-b84a3000381a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087490 May 10 02:21:03.643738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1261/2622] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:03.650437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ff654375-de32-40f4-bdb4-509113233eac req-8c728f0e-34ec-47c9-aaf1-5136a31d1a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c61b83-d483-4b66-80b8-9be86abdea13", "tag": "75ee04d3-e055-42ce-ad11-b24fd3cbadf9"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:03.676155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff654375-de32-40f4-bdb4-509113233eac req-8c728f0e-34ec-47c9-aaf1-5136a31d1a48 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.676813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff654375-de32-40f4-bdb4-509113233eac req-8c728f0e-34ec-47c9-aaf1-5136a31d1a48 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.700159 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ff654375-de32-40f4-bdb4-509113233eac req-8c728f0e-34ec-47c9-aaf1-5136a31d1a48 service nova] Creating event network-changed:75ee04d3-e055-42ce-ad11-b24fd3cbadf9 for instance 26c61b83-d483-4b66-80b8-9be86abdea13 on n-h2-841089-2 May 10 02:21:03.708896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:03.714339 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ff654375-de32-40f4-bdb4-509113233eac req-8c728f0e-34ec-47c9-aaf1-5136a31d1a48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068998 May 10 02:21:03.714959 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1262/2623] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:03.721375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e657c551-5ecc-4289-a1bc-a0f156305f6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1266 microversion: 2.1 time: 0.275831 May 10 02:21:03.724979 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1362/2624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:03 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:03.729255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:03.732627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:03.742779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.745312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.748335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.748964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.758250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:03.759010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:03.766636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.767204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:03.769688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:03.770193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.240567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:04.251559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-df4d7192-d866-4354-9071-ec950720b7e4 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1574 microversion: 2.1 time: 0.533154 May 10 02:21:04.252161 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1263/2625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:03 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1574 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:04.262948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:04.263558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:04.282351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.282787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.288247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.288989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.346154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:04.362881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54183d2c-7c6b-497f-9a41-1ad438922c04 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1500 microversion: 2.1 time: 0.635134 May 10 02:21:04.363524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1363/2626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:03 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1500 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:04.376084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:04.376959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:04.394656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.395527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.396543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.397174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.411882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:04.426848 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2c04e03-779c-44c6-b88d-8ebf2999cf76 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1277 microversion: 2.1 time: 0.173487 May 10 02:21:04.428090 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1264/2627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:04 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:04.432932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:04.437393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:04.456316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.457454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.458468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.459903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.508586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:04.709495 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b357ab94-e7da-458e-87a1-84553c0c7230 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "DELETE /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 204 len: 0 microversion: 2.1 time: 0.279196 May 10 02:21:04.715861 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1265/2628] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:04 2022] DELETE /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:04.736825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:04.738203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:04.758291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.759836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.763632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.764142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.832377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:04.840422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf8609a3-bcb2-42a9-b970-bfd9fe6056b5 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.468177 May 10 02:21:04.843576 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1364/2629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:04 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:04.851365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:04.852020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:04.868070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.868522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:04.869507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:04.869762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.213872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:05.223689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-885b9f2c-05a8-4128-81a3-4f97f96f1e91 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.505296 May 10 02:21:05.224297 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1266/2630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:04 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:05.236490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:05.245474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:05.255374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.256045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.257204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.257616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.312683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:05.320465 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ebc23d7-d8a1-469e-9c92-2550c5a3e5b6 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.475795 May 10 02:21:05.321067 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1365/2631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:04 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:05.325563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:05.326184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:05.339830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.340240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.341257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.341916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.541880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:05.550940 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb8845ed-91fe-4d83-8545-475468acce39 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.318111 May 10 02:21:05.551895 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1267/2632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:05 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:05.569272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:05.570149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:05.576407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.577168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.578180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.578830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.679742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:05.683435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:05.693225 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b6d66d43-73a1-4bf9-88d8-5445c523cc00 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1275 microversion: 2.1 time: 0.129118 May 10 02:21:05.702890 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1268/2633] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:05 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:05.704101 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e27ebb64-6d5e-43e7-a836-b066b9be344d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1572 microversion: 2.1 time: 0.381748 May 10 02:21:05.704585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1366/2634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:05 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1572 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:05.721918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1370439761"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:05.722460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:05.730027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.730482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.731296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.731771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.864560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:05.878437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:05.896312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.897110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.898133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:05.898781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:05.917333 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.network.security_group_api [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Adding security group d37637f4-da9e-4169-91b3-4b85e159e48a to port 0628eb83-1eea-4c13-8e62-e5ca779664ca May 10 02:21:06.192665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:06.204754 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26363838-4678-4559-a6ac-4bbcc0e594d4 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.348335 May 10 02:21:06.213919 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1367/2635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:05 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:06.241706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:06.242341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:06.250668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.251416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.252441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.253072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.477029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:06.485678 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab75adbf-988c-4ef4-86aa-946aab66a413 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.248690 May 10 02:21:06.496728 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1368/2636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:06 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:06.501908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:06.502926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:06.514405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.518837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.520061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.520624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.526841 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7426480a-fe51-451b-ab9c-56093cf0a088 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca/action" status: 202 len: 0 microversion: 2.1 time: 0.809229 May 10 02:21:06.527997 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1269/2637] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:21:05 2022] POST /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:06.536750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e4278704-d968-46d2-9427-fcd11b8db78b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36ffd430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:06.735176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:06.735916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-e4278704-d968-46d2-9427-fcd11b8db78b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use.", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:06.736754 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e4278704-d968-46d2-9427-fcd11b8db78b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.736754 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e4278704-d968-46d2-9427-fcd11b8db78b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a HTTP/1.1 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: exception: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd37637f4-da9e-4169-91b3-4b85e159e48a'} May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:06.738825 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e4278704-d968-46d2-9427-fcd11b8db78b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 400 to user: Security Group d37637f4-da9e-4169-91b3-4b85e159e48a in use. May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-c65e0be2-10c6-45bd-a48c-5ebdb7836c91'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:06.741847 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e4278704-d968-46d2-9427-fcd11b8db78b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a" status: 400 len: 185 microversion: 2.1 time: 0.208489 May 10 02:21:06.743959 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1708f76b-dbff-4132-a1ff-6d1614b96c10 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.245053 May 10 02:21:06.744916 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1270/2638] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:06 2022] DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a => generated 185 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:21:06.749705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0159d662-ec2b-46b4-839f-58de8df7b390 req-5ab81e4b-ceaa-48e4-8167-23a603826c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee8eecd-3d75-4867-889a-05da5e8755ca", "tag": "0628eb83-1eea-4c13-8e62-e5ca779664ca"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:06.752685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1369/2639] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:06 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:06.757698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:06.758397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:06.759214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0159d662-ec2b-46b4-839f-58de8df7b390 req-5ab81e4b-ceaa-48e4-8167-23a603826c63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.759675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0159d662-ec2b-46b4-839f-58de8df7b390 req-5ab81e4b-ceaa-48e4-8167-23a603826c63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.765528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.766134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.766973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.767545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.770664 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0159d662-ec2b-46b4-839f-58de8df7b390 req-5ab81e4b-ceaa-48e4-8167-23a603826c63 service nova] Creating event network-changed:0628eb83-1eea-4c13-8e62-e5ca779664ca for instance 0ee8eecd-3d75-4867-889a-05da5e8755ca on n-h1-841089-2 May 10 02:21:06.776026 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0159d662-ec2b-46b4-839f-58de8df7b390 req-5ab81e4b-ceaa-48e4-8167-23a603826c63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029793 May 10 02:21:06.776620 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1271/2640] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:06.784432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-822141428", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "91efaa3a-5a89-43e1-9535-a0d9e4bafa52"}], "security_groups": [{"name": "tempest-securitygroup--1361811884"}], "key_name": "tempest-keypair-1898453497", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:06.920339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] validate_networks() for [('91efaa3a-5a89-43e1-9535-a0d9e4bafa52', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:06.945481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:06.953420 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ffa125c2-530a-43bb-85de-a342d4f236ca tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.199431 May 10 02:21:06.954012 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1370/2641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:06 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:06.959050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:06.960097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:06.966045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.966507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:06.967315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:06.967764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.037338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:07.045430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-160f4598-17b8-466e-9a69-40afb3c9d6a8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1275 microversion: 2.1 time: 0.090377 May 10 02:21:07.055261 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1371/2642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:06 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:07.059873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.060771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.067160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.067855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.068405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.068850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.095287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:07.181147 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12f04f30-4d86-4009-b48e-76dda9a0355e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 204 len: 0 microversion: 2.1 time: 0.124647 May 10 02:21:07.182156 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1372/2643] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:07 2022] DELETE /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:07.191017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.191787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.198570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.199514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.200308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.200749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.456168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:07.465001 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9b0b5a4b-7792-47e6-a6d0-39cf62bd1784 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1647 microversion: 2.1 time: 0.279000 May 10 02:21:07.465933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Getting quotas for project bddc907860574bf4973e53c83feafecd. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:07.471614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Getting quotas for user 59d4842db6fb424788c7c7e38ee8e474 and project bddc907860574bf4973e53c83feafecd. Resources: dict_keys(['metadata_items']) {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:07.474923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1373/2644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:07 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1647 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:07.481220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.482157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.485010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:07.485729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:07.486324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:07.487442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:07.488002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:07.489546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.490063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.490852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.491326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.496504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.496958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.497769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.498291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.515632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Getting quotas for project bddc907860574bf4973e53c83feafecd. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:07.520977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Getting quotas for user 59d4842db6fb424788c7c7e38ee8e474 and project bddc907860574bf4973e53c83feafecd. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:07.533616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:07.536111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:07.602158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0779d36-4854-4211-b529-c8f483026d79 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.823483 May 10 02:21:07.607788 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1272/2645] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:21:07.617161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.617794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.643910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.644638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.645654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.646314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.747346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:07.756064 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4ecd75fc-b541-449f-b22b-71b2fb0052b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.279758 May 10 02:21:07.759192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1374/2646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:07 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:07.769226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9263081e-308c-4d3e-9d57-53f2fb8047ab tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.772392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9263081e-308c-4d3e-9d57-53f2fb8047ab tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.857385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:07.868545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bae37353-a6f6-462b-85c2-1d03e4e703d2 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1317 microversion: 2.1 time: 0.262380 May 10 02:21:07.869915 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1273/2647] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:07 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:07.884666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.886237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.894908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.895641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.896769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.897225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.936668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9263081e-308c-4d3e-9d57-53f2fb8047ab tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:07.948890 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9263081e-308c-4d3e-9d57-53f2fb8047ab tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1277 microversion: 2.1 time: 0.187850 May 10 02:21:07.949971 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1375/2648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:07 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:07.969949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:07.973310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:07.982207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.982685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:07.985379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:07.986036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.347737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:08.363247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:08.363622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b13beb11-9daa-45bb-9165-1e972fd7cb7f tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.491781 May 10 02:21:08.373194 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1cad4c4e-219e-4cfb-abe0-968b233b8f62 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.407135 May 10 02:21:08.373508 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1274/2649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:07 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:08.374397 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1376/2650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:07 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:08.379397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:08.380163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:08.391433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.392173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.397994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.398666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.482123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:08.483014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:08.489770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.490451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.491448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.492079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.529038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:08.536652 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5454c6d-b5dd-452f-8cd6-ee707ac4158f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1275 microversion: 2.1 time: 0.161725 May 10 02:21:08.537542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1275/2651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:08 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:08.724413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:08.740701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-022cafd7-556f-42eb-a1eb-f15bbb470cac tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1647 microversion: 2.1 time: 0.261865 May 10 02:21:08.744156 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1377/2652] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:08 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1647 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:08.777170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:08.778068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:08.793456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.796617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.803085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.803774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.889762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:08.892271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:08.918520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.919375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:08.922205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:08.925463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.415540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:09.426675 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-111b4423-11c8-41dc-880f-34c258a6484b tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.654214 May 10 02:21:09.427558 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1276/2653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:08 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:09.433369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-dab6b3a1-f8cd-4ffc-9878-a3f253cf5f3b req-0fb24996-920c-4a5d-8fb1-9b84802a35e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c61b83-d483-4b66-80b8-9be86abdea13", "name": "network-vif-plugged", "status": "completed", "tag": "75ee04d3-e055-42ce-ad11-b24fd3cbadf9"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:09.436048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:09.442827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-dab6b3a1-f8cd-4ffc-9878-a3f253cf5f3b req-0fb24996-920c-4a5d-8fb1-9b84802a35e6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.443317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-dab6b3a1-f8cd-4ffc-9878-a3f253cf5f3b req-0fb24996-920c-4a5d-8fb1-9b84802a35e6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.445422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4693b7f-96e1-439d-aa43-fcf0658566da tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1506 microversion: 2.1 time: 0.562926 May 10 02:21:09.446455 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1378/2654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:08 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:09.451446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:09.452219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:09.458770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.459462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.460392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.461147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.470874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-dab6b3a1-f8cd-4ffc-9878-a3f253cf5f3b req-0fb24996-920c-4a5d-8fb1-9b84802a35e6 service nova] Creating event network-vif-plugged:75ee04d3-e055-42ce-ad11-b24fd3cbadf9 for instance 26c61b83-d483-4b66-80b8-9be86abdea13 on n-h2-841089-2 May 10 02:21:09.476519 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-dab6b3a1-f8cd-4ffc-9878-a3f253cf5f3b req-0fb24996-920c-4a5d-8fb1-9b84802a35e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047433 May 10 02:21:09.477278 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1277/2655] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:09.487419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:09.488289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:09.495854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.497105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.498019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.498586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.594691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:09.602405 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ea48e71-5c05-457a-95ba-e1a9d9daf721 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1335 microversion: 2.1 time: 0.154646 May 10 02:21:09.604174 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1379/2656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:09 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1335 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:09.609028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:09.609787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:09.616594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.617119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:09.617958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:09.618591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.130417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:10.151826 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7779bbbf-8819-49b0-80e2-b511ec1b4717 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 200 len: 1506 microversion: 2.1 time: 0.669128 May 10 02:21:10.155036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1278/2657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:09 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:10.180279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.181652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:10.189605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.190470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.192651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.193924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.242740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:10.255635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7280b47e-b871-404e-8724-3f78b73b1454 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.650015 May 10 02:21:10.259572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1380/2658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:09 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:10.273458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.274368 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a8e2fe82-266d-4c2d-9eb1-361f26a8c97a tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed/ips" status: 200 len: 109 microversion: 2.1 time: 0.114365 May 10 02:21:10.274683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:10.287479 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1279/2659] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed/ips => generated 109 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:10.288511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.289309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.290646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.291451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.293294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.293852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:10.313105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.313583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.314404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.314915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.362231 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20e80094-1888-4af1-a385-085a5f38d6f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/ips" status: 200 len: 151 microversion: 2.20 time: 0.073013 May 10 02:21:10.363441 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1280/2660] 10.222.0.52 () {60 vars in 1288 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:21:10.375160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.375824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:10.383712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.385009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.386096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.387623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.847430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:10.857220 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2db03088-ce28-45ed-9ff4-e26e7121bdc7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.596250 May 10 02:21:10.876448 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1381/2661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:10.881657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7cf637f4-b018-4ff9-afea-dc30c439757a req-f1b7fd0c-2576-43fa-b8cf-2b54fec83d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d59b3116-5ef4-4ade-8cb5-ef09f7266e62", "tag": "3d1b417a-ac60-4fdf-941e-c10591fd83e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:10.890374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7cf637f4-b018-4ff9-afea-dc30c439757a req-f1b7fd0c-2576-43fa-b8cf-2b54fec83d5b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.891297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7cf637f4-b018-4ff9-afea-dc30c439757a req-f1b7fd0c-2576-43fa-b8cf-2b54fec83d5b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.904324 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7cf637f4-b018-4ff9-afea-dc30c439757a req-f1b7fd0c-2576-43fa-b8cf-2b54fec83d5b service nova] Creating event network-changed:3d1b417a-ac60-4fdf-941e-c10591fd83e3 for instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 on n-h1-841089-2 May 10 02:21:10.910301 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7cf637f4-b018-4ff9-afea-dc30c439757a req-f1b7fd0c-2576-43fa-b8cf-2b54fec83d5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 May 10 02:21:10.911537 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1382/2662] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:10.917985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.919091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:10.927406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.928016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.929107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.929714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.957183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:10.958391 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09943806-db4d-46f5-b5e5-3f80a5913394 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed/ips" status: 200 len: 109 microversion: 2.1 time: 0.045416 May 10 02:21:10.958993 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1383/2663] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed/ips => generated 109 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:10.963825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.964631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:10.968705 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-174362c9-d879-4272-9729-25d880bf995b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1647 microversion: 2.1 time: 0.602129 May 10 02:21:10.970752 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1281/2664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1647 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:10.984105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.984797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.985248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:10.985931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:10.986591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:10.986762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:11.003433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:11.008864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:11.011632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:11.013739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:11.777282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:11.793918 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9922bdc7-f9cf-4f38-8330-91ef23de0d91 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.819353 May 10 02:21:11.795127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1282/2665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:11.803246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3456ee2b-81e5-4829-88b4-108caf108418 req-2e4b8dd6-b6e1-4b0b-9171-14b5d2204fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f1fc9f-2151-4704-9c5b-288d3f334feb", "name": "network-vif-deleted", "tag": "85cfb217-b5a3-4a30-9e60-b226c9e86a51"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:11.852097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3456ee2b-81e5-4829-88b4-108caf108418 req-2e4b8dd6-b6e1-4b0b-9171-14b5d2204fbf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:11.852573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3456ee2b-81e5-4829-88b4-108caf108418 req-2e4b8dd6-b6e1-4b0b-9171-14b5d2204fbf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:11.884419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:11.896149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63305897-68c9-4703-8685-4ad32d256010 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1328 microversion: 2.1 time: 0.935854 May 10 02:21:11.897045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1384/2666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:10 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1328 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:11.905679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:11.906444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:11.926256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:11.927001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:11.930531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:11.931429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:11.931788 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3456ee2b-81e5-4829-88b4-108caf108418 req-2e4b8dd6-b6e1-4b0b-9171-14b5d2204fbf service nova] Creating event network-vif-deleted:85cfb217-b5a3-4a30-9e60-b226c9e86a51 for instance 04f1fc9f-2151-4704-9c5b-288d3f334feb on n-h1-841089-2 May 10 02:21:11.951861 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3456ee2b-81e5-4829-88b4-108caf108418 req-2e4b8dd6-b6e1-4b0b-9171-14b5d2204fbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154627 May 10 02:21:11.958688 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1283/2667] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:11.970805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:11.981184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 04f1fc9f-2151-4704-9c5b-288d3f334feb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:11.985253 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86521fa3-f292-434d-99ab-1e8a69731145 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed/ips/tempest-ServerAddressesTestJSON-1750392536-network" status: 200 len: 94 microversion: 2.1 time: 0.086901 May 10 02:21:11.986393 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1385/2668] 10.222.0.52 () {58 vars in 1400 bytes} [Tue May 10 02:21:11 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed/ips/tempest-ServerAddressesTestJSON-1750392536-network => generated 94 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:21:11.992102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:11.992963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:11.994644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:11.995531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.000013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.000705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.001223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.001753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.002032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.002651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.023801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] HTTP exception thrown: Instance 04f1fc9f-2151-4704-9c5b-288d3f334feb could not be found. May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Request method failure captured: May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb HTTP/1.1 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecuWZwC6X7YR1CFYP4bLr5Tddhsw3CLf-to4EuTDpXynlcIThd4zby0FISZjN7cdkWGEoofvhXXABZWPxVmA5fSX-PbdxfKGH1iYW2TWJbpl0lZizon8TzPg0-hD7LGQh9sqlnjesSkx2goRrMk5clpqiET0cUiP_YCPvyfEg8c9PX0 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 32fe833856714629a13a779adad72d2e May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueTestJSON-2083588085 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_32fe833856714629a13a779adad72d2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32fe833856714629a13a779adad72d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/32fe833856714629a13a779adad72d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32fe833856714629a13a779adad72d2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueTestJSON-2083588085 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 32fe833856714629a13a779adad72d2e May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueTestJSON-2083588085 May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueTestJSON-2083588085-project May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c787058dc32b484b945c1bd80d3b34ea May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueTestJSON-2083588085-project May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 04f1fc9f-2151-4704-9c5b-288d3f334feb could not be found. May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '04f1fc9f-2151-4704-9c5b-288d3f334feb'} May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f1fc9f-2151-4704-9c5b-288d3f334feb could not be found. May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f1fc9f-2151-4704-9c5b-288d3f334feb could not be found. May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:12.032659 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f1fc9f-2151-4704-9c5b-288d3f334feb could not be found. May 10 02:21:12.037786 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:12.038541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Returning 404 to user: Instance 04f1fc9f-2151-4704-9c5b-288d3f334feb could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:12.038927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d41b26e2-42d6-49ce-9597-a55e6c8a6945 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb" status: 404 len: 111 microversion: 2.1 time: 0.078921 May 10 02:21:12.043570 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1284/2669] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:11 2022] GET /compute/v2.1/servers/04f1fc9f-2151-4704-9c5b-288d3f334feb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:12.064908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:12.065548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:12.077580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.078279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.079164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.079610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.195084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:12.208046 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d00f314-2375-4b27-bbbc-909c39646098 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.220168 May 10 02:21:12.214021 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1386/2670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:11 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:12.219598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:12.224914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:12.239935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.240508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.241411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.245095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.378190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:12.387423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65237118-220d-4914-9916-ddabf9a7e0d5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1467 microversion: 2.1 time: 0.172165 May 10 02:21:12.400640 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1387/2671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:12 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1467 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:12.407170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:12.408016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:12.421728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.423626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.426099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.426778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.450048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:12.459866 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5b24943b-db0f-4ac1-9138-b444651fc0ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.412551 May 10 02:21:12.460760 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1285/2672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:12 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:12.468634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:12.469139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:12.470687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:12.476288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.476740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.477545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.477984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.556586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:12.597987 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d98ebc8-04ba-439b-babd-7ff243f5f019 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "DELETE /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 204 len: 0 microversion: 2.1 time: 0.202790 May 10 02:21:12.599371 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1388/2673] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:12 2022] DELETE /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:12.619271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:12.620215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:12.627317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.628405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.630270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.630803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.731490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6930d70d-ab00-467c-9da1-ba01ea222319 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 204 len: 0 microversion: 2.1 time: 0.267316 May 10 02:21:12.737250 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1286/2674] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:12 2022] DELETE /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:12.743611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:12.744378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:12.751341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.752169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.753872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:12.754594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:12.993510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.001226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e81fc13-d26e-456b-80e6-e7d65c4f55f1 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1512 microversion: 2.1 time: 0.386580 May 10 02:21:13.011099 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1389/2675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:12 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.011099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.011099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.013674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.014121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.015026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.015533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.025432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.033242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb458ae9-713d-4a01-b9b2-b5a2b9dabd53 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1493 microversion: 2.1 time: 0.294468 May 10 02:21:13.033846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1287/2676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:12 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1493 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.038232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.038846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.045016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.045475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.046252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.046693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.210121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.216901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.217713 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b271f5db-6f13-4bb2-8f17-f7d7da468647 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.213821 May 10 02:21:13.218519 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1390/2677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.224230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-44542876-4a63-4e4e-bb49-e211aef7706f req-b047be96-8de9-405f-8d60-a10ef10d6653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee8eecd-3d75-4867-889a-05da5e8755ca", "name": "network-vif-deleted", "tag": "0628eb83-1eea-4c13-8e62-e5ca779664ca"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:13.226690 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fef82c19-ef9d-402e-83e1-8eaa1447f17a tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1527 microversion: 2.1 time: 0.191806 May 10 02:21:13.227394 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1288/2678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1527 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.232259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.232382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-44542876-4a63-4e4e-bb49-e211aef7706f req-b047be96-8de9-405f-8d60-a10ef10d6653 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.232808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-44542876-4a63-4e4e-bb49-e211aef7706f req-b047be96-8de9-405f-8d60-a10ef10d6653 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.232924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.239980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.240433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.241237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.241680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.246073 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-44542876-4a63-4e4e-bb49-e211aef7706f req-b047be96-8de9-405f-8d60-a10ef10d6653 service nova] Creating event network-vif-deleted:0628eb83-1eea-4c13-8e62-e5ca779664ca for instance 0ee8eecd-3d75-4867-889a-05da5e8755ca on n-h1-841089-2 May 10 02:21:13.250873 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-44542876-4a63-4e4e-bb49-e211aef7706f req-b047be96-8de9-405f-8d60-a10ef10d6653 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030795 May 10 02:21:13.251505 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1391/2679] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:13.256441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.257146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.263135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.263595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.264369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.264814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.440633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.443592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.447971 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8109e53-edee-4376-be58-80e009738327 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.219620 May 10 02:21:13.448688 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1289/2680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.451155 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-142f0962-8aa8-4601-b70a-74ff4acfad5e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1527 microversion: 2.1 time: 0.198517 May 10 02:21:13.451866 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1392/2681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1527 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.453302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.453927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.460075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.460536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.461308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.461756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.523046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.530651 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4abd0fe-15f7-4819-9b66-01939f293b2b tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1300 microversion: 2.1 time: 0.080844 May 10 02:21:13.531260 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1290/2682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1300 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.536359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.536963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.542564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.543024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.543801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.544237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.571419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.571924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.577984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.578439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.579240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.579683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.593812 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] HTTP exception thrown: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Request method failure captured: May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 HTTP/1.1 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwHfby7BY5V5KY-pxcDo1KlqKLld6oafBeWY6DW3W3HaZhjfjdOFLvO308dQcNz1h0MwG_I-zel7rRGBgpCvpVQs2ys5CPgv81PK3wwuwGgYB4aQieUvXmTLCFEjDml2EEI23bQpheB2F75jVRYluhwnnqgpCbH8DP_9bLeQuf4xy8 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f472ac084f8f4dadb3466d69c5585500 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-844571309 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f472ac084f8f4dadb3466d69c5585500", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f472ac084f8f4dadb3466d69c5585500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f472ac084f8f4dadb3466d69c5585500"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f472ac084f8f4dadb3466d69c5585500"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-844571309 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f472ac084f8f4dadb3466d69c5585500 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-844571309 May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestMultiTenantJSON-844571309-project May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: e921f0363f8149a09d9881769b1582db May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-844571309-project May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '26c61b83-d483-4b66-80b8-9be86abdea13'} May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:13.595508 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Returning 404 to user: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:13.599803 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bfcf6d30-0c10-4b23-98a5-cbbc8b7f3181 tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 404 len: 111 microversion: 2.1 time: 0.134103 May 10 02:21:13.601152 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1393/2683] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:13 2022] DELETE /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:13.606869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.607519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.613450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.613904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.614672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.615133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.708801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.722886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1c23455-54f5-4478-9d48-c3e12b5db2ad tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.190560 May 10 02:21:13.723663 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1291/2684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:13.767684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:13.775652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aaad2999-14e2-4742-affd-ce3740385796 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1527 microversion: 2.1 time: 0.172530 May 10 02:21:13.776220 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1394/2685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:13.793661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Action: 'update', calling method: >, body: {"server": {"name": "26c61b83-d483-4b66-80b8-9be86abdea13_new"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:13.794910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.801271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.801728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.802532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.802956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.817644 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] HTTP exception thrown: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Request method failure captured: May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: request: PUT /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 HTTP/1.1 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 64 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwHfby7BY5V5KY-pxcDo1KlqKLld6oafBeWY6DW3W3HaZhjfjdOFLvO308dQcNz1h0MwG_I-zel7rRGBgpCvpVQs2ys5CPgv81PK3wwuwGgYB4aQieUvXmTLCFEjDml2EEI23bQpheB2F75jVRYluhwnnqgpCbH8DP_9bLeQuf4xy8 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f472ac084f8f4dadb3466d69c5585500 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-844571309 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f472ac084f8f4dadb3466d69c5585500", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f472ac084f8f4dadb3466d69c5585500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f472ac084f8f4dadb3466d69c5585500"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f472ac084f8f4dadb3466d69c5585500"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-844571309 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f472ac084f8f4dadb3466d69c5585500 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-844571309 May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestMultiTenantJSON-844571309-project May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: e921f0363f8149a09d9881769b1582db May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-844571309-project May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "26c61b83-d483-4b66-80b8-9be86abdea13_new"}} May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '26c61b83-d483-4b66-80b8-9be86abdea13', 'body': {'server': {'name': '26c61b83-d483-4b66-80b8-9be86abdea13_new'}}} May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:21:13.819446 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] Returning 404 to user: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e0f49bb9-fad5-4d68-9e9a-82c5d42bbd3e tempest-ServersNegativeTestMultiTenantJSON-844571309 tempest-ServersNegativeTestMultiTenantJSON-844571309-project] 10.222.0.52 "PUT /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 404 len: 111 microversion: 2.1 time: 0.031215 May 10 02:21:13.822779 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1292/2686] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:21:13 2022] PUT /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:13.830327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.831632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.840664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.840664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.841650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.843021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.870571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:13.944980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26de52d4-68c8-4876-a41e-8f9f7350539e tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 204 len: 0 microversion: 2.1 time: 0.118246 May 10 02:21:13.945570 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1395/2687] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:13 2022] DELETE /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:13.955043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:13.956316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:13.962928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.963417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.964217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.964648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:13.988558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3dfb0e52-6285-4964-b4e1-12823440d532 req-f4d54141-bd0f-4c3a-81f5-fd6311fcb1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f391397-d509-4342-b1fc-5864a0c80873", "tag": "441629e8-5491-45ab-9aa8-5227678dd069"}, {"name": "network-changed", "server_uuid": "6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9", "tag": "4d429704-892e-425f-8265-395b5d209a46"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:13.997939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3dfb0e52-6285-4964-b4e1-12823440d532 req-f4d54141-bd0f-4c3a-81f5-fd6311fcb1f6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:13.998565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3dfb0e52-6285-4964-b4e1-12823440d532 req-f4d54141-bd0f-4c3a-81f5-fd6311fcb1f6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.012358 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3dfb0e52-6285-4964-b4e1-12823440d532 req-f4d54141-bd0f-4c3a-81f5-fd6311fcb1f6 service nova] Creating event network-changed:441629e8-5491-45ab-9aa8-5227678dd069 for instance 4f391397-d509-4342-b1fc-5864a0c80873 on n-h1-841089-2 May 10 02:21:14.014413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3dfb0e52-6285-4964-b4e1-12823440d532 req-f4d54141-bd0f-4c3a-81f5-fd6311fcb1f6 service nova] Creating event network-changed:4d429704-892e-425f-8265-395b5d209a46 for instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 on n-h2-841089-2 May 10 02:21:14.021400 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3dfb0e52-6285-4964-b4e1-12823440d532 req-f4d54141-bd0f-4c3a-81f5-fd6311fcb1f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038076 May 10 02:21:14.022015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1396/2688] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:21:14.027013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.027825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.034388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.034850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.035671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.036114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.142005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:14.149490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bba4b9e8-3a66-438f-b55c-88c02be182a0 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1533 microversion: 2.1 time: 0.199615 May 10 02:21:14.150066 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1293/2689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:13 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1533 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:14.154772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.155442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.160994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.161451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.162220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.162660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.187881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:14.195929 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16f587f6-ccdd-4acf-bb0c-252663a1ddaf tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1512 microversion: 2.1 time: 0.172815 May 10 02:21:14.196514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1397/2690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:14.234271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.234902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.241594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.242055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.242844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.243316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.325960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:14.333349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c736d5ec-94fd-43d9-acda-17c98f40e46a tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1493 microversion: 2.1 time: 0.182313 May 10 02:21:14.333929 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1294/2691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1493 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:14.389303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:14.396633 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1e9c2e4-0534-46fe-a94d-800184fcff02 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.166280 May 10 02:21:14.397201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1398/2692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:14.465359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.465977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.472374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.472823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.473582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.474022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.506412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:14.507049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.513406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.513853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.514714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.515176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.539836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lazy-loading 'flavor' on Instance uuid 62292e53-bc84-4672-ad76-e3f6f50ffd67 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:21:14.626054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:14.634854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7bd00b72-aab9-441b-8ce8-cd592980bdae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.172690 May 10 02:21:14.645020 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1295/2693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:14.650036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.650651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.657441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.657898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.659233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.659676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.692851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.693536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.693986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lazy-loading 'fault' on Instance uuid 0ee8eecd-3d75-4867-889a-05da5e8755ca {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:21:14.817313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:14.827184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-333ad09c-e9be-4600-b030-90eee3c83800 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 200 len: 1305 microversion: 2.1 time: 0.180859 May 10 02:21:14.827825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1296/2694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 1305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:14.833554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.834192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.840160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.840615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.841582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.841897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.867843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b062629f-cdd1-4bb5-817e-9fb80ebcee9f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/action" status: 202 len: 0 microversion: 2.20 time: 0.365411 May 10 02:21:14.871106 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1399/2695] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:21:14 2022] POST /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 02:21:14.876957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:14.877699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:14.884798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.885268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:14.886064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:14.886502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.121651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.133023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-566367d6-0b30-4ce9-9122-84af6c83b8bb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.303828 May 10 02:21:15.144042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1297/2696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:15.168094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.169986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:15.170834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:15.178094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.178850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.179685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.180197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.180705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.183418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.186669 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a52e29f7-efb0-4940-80da-d703706aaa06 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.313716 May 10 02:21:15.188229 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1400/2697] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:14 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:15.213673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:15.214657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:15.222092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.222713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.223671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.224241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.562461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.570923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62365d01-9e62-4465-97a3-25786d84d3b9 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1533 microversion: 2.1 time: 0.405391 May 10 02:21:15.571538 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1298/2698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:15 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1533 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:15.576147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:15.576812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:15.582536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.582993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.583822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.584271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.646188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69fc8630e34fb1ad2d028016aa2a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22be97e937874f77bfe9b8eae4635798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.654399 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e224008-c82b-43e1-8c7a-4f0d563f6799 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 200 len: 1512 microversion: 2.1 time: 0.445543 May 10 02:21:15.654984 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1401/2699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:15 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:15.661247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:15.662384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:15.669185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.669649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.670441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.670886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.925990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.935702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-376e9de3-a3c2-48f9-ab4d-ebe25591da81 tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1493 microversion: 2.1 time: 0.362948 May 10 02:21:15.946053 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1299/2700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:15 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1493 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:15.946053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:15.946053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:15.950080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:15.958778 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f1bcb89-8e64-4a1b-9186-92829455ddae tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.302651 May 10 02:21:15.959790 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1402/2701] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:15 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:15.964790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:15.965656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:15.972948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.973945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.974801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.975311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.975977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.976610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:15.976844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.978525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:15.994139 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca HTTP/1.1 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '0ee8eecd-3d75-4867-889a-05da5e8755ca'} May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:15.995973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00c5cae3-f9cc-44b5-8e90-7089eb001b4a tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 404 len: 111 microversion: 2.1 time: 0.036437 May 10 02:21:15.999181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1403/2702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:15 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:16.006756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57428ec2-5c93-42f9-9c78-6de133c9d943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36493e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:16.329256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:16.340086 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ecdafd9-eb2e-48bb-bf04-54a77d76539d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.401342 May 10 02:21:16.340961 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1300/2703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:15 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:16.347569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:16.348192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:16.355752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.356211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.356994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.357517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.510799 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57428ec2-5c93-42f9-9c78-6de133c9d943 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8" status: 202 len: 0 microversion: 2.1 time: 0.508127 May 10 02:21:16.514645 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1404/2704] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:16 2022] DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:16.516567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-93c2708f-d389-4618-8460-d214cb832131 req-45acd818-cd4a-4cc2-b812-f33ee4287a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471d18d9-30f1-4ca1-af0e-41a0bf95beed", "name": "network-vif-deleted", "tag": "12d59ff3-e839-4529-b220-b93722f8747b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:16.526732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-93c2708f-d389-4618-8460-d214cb832131 req-45acd818-cd4a-4cc2-b812-f33ee4287a92 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.527348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-93c2708f-d389-4618-8460-d214cb832131 req-45acd818-cd4a-4cc2-b812-f33ee4287a92 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.539151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:16.547629 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-93c2708f-d389-4618-8460-d214cb832131 req-45acd818-cd4a-4cc2-b812-f33ee4287a92 service nova] Creating event network-vif-deleted:12d59ff3-e839-4529-b220-b93722f8747b for instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed on n-h1-841089-2 May 10 02:21:16.548999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f3161b96-52b7-4f0b-ac8b-d48eecd37231 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.206616 May 10 02:21:16.559574 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1301/2705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:16 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:16.562181 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-93c2708f-d389-4618-8460-d214cb832131 req-45acd818-cd4a-4cc2-b812-f33ee4287a92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048019 May 10 02:21:16.563837 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1405/2706] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:16.566641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:16.567445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:16.570922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1e32cee-b711-41c8-b5cb-d7852a960c39 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d364f8ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:16.574865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.575596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.576513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.577098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.817840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:16.826810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:16.828698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:16.830029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4636478e-390a-45f1-9cd4-371ce6289290 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.269080 May 10 02:21:16.830990 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1302/2707] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:16 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:16.845440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:16.846813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:16.853102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.853634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.854479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.854994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.869863 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1e32cee-b711-41c8-b5cb-d7852a960c39 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a" status: 202 len: 0 microversion: 2.1 time: 0.304459 May 10 02:21:16.871653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1406/2708] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:16 2022] DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:16.879359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:16.880496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] [instance: 471d18d9-30f1-4ca1-af0e-41a0bf95beed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:16.890381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.891246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.892605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.894421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.912913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] HTTP exception thrown: Instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed could not be found. May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Request method failure captured: May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed HTTP/1.1 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecv8R0iLCU4UYcpWp7N_XTanmgDy83qZ28X0GT7UnGobnBKuExPmFF8Dy2doIsZ42WJZaDyrr-1Rp3v7cD45zTn9Ie3XL1V7ERiuh6d5xJRRteuOWf1yHfBf8smvV7KzP3f49WC6DgjC3hi_CgkcLw_J7l7eG3ssF_vHi0k67sCzEBQ May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 22be97e937874f77bfe9b8eae4635798 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerAddressesTestJSON-1116605083 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_22be97e937874f77bfe9b8eae4635798", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22be97e937874f77bfe9b8eae4635798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/22be97e937874f77bfe9b8eae4635798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/22be97e937874f77bfe9b8eae4635798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerAddressesTestJSON-1116605083 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 22be97e937874f77bfe9b8eae4635798 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1116605083 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerAddressesTestJSON-1116605083-project May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 9c69fc8630e34fb1ad2d028016aa2a25 May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerAddressesTestJSON-1116605083-project May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed could not be found. May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '471d18d9-30f1-4ca1-af0e-41a0bf95beed'} May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed could not be found. May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed could not be found. May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:16.915017 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed could not be found. May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] Returning 404 to user: Instance 471d18d9-30f1-4ca1-af0e-41a0bf95beed could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d06bc92-176c-43a6-a177-d09c701a1e28 tempest-ServerAddressesTestJSON-1116605083 tempest-ServerAddressesTestJSON-1116605083-project] 10.222.0.52 "GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed" status: 404 len: 111 microversion: 2.1 time: 0.044292 May 10 02:21:16.918423 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1407/2709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:16 2022] GET /compute/v2.1/servers/471d18d9-30f1-4ca1-af0e-41a0bf95beed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:16.931730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0454d033-eac6-48dc-bf6c-d8c1840f910a req-e2f835ef-9edf-4c2f-9e18-16d9540f9270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d59b3116-5ef4-4ade-8cb5-ef09f7266e62", "name": "network-vif-plugged", "status": "completed", "tag": "3d1b417a-ac60-4fdf-941e-c10591fd83e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:16.944165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0454d033-eac6-48dc-bf6c-d8c1840f910a req-e2f835ef-9edf-4c2f-9e18-16d9540f9270 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:16.944617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0454d033-eac6-48dc-bf6c-d8c1840f910a req-e2f835ef-9edf-4c2f-9e18-16d9540f9270 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:16.960044 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0454d033-eac6-48dc-bf6c-d8c1840f910a req-e2f835ef-9edf-4c2f-9e18-16d9540f9270 service nova] Creating event network-vif-plugged:3d1b417a-ac60-4fdf-941e-c10591fd83e3 for instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 on n-h1-841089-2 May 10 02:21:16.967919 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0454d033-eac6-48dc-bf6c-d8c1840f910a req-e2f835ef-9edf-4c2f-9e18-16d9540f9270 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048737 May 10 02:21:16.968713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1408/2710] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:16.990090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae254d18-4147-42cd-a8b8-9d71b3765276 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'create', calling method: .version_select at 0x7f3d36493430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1838334354", "description": "tempest-description-1325819075"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:17.105202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:17.114881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68495eca-23a7-4f49-8349-ac3d9bdb5b78 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1533 microversion: 2.1 time: 0.282612 May 10 02:21:17.122347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1303/2711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:16 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1533 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:17.139889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:17.140824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:17.154832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:17.155574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:17.156368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:17.157033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:17.296420 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae254d18-4147-42cd-a8b8-9d71b3765276 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.324781 May 10 02:21:17.304783 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1409/2712] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:21:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:17.311974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:17.313235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:17.321162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:17.321736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:17.322736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:17.323441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:17.842442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:17.852166 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b673cee3-70e6-4bba-952c-0bd2ce60d03e tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1493 microversion: 2.1 time: 0.716313 May 10 02:21:17.853282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1304/2713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:17 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1493 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:17.866486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e74c7832-81b5-4199-9e05-eb3f7f0276e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Action: 'update', calling method: .version_select at 0x7f3d366aa940>, body: {"security_group": {"name": "tempest-sg-hth-770169650", "description": "tempest-description-hth-80724791"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:18.053329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:18.061820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9aa82589-026f-4c30-be69-ce5c6b1ce89d tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.754954 May 10 02:21:18.062348 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1410/2714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:17 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:18.067616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:18.068234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:18.074728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.075238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.076040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.076492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.419244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:18.433030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-491539a9-4d2a-4f3e-b606-79da65820688 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1308 microversion: 2.1 time: 0.366688 May 10 02:21:18.433030 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1411/2715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:18 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:18.444841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:18.445460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:18.453431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.453894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.454815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.455550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.464689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e74c7832-81b5-4199-9e05-eb3f7f0276e1 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/dc907d7a-a647-476d-9c1d-6037fd404896" status: 200 len: 215 microversion: 2.1 time: 0.610102 May 10 02:21:18.465833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1305/2716] 10.222.0.52 () {60 vars in 1289 bytes} [Tue May 10 02:21:17 2022] PUT /compute/v2.1/os-security-groups/dc907d7a-a647-476d-9c1d-6037fd404896 => generated 215 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:18.476530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:18.477264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:18.486003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.487459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.488399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.488991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.881727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:18.891041 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19ee72d9-2c32-4b73-9826-2efb5edcd300 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.449730 May 10 02:21:18.891583 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1412/2717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:18 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:18.899711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:18.900452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:18.908191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:18.911414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.911882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.912676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:18.913119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:18.918203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:18.926687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:18.930400 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bce2f41e-a22a-4b40-9153-c46009f06ba8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.463155 May 10 02:21:18.931466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1306/2718] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:18 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:18.955327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-876d3e2a-aec2-4bc2-af3a-235601444148 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d37016d30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.053088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad7286e0a784f24986aa051cbd29cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff68662ee834e1bbdfc9274d2ba5491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:19.061926 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-876d3e2a-aec2-4bc2-af3a-235601444148 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/dc907d7a-a647-476d-9c1d-6037fd404896" status: 200 len: 215 microversion: 2.1 time: 0.128446 May 10 02:21:19.062891 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1307/2719] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:21:18 2022] GET /compute/v2.1/os-security-groups/dc907d7a-a647-476d-9c1d-6037fd404896 => generated 215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:19.064009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1052abf6-c278-415b-9e24-d4d53cd49436 tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 200 len: 1491 microversion: 2.1 time: 0.167892 May 10 02:21:19.069101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1339a907-ef47-48da-be85-fe4fe9f5e453 req-dd7cad1e-89cc-48af-ad30-e49d761859e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef84007-a8d7-40a4-aaf9-04f704daef31", "name": "network-vif-deleted", "tag": "6e0d474c-152e-41ed-821c-13055986f560"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:19.075182 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1413/2720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:18 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 1491 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:19.086474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.087364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.093568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1339a907-ef47-48da-be85-fe4fe9f5e453 req-dd7cad1e-89cc-48af-ad30-e49d761859e8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.096641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.096766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1339a907-ef47-48da-be85-fe4fe9f5e453 req-dd7cad1e-89cc-48af-ad30-e49d761859e8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.097283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.098198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.098720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.118159 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1339a907-ef47-48da-be85-fe4fe9f5e453 req-dd7cad1e-89cc-48af-ad30-e49d761859e8 service nova] Creating event network-vif-deleted:6e0d474c-152e-41ed-821c-13055986f560 for instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 on n-h2-841089-2 May 10 02:21:19.129507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1339a907-ef47-48da-be85-fe4fe9f5e453 req-dd7cad1e-89cc-48af-ad30-e49d761859e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064858 May 10 02:21:19.130127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1308/2721] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:19.135293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-92f2b81e-ecdf-49b3-bc1f-0d2205274740 req-064ef302-737b-4412-b447-8d25b16ace70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f391397-d509-4342-b1fc-5864a0c80873", "name": "network-vif-plugged", "status": "completed", "tag": "441629e8-5491-45ab-9aa8-5227678dd069"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:19.143917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-92f2b81e-ecdf-49b3-bc1f-0d2205274740 req-064ef302-737b-4412-b447-8d25b16ace70 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.144709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-92f2b81e-ecdf-49b3-bc1f-0d2205274740 req-064ef302-737b-4412-b447-8d25b16ace70 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.147965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.148431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.149457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lazy-loading 'fault' on Instance uuid 7ef84007-a8d7-40a4-aaf9-04f704daef31 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:21:19.156600 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-92f2b81e-ecdf-49b3-bc1f-0d2205274740 req-064ef302-737b-4412-b447-8d25b16ace70 service nova] Creating event network-vif-plugged:441629e8-5491-45ab-9aa8-5227678dd069 for instance 4f391397-d509-4342-b1fc-5864a0c80873 on n-h1-841089-2 May 10 02:21:19.162058 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-92f2b81e-ecdf-49b3-bc1f-0d2205274740 req-064ef302-737b-4412-b447-8d25b16ace70 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030571 May 10 02:21:19.163119 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1309/2722] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:19.169334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60758177-9714-4a54-883d-dfb63272c8d3 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36614ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.211339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c787058dc32b484b945c1bd80d3b34ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fe833856714629a13a779adad72d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:19.222640 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-132f7433-a7fb-424c-979a-87f988101dbb tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 200 len: 1304 microversion: 2.1 time: 0.145413 May 10 02:21:19.223742 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1414/2723] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:19 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:19.228783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.230430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.240748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.242090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.243409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.243983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.464598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:19.474462 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5d62b4a-64a0-4a71-ad4e-e0558e04da29 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.249442 May 10 02:21:19.475722 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1415/2724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:19 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:19.480895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.481640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.488986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.490563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.491988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.492515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.749540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:19.759061 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4f5cd954-09be-479d-b475-1285de79e3bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1489 microversion: 2.1 time: 0.282656 May 10 02:21:19.763721 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1416/2725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:19 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1489 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:19.777357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:19.778183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.787517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.788209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.789075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.789592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.862653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ca76c98-811b-4349-ad88-06ea8bd8eac9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62/action" status: 202 len: 0 microversion: 2.1 time: 0.088781 May 10 02:21:19.863367 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1417/2726] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:21:19 2022] POST /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:21:19.872516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.873228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.879922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.880318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.881215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.881678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.890957 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60758177-9714-4a54-883d-dfb63272c8d3 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/dc907d7a-a647-476d-9c1d-6037fd404896" status: 202 len: 0 microversion: 2.1 time: 0.726583 May 10 02:21:19.891693 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1310/2727] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:19 2022] DELETE /compute/v2.1/os-security-groups/dc907d7a-a647-476d-9c1d-6037fd404896 => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:19.900139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.900919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.911879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.913224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.914545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.915583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.933596 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca HTTP/1.1 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '0ee8eecd-3d75-4867-889a-05da5e8755ca'} May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:19.935426 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c6cc0c8-1529-4fe7-9e76-c8ba33773618 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 404 len: 111 microversion: 2.1 time: 0.040567 May 10 02:21:19.939054 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1311/2728] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:19 2022] DELETE /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:21:19.943995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:19.944603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:19.950405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.950863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:19.951676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:19.952111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.148584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:20.157101 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75bbe31e-d69b-48c7-92ba-32c15bcd8ac5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1494 microversion: 2.1 time: 0.289341 May 10 02:21:20.157700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1418/2729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:19 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1494 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:20.162797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.163580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: 0ee8eecd-3d75-4867-889a-05da5e8755ca] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:20.169551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.170011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.170799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.171276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.188016 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca HTTP/1.1 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '0ee8eecd-3d75-4867-889a-05da5e8755ca'} May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.189679 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Instance 0ee8eecd-3d75-4867-889a-05da5e8755ca could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79bed2a9-20e1-44c9-8c25-861b665ce94f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca" status: 404 len: 111 microversion: 2.1 time: 0.032457 May 10 02:21:20.194700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1419/2730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:20 2022] GET /compute/v2.1/servers/0ee8eecd-3d75-4867-889a-05da5e8755ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.198319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.198907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:20.204967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.205947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.206676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:20.206829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.207200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.215110 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b6f37566-4f19-45e7-a783-97e2cf37788c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1317 microversion: 2.1 time: 0.276340 May 10 02:21:20.215990 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1312/2731] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:19 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:20.221055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.222331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] [instance: 26c61b83-d483-4b66-80b8-9be86abdea13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:20.228752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.229449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.230434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.230880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.247645 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] HTTP exception thrown: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Request method failure captured: May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 HTTP/1.1 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwBdEULkHbMMTE0K847VUrM4p3Vvyn74cbR1ik4lg3KttWuZyrcpAtGDyGThJcFpYMFOjSRYsWmnKHwUVI3ZtOhZlElqVqaoe1lPzWFwi11QuChPor8KwAYWzxLogOyGjyTcHSKkORagyzY8fLSFwNVwNWcy5G2PcOOOY_KGz6rC_k May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: aff68662ee834e1bbdfc9274d2ba5491 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1510499669 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aff68662ee834e1bbdfc9274d2ba5491", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aff68662ee834e1bbdfc9274d2ba5491"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aff68662ee834e1bbdfc9274d2ba5491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aff68662ee834e1bbdfc9274d2ba5491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1510499669 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: aff68662ee834e1bbdfc9274d2ba5491 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1510499669 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1510499669-project May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 3ad7286e0a784f24986aa051cbd29cd0 May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1510499669-project May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '26c61b83-d483-4b66-80b8-9be86abdea13'} May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:20.249110 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. May 10 02:21:20.253109 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.254323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] Returning 404 to user: Instance 26c61b83-d483-4b66-80b8-9be86abdea13 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.255350 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6db06daa-3ee7-4806-8144-264cb077ba7d tempest-ServersNegativeTestMultiTenantJSON-1510499669 tempest-ServersNegativeTestMultiTenantJSON-1510499669-project] 10.222.0.52 "GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13" status: 404 len: 111 microversion: 2.1 time: 0.038141 May 10 02:21:20.256054 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1313/2732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:20 2022] GET /compute/v2.1/servers/26c61b83-d483-4b66-80b8-9be86abdea13 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.265136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36116e50>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.316648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:20.317939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.security_group_api [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group d37637f4-da9e-4169-91b3-4b85e159e48a not found {{(pid=118717) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:21:20.318586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.318586 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a HTTP/1.1 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: exception: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd37637f4-da9e-4169-91b3-4b85e159e48a'} May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:20.320619 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] May 10 02:21:20.324513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.333232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group d37637f4-da9e-4169-91b3-4b85e159e48a does not exist May 10 02:21:20.333232 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-120fd081-a634-4137-82f8-c2efed119ab5'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.334352 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-079df639-8587-4fbf-8994-caf1cc04ffd5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a" status: 404 len: 194 microversion: 2.1 time: 0.077150 May 10 02:21:20.335004 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1314/2733] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/os-security-groups/d37637f4-da9e-4169-91b3-4b85e159e48a => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.340332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.341051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] [instance: 7ef84007-a8d7-40a4-aaf9-04f704daef31] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:20.348780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.349330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.350192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.350709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.366213 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] HTTP exception thrown: Instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 could not be found. May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Request method failure captured: May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 HTTP/1.1 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecuWZwC6X7YR1CFYP4bLr5Tddhsw3CLf-to4EuTDpXynlcIThd4zby0FISZjN7cdkWGEoofvhXXABZWPxVmA5fSX-PbdxfKGH1iYW2TWJbpl0lZizon8TzPg0-hD7LGQh9sqlnjesSkx2goRrMk5clpqiET0cUiP_YCPvyfEg8c9PX0 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 32fe833856714629a13a779adad72d2e May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueTestJSON-2083588085 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_32fe833856714629a13a779adad72d2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32fe833856714629a13a779adad72d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/32fe833856714629a13a779adad72d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/32fe833856714629a13a779adad72d2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueTestJSON-2083588085 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 32fe833856714629a13a779adad72d2e May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueTestJSON-2083588085 May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueTestJSON-2083588085-project May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: c787058dc32b484b945c1bd80d3b34ea May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueTestJSON-2083588085-project May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 could not be found. May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '7ef84007-a8d7-40a4-aaf9-04f704daef31'} May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 could not be found. May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 could not be found. May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.368542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 could not be found. May 10 02:21:20.371954 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.374067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] Returning 404 to user: Instance 7ef84007-a8d7-40a4-aaf9-04f704daef31 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.375174 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-caf67438-2bbb-4cc5-aa2f-8acb6b9ce8fd tempest-ServerRescueTestJSON-2083588085 tempest-ServerRescueTestJSON-2083588085-project] 10.222.0.52 "GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31" status: 404 len: 111 microversion: 2.1 time: 0.038975 May 10 02:21:20.375907 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1315/2734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:20 2022] GET /compute/v2.1/servers/7ef84007-a8d7-40a4-aaf9-04f704daef31 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.405154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:20.405459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36ffd940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.425226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:20.427054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:20.428390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-77ccee57-a8b0-4c3e-b3c8-ea74355fcc31 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.235519 May 10 02:21:20.429062 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1420/2735] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:20 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:20.461134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:20.461755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.security_group_api [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 not found {{(pid=118717) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:21:20.462298 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.462298 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8 HTTP/1.1 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: exception: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2daf552a-5e54-495c-b7a6-a8c0222ea2f8'} May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:20.464589 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group 2daf552a-5e54-495c-b7a6-a8c0222ea2f8 does not exist May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-7cd2814f-3c92-48a2-ba19-88f40309f423'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.467775 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6b246b6-f757-46ca-a23f-a8a191a28c91 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8" status: 404 len: 194 microversion: 2.1 time: 0.089013 May 10 02:21:20.469789 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1316/2736] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/os-security-groups/2daf552a-5e54-495c-b7a6-a8c0222ea2f8 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.477521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d364cad30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.491486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.492172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:20.505099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.505808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.506610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.507056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.508584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:20.509190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group d7509495-2d20-4712-b521-9bc0d7b79ff6 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:21:20.509718 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.509718 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6 HTTP/1.1 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd7509495-2d20-4712-b521-9bc0d7b79ff6'} May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:20.512352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] May 10 02:21:20.516255 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.520423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group d7509495-2d20-4712-b521-9bc0d7b79ff6 does not exist May 10 02:21:20.520423 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-8a8474ee-7a77-4956-9398-eb276d6dd2c4'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.521550 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b0c69dc-1d94-405f-a575-30dd387d78ad tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6" status: 404 len: 194 microversion: 2.1 time: 0.050457 May 10 02:21:20.523105 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1421/2737] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/os-security-groups/d7509495-2d20-4712-b521-9bc0d7b79ff6 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.563496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36496430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.638530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:20.639420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:21:20.640095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.640095 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505 HTTP/1.1 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '02ee3016-2aeb-48c7-a9a8-684b8ac4b505'} May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:20.644516 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group 02ee3016-2aeb-48c7-a9a8-684b8ac4b505 does not exist May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-15293cf4-6d7e-4479-b049-2977a8634b79'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21a7671e-76a9-4279-9ef6-50159b9ccc75 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505" status: 404 len: 194 microversion: 2.1 time: 0.120104 May 10 02:21:20.650882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1422/2738] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/os-security-groups/02ee3016-2aeb-48c7-a9a8-684b8ac4b505 => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:21:20.724591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:20.738545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-382676300", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "94c0c1f7-fb51-47c2-afdb-1c5443c8b396"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:20.743974 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-946a94bb-ef01-4243-9a06-984b5362ee60 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.256131 May 10 02:21:20.744556 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1317/2739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:20 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:20.762169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d36551af0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.818323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] validate_networks() for [('94c0c1f7-fb51-47c2-afdb-1c5443c8b396', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:20.860255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:20.860857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.security_group_api [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 not found {{(pid=118717) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:21:20.861382 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.861382 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965 HTTP/1.1 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: exception: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '390aa755-40ad-4fcb-bca9-c0e9b8939965'} May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:20.864455 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group 390aa755-40ad-4fcb-bca9-c0e9b8939965 does not exist May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-dc1b4260-f9ca-4929-8036-40869c019b4a'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.868354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d315da23-e911-4ace-8ab8-1b1d9e0847dc tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965" status: 404 len: 194 microversion: 2.1 time: 0.119256 May 10 02:21:20.870776 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1318/2740] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/os-security-groups/390aa755-40ad-4fcb-bca9-c0e9b8939965 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.875349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d361704c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.946322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:21:20.946911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.security_group_api [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Neutron security group f80c551f-3759-4e01-8a47-dab63e5f0131 not found {{(pid=118717) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:21:20.947652 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.947652 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131 HTTP/1.1 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: exception: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f80c551f-3759-4e01-8a47-dab63e5f0131'} May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:21:20.952546 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] May 10 02:21:20.957001 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:20.960029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Security group f80c551f-3759-4e01-8a47-dab63e5f0131 does not exist May 10 02:21:20.960029 n-d-841089-2 devstack@n-api.service[118717]: Neutron server returns request_ids: ['req-07c9054c-afd1-4150-b86c-6ce41a648dfa'] {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:20.961255 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98af1615-cdb5-41db-9dc2-e0f5110d4825 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131" status: 404 len: 194 microversion: 2.1 time: 0.089954 May 10 02:21:20.962402 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1319/2741] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/os-security-groups/f80c551f-3759-4e01-8a47-dab63e5f0131 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:20.970752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:20.972321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:20.979768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.981299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:20.982490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:20.983088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.014944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:21.114999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c691983d-5a5e-448d-9b8f-5192760d861d tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 204 len: 0 microversion: 2.1 time: 0.147555 May 10 02:21:21.115823 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1320/2742] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:20 2022] DELETE /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:21.124492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:21.125206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:21.131919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.132375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.133155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.133600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.544009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:21.553338 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7fcf3c90-1228-4e8c-90ac-24ebf6138e4e tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1645 microversion: 2.1 time: 0.433147 May 10 02:21:21.563524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1321/2743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:21 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1645 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:21.568780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-942f0e3a-6eb4-456c-9e8d-da1722f5b8d5 req-d82a0ebb-d3e5-495f-8f59-7068570f066c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c61b83-d483-4b66-80b8-9be86abdea13", "name": "network-vif-deleted", "tag": "75ee04d3-e055-42ce-ad11-b24fd3cbadf9"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:21.576984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-942f0e3a-6eb4-456c-9e8d-da1722f5b8d5 req-d82a0ebb-d3e5-495f-8f59-7068570f066c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.577641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-942f0e3a-6eb4-456c-9e8d-da1722f5b8d5 req-d82a0ebb-d3e5-495f-8f59-7068570f066c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.589772 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-942f0e3a-6eb4-456c-9e8d-da1722f5b8d5 req-d82a0ebb-d3e5-495f-8f59-7068570f066c service nova] Creating event network-vif-deleted:75ee04d3-e055-42ce-ad11-b24fd3cbadf9 for instance 26c61b83-d483-4b66-80b8-9be86abdea13 on n-h2-841089-2 May 10 02:21:21.595318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-942f0e3a-6eb4-456c-9e8d-da1722f5b8d5 req-d82a0ebb-d3e5-495f-8f59-7068570f066c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 May 10 02:21:21.596664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1322/2744] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:21.605028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:21.605737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:21.612567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.613017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.613790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.614407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.659469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:21.659966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:21.660460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:21.660951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:21.661592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:21.670933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.671423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.672243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.672692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.692406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Getting quotas for project ce7fac55bd254b8e990b528a5f3e0fd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:21.699451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Getting quotas for user 980ae01e31e545fb8969dccbd0089006 and project ce7fac55bd254b8e990b528a5f3e0fd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:21.714855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:21.717771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:21.773934 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-81de432e-f6bd-486c-9cee-64b03eeba0d7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125463 May 10 02:21:21.779192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1423/2745] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:21:21.783458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-63d612a0-b0c7-4915-a505-98c9e8b08691 req-81e1af72-bd11-46d9-a940-5e6aac18bfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9", "name": "network-vif-plugged", "status": "completed", "tag": "4d429704-892e-425f-8265-395b5d209a46"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:21.795085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-63d612a0-b0c7-4915-a505-98c9e8b08691 req-81e1af72-bd11-46d9-a940-5e6aac18bfed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.795645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-63d612a0-b0c7-4915-a505-98c9e8b08691 req-81e1af72-bd11-46d9-a940-5e6aac18bfed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.828635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-63d612a0-b0c7-4915-a505-98c9e8b08691 req-81e1af72-bd11-46d9-a940-5e6aac18bfed service nova] Creating event network-vif-plugged:4d429704-892e-425f-8265-395b5d209a46 for instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 on n-h2-841089-2 May 10 02:21:21.840093 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-63d612a0-b0c7-4915-a505-98c9e8b08691 req-81e1af72-bd11-46d9-a940-5e6aac18bfed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063420 May 10 02:21:21.841418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1424/2746] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:21.844588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:21.847901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:21.849287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:21.852861 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c88d2f3b-ee5a-44ef-a0b8-aecd65bc4e1c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 200 len: 1474 microversion: 2.1 time: 0.254064 May 10 02:21:21.853458 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1323/2747] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:21 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 1474 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:21.857398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.858090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.859277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.860339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.874765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:21.875423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:21.888787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.889245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:21.891015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:21.891677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.138829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:22.147422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ef960f6-406f-4442-94f8-77cf05099d18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1467 microversion: 2.1 time: 0.304263 May 10 02:21:22.147758 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1425/2748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:21 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1467 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:22.155112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:22.156383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:22.163698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:22.164832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.165356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.166882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.167427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.174891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:22.176493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:22.177723 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1d75a861-1825-4251-8bd9-471a38418ec9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.307874 May 10 02:21:22.189845 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1324/2749] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:21 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:22.196174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-17aecbc9-98b8-4819-b3bf-0e264fdfbf7d tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:22.197027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-17aecbc9-98b8-4819-b3bf-0e264fdfbf7d tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:22.289347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17aecbc9-98b8-4819-b3bf-0e264fdfbf7d tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:22.299889 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-17aecbc9-98b8-4819-b3bf-0e264fdfbf7d tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1215 microversion: 2.1 time: 0.107777 May 10 02:21:22.300865 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1325/2750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:22 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:22.307119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-653509045"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:22.308656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:22.317715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.318271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.319840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.320442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.366247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:22.382096 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c62d7705-2b8c-453e-a352-0d8feb3a33d9 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.233170 May 10 02:21:22.382735 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1426/2751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:22 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:22.532452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:22.533109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:22.549820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.550543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.551617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.552153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.703540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56b8fd63-a69e-478d-8e9b-6ef4a8ad4ee4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62/action" status: 202 len: 0 microversion: 2.1 time: 0.400513 May 10 02:21:22.705188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1326/2752] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:21:22 2022] POST /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:21:22.714563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:22.715922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:22.726414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.727921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:22.729141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:22.729801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.384489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:23.411461 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60d17150-770e-479d-840f-c654433d2e3c tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1645 microversion: 2.1 time: 0.700255 May 10 02:21:23.423148 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1327/2753] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:22 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1645 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:23.431020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6944d15c-0773-407b-a7d7-95576b19a82e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d3611b040>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:23.503265 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6944d15c-0773-407b-a7d7-95576b19a82e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 200 len: 1413 microversion: 2.1 time: 0.078648 May 10 02:21:23.515606 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1328/2754] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:21:23 2022] GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:23.521347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:23.522308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:23.535437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:23.536171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.537172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:23.540089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.565256 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18a29fa9-9b73-429d-a071-09d274179f7b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1618 microversion: 2.1 time: 1.180550 May 10 02:21:23.569178 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1427/2755] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:22 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1618 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:23.583261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:23.584237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:23.592952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:23.593743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.595170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:23.595782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.721785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:23.732148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d8f636e-c92e-4bcf-8c21-c20c2345d959 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1285 microversion: 2.1 time: 0.156953 May 10 02:21:23.732745 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1428/2756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:23 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:23.737294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:23.737904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:23.760102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:23.761426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.762974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:23.763914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:23.871483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:23.881792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:23.883524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:23.885018 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9c2b812-e754-4fe0-b126-a1a04ce0a829 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.367779 May 10 02:21:23.897276 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1329/2757] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:23 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:23.904417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16136207-edc4-4cba-b21f-8bae7bacfa8a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: .version_select at 0x7f3d36170700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1093579169", "policies": ["affinity"]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:23.924487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-16136207-edc4-4cba-b21f-8bae7bacfa8a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:23.931337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-16136207-edc4-4cba-b21f-8bae7bacfa8a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:24.011520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-16136207-edc4-4cba-b21f-8bae7bacfa8a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:24.021127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-16136207-edc4-4cba-b21f-8bae7bacfa8a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:24.042532 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-16136207-edc4-4cba-b21f-8bae7bacfa8a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.143758 May 10 02:21:24.043977 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1330/2758] 10.222.0.52 () {60 vars in 1173 bytes} [Tue May 10 02:21:23 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:24.175294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1239769322", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3f5c0835-6a51-4402-b3db-7c7efc8b0e8b"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:24.244920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:24.304260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:24.312413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3f1b627-9a3b-47ad-b81e-c283fde385ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1403 microversion: 2.1 time: 0.578645 May 10 02:21:24.322419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1429/2759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:23 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1403 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:24.350306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d9ce0a4d-7d2b-4a25-8b84-77d806fc5efd req-7cf6d80d-f56f-4d71-a9ae-f6661f7661c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc074c9c-7a50-4f31-92da-cd52a1034f16", "name": "network-vif-deleted", "tag": "04943d83-a529-4e19-a5a3-a9fc0b2d1ce7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:24.364191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d9ce0a4d-7d2b-4a25-8b84-77d806fc5efd req-7cf6d80d-f56f-4d71-a9ae-f6661f7661c5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.364929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d9ce0a4d-7d2b-4a25-8b84-77d806fc5efd req-7cf6d80d-f56f-4d71-a9ae-f6661f7661c5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.409159 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d9ce0a4d-7d2b-4a25-8b84-77d806fc5efd req-7cf6d80d-f56f-4d71-a9ae-f6661f7661c5 service nova] Creating event network-vif-deleted:04943d83-a529-4e19-a5a3-a9fc0b2d1ce7 for instance fc074c9c-7a50-4f31-92da-cd52a1034f16 on n-h2-841089-2 May 10 02:21:24.430237 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d9ce0a4d-7d2b-4a25-8b84-77d806fc5efd req-7cf6d80d-f56f-4d71-a9ae-f6661f7661c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084395 May 10 02:21:24.432787 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1430/2760] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:21:24.459472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:24.460613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:24.472097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.473049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.475743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.476457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.625736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45f2c2d3102f4f7caf7d578e0091aca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11a5b99914f159cd7844490e3bf7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:24.635672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-948cb416-5d35-4f01-81b7-32881d65c52f tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 200 len: 1300 microversion: 2.1 time: 0.201117 May 10 02:21:24.636509 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1431/2761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:24 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:24.642602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91e79801-6c57-4747-8efc-29de60bf4392 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d364a94c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:24.700764 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91e79801-6c57-4747-8efc-29de60bf4392 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 200 len: 1413 microversion: 2.1 time: 0.062453 May 10 02:21:24.701912 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1432/2762] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:21:24 2022] GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:24.753891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:24.755773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:24.763719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:24.764684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:24.765313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:24.765888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:24.766460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:24.768433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.769192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.770228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.772135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.795966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.799394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.803933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:24.808212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:24.855133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:24.864960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:24.881012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Going to run 2 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:24.883789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:24.946742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:24.950326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=118717) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 10 02:21:24.979018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3dae654-9813-4569-ac15-31ff107f2519 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1273 microversion: 2.1 time: 0.233920 May 10 02:21:24.991236 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1433/2763] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:24 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:24.998612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:24.999295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:24.999544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:25.005966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.007139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.007945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.008451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.016301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:25.109518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:25.118168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:25.168781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=3614adc7-3fb7-40b5-a21b-19d2a5965cf4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:25.230404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:25.249197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:25.249197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:25.249197 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90662358-5934-4501-90c0-5652afa4e394 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.253546 May 10 02:21:25.249474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:25.249555 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1434/2764] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:24 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:25.254483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:25.302650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:25.314194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:25.332062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:25.333196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:25.344910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.346571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.348138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.349239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.413872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fea5a1f6-1bd3-45a1-8d0c-c7bad0e1c13c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.242314 May 10 02:21:25.417614 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1331/2765] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 10 02:21:25.423425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:25.426784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:25.427714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Searching by: {'deleted': False, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:21:25.446539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.447016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.447845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.448287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.473465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:21:25.512532 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e9138fd-af24-4ffd-98bb-633166935fa8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.093740 May 10 02:21:25.519294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1332/2766] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:21:25 2022] GET /compute/v2.1/servers => generated 1004 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:25.524930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64f2a1db-e7af-4482-a397-aace0fab7a2e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:25.525552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-64f2a1db-e7af-4482-a397-aace0fab7a2e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:25.703938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-64f2a1db-e7af-4482-a397-aace0fab7a2e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:25.713658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64f2a1db-e7af-4482-a397-aace0fab7a2e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1219 microversion: 2.1 time: 0.193037 May 10 02:21:25.716087 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1333/2767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:25 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:25.725133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:25.725754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] [instance: fc074c9c-7a50-4f31-92da-cd52a1034f16] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:25.756644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.757256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.761086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.761944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.796233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:25.802470 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] HTTP exception thrown: Instance fc074c9c-7a50-4f31-92da-cd52a1034f16 could not be found. May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Request method failure captured: May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 HTTP/1.1 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecu7rMdx545GOGpmadTSl56JzXXhuEqDZksiHn5onhqG4YfAux7yrzEV7PJDFhFmFGIWAATMZhiYTZf2vivWra6KuL6vgHw7302Xm3sbAk8nqaSn2nhO2NIju_uc-K-ZGUlaWnXIyN8xxvv3eOcpvoEEk_QK_wzo-1Q3s6juV02OQP8 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fd11a5b99914f159cd7844490e3bf7b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fd11a5b99914f159cd7844490e3bf7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5fd11a5b99914f159cd7844490e3bf7b May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-646807374 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 45f2c2d3102f4f7caf7d578e0091aca5 May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-SecurityGroupsTestJSON-646807374-project May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance fc074c9c-7a50-4f31-92da-cd52a1034f16 could not be found. May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fc074c9c-7a50-4f31-92da-cd52a1034f16'} May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc074c9c-7a50-4f31-92da-cd52a1034f16 could not be found. May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc074c9c-7a50-4f31-92da-cd52a1034f16 could not be found. May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:21:25.805051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc074c9c-7a50-4f31-92da-cd52a1034f16 could not be found. May 10 02:21:25.809092 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:21:25.809472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-036938e9-509e-43cd-85fa-b1116382c106 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1590 microversion: 2.1 time: 0.478981 May 10 02:21:25.815880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Returning 404 to user: Instance fc074c9c-7a50-4f31-92da-cd52a1034f16 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:21:25.817112 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-239d264a-acf4-43e3-b1bb-92154692dc90 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16" status: 404 len: 111 microversion: 2.1 time: 0.100434 May 10 02:21:25.832691 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1435/2768] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:25 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1590 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:25.839146 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1334/2769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:25 2022] GET /compute/v2.1/servers/fc074c9c-7a50-4f31-92da-cd52a1034f16 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:21:25.859725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:25.859725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:25.866896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.867517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2484a3e5-235b-462e-806d-f04537fe72a6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d364ca0d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:25.867937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.868970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:25.869586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:25.961015 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2484a3e5-235b-462e-806d-f04537fe72a6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 200 len: 1413 microversion: 2.1 time: 0.127071 May 10 02:21:25.961608 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1436/2770] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:21:25 2022] GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:25.977150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-013f28b7-05da-42b5-905e-2a75775d09c5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d364b8ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:26.269227 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-624008f6-8783-4dfa-99b5-91b2c0e439c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.428644 May 10 02:21:26.275541 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1335/2771] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:21:25 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9/os-interface => generated 284 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:26.280661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:26.281287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:26.294256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:26.294715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:26.297915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:26.298594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:26.842718 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-013f28b7-05da-42b5-905e-2a75775d09c5 tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1133c9d0-dc36-45c8-85ee-f1f972f84a3f" status: 202 len: 0 microversion: 2.1 time: 0.879876 May 10 02:21:26.843323 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1437/2772] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:25 2022] DELETE /compute/v2.1/os-security-groups/1133c9d0-dc36-45c8-85ee-f1f972f84a3f => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:26.848397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:26.849865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:26.865263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:26.865697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:26.866546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:26.867039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:26.908840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:26.918084 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c773330f-0e39-4a5a-bdde-a846ca637e52 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1315 microversion: 2.1 time: 0.641257 May 10 02:21:26.930108 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1336/2773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:26 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:26.950817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:26.953355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:26.970692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:26.971550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:26.976575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:26.977313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:27.161468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:27.175582 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b706e2c3-85e4-4d08-952e-daa47a3530c4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1215 microversion: 2.1 time: 0.240227 May 10 02:21:27.179002 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1337/2774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:26 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:27.197317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d7a2fd6-9c8d-4a4b-8463-b4d0e0b04fde tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] Calling method '.version_select at 0x7f3d360c9940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:27.420172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:27.438522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:27.448164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:27.451606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8fe2923e-bbe5-497f-ab7e-c8c7ba436aa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1744 microversion: 2.20 time: 0.606853 May 10 02:21:27.456264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1438/2775] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:26 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1744 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:27.473411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14dc057e-5984-4033-9ef3-99309b978689 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d364a9040>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:27.565563 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14dc057e-5984-4033-9ef3-99309b978689 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 200 len: 1413 microversion: 2.1 time: 0.107372 May 10 02:21:27.566159 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1439/2776] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:21:27 2022] GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:27.936762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:27.938035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:27.947481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:27.953430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:27.954451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:27.955109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:29.072689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:29.093189 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24fe99b6-c7a7-4cf3-9427-729ed5ea6326 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1315 microversion: 2.1 time: 1.160904 May 10 02:21:29.096328 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1440/2777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:27 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:29.101141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:29.115027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:29.122474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:29.129131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:29.138239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:29.138746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:29.143483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d7a2fd6-9c8d-4a4b-8463-b4d0e0b04fde tempest-SecurityGroupsTestJSON-646807374 tempest-SecurityGroupsTestJSON-646807374-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/b7025f5e-cccd-4323-845f-f556bb539f33" status: 202 len: 0 microversion: 2.1 time: 1.959908 May 10 02:21:29.144625 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1338/2778] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:21:27 2022] DELETE /compute/v2.1/os-security-groups/b7025f5e-cccd-4323-845f-f556bb539f33 => generated 0 bytes in 1965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:21:29.149578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:29.150448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:29.174779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:29.175528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:29.177638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:29.182781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:30.027318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:30.035934 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e6fe2347-e318-47af-a7f4-2cb3e23184ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1277 microversion: 2.1 time: 0.938483 May 10 02:21:30.043288 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1441/2779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:29 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1277 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:30.057077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6520e02e-1e4d-4a31-b347-19ee8c43a960 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36496f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:31.038818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:31.063462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:31.069333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:31.076903 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1670a43-0e8a-46fe-b808-456fba918721 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1739 microversion: 2.20 time: 1.925404 May 10 02:21:31.093191 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1339/2780] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:29 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1739 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:31.105553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:31.107741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:31.121210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:31.125121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:31.126221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:31.126855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:31.962024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:31.970634 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1f9827fc-6d93-4e22-9e1f-26097b8a8335 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1590 microversion: 2.1 time: 0.872955 May 10 02:21:31.977400 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1340/2781] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:31 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1590 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:31.997043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7c10e7d6-104d-41eb-b528-7125f19307e6 req-f574dc46-3d82-442e-aab1-2e287630fb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9", "tag": "4d429704-892e-425f-8265-395b5d209a46"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:32.022604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7c10e7d6-104d-41eb-b528-7125f19307e6 req-f574dc46-3d82-442e-aab1-2e287630fb5b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.024319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7c10e7d6-104d-41eb-b528-7125f19307e6 req-f574dc46-3d82-442e-aab1-2e287630fb5b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:32.091921 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7c10e7d6-104d-41eb-b528-7125f19307e6 req-f574dc46-3d82-442e-aab1-2e287630fb5b service nova] Creating event network-changed:4d429704-892e-425f-8265-395b5d209a46 for instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 on n-h2-841089-2 May 10 02:21:32.103493 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7c10e7d6-104d-41eb-b528-7125f19307e6 req-f574dc46-3d82-442e-aab1-2e287630fb5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120635 May 10 02:21:32.105633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1341/2782] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:32.116515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0c827289-d90d-491a-970d-3b570ec7c832 req-40c64ba8-6594-486d-9ff3-b868797d546f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf94666-d976-4cf6-ad89-8c1b167c39f2", "tag": "8cb2615d-2499-4251-b8fe-cc506b9fbd62"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:32.136648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0c827289-d90d-491a-970d-3b570ec7c832 req-40c64ba8-6594-486d-9ff3-b868797d546f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.140295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0c827289-d90d-491a-970d-3b570ec7c832 req-40c64ba8-6594-486d-9ff3-b868797d546f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:32.165347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0c827289-d90d-491a-970d-3b570ec7c832 req-40c64ba8-6594-486d-9ff3-b868797d546f service nova] Creating event network-changed:8cb2615d-2499-4251-b8fe-cc506b9fbd62 for instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 on n-h2-841089-2 May 10 02:21:32.181711 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0c827289-d90d-491a-970d-3b570ec7c832 req-40c64ba8-6594-486d-9ff3-b868797d546f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072446 May 10 02:21:32.182721 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1342/2783] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:32.192853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:32.202447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:32.218005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.224180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:32.227322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.228476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:32.790414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:32.799165 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90ebc2eb-ac14-4334-928d-0f1ec15ea547 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1315 microversion: 2.1 time: 0.614962 May 10 02:21:32.808166 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1343/2784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:32 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:32.813131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f7def354-0fba-4349-9184-f21854fff6de req-c46e67fe-cef9-46ba-8337-aa7a9329a152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d59b3116-5ef4-4ade-8cb5-ef09f7266e62", "name": "network-vif-plugged", "status": "completed", "tag": "3d1b417a-ac60-4fdf-941e-c10591fd83e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:32.849141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f7def354-0fba-4349-9184-f21854fff6de req-c46e67fe-cef9-46ba-8337-aa7a9329a152 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.849833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f7def354-0fba-4349-9184-f21854fff6de req-c46e67fe-cef9-46ba-8337-aa7a9329a152 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:32.921865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f7def354-0fba-4349-9184-f21854fff6de req-c46e67fe-cef9-46ba-8337-aa7a9329a152 service nova] Creating event network-vif-plugged:3d1b417a-ac60-4fdf-941e-c10591fd83e3 for instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 on n-h1-841089-2 May 10 02:21:32.935369 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f7def354-0fba-4349-9184-f21854fff6de req-c46e67fe-cef9-46ba-8337-aa7a9329a152 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125557 May 10 02:21:32.936171 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1344/2785] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:32.957754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:32.958475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:32.977734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.978205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:32.979021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:32.979499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:34.087053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:34.117303 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec65f75e-ffd5-45c7-b9e3-b5a449be3958 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1277 microversion: 2.1 time: 1.164202 May 10 02:21:34.144540 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1345/2786] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:32 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1277 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:34.149924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:34.162608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:34.190449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:34.194921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:34.196322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:34.196433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:36.000174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:36.023334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:36.026416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:36.038744 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b6aa8917-f74d-4cd7-ad72-265080b89422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1739 microversion: 2.20 time: 1.892560 May 10 02:21:36.051641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1346/2787] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:34 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1739 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:36.057507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:36.087725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:36.118501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:36.138569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:36.139665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:36.143372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:37.046568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:37.063708 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b35a8fa3-5e23-4cb9-978e-f9a60bdc23e7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1315 microversion: 2.1 time: 1.009665 May 10 02:21:37.075496 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1347/2788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:36 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:37.085784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:37.090846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:37.104860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:37.107577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:37.108567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:37.111036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:39.207759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:39.221962 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b02eecf4-9b96-4604-a799-df0211cd605b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1319 microversion: 2.1 time: 2.143035 May 10 02:21:39.229109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1348/2789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:37 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1319 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:39.234493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:39.238692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:39.256760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:39.262597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:39.263694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:39.266901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:41.031231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:41.060171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:41.064475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:41.069293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7b6d1509-7976-49f7-8bfe-8e10cf1802ad tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1739 microversion: 2.20 time: 1.838720 May 10 02:21:41.073085 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1349/2790] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:39 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1739 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:41.089737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-16e1aed2-7d9a-490d-9c66-f64e15c45cbe req-199f26ef-cdcc-48cc-b948-37dd8296e552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "name": "network-vif-plugged", "status": "completed", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:41.113566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-16e1aed2-7d9a-490d-9c66-f64e15c45cbe req-199f26ef-cdcc-48cc-b948-37dd8296e552 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:41.117383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-16e1aed2-7d9a-490d-9c66-f64e15c45cbe req-199f26ef-cdcc-48cc-b948-37dd8296e552 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:41.158166 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-16e1aed2-7d9a-490d-9c66-f64e15c45cbe req-199f26ef-cdcc-48cc-b948-37dd8296e552 service nova] Creating event network-vif-plugged:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h2-841089-2 May 10 02:21:41.170381 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-16e1aed2-7d9a-490d-9c66-f64e15c45cbe req-199f26ef-cdcc-48cc-b948-37dd8296e552 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091089 May 10 02:21:41.177577 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1350/2791] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:41.194844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:41.195619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:41.219685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:41.221480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:41.228115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:41.229237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:43.847565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:43.905463 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56028000-e96f-41ef-a697-f6b019e39746 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1315 microversion: 2.1 time: 2.708453 May 10 02:21:43.918256 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1351/2792] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:41 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1315 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:43.958420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:43.967021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:44.018956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:44.030522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:44.033301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:44.038656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:45.060813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:45.072661 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9dc03c5-0100-4f92-a767-f4d0639c0336 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1319 microversion: 2.1 time: 1.152866 May 10 02:21:45.073978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1352/2793] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:43 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1319 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:45.117155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:45.128585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:45.148963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:45.149746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:45.153130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:45.156169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:46.767460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:46.778866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:46.782309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:46.790169 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-239c6299-f80d-459e-b40a-4a3c5a23bc1c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1739 microversion: 2.20 time: 1.711553 May 10 02:21:46.790770 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1353/2794] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:45 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1739 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:47.198194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9d3838e5-62d8-41ae-80aa-42f2f802f179 req-1025ca71-18b9-47b3-a383-7011aca207ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf94666-d976-4cf6-ad89-8c1b167c39f2", "name": "network-vif-plugged", "status": "completed", "tag": "8cb2615d-2499-4251-b8fe-cc506b9fbd62"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:47.225369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9d3838e5-62d8-41ae-80aa-42f2f802f179 req-1025ca71-18b9-47b3-a383-7011aca207ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:47.225821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9d3838e5-62d8-41ae-80aa-42f2f802f179 req-1025ca71-18b9-47b3-a383-7011aca207ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:47.262158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9d3838e5-62d8-41ae-80aa-42f2f802f179 req-1025ca71-18b9-47b3-a383-7011aca207ae service nova] Creating event network-vif-plugged:8cb2615d-2499-4251-b8fe-cc506b9fbd62 for instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 on n-h2-841089-2 May 10 02:21:47.280493 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9d3838e5-62d8-41ae-80aa-42f2f802f179 req-1025ca71-18b9-47b3-a383-7011aca207ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.485995 May 10 02:21:47.286446 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1354/2795] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:47.470624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afac2e8d-4917-4d2b-99b4-c38b3371eff3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: .version_select at 0x7f3d36170790>, body: {"keypair": {"name": "tempest-keypair-741386144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIW1qTzmcVy/NQTp5ZdUXCcw3Y74nIkO7ryuwC7/6a94u65snrUkAm3F3n6vYVl64hwpOy/Jdit/01Oc3V8KORLqmU4jKbNSLSaXDG/h7zTjZlUh+WfeiOwfVCj3jzw90Q=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:47.533229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-afac2e8d-4917-4d2b-99b4-c38b3371eff3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:47.570335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-afac2e8d-4917-4d2b-99b4-c38b3371eff3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for user 1d0edd300fe34f92a9e265863d12718a and project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:47.683340 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afac2e8d-4917-4d2b-99b4-c38b3371eff3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.393038 May 10 02:21:47.697196 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1355/2796] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:21:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:47.856196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-6eb9f599-6711-4ae6-af90-018184e58133 req-f02c8e65-dd6a-46e5-91b1-c679205f1718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3614adc7-3fb7-40b5-a21b-19d2a5965cf4", "tag": "eb921274-3ef4-4970-bd64-994ae32503ea"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:47.883969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6eb9f599-6711-4ae6-af90-018184e58133 req-f02c8e65-dd6a-46e5-91b1-c679205f1718 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:47.887059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6eb9f599-6711-4ae6-af90-018184e58133 req-f02c8e65-dd6a-46e5-91b1-c679205f1718 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:47.916803 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-6eb9f599-6711-4ae6-af90-018184e58133 req-f02c8e65-dd6a-46e5-91b1-c679205f1718 service nova] Creating event network-changed:eb921274-3ef4-4970-bd64-994ae32503ea for instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 on n-h1-841089-2 May 10 02:21:47.933429 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-6eb9f599-6711-4ae6-af90-018184e58133 req-f02c8e65-dd6a-46e5-91b1-c679205f1718 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234298 May 10 02:21:47.937425 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1356/2797] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:47.960581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:47.963714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:47.980078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:47.980894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:47.985523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:47.986322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:49.310839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:49.323447 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4feb8a4a-8218-41fa-99df-c220a6995ac1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1315 microversion: 2.1 time: 1.381681 May 10 02:21:49.324080 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1357/2798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:47 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1315 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:49.358056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:49.359174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:49.384931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:49.385943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:49.389942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:49.392317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:49.757060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:49.770164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1fe0b2c0-0ea2-4ee3-b7a5-e3e06ff43fc3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1319 microversion: 2.1 time: 0.426882 May 10 02:21:49.797667 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1358/2799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:49 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:49.803548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:49.804695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:49.812288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:49.813080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:49.814462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:49.815677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:50.178905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:50.190460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:50.192416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:50.193861 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5fd66302-908b-47cc-a353-cc7e5fa78422 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1739 microversion: 2.20 time: 0.394780 May 10 02:21:50.198212 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1359/2800] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:49 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:50.231870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7169707a-94ab-47cf-ae7f-726b93f191a2 req-be41c45f-935a-4763-a2e8-fbf32f6fcbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdbd3e7-471a-4d74-a8d9-ed0878906f69", "tag": "f89a9543-6bb6-4959-9e21-247da8114beb"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:50.248912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7169707a-94ab-47cf-ae7f-726b93f191a2 req-be41c45f-935a-4763-a2e8-fbf32f6fcbd1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:50.249453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7169707a-94ab-47cf-ae7f-726b93f191a2 req-be41c45f-935a-4763-a2e8-fbf32f6fcbd1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:50.274440 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7169707a-94ab-47cf-ae7f-726b93f191a2 req-be41c45f-935a-4763-a2e8-fbf32f6fcbd1 service nova] Creating event network-changed:f89a9543-6bb6-4959-9e21-247da8114beb for instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 on n-h1-841089-2 May 10 02:21:50.293062 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7169707a-94ab-47cf-ae7f-726b93f191a2 req-be41c45f-935a-4763-a2e8-fbf32f6fcbd1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071036 May 10 02:21:50.295784 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1360/2801] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:50.342834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:50.344620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:50.360157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:50.362843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:50.373702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:50.374410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:50.622125 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6520e02e-1e4d-4a31-b347-19ee8c43a960 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 200 len: 1422 microversion: 2.1 time: 20.577073 May 10 02:21:50.629920 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1442/2802] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:21:30 2022] GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 1422 bytes in 20586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:50.642555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1cb1b7ff-113e-4053-9074-9aea6500c86a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36442a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:50.764121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1cb1b7ff-113e-4053-9074-9aea6500c86a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 200 len: 1422 microversion: 2.1 time: 0.133082 May 10 02:21:50.771642 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1443/2803] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:21:50 2022] GET /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 1422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:50.780738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e4c0139-323d-4009-94dd-d84362490145 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36493430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:51.554079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:51.563750 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60600222-14cf-4d50-9303-c62f092f5c9c tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1504 microversion: 2.1 time: 1.225702 May 10 02:21:51.566871 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1361/2804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:50 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1504 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:21:51.582510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:51.587380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:51.615419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:51.616045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:51.617008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:51.617605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:51.930427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:51.939418 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b464e002-e19b-4652-9821-577a53417f09 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1319 microversion: 2.1 time: 0.365815 May 10 02:21:51.943912 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1362/2805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:51 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:51.962303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:51.964497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:52.008885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:52.009842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:52.010828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:52.024525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:52.273228 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e4c0139-323d-4009-94dd-d84362490145 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 204 len: 0 microversion: 2.1 time: 1.500068 May 10 02:21:52.276983 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1444/2806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:50 2022] DELETE /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 0 bytes in 1502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:52.282807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:52.283383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:52.308496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:52.309021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:52.310502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:52.311017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:52.465334 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14f9569c-bef6-4918-88ed-a662c7e80875 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.187129 May 10 02:21:52.466828 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1445/2807] 10.222.0.52 () {58 vars in 1295 bytes} [Tue May 10 02:21:52 2022] DELETE /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2/os-server-password => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:52.474731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:52.475654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:52.482860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:52.483755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:52.484833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:52.485509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:52.521731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:52.646169 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9397ad2f-7310-4959-9548-8622787a8c64 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 204 len: 0 microversion: 2.1 time: 0.177534 May 10 02:21:52.650428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1446/2808] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:52 2022] DELETE /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:52.798398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1821305220", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:52.908315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] validate_networks() for [('82cff4a3-2ea6-4f0d-ab9b-dd9f65750280', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:53.315368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:53.323358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:53.324902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:53.336242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ab34729-f857-4fa7-8a67-2955b6dbcd0e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1739 microversion: 2.20 time: 1.391016 May 10 02:21:53.348481 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1363/2809] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:51 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1739 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:53.348481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:53.348481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:53.354495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:53.354959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:53.355789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:53.356234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:53.419498 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b7de35c6-7844-42c4-9055-a929d1f80fc7 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.080954 May 10 02:21:53.420422 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1364/2810] 10.222.0.52 () {58 vars in 1292 bytes} [Tue May 10 02:21:53 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2/os-server-password => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:21:53.429800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1155906606", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "f68d8830-2b07-4e10-861f-42f50aa74911"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:53.517483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] validate_networks() for [('f68d8830-2b07-4e10-861f-42f50aa74911', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:54.255202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:54.255679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:54.256093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:54.256485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:54.256906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:54.273520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:54.275166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:54.277816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:54.278568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:54.313364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for project ea90205bb50b414890bf521c1182bcd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:54.322462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for user 0a2a71a6cd7c48bcb26383b5cece8a00 and project ea90205bb50b414890bf521c1182bcd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:54.344696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:54.351332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:54.434230 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea85f17c-2f00-4800-8026-c64002b3acfe tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.782151 May 10 02:21:54.435798 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1447/2811] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:21:54.448352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:54.449438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:54.460928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:54.461678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:54.465213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:54.465951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:55.949164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:55.956757 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0cb23179-ea94-467e-ba35-0118c11c5a82 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1319 microversion: 2.1 time: 1.519576 May 10 02:21:55.957342 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1448/2812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:54 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1319 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:55.974466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:55.975086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:55.984164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:55.984615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:55.985617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:55.986206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.048987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:21:56.199819 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f3644bc-d1be-4ffa-995b-de15ae09f9dc tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 204 len: 0 microversion: 2.1 time: 0.235635 May 10 02:21:56.200592 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1449/2813] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:21:55 2022] DELETE /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:21:56.208589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2e02aea4-0b53-43f1-a5c9-d525142a36dc req-0f07a549-4a10-4627-aa11-87d2e8b51c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d59b3116-5ef4-4ade-8cb5-ef09f7266e62", "name": "network-vif-unplugged", "status": "completed", "tag": "3d1b417a-ac60-4fdf-941e-c10591fd83e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:56.219917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2e02aea4-0b53-43f1-a5c9-d525142a36dc req-0f07a549-4a10-4627-aa11-87d2e8b51c18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.220690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2e02aea4-0b53-43f1-a5c9-d525142a36dc req-0f07a549-4a10-4627-aa11-87d2e8b51c18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.235048 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2e02aea4-0b53-43f1-a5c9-d525142a36dc req-0f07a549-4a10-4627-aa11-87d2e8b51c18 service nova] Creating event network-vif-unplugged:3d1b417a-ac60-4fdf-941e-c10591fd83e3 for instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 on n-h1-841089-2 May 10 02:21:56.240643 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2e02aea4-0b53-43f1-a5c9-d525142a36dc req-0f07a549-4a10-4627-aa11-87d2e8b51c18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037461 May 10 02:21:56.242045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1450/2814] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:56.247487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:56.248511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:56.256122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.256887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.257820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.258409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.551052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:56.551637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:56.551970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:56.552611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:56.553191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:56.579412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.580048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.581607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.582225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.605288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:56.620247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for user 81137d6fb1bc4f75a706134b0c13ce63 and project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:56.649259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:56.659230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:21:56.761607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac225d33-e999-401e-abf7-5f578f9355a2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.339667 May 10 02:21:56.768723 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1365/2815] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:21:56.776157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:56.777419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:56.792242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.793055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.794051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.794679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.864686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:56.873173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:56.874693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:56.893786 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2693e309-2ad1-45ac-a7f3-1c5d594f1869 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1721 microversion: 2.20 time: 0.649796 May 10 02:21:56.894394 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1451/2816] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:56 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1721 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:56.901399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:56.902026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:56.944635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.945094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:56.949099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:56.949725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:57.042905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:57.064886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ffe23e5d-f5fd-4cca-92bd-046f88996bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1292 microversion: 2.1 time: 0.293465 May 10 02:21:57.067449 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1366/2817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:56 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:57.098118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5a7627d6-2541-45ef-92b7-f73479e52cfa tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:57.098850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5a7627d6-2541-45ef-92b7-f73479e52cfa tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:57.388020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5a7627d6-2541-45ef-92b7-f73479e52cfa tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:57.414406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5a7627d6-2541-45ef-92b7-f73479e52cfa tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1208 microversion: 2.1 time: 0.343663 May 10 02:21:57.417262 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1367/2818] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:57 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1208 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:57.443694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:57.445793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:57.463319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:57.466055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:57.467175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:57.469208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:58.155452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ae01e31e545fb8969dccbd0089006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fac55bd254b8e990b528a5f3e0fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:58.167456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1caf411f-ff8f-4ead-8847-6bc8b1865df1 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 200 len: 1510 microversion: 2.1 time: 1.267894 May 10 02:21:58.168588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1452/2819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:56 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 1510 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:58.187240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-618587020", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:58.346290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:58.358974 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-26bfe7f9-0fec-4ec1-b28f-c5106e674bfc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1319 microversion: 2.1 time: 0.925990 May 10 02:21:58.360047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1368/2820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:21:57 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1319 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:21:58.367276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:21:58.368627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:21:58.376674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:58.377192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] validate_networks() for [('82cff4a3-2ea6-4f0d-ab9b-dd9f65750280', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:58.384498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:58.386277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:58.386968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:58.828793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:58.838298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:58.842013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:21:58.844300 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71338dea-0507-4f6e-bee3-e38f172722cc tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1721 microversion: 2.20 time: 0.480349 May 10 02:21:58.845113 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1369/2821] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:21:58 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1721 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:21:58.855569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a9f518d5-1224-4cd3-a6c9-b274366d9542 req-5350c0c9-ba4e-4449-84fc-d1b85badf445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d59b3116-5ef4-4ade-8cb5-ef09f7266e62", "name": "network-vif-deleted", "tag": "3d1b417a-ac60-4fdf-941e-c10591fd83e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:58.874230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a9f518d5-1224-4cd3-a6c9-b274366d9542 req-5350c0c9-ba4e-4449-84fc-d1b85badf445 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:58.875023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a9f518d5-1224-4cd3-a6c9-b274366d9542 req-5350c0c9-ba4e-4449-84fc-d1b85badf445 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:58.902947 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a9f518d5-1224-4cd3-a6c9-b274366d9542 req-5350c0c9-ba4e-4449-84fc-d1b85badf445 service nova] Creating event network-vif-deleted:3d1b417a-ac60-4fdf-941e-c10591fd83e3 for instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 on n-h1-841089-2 May 10 02:21:58.913908 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a9f518d5-1224-4cd3-a6c9-b274366d9542 req-5350c0c9-ba4e-4449-84fc-d1b85badf445 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066225 May 10 02:21:58.915240 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1370/2822] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:58.921141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-aeca58f3-f067-4daa-b429-564c3c8b208f req-40ba8f5a-3e8a-40ac-ab6d-a23ea0cc3346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3614adc7-3fb7-40b5-a21b-19d2a5965cf4", "name": "network-vif-plugged", "status": "completed", "tag": "eb921274-3ef4-4970-bd64-994ae32503ea"}, {"server_uuid": "dfdbd3e7-471a-4d74-a8d9-ed0878906f69", "name": "network-vif-plugged", "status": "completed", "tag": "f89a9543-6bb6-4959-9e21-247da8114beb"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:58.946199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-aeca58f3-f067-4daa-b429-564c3c8b208f req-40ba8f5a-3e8a-40ac-ab6d-a23ea0cc3346 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:58.947055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-aeca58f3-f067-4daa-b429-564c3c8b208f req-40ba8f5a-3e8a-40ac-ab6d-a23ea0cc3346 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:58.969912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-aeca58f3-f067-4daa-b429-564c3c8b208f req-40ba8f5a-3e8a-40ac-ab6d-a23ea0cc3346 service nova] Creating event network-vif-plugged:eb921274-3ef4-4970-bd64-994ae32503ea for instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 on n-h1-841089-2 May 10 02:21:58.970746 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-aeca58f3-f067-4daa-b429-564c3c8b208f req-40ba8f5a-3e8a-40ac-ab6d-a23ea0cc3346 service nova] Creating event network-vif-plugged:f89a9543-6bb6-4959-9e21-247da8114beb for instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 on n-h1-841089-2 May 10 02:21:58.980566 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-aeca58f3-f067-4daa-b429-564c3c8b208f req-40ba8f5a-3e8a-40ac-ab6d-a23ea0cc3346 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063345 May 10 02:21:58.981527 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1371/2823] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:21:58.990940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-355890419", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8682642c-6073-47d1-98e4-db33bce76423"}], "security_groups": [{"name": "tempest-securitygroup--203615665"}], "key_name": "tempest-keypair-741386144", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:21:59.578127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] validate_networks() for [('8682642c-6073-47d1-98e4-db33bce76423', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:21:59.825564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:21:59.826153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:21:59.826700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:21:59.827256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:21:59.827804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:21:59.847884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:59.848619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:59.850197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:21:59.850881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:21:59.884414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for project ea90205bb50b414890bf521c1182bcd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:21:59.892142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for user 0a2a71a6cd7c48bcb26383b5cece8a00 and project ea90205bb50b414890bf521c1182bcd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:21:59.912962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:21:59.916607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:00.081685 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a0ce2927-e616-4b46-8e5d-dfe75547e6e9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.911652 May 10 02:22:00.086865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1453/2824] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:22:00.092194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:00.105780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:00.148080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:00.148799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:00.159864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:00.166538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:00.479461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:00.505643 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2830fab6-6010-4723-91b6-08c025674e66 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1268 microversion: 2.1 time: 0.417236 May 10 02:22:00.506309 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1454/2825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:00 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1268 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:00.541850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-754196718", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "3dc2ec51-8664-4f8d-90cd-c1b3d119ca9e"}, {"uuid": "2165c63a-f8bd-48e6-b56b-3e1adb601f9c"}, {"uuid": "3dc2ec51-8664-4f8d-90cd-c1b3d119ca9e"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:00.708075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] validate_networks() for [('3dc2ec51-8664-4f8d-90cd-c1b3d119ca9e', None, None, None, None, None), ('2165c63a-f8bd-48e6-b56b-3e1adb601f9c', None, None, None, None, None), ('3dc2ec51-8664-4f8d-90cd-c1b3d119ca9e', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:22:01.205709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:22:01.206266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:22:01.206606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:22:01.207024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:22:01.207468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:22:01.224509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.225189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:01.227221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.229669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:01.296658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:01.326491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for user 1d0edd300fe34f92a9e265863d12718a and project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:01.363496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:22:01.368948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:01.430461 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e781cb9b-c1f8-438c-81c5-e5e37e51b543 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.447315 May 10 02:22:01.431413 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1372/2826] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:21:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:22:01.688991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8600e557-166d-4784-b397-fab327b6f236 req-9f6cc6aa-cf9f-450b-babd-d910409a70cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf94666-d976-4cf6-ad89-8c1b167c39f2", "name": "network-vif-deleted", "tag": "8cb2615d-2499-4251-b8fe-cc506b9fbd62"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:01.711542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8600e557-166d-4784-b397-fab327b6f236 req-9f6cc6aa-cf9f-450b-babd-d910409a70cb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.712004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8600e557-166d-4784-b397-fab327b6f236 req-9f6cc6aa-cf9f-450b-babd-d910409a70cb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:01.759416 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8600e557-166d-4784-b397-fab327b6f236 req-9f6cc6aa-cf9f-450b-babd-d910409a70cb service nova] Creating event network-vif-deleted:8cb2615d-2499-4251-b8fe-cc506b9fbd62 for instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 on n-h2-841089-2 May 10 02:22:01.775960 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8600e557-166d-4784-b397-fab327b6f236 req-9f6cc6aa-cf9f-450b-babd-d910409a70cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334532 May 10 02:22:01.777840 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1373/2827] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:01.786873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:01.794364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] [instance: 5bf94666-d976-4cf6-ad89-8c1b167c39f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:01.801459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.801918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:01.802704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.803207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:01.837713 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] HTTP exception thrown: Instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 could not be found. May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Request method failure captured: May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 HTTP/1.1 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwgks1mrsouIHKUpNvzd7sYvJrmmjDDV0eoVQRkeYbRreQmN3dmD1TzxREPU4HrNpsi2PzICyxvRFuSRYjGHIoigABTrvFLsKhuDmSx2M8hiqYZBlQQApBG9ba0ZAodMqzcU9QZgzLfTZpHaRey5_n-0RYTCN9zjskqNOlIAB8xQX8 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ce7fac55bd254b8e990b528a5f3e0fd5 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerPasswordTestJSON-1354244629 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce7fac55bd254b8e990b528a5f3e0fd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce7fac55bd254b8e990b528a5f3e0fd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce7fac55bd254b8e990b528a5f3e0fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce7fac55bd254b8e990b528a5f3e0fd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerPasswordTestJSON-1354244629 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ce7fac55bd254b8e990b528a5f3e0fd5 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1354244629 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerPasswordTestJSON-1354244629-project May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 980ae01e31e545fb8969dccbd0089006 May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerPasswordTestJSON-1354244629-project May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 could not be found. May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5bf94666-d976-4cf6-ad89-8c1b167c39f2'} May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 could not be found. May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 could not be found. May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:01.853037 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 could not be found. May 10 02:22:01.857443 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:01.861126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] Returning 404 to user: Instance 5bf94666-d976-4cf6-ad89-8c1b167c39f2 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:22:01.870506 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92df39db-1b01-4ddf-a686-c973423d1f60 tempest-ServerPasswordTestJSON-1354244629 tempest-ServerPasswordTestJSON-1354244629-project] 10.222.0.52 "GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2" status: 404 len: 111 microversion: 2.1 time: 0.086599 May 10 02:22:01.872477 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1374/2828] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:01 2022] GET /compute/v2.1/servers/5bf94666-d976-4cf6-ad89-8c1b167c39f2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:22:01.884101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:01.888053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:01.901116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.901800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:01.902933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:01.903551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:02.603343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:02.614393 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-09776271-5acc-4719-b07a-e2c0b4aa2551 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1469 microversion: 2.1 time: 0.739897 May 10 02:22:02.619856 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1375/2829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:01 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1469 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:02.637584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:02.639552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:02.677876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:02.678602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:02.681226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:02.682144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.253009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:04.267451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:04.274700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:04.276110 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa9a9e49-d0db-425a-b357-fb235a9314e0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1664 microversion: 2.20 time: 1.655092 May 10 02:22:04.279589 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1376/2830] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:02 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1664 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:04.288161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:04.295575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:04.334342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.335436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.336804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.337475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.484276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:04.498258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0bcd36b0-26d5-4f11-a598-93a3f01a5171 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1279 microversion: 2.1 time: 0.212920 May 10 02:22:04.503510 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1377/2831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:04 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:04.517372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-34c0660d-be9b-400e-a3dc-6dde918b788a req-d1e7450a-aed4-41f0-a290-e50ab75f5b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "name": "network-vif-unplugged", "status": "completed", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:04.549768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-34c0660d-be9b-400e-a3dc-6dde918b788a req-d1e7450a-aed4-41f0-a290-e50ab75f5b62 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.553126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-34c0660d-be9b-400e-a3dc-6dde918b788a req-d1e7450a-aed4-41f0-a290-e50ab75f5b62 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.573711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.server_external_events [req-34c0660d-be9b-400e-a3dc-6dde918b788a req-d1e7450a-aed4-41f0-a290-e50ab75f5b62 service nova] Unable to find a host for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67. Dropping event network-vif-unplugged {{(pid=118717) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 02:22:04.574611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-34c0660d-be9b-400e-a3dc-6dde918b788a req-d1e7450a-aed4-41f0-a290-e50ab75f5b62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066400 May 10 02:22:04.581983 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1378/2832] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 02:22:04.586707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:04.587365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:04.604804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.605547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.606486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.607625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.861014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:04.883635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e28fb3b4-2f38-4c57-a97d-99fc8e19952f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1294 microversion: 2.1 time: 0.300498 May 10 02:22:04.896425 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1379/2833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:04 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1294 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:04.899017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:04.899978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:04.921072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.922470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:04.927032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:04.927955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:05.524905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:22:05.527149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:22:05.527785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:22:05.528321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:22:05.530630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:22:05.552492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:05.553079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:05.554002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:05.557483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:05.604623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Getting quotas for project 90addb32e3db4346af6f860d63976eff. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:05.620047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Getting quotas for user 2125b740188b47d290e25d2423cb84dc and project 90addb32e3db4346af6f860d63976eff. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:05.651709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:22:05.654036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:05.768841 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99d6ca4d-1601-42d6-aeb0-e398d05c5e98 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.261424 May 10 02:22:05.774493 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1455/2834] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:22:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:22:05.787647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:05.788397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:05.813684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:05.814343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:05.815913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:05.816520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.467046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:06.475349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e692a310-7bbe-434a-836a-17811667d802 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1308 microversion: 2.1 time: 1.586468 May 10 02:22:06.479109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1380/2835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:04 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1308 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:06.489642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddeb9bd6-d849-4eab-91ca-a55734696760"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:06.500783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:06.516794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.517662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.518696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.523058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.713456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:06.726255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c093d30d-6f43-477e-ae99-43d14497d1ca tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1469 microversion: 2.1 time: 0.949791 May 10 02:22:06.731609 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1456/2836] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:05 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1469 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:06.746452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:06.754700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:06.756328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Searching by: {'deleted': False, 'project_id': 'bddc907860574bf4973e53c83feafecd'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:22:06.773167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.774341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.778530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.779523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.849210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:22:06.884119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-749ee2f1-7bd3-46d6-99f7-bba22acac9c6 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.149498 May 10 02:22:06.885227 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1457/2837] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:22:06 2022] GET /compute/v2.1/servers => generated 339 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:06.891484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-60fc7ebd-afa5-4883-8757-af77418a2e75 req-67616d7a-4023-4c23-961f-71a92610f453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4054a3-0198-45f3-8869-b8f39181090f", "tag": "30c3473a-9334-49c5-8e24-25b29fbba44a"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:06.900255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-60fc7ebd-afa5-4883-8757-af77418a2e75 req-67616d7a-4023-4c23-961f-71a92610f453 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.900915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-60fc7ebd-afa5-4883-8757-af77418a2e75 req-67616d7a-4023-4c23-961f-71a92610f453 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.912374 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-60fc7ebd-afa5-4883-8757-af77418a2e75 req-67616d7a-4023-4c23-961f-71a92610f453 service nova] Creating event network-changed:30c3473a-9334-49c5-8e24-25b29fbba44a for instance 5d4054a3-0198-45f3-8869-b8f39181090f on n-h2-841089-2 May 10 02:22:06.918541 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-60fc7ebd-afa5-4883-8757-af77418a2e75 req-67616d7a-4023-4c23-961f-71a92610f453 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031965 May 10 02:22:06.919496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1458/2838] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:06.926887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:06.927885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:06.934957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.935881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.936996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.938117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.966937 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-15ae6ae4-8cfe-4317-a882-c228598634b7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.485643 May 10 02:22:06.967971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1381/2839] 10.222.0.52 () {62 vars in 1363 bytes} [Tue May 10 02:22:06 2022] POST /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 188 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:22:06.978226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:06.979663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:06.987939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.988712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:06.989864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:06.990563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:07.154175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:07.162834 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-596b9b2a-0911-4ea8-abd2-15ac101bbc8a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1216 microversion: 2.1 time: 0.192496 May 10 02:22:07.163696 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1382/2840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:06 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:07.168469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:07.169328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:07.176650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:07.177445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:07.178412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:07.179035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:07.379213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:07.386969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46bc839c-00cb-4882-a4cc-e2ef95cdc4d9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.465880 May 10 02:22:07.396601 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1459/2841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:06 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:07.400753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6fcc66c1-dfa0-4b9c-9667-4f5ecd901d06 req-634b4c56-8597-4e42-8198-c9cb9da13bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d467dd-f2fb-4d80-b26a-16fe06043cec", "tag": "69ddc964-8950-48c3-a491-0650f386909b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:07.415751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6fcc66c1-dfa0-4b9c-9667-4f5ecd901d06 req-634b4c56-8597-4e42-8198-c9cb9da13bc4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:07.416200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6fcc66c1-dfa0-4b9c-9667-4f5ecd901d06 req-634b4c56-8597-4e42-8198-c9cb9da13bc4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:07.437036 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6fcc66c1-dfa0-4b9c-9667-4f5ecd901d06 req-634b4c56-8597-4e42-8198-c9cb9da13bc4 service nova] Creating event network-changed:69ddc964-8950-48c3-a491-0650f386909b for instance 69d467dd-f2fb-4d80-b26a-16fe06043cec on n-h2-841089-2 May 10 02:22:07.446818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6fcc66c1-dfa0-4b9c-9667-4f5ecd901d06 req-634b4c56-8597-4e42-8198-c9cb9da13bc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058151 May 10 02:22:07.453507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1460/2842] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:07.661871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-532f8bc1-c6af-4fab-8a44-a359b1967b3e tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Action: 'create', calling method: .version_select at 0x7f3d364b8790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-254344498", "metadata": {"Type": "work"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:07.711206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:07.721442 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9125c07a-0a05-43c7-9d88-b173a7387271 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 0.556343 May 10 02:22:07.722017 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1383/2843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:07 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:07.745819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:07.752899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:07.758053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Searching by: {'reservation_id': 'r-0juqs03c', 'deleted': False, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:22:07.774033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:07.775173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:07.776299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:07.776900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:07.932776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:22:08.051589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:08.059570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.060236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.137150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-532f8bc1-c6af-4fab-8a44-a359b1967b3e tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.681732 May 10 02:22:08.137782 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1461/2844] 10.222.0.52 () {60 vars in 1155 bytes} [Tue May 10 02:22:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 683 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 02:22:08.143201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:08.149124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:08.150263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Searching by: {'deleted': False, 'project_id': 'bddc907860574bf4973e53c83feafecd'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:22:08.157427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.158167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.159396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.160241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.216733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:22:08.269964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:08.285412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.286168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.900787 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e848daf-57d6-4070-8c1a-c358c4ea73ef tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.761845 May 10 02:22:08.907197 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1462/2845] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:22:08 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:08.911338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:08.912341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:08.919349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.919818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.920601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.921049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.933625 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abaa8fb5-91b5-47ef-ae01-771eed6d7337 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-0juqs03c" status: 200 len: 2931 microversion: 2.1 time: 1.206900 May 10 02:22:08.947356 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1384/2846] 10.222.0.52 () {58 vars in 1196 bytes} [Tue May 10 02:22:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0juqs03c => generated 2931 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:08.953301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:08.954130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:08.961232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.961899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:08.962678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:08.963140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:09.080695 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c73b89e-6d6e-4df8-b8af-80406fb7f001 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/action" status: 202 len: 0 microversion: 2.20 time: 0.177430 May 10 02:22:09.082618 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1463/2847] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:22:08 2022] POST /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:22:09.089606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dcea0d6e-7af6-47b9-b768-1b9777422e94 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d364b8550>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:09.193637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dcea0d6e-7af6-47b9-b768-1b9777422e94 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 200 len: 352 microversion: 2.1 time: 0.109422 May 10 02:22:09.194403 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1464/2848] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:09 2022] GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:09.199881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:09.200789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:09.208898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:09.209497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:09.210507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:09.211206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:09.374513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:09.383188 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c9ec8e8-04bf-4617-8441-6025e7e8583b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1270 microversion: 2.1 time: 0.187064 May 10 02:22:09.384084 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1465/2849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:09 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:09.391224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:09.391838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:09.399412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:09.400022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:09.402051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:09.402512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:09.495097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:09.515261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-296086d9-219b-4886-9710-7e39e8663ea3 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1308 microversion: 2.1 time: 0.562501 May 10 02:22:09.517128 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1385/2850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:08 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:09.534189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:09.536576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:09.555768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:09.560151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:09.561045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:09.561497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:10.094869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:10.103693 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e69c14f2-12ac-473d-96e0-a509c6fd3364 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.718007 May 10 02:22:10.124962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1466/2851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:09 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:10.142822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-033d57cf-f333-423b-b388-91110b5ff030 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:10.158146 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-033d57cf-f333-423b-b388-91110b5ff030 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028143 May 10 02:22:10.177752 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1467/2852] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:22:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:10.184009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2fd2d57-0210-43f7-bff4-7b768303e7c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:10.221496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.server_groups [None req-c2fd2d57-0210-43f7-bff4-7b768303e7c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Querying cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) for 2 instances {{(pid=118716) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 10 02:22:10.222329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2fd2d57-0210-43f7-bff4-7b768303e7c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:10.226775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2fd2d57-0210-43f7-bff4-7b768303e7c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:10.265497 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c2fd2d57-0210-43f7-bff4-7b768303e7c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/3f5c0835-6a51-4402-b3db-7c7efc8b0e8b" status: 200 len: 266 microversion: 2.1 time: 0.084574 May 10 02:22:10.266336 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1468/2853] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:22:10 2022] GET /compute/v2.1/os-server-groups/3f5c0835-6a51-4402-b3db-7c7efc8b0e8b => generated 266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:10.273884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:10.274789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:10.283115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:10.284083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:10.284883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:10.285495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:10.596730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:10.606713 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-79c70874-b229-4222-9fb0-087420f748f5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 1.086761 May 10 02:22:10.607561 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1386/2854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:09 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:10.612322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ef6f325-4158-49aa-a89e-3317c9168346 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d3609e280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:10.673745 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ef6f325-4158-49aa-a89e-3317c9168346 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 200 len: 353 microversion: 2.1 time: 0.064841 May 10 02:22:10.684050 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1387/2855] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:10 2022] GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:10.689295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:10.690553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:10.696740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:10.697201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:10.697995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:10.698445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.115788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:11.125699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:11.128296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:11.132418 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c03ccfc2-c7db-45f0-8a18-306ebb24c9f3 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1750 microversion: 2.20 time: 0.863743 May 10 02:22:11.146782 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1469/2856] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:10 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1750 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:11.157119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:11.157949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:11.164573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.165033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.165828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.166817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.264508 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d2e8fce5-d62a-40c2-af8e-25cc1c793b8b tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 200 len: 1620 microversion: 2.1 time: 0.578896 May 10 02:22:11.265638 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1388/2857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:10 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 1620 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:11.270925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:11.271605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:11.280105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.281143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.282110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.282726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.313528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:22:11.401647 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a65f75d2-2835-47f4-8ba5-bf39e3167c3a tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 204 len: 0 microversion: 2.1 time: 0.133868 May 10 02:22:11.403533 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1389/2858] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:22:11 2022] DELETE /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:22:11.413559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:11.414445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:11.421216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.421672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.422450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.422917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.810896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:11.828812 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc2b419b-6986-4e2c-8422-1e8fb5b5c9a1 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1312 microversion: 2.1 time: 0.678266 May 10 02:22:11.838827 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1470/2859] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:11 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:11.844676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce285428-963e-4191-99ca-85a90cec0890 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d36442ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:11.907427 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce285428-963e-4191-99ca-85a90cec0890 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 200 len: 353 microversion: 2.1 time: 0.066698 May 10 02:22:11.908320 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1471/2860] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:11 2022] GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:11.915003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5e0b2be6-b9fd-4e44-befd-c9cfcd2f4f19 req-7af7cc31-ba3d-420a-a341-e1af7eb38b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271a109c-84b1-40fc-a0e3-0dbe5ac14af9", "tag": "15150371-b677-48f5-a5c7-d99cb60f1037"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:11.923745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5e0b2be6-b9fd-4e44-befd-c9cfcd2f4f19 req-7af7cc31-ba3d-420a-a341-e1af7eb38b54 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.924738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5e0b2be6-b9fd-4e44-befd-c9cfcd2f4f19 req-7af7cc31-ba3d-420a-a341-e1af7eb38b54 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.936491 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5e0b2be6-b9fd-4e44-befd-c9cfcd2f4f19 req-7af7cc31-ba3d-420a-a341-e1af7eb38b54 service nova] Creating event network-changed:15150371-b677-48f5-a5c7-d99cb60f1037 for instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 on n-h1-841089-2 May 10 02:22:11.942816 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5e0b2be6-b9fd-4e44-befd-c9cfcd2f4f19 req-7af7cc31-ba3d-420a-a341-e1af7eb38b54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033271 May 10 02:22:11.944672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1472/2861] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:11.957144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:11.958483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:11.967483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.967951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:11.968751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:11.969200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.123745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:12.131488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5403fbf-2e5e-4470-b48f-0efe83f0eeab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1308 microversion: 2.1 time: 0.726164 May 10 02:22:12.137995 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1390/2862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:11 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:12.143865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:12.144507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:12.151101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.152054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.152858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.153306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.353846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:12.360936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1ace1cb5-5766-43d8-bc76-87624139be23 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.414785 May 10 02:22:12.361487 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1473/2863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:11 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:12.373263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:12.373968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:12.382076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.382616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.383754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.384417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.531458 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51199c61-d33e-41fe-b37f-2ed6515347f9 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1620 microversion: 2.1 time: 0.391123 May 10 02:22:12.546996 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1391/2864] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:12 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1620 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:12.553244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:12.554237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:12.564561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.565023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.565852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.566461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.780406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:12.789220 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29dae2a5-b913-4980-bad5-da77b2469326 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1715 microversion: 2.1 time: 0.426085 May 10 02:22:12.789797 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1474/2865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:12 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1715 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:12.803484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8e2805b0-2079-4837-9fde-08fc75499116 req-ebca13e2-ff33-42ba-8364-3338fdbd8bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4054a3-0198-45f3-8869-b8f39181090f", "name": "network-vif-plugged", "status": "completed", "tag": "30c3473a-9334-49c5-8e24-25b29fbba44a"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:12.812123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8e2805b0-2079-4837-9fde-08fc75499116 req-ebca13e2-ff33-42ba-8364-3338fdbd8bdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.813277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8e2805b0-2079-4837-9fde-08fc75499116 req-ebca13e2-ff33-42ba-8364-3338fdbd8bdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.826175 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8e2805b0-2079-4837-9fde-08fc75499116 req-ebca13e2-ff33-42ba-8364-3338fdbd8bdd service nova] Creating event network-vif-plugged:30c3473a-9334-49c5-8e24-25b29fbba44a for instance 5d4054a3-0198-45f3-8869-b8f39181090f on n-h2-841089-2 May 10 02:22:12.833235 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8e2805b0-2079-4837-9fde-08fc75499116 req-ebca13e2-ff33-42ba-8364-3338fdbd8bdd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 May 10 02:22:12.838088 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1475/2866] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:12.843962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-811d2bde-c906-4047-af1c-8b1ecafc4b50 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d36442d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:12.934261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-811d2bde-c906-4047-af1c-8b1ecafc4b50 tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 202 len: 0 microversion: 2.1 time: 0.094546 May 10 02:22:12.935225 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1476/2867] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:22:12 2022] DELETE /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:22:12.942847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:12.944092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:12.951440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.952383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:12.953653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:12.954373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:13.262920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:13.276347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e5534d5-73c5-43f8-aa96-4cb6199c4199 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 0.728007 May 10 02:22:13.277495 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1392/2868] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:12 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:13.285448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe82c16e-5c44-4c0d-9947-a597f134f3bc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: .version_select at 0x7f3d35f96b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-76636874", "policies": ["anti-affinity"]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:13.318610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fe82c16e-5c44-4c0d-9947-a597f134f3bc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:13.329824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fe82c16e-5c44-4c0d-9947-a597f134f3bc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:13.403214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fe82c16e-5c44-4c0d-9947-a597f134f3bc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:13.410077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fe82c16e-5c44-4c0d-9947-a597f134f3bc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:13.426820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe82c16e-5c44-4c0d-9947-a597f134f3bc tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.146576 May 10 02:22:13.428915 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1393/2869] 10.222.0.52 () {60 vars in 1173 bytes} [Tue May 10 02:22:13 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:13.436138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:13.437263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:13.447423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:13.448918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:13.449988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:13.451113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:13.608168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:13.618285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:13.633228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:13.634740 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0deb0fe4-7569-416a-a15c-10110ef09fb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1752 microversion: 2.20 time: 0.698376 May 10 02:22:13.635811 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1477/2870] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:12 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1752 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:13.650027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3b3de4a-8b27-467d-ab8e-a33355437a2b tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d364a93a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:13.759343 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3b3de4a-8b27-467d-ab8e-a33355437a2b tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 200 len: 352 microversion: 2.1 time: 0.122193 May 10 02:22:13.759928 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1478/2871] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:13 2022] GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:13.765203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:13.766582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:13.779110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:13.779570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:13.780621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:13.781062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:14.192551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:14.203857 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d79f7de-f8b2-4d3b-821e-89ef5b9c5bf2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1312 microversion: 2.1 time: 0.773139 May 10 02:22:14.209666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1394/2872] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:13 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1312 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:14.214704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:14.227163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:14.232891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:14.255911 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cd83222-b7e5-4e93-9aa6-d36c0be61835 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1308 microversion: 2.1 time: 0.494398 May 10 02:22:14.258656 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1479/2873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:13 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:14.260934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:14.267560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:14.269559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:14.270425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:14.271915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-862724268", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7d4bd606-5bd9-4756-aa38-890298eebcd9"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:14.381406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:22:14.852673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:14.884838 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fd42daf-e954-45b0-bd95-277163fc7b41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.672934 May 10 02:22:14.890948 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1395/2874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:14 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:14.912755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:14.913691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:14.923856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:14.925254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:14.926353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:14.927079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:15.618826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:22:15.620377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:22:15.621036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:22:15.621613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:22:15.622669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:22:15.652781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:15.659023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:15.662100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:15.663424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:15.693346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:15.703409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:15.742633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Going to run 2 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:22:15.748591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:15.817466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=118716) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 10 02:22:15.866047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:15.876082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:15.916260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d4842db6fb424788c7c7e38ee8e474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bddc907860574bf4973e53c83feafecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:15.928117 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [af0ce678-38af-40ed-bccb-524a4108395c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 02:22:15.930021 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fb19e90-7e96-4b56-8016-8dbd0a99e8d0 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 200 len: 1715 microversion: 2.1 time: 1.037235 May 10 02:22:15.930898 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1396/2875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:14 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 1715 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:15.955937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-51d2e6df-cff3-4539-bb0f-0daea5084325 req-6cf72a8b-097c-4b04-8bff-a8c1075c43ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f", "tag": "b4c87fe7-502a-4015-99c8-304fad130fc6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:15.973803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-51d2e6df-cff3-4539-bb0f-0daea5084325 req-6cf72a8b-097c-4b04-8bff-a8c1075c43ef service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:15.975673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-51d2e6df-cff3-4539-bb0f-0daea5084325 req-6cf72a8b-097c-4b04-8bff-a8c1075c43ef service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:16.005658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-51d2e6df-cff3-4539-bb0f-0daea5084325 req-6cf72a8b-097c-4b04-8bff-a8c1075c43ef service nova] Creating event network-changed:b4c87fe7-502a-4015-99c8-304fad130fc6 for instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f on n-h1-841089-2 May 10 02:22:16.023761 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-51d2e6df-cff3-4539-bb0f-0daea5084325 req-6cf72a8b-097c-4b04-8bff-a8c1075c43ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068850 May 10 02:22:16.043207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1397/2876] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:16.062118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:16.063261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:16.072742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:16.073429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:16.074439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:16.075039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:16.874488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:16.891912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fd4d1f23-c331-4ac8-9b64-8ba9549ff9b8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 0.844256 May 10 02:22:16.897263 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1398/2877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:16 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:16.907294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:16.916221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:16.937094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:16.937730 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [af0ce678-38af-40ed-bccb-524a4108395c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60768. May 10 02:22:16.938107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:16.943957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:16.944382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:16.975632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:16.993171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:17.048257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=255f02d9-1a66-4536-a9c4-4535832be9ea,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:17.189354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:17.198890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:17.273087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:17.288140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:17.376107 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7fe69181-bab2-477d-b321-7a68c6e375c5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.115833 May 10 02:22:17.377235 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1480/2878] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:22:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 3118 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 10 02:22:17.382073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7514e332-d087-4a0a-bd60-01072672c93c tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d364a9430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:17.491421 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7514e332-d087-4a0a-bd60-01072672c93c tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 200 len: 352 microversion: 2.1 time: 0.112982 May 10 02:22:17.492117 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1481/2879] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:17 2022] GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:17.496867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:17.497773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:17.515666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:17.523793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:17.524942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:17.531215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:17.718252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:17.733391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:17.735574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:17.739464 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56dac3be-05c2-4b15-8e4e-cac212c510f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1752 microversion: 2.20 time: 0.841105 May 10 02:22:17.742884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1399/2880] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:16 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1752 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:17.766407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:17.771845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:17.779344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:17.780255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:17.781355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:17.781979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.140444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:18.160837 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-386edae7-b48f-4b5b-8a70-f6d6a657e05a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1333 microversion: 2.1 time: 0.654776 May 10 02:22:18.162045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1482/2881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:17 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1333 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:18.175971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:18.181876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:18.198023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.198476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.199300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.199742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.412458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:18.424015 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee670198-1224-4f85-aa62-7c9aa81466ce tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1489 microversion: 2.1 time: 0.666385 May 10 02:22:18.443575 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1400/2882] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:17 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1489 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:18.448381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e628d7d8-e43f-4e88-b949-cab1561ca89a req-2b68de6b-5044-45a2-8723-c17166a6dc4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d467dd-f2fb-4d80-b26a-16fe06043cec", "name": "network-vif-plugged", "status": "completed", "tag": "69ddc964-8950-48c3-a491-0650f386909b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:18.474630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e628d7d8-e43f-4e88-b949-cab1561ca89a req-2b68de6b-5044-45a2-8723-c17166a6dc4e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.475188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e628d7d8-e43f-4e88-b949-cab1561ca89a req-2b68de6b-5044-45a2-8723-c17166a6dc4e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.505951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:18.514236 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07aa9134-e408-49af-895c-c0f5e61481f7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.350968 May 10 02:22:18.517475 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1483/2883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:18 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:18.518178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e628d7d8-e43f-4e88-b949-cab1561ca89a req-2b68de6b-5044-45a2-8723-c17166a6dc4e service nova] Creating event network-vif-plugged:69ddc964-8950-48c3-a491-0650f386909b for instance 69d467dd-f2fb-4d80-b26a-16fe06043cec on n-h2-841089-2 May 10 02:22:18.528708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:18.529757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] [instance: 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:18.535485 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e628d7d8-e43f-4e88-b949-cab1561ca89a req-2b68de6b-5044-45a2-8723-c17166a6dc4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090432 May 10 02:22:18.541577 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1401/2884] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:18.545082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.545745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.547104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:18.548123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.549849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.566271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:18.567266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Searching by: {'deleted': False, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:22:18.578523 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] HTTP exception thrown: Instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 could not be found. May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Request method failure captured: May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 HTTP/1.1 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwOCBOGdt8mgulmP080OkqtM_g8qsyq0CN85nFPSYBNkN6ZE7UBrNWm37Tkj5GB7wZkq5E_x5bUGkDZBTOWwH0g22O2ju4G-CpegcZkK7ygIL9k4lMkFGHwp_iQ-CnsLJKlxSOScfVOXYbDuLvPf0Ey3y46voHC9lsFEK8waEBnndk May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: bddc907860574bf4973e53c83feafecd May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestManualDisk-2031397015 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bddc907860574bf4973e53c83feafecd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bddc907860574bf4973e53c83feafecd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bddc907860574bf4973e53c83feafecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bddc907860574bf4973e53c83feafecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestManualDisk-2031397015 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: bddc907860574bf4973e53c83feafecd May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestManualDisk-2031397015 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestManualDisk-2031397015-project May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 59d4842db6fb424788c7c7e38ee8e474 May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestManualDisk-2031397015-project May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 could not be found. May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9'} May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 could not be found. May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 could not be found. May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:18.591337 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 could not be found. May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Returning 404 to user: Instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:22:18.596457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4343b307-b01b-46fc-af1b-c9af1410b32f tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9" status: 404 len: 111 microversion: 2.1 time: 0.073595 May 10 02:22:18.597156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.597156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.597156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.597156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.597531 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1484/2885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:18 2022] GET /compute/v2.1/servers/6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:22:18.606213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:18.612835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:18.622776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.623264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.626873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.635592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.657207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:22:18.722632 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-913faa56-6441-4a7f-8ab6-08116c3ee6b7 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.179593 May 10 02:22:18.723270 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1402/2886] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:22:18 2022] GET /compute/v2.1/servers => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:18.733199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ef8ee7d8-b51e-4b99-be6a-c56beeb1687e req-90e64be9-4952-4db7-8ef7-1ef8cbd28864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9", "name": "network-vif-deleted", "tag": "4d429704-892e-425f-8265-395b5d209a46"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:18.751737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ef8ee7d8-b51e-4b99-be6a-c56beeb1687e req-90e64be9-4952-4db7-8ef7-1ef8cbd28864 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.753660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ef8ee7d8-b51e-4b99-be6a-c56beeb1687e req-90e64be9-4952-4db7-8ef7-1ef8cbd28864 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.787946 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ef8ee7d8-b51e-4b99-be6a-c56beeb1687e req-90e64be9-4952-4db7-8ef7-1ef8cbd28864 service nova] Creating event network-vif-deleted:4d429704-892e-425f-8265-395b5d209a46 for instance 6e338e69-8bb3-4e7c-8b86-3af5dc7c14e9 on n-h2-841089-2 May 10 02:22:18.804261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ef8ee7d8-b51e-4b99-be6a-c56beeb1687e req-90e64be9-4952-4db7-8ef7-1ef8cbd28864 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079718 May 10 02:22:18.805463 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1403/2887] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:18.811375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4197c5bc-65dc-46b6-9c43-7d7d40bea63e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:18.820463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4197c5bc-65dc-46b6-9c43-7d7d40bea63e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:18.828925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4197c5bc-65dc-46b6-9c43-7d7d40bea63e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:18.875025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4197c5bc-65dc-46b6-9c43-7d7d40bea63e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:22:18.980193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4197c5bc-65dc-46b6-9c43-7d7d40bea63e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f/action" status: 202 len: 0 microversion: 2.1 time: 0.173148 May 10 02:22:18.980823 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1404/2888] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:22:18 2022] POST /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:22:18.996999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e665350-e65c-49b3-af6d-650adebb96ed tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Calling method '.version_select at 0x7f3d35f9adc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:19.111396 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2e665350-e65c-49b3-af6d-650adebb96ed tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] HTTP exception thrown: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e665350-e65c-49b3-af6d-650adebb96ed tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Request method failure captured: May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd HTTP/1.1 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxOwrrU5ydaO7-Lx2mt7Qat0mtaMKVDbR18x3Pam08b73HmBbuYH58CwSRZoKmU6F4xDgUYq2Zv4adAgNZiKC8Jn8HjxX8MBGGFHfHPYqRQ7Rpu7AqwdGMEvQ4SC5H_jqIG-BEypUDH2Me3bzk-5ED2SbDurV5HK80CvWDMjBZ4604 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: cdd7b6be0a5541148e76beef5d21b07a May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesGetTestJSON-1229697046 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdd7b6be0a5541148e76beef5d21b07a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdd7b6be0a5541148e76beef5d21b07a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdd7b6be0a5541148e76beef5d21b07a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdd7b6be0a5541148e76beef5d21b07a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesGetTestJSON-1229697046 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: cdd7b6be0a5541148e76beef5d21b07a May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesGetTestJSON-1229697046 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesGetTestJSON-1229697046-project May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4d77edcb62c8482d9dd0bc928a43c013 May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesGetTestJSON-1229697046-project May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: exception: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd'} May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. (HTTP 404) (Request-ID: req-45a3d08c-8b54-4aa3-a167-683bd3271780) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:22:19.123979 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e665350-e65c-49b3-af6d-650adebb96ed tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] Returning 404 to user: Volume 39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:22:19.127998 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e665350-e65c-49b3-af6d-650adebb96ed tempest-VolumesGetTestJSON-1229697046 tempest-VolumesGetTestJSON-1229697046-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd" status: 404 len: 109 microversion: 2.1 time: 0.132874 May 10 02:22:19.130103 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1405/2889] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:18 2022] GET /compute/v2.1/os-volumes/39ba62c2-a5fe-4dd8-907c-2f5c2f9327dd => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:22:19.152369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-704dc0f8-f11b-429a-b453-529c3e70f535 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] Calling method '.version_select at 0x7f3d360bddc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:19.220773 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-704dc0f8-f11b-429a-b453-529c3e70f535 tempest-ServersTestManualDisk-2031397015 tempest-ServersTestManualDisk-2031397015-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898453497" status: 202 len: 0 microversion: 2.1 time: 0.088908 May 10 02:22:19.221596 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1406/2890] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898453497 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:22:19.234089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:19.247560 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0bdb166-d869-450d-aae8-62177f90dd6c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 0.649046 May 10 02:22:19.248788 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1485/2891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:18 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:19.259521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:19.260288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:19.260864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:19.263832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:19.288758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:19.291227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:19.291555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:19.292126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:19.293063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:19.293980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:19.294530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:19.295095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:19.817348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:19.827195 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5a8565f-973e-447a-9636-41678d8bcecb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1214 microversion: 2.1 time: 0.603296 May 10 02:22:19.839927 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1407/2892] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:19 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1214 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:19.850974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:19.851982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:19.866675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:19.867574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:19.868669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:19.869334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:20.309736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:20.324963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:20.326633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:20.330073 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-30804f2a-68f7-4484-bd00-c0cefc8c8a81 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1752 microversion: 2.20 time: 1.078086 May 10 02:22:20.344325 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1486/2893] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:19 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1752 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:20.357651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:20.358667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:20.384012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:20.385451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:20.387194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:20.388820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:20.479023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:20.491456 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9cda93b-f73c-448f-9242-e0401e7cb498 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.646567 May 10 02:22:20.492265 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1408/2894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:19 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:20.505656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:20.506287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:20.519362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:20.519988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:20.520797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:20.521246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.075451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:21.114956 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6aabc64-2c56-41ac-b477-5b667aaaa4a8 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.768986 May 10 02:22:21.116481 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1487/2895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:20 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:21.128639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:21.129976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:21.141766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.147081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.150495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.151139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.233752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:21.243456 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-31603314-e6aa-4e10-9c2a-5b708c7424c3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.750108 May 10 02:22:21.247540 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1409/2896] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:20 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:21.252705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-88fd6b8c-f04f-4c67-bb68-a87f36c6c10a req-a29c9d1c-eb8c-4ccd-9945-d851c024a135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271a109c-84b1-40fc-a0e3-0dbe5ac14af9", "name": "network-vif-plugged", "status": "completed", "tag": "15150371-b677-48f5-a5c7-d99cb60f1037"}, {"server_uuid": "eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f", "name": "network-vif-plugged", "status": "completed", "tag": "b4c87fe7-502a-4015-99c8-304fad130fc6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:21.283688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-88fd6b8c-f04f-4c67-bb68-a87f36c6c10a req-a29c9d1c-eb8c-4ccd-9945-d851c024a135 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.287778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-88fd6b8c-f04f-4c67-bb68-a87f36c6c10a req-a29c9d1c-eb8c-4ccd-9945-d851c024a135 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.318725 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-88fd6b8c-f04f-4c67-bb68-a87f36c6c10a req-a29c9d1c-eb8c-4ccd-9945-d851c024a135 service nova] Creating event network-vif-plugged:15150371-b677-48f5-a5c7-d99cb60f1037 for instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 on n-h1-841089-2 May 10 02:22:21.320893 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-88fd6b8c-f04f-4c67-bb68-a87f36c6c10a req-a29c9d1c-eb8c-4ccd-9945-d851c024a135 service nova] Creating event network-vif-plugged:b4c87fe7-502a-4015-99c8-304fad130fc6 for instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f on n-h1-841089-2 May 10 02:22:21.333362 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-88fd6b8c-f04f-4c67-bb68-a87f36c6c10a req-a29c9d1c-eb8c-4ccd-9945-d851c024a135 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084480 May 10 02:22:21.334581 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1410/2897] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:21.346862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:21.350397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:21.382893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.383963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.386287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.395458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.686018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:21.694778 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-053c6ed3-5c3d-4c66-8e98-afe6f8da83de tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1276 microversion: 2.1 time: 0.354921 May 10 02:22:21.706975 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1411/2898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:21 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1276 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:21.712206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:21.713048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:21.736895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.738154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.739778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.740918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.901432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:21.928527 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b006f1dc-c4fb-4763-9656-59d213d7f05d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 0.805006 May 10 02:22:21.953112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1488/2899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:21 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:21.976541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:21.977660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:21.990887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:21.994278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:21.995402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:22.003496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:22.447249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:22.454672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-420a5d03-eddb-4d99-969f-8f3e1e5109ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.499251 May 10 02:22:22.460110 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1489/2900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:21 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:22.472121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:22.472762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:22.480199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:22.490780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:22.491289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:22.492095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:22.492545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:22.495026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:22.498559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:22.501339 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e79f99c-743b-44de-bd0e-fafed83c76f4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1752 microversion: 2.20 time: 0.793040 May 10 02:22:22.504453 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1412/2901] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:21 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1752 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:22.510443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:22.516848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:22.527392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:22.537265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:22.539772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:22.541362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.244163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:23.252758 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bfa4b58b-b3e6-47a0-959e-55f8ff755a3f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.791472 May 10 02:22:23.259579 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1490/2902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:22 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:23.270107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:23.270661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:23.282646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.284121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.285088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.285684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.450111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:23.458519 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5c73774-6775-4a82-a867-86c98bac383f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1276 microversion: 2.1 time: 0.197610 May 10 02:22:23.459693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1491/2903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:23 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:23.461348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:23.465524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:23.466328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:23.475668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.476358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.476481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92db073a-277e-4ffd-8bec-4fbe3bce61d4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1321 microversion: 2.1 time: 0.970640 May 10 02:22:23.476962 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1413/2904] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:22 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1321 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:23.477589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.478189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.497466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-21611ff5-df76-4364-a137-a9b17d4787fd req-ff38ac43-1a62-43cf-afb9-fe3c1c29aa1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "tag": "5697ea60-aabd-4aa8-9db0-1ec1c3efab59"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:23.525971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21611ff5-df76-4364-a137-a9b17d4787fd req-ff38ac43-1a62-43cf-afb9-fe3c1c29aa1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.526439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21611ff5-df76-4364-a137-a9b17d4787fd req-ff38ac43-1a62-43cf-afb9-fe3c1c29aa1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.563102 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-21611ff5-df76-4364-a137-a9b17d4787fd req-ff38ac43-1a62-43cf-afb9-fe3c1c29aa1b service nova] Creating event network-changed:5697ea60-aabd-4aa8-9db0-1ec1c3efab59 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:23.574739 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-21611ff5-df76-4364-a137-a9b17d4787fd req-ff38ac43-1a62-43cf-afb9-fe3c1c29aa1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090247 May 10 02:22:23.575892 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1414/2905] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:23.581256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:23.581974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:23.589217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.589950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:23.591221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:23.591908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:24.315438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:24.325614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc898217-8eae-4fbe-9b42-1887382a3c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1361 microversion: 2.1 time: 0.864649 May 10 02:22:24.334915 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1492/2906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:23 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1361 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:24.360821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:24.375998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:24.391382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:24.400158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:24.401427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:24.402679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:24.434811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:24.443359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b2b87ac-a47f-43e4-bd01-ec668bcd4877 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.866169 May 10 02:22:24.458261 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1415/2907] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:23 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:24.463980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:24.464890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:24.481894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:24.484107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:24.488380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:24.489183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:25.382630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:25.392885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:25.395598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:25.396961 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eba1ff08-9c9c-4b6f-9879-6ba5b1cb5dab tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1752 microversion: 2.20 time: 1.051816 May 10 02:22:25.397668 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1493/2908] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:24 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1752 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:25.403920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:25.404873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:25.411678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:25.412207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:25.413064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:25.413783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:25.442816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:25.450732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3983bc98-4e6a-44e4-9474-35ee2471826a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.990930 May 10 02:22:25.457977 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1416/2909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:24 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:25.464163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:25.465155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:25.472648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:25.473382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:25.474521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:25.474974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:25.924073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:25.931356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1e898f71-98d3-4c4b-8879-1eaaa13923e8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1276 microversion: 2.1 time: 0.531322 May 10 02:22:25.931936 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1494/2910] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:25 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1276 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:25.941120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-823d70ad-5445-4615-b948-5176408ce090 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d36fe0280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:25.981564 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-823d70ad-5445-4615-b948-5176408ce090 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/aafc964c-9469-4c1b-ae3b-243a7c9e8838" status: 200 len: 351 microversion: 2.1 time: 0.048586 May 10 02:22:25.988343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1495/2911] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:25 2022] GET /compute/v2.1/os-volumes/aafc964c-9469-4c1b-ae3b-243a7c9e8838 => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:25.988343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:25.988343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:25.994469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:25.995090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:25.995944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:25.996561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:26.398665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:26.407140 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b3163a72-b17f-440e-b95f-19ee2083d66f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1514 microversion: 2.1 time: 0.947771 May 10 02:22:26.407845 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1417/2912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:25 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1514 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:26.413957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:26.414878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:26.422167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:26.422771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:26.423585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:26.424232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:26.647766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:26.670376 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09e3b59c-29f4-4868-89bb-823ef5113755 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1546 microversion: 2.1 time: 0.687149 May 10 02:22:26.677752 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1496/2913] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:25 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1546 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:26.690185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:26.693623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:26.704123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:26.704787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:26.705825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:26.706432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:27.237031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:27.245785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c60e5ca-6274-47c2-a0ef-b54383a7eab8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.836440 May 10 02:22:27.246369 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1418/2914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:26 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:27.255841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:27.257274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:27.265550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:27.266229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:27.267376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:27.268815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:27.308824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'flavor' on Instance uuid 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:22:27.370967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:27.379769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:27.393070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:27.394556 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-119aafab-72c7-4239-97fb-485928ba96ba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.715612 May 10 02:22:27.395174 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1497/2915] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:26 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:27.399828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:27.400623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:27.417418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:27.417886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:27.418691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:27.419176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:27.438423 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a00dc4c1-0200-46ca-9cdc-4a770815f395 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action" status: 200 len: 32 microversion: 2.1 time: 0.190315 May 10 02:22:27.444744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1419/2916] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:22:27 2022] POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:22:27.457693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:27.458683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:27.466506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:27.466973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:27.467909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:27.476515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:28.078128 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7558e14e-3730-40db-a187-9d28402ee633 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.629503 May 10 02:22:28.079156 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1420/2917] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:22:27 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-interface => generated 284 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:28.085042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:28.086110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:28.093788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:28.094721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:28.095856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:28.096448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:28.457984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:28.475768 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3df8478-0ea7-4025-870e-739252a47a5b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 1.079330 May 10 02:22:28.487567 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1498/2918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:27 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:28.489821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:28.490683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:28.506863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:28.507648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:28.508457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:28.508912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:29.150370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:29.158835 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19f4ea35-e21d-4f35-ad6d-8bba4b2b9c9b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 1.078558 May 10 02:22:29.160007 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1421/2919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:28 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:29.165690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:29.166645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:29.173152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:29.175139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:29.176163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:29.176827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:29.387096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:29.402936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8e9f784-3381-4ec1-afe8-b2cd87f38d4e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.923570 May 10 02:22:29.415723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1499/2920] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:28 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:29.415723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:29.420588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:29.431098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:29.431955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:29.433044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:29.434033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:30.067036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:30.082238 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75c830ea-c177-419e-9813-232cbbc716ba tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.920078 May 10 02:22:30.096770 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1422/2921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:29 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:30.104539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1d9c1be5-fe4b-4412-a8fc-b740cb972829 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d35fa00d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:30.218739 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1d9c1be5-fe4b-4412-a8fc-b740cb972829 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/dd6cadec-d2d3-4ac0-ad10-a16c8bacb0d0" status: 200 len: 351 microversion: 2.1 time: 0.120582 May 10 02:22:30.226638 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1423/2922] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:30 2022] GET /compute/v2.1/os-volumes/dd6cadec-d2d3-4ac0-ad10-a16c8bacb0d0 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:30.232665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ef0956d2-db33-41d2-bd2c-8a605ee7c51b req-d815770b-66a7-4af1-81cf-436165d7f46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "tag": "a84ac88c-2929-40c2-8767-ad081523d466"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:30.242011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ef0956d2-db33-41d2-bd2c-8a605ee7c51b req-d815770b-66a7-4af1-81cf-436165d7f46c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:30.242644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ef0956d2-db33-41d2-bd2c-8a605ee7c51b req-d815770b-66a7-4af1-81cf-436165d7f46c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:30.254821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:30.256668 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ef0956d2-db33-41d2-bd2c-8a605ee7c51b req-d815770b-66a7-4af1-81cf-436165d7f46c service nova] Creating event network-changed:a84ac88c-2929-40c2-8767-ad081523d466 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:30.262646 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ef0956d2-db33-41d2-bd2c-8a605ee7c51b req-d815770b-66a7-4af1-81cf-436165d7f46c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 May 10 02:22:30.263529 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1424/2923] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:30.269179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:30.270585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:30.277361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:30.278094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:30.279055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:30.279810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:30.331400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:30.333028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:30.334258 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-73bdab03-a233-459b-a487-983d0c65dc11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.923648 May 10 02:22:30.334829 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1500/2924] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:29 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:30.375298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-492b9b58-f19f-4637-8ac9-f1eef33b131a req-30fde6d9-4180-4df1-a9ef-5ef3a3618fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f", "tag": "b4c87fe7-502a-4015-99c8-304fad130fc6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:30.398417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-492b9b58-f19f-4637-8ac9-f1eef33b131a req-30fde6d9-4180-4df1-a9ef-5ef3a3618fb9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:30.398801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-492b9b58-f19f-4637-8ac9-f1eef33b131a req-30fde6d9-4180-4df1-a9ef-5ef3a3618fb9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:30.428875 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-492b9b58-f19f-4637-8ac9-f1eef33b131a req-30fde6d9-4180-4df1-a9ef-5ef3a3618fb9 service nova] Creating event network-changed:b4c87fe7-502a-4015-99c8-304fad130fc6 for instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f on n-h1-841089-2 May 10 02:22:30.436680 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-492b9b58-f19f-4637-8ac9-f1eef33b131a req-30fde6d9-4180-4df1-a9ef-5ef3a3618fb9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095380 May 10 02:22:30.438414 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1501/2925] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:30.446256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:30.447319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:30.455785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:30.456607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:30.457622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:30.458394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:31.220495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:31.242372 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f6dd4f78-1420-4f4b-9678-23434735d2d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.977406 May 10 02:22:31.243437 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1425/2926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:30 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:31.253041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:31.257732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:31.271082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:31.274184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:31.275008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:31.275720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:31.332095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:31.342266 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddba1b40-35a2-4e0c-98a1-cadf8e043b0d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.902381 May 10 02:22:31.343286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1502/2927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:30 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:31.347871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:31.354114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:31.367011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:31.367505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:31.368305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:31.374010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:32.158800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:32.170279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fcb8d437-fb0d-413b-a3fc-5c14b32902ac tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.825457 May 10 02:22:32.171455 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1503/2928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:31 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:32.179872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:32.181748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:32.190316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:32.191016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:32.192009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:32.192686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:32.312099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:32.342893 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acba027f-368c-46bc-b9ab-ff77bc17e775 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 1.098191 May 10 02:22:32.352310 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1426/2929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:31 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:32.370551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:32.373566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:32.408833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:32.409767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:32.410724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:32.411352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.222814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:33.231401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:33.232916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:33.236048 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-add72d8d-7335-4c4e-af14-1b1493daad61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 1.062318 May 10 02:22:33.247475 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1504/2930] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:32 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:33.249519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-49c5a6ca-730d-451a-981e-6b4a30bc7211 req-afc1ec3e-4774-4f44-b495-bd1b3ec658b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "255f02d9-1a66-4536-a9c4-4535832be9ea", "tag": "9251dc32-040f-40eb-95a7-22f9f242aedb"}, {"name": "network-changed", "server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:33.258672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-49c5a6ca-730d-451a-981e-6b4a30bc7211 req-afc1ec3e-4774-4f44-b495-bd1b3ec658b3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.259154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-49c5a6ca-730d-451a-981e-6b4a30bc7211 req-afc1ec3e-4774-4f44-b495-bd1b3ec658b3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.271802 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-49c5a6ca-730d-451a-981e-6b4a30bc7211 req-afc1ec3e-4774-4f44-b495-bd1b3ec658b3 service nova] Creating event network-changed:9251dc32-040f-40eb-95a7-22f9f242aedb for instance 255f02d9-1a66-4536-a9c4-4535832be9ea on n-h1-841089-2 May 10 02:22:33.272327 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-49c5a6ca-730d-451a-981e-6b4a30bc7211 req-afc1ec3e-4774-4f44-b495-bd1b3ec658b3 service nova] Creating event network-changed:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h1-841089-2 May 10 02:22:33.279430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-49c5a6ca-730d-451a-981e-6b4a30bc7211 req-afc1ec3e-4774-4f44-b495-bd1b3ec658b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035662 May 10 02:22:33.280808 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1505/2931] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:33.287541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:33.288323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:33.305062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.305711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.306889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.307544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.437562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:33.444996 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-27646b81-4761-43f1-a2b8-4f41555fcc96 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 1.090801 May 10 02:22:33.445670 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1427/2932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:32 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:33.458730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38ec74fa-4526-415a-9518-83474732e1e9 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d35f9a9d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:33.509812 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38ec74fa-4526-415a-9518-83474732e1e9 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8a44e3ef-6aef-42b1-b7ef-57906f6e4e47" status: 200 len: 350 microversion: 2.1 time: 0.054613 May 10 02:22:33.510396 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1428/2933] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:22:33 2022] GET /compute/v2.1/os-volumes/8a44e3ef-6aef-42b1-b7ef-57906f6e4e47 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:33.520514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:33.521139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:33.527456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.528024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.528720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.529143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.777192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:33.785648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8cef0a75-3979-4eb5-bce2-f97b2c8b3341 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.503682 May 10 02:22:33.786434 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1506/2934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:33 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:33.896996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-599114619", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "1c775d85-3505-428f-bf4d-c939f0051303"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:33.926671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:33.934434 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8d2becc6-678e-446f-b5c2-b7b870a40326 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.421720 May 10 02:22:33.934999 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1429/2935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:33 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:33.945690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:33.946464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:33.952930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] validate_networks() for [('1c775d85-3505-428f-bf4d-c939f0051303', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:22:33.953101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.953580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:33.954359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:33.954792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.294126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:34.302333 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7f794f9-430c-4314-9c27-bec8e0c90188 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.366094 May 10 02:22:34.303003 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1430/2936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:33 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:34.307516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b87f9ec5-ca2b-4406-894e-6ee55b12ffe7 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d36131040>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.392057 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b87f9ec5-ca2b-4406-894e-6ee55b12ffe7 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087975 May 10 02:22:34.392658 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1431/2937] 10.222.0.52 () {58 vars in 1133 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:34.397374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.398016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:34.404121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.404580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.405615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.406060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.580851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:22:34.581319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:22:34.581787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:22:34.582204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:22:34.582623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:22:34.591522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.591984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.593877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.594324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.603204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:34.612134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:34.613279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Getting quotas for project 91cb529204ff4bfbb2e27402217ff248. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:34.614012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:34.615279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b69d9fd-5aaf-4dab-a04a-28f04c1df398 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.221470 May 10 02:22:34.615838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1432/2938] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:34.620335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acaf812b-38de-4cd3-8dc1-e9a1283368dd tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d35f67c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.630083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Getting quotas for user 4317ec250efd47ac82e0d04a39f6ebec and project 91cb529204ff4bfbb2e27402217ff248. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:34.648150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:22:34.650525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:34.696395 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f54bbb3f-0f35-479d-8846-58bbc4633494 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909044 May 10 02:22:34.697542 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1507/2939] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:22:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:22:34.702659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.703547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:34.711823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.712471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.713417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.714011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.715024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acaf812b-38de-4cd3-8dc1-e9a1283368dd tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097944 May 10 02:22:34.717319 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1433/2940] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:34.727922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7bc8841-c8d1-4b02-a41c-c06a26a6d946 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.728789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7bc8841-c8d1-4b02-a41c-c06a26a6d946 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:34.870747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7bc8841-c8d1-4b02-a41c-c06a26a6d946 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:34.880918 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7bc8841-c8d1-4b02-a41c-c06a26a6d946 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1216 microversion: 2.1 time: 0.161454 May 10 02:22:34.882642 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1434/2941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:34.888510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6063882b-958e-4040-962d-7808130ffa44 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d360bdc10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.979599 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6063882b-958e-4040-962d-7808130ffa44 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095223 May 10 02:22:34.980342 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1435/2942] 10.222.0.52 () {58 vars in 1133 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:34.987626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:34.988375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:34.995612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.996068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:34.996901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:34.997622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.068515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:35.076118 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dd84115d-f090-4297-930d-f16f380ae164 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.377392 May 10 02:22:35.076777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1508/2943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:35.083396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:35.084395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:35.091148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.091682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.092535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.093047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.644026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:35.651455 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b1ff17e-9811-45a2-801a-830d1da0ee9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.669365 May 10 02:22:35.662795 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1436/2944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:34 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:35.662795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-113ed979-b637-4f4c-bcb5-a10d0076e0d9 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d35fa40d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:35.698762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:35.706744 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bcbbf6b2-1fbb-45ef-9363-4a628bbea55f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.628669 May 10 02:22:35.708914 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1509/2945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:35 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:35.722064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:35.722903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:35.737802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.738299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.739139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.739596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.761876 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-113ed979-b637-4f4c-bcb5-a10d0076e0d9 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.107932 May 10 02:22:35.763571 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1437/2946] 10.222.0.52 () {58 vars in 1166 bytes} [Tue May 10 02:22:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:35.779209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-687da39c-2f0b-4e8b-8a55-a56e6e2b25cb req-e238ef67-d7b6-4bd4-bb20-70840feff46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c39c22-4838-4b6b-8166-11627cded45c", "tag": "957b1852-a0da-4bcd-9397-df8e7a46fd7f"}, {"name": "network-changed", "server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "tag": "b35538e5-7022-4777-80ca-32b6af2d1cb5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:35.810515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-687da39c-2f0b-4e8b-8a55-a56e6e2b25cb req-e238ef67-d7b6-4bd4-bb20-70840feff46a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.812536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-687da39c-2f0b-4e8b-8a55-a56e6e2b25cb req-e238ef67-d7b6-4bd4-bb20-70840feff46a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.839732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-687da39c-2f0b-4e8b-8a55-a56e6e2b25cb req-e238ef67-d7b6-4bd4-bb20-70840feff46a service nova] Creating event network-changed:957b1852-a0da-4bcd-9397-df8e7a46fd7f for instance 15c39c22-4838-4b6b-8166-11627cded45c on n-h2-841089-2 May 10 02:22:35.840531 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-687da39c-2f0b-4e8b-8a55-a56e6e2b25cb req-e238ef67-d7b6-4bd4-bb20-70840feff46a service nova] Creating event network-changed:b35538e5-7022-4777-80ca-32b6af2d1cb5 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:35.859142 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-687da39c-2f0b-4e8b-8a55-a56e6e2b25cb req-e238ef67-d7b6-4bd4-bb20-70840feff46a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085621 May 10 02:22:35.860438 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1438/2947] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:35.867685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:35.868726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:35.877213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.877948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:35.879116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:35.879725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:36.427777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:36.435677 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b611fc9-b4ba-4338-9506-bb90fcfb471c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.722968 May 10 02:22:36.436268 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1510/2948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:35 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:36.449480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69e2b5a2-f705-43ef-a281-902e9e4ef174 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d3644af70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:36.535538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:36.554632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:36.556337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:36.557367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96cfa9d8-59fa-45e2-8a6e-de55ed59bfb6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.695439 May 10 02:22:36.558094 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1439/2949] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:35 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:36.558827 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69e2b5a2-f705-43ef-a281-902e9e4ef174 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.121326 May 10 02:22:36.559470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1511/2950] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:22:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:36.563948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:36.566319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:36.577393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:36.578098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:36.579040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:36.579657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:36.581781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:36.582427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:36.588829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:36.589295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:36.590098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:36.590541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:36.773036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:36.781203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e0844015-c276-49f2-b3d9-d569e2fdaeeb tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1274 microversion: 2.1 time: 0.212938 May 10 02:22:36.791875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1440/2951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:36 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:36.796925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-528f9114-ed9e-4a0f-9f54-57c45e03d7a1 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d36116dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:36.881605 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-528f9114-ed9e-4a0f-9f54-57c45e03d7a1 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088282 May 10 02:22:36.882182 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1441/2952] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:22:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:36.886639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:36.887426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:36.894185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:36.894641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:36.895457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:36.895887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:37.146910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:37.154828 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f4a779c-7043-4733-8cd1-33919144c58c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.594370 May 10 02:22:37.155779 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1512/2953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:36 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:37.160785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:37.161490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:37.168547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:37.169073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:37.169923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:37.170810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:37.431111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:37.439379 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da49a545-e545-4c24-aadb-f64f6d8e8c18 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.556107 May 10 02:22:37.440547 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1442/2954] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:36 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:37.457911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94da6d5b-3851-4885-9d63-03c52451c4b5 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d360bb160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:37.555949 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94da6d5b-3851-4885-9d63-03c52451c4b5 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114336 May 10 02:22:37.556534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1443/2955] 10.222.0.52 () {58 vars in 1187 bytes} [Tue May 10 02:22:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:37.560994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:37.561606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:37.572679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:37.573150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:37.574032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:37.574482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:37.713472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:37.721433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0713b83-98ad-4a0a-b950-691e5ce9804c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.563935 May 10 02:22:37.722870 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1513/2956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:37 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:37.727593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e09947d1-a904-4bd1-9673-7c3d161d18e9 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] Calling method '.version_select at 0x7f3d36388f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:37.820335 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e09947d1-a904-4bd1-9673-7c3d161d18e9 tempest-VolumesTestJSON-1047121475 tempest-VolumesTestJSON-1047121475-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.096151 May 10 02:22:37.821417 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1514/2957] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:22:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:37.826096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:37.826898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:37.834180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:37.834868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:37.835854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:37.836577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:38.447057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:38.455534 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7698b92f-8c77-4c41-8f37-b0267652e66d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.897944 May 10 02:22:38.456709 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1444/2958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:37 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:38.462448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:38.463405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:38.469686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:38.470415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:38.472140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:38.472813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:38.628677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:38.636847 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-55a4a590-e24b-45bd-ad16-d1dcb99b69d2 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1274 microversion: 2.1 time: 0.178784 May 10 02:22:38.640194 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1445/2959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:38 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:38.659212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:38.660540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:38.666882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:38.667676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:38.668711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:38.669383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:38.872398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:38.891812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:38.894905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:38.897051 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01e280c4-5107-4714-aaf2-360611e8c5d0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 1.074405 May 10 02:22:38.915028 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1515/2960] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:37 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:38.920464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:38.921393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:38.936230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:38.936934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:38.938849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:38.939581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.164270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:39.196348 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7729f414-ea2b-461b-a2d0-c16373e1604d tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.550654 May 10 02:22:39.199164 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1446/2961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:38 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:39.204754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:39.205435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:39.216566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.217135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.223013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.223608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.324400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:39.341536 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c785bc8a-9693-4f34-87ca-d891e9088292 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.418378 May 10 02:22:39.342457 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1516/2962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:38 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:39.433228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:39.446210 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f2a0960-0e21-4b86-b9e6-bc33d780d84a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.245893 May 10 02:22:39.447048 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1447/2963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:39 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:39.473040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:39.473723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:39.480256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.481054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.482320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.482766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.656572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:39.657431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:39.664859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.665340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.666282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.666865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.671998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:39.688923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1585010b-76b1-407f-ae0c-3b8d66973750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.220470 May 10 02:22:39.689855 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1517/2964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:39 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:39.844457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:39.853702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2a56a90-d84d-4a3a-b85e-3445f12cfb67 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.201440 May 10 02:22:39.862854 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1448/2965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:39 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:39.918916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:39.920304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:39.927633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.929347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.930372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:39.931096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:39.984564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ce11757b-121b-4860-a867-c3bd3f338d04 req-10a328cb-d7ba-45b6-99a2-086305e58516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255f02d9-1a66-4536-a9c4-4535832be9ea", "name": "network-vif-plugged", "status": "completed", "tag": "9251dc32-040f-40eb-95a7-22f9f242aedb"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:40.016773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ce11757b-121b-4860-a867-c3bd3f338d04 req-10a328cb-d7ba-45b6-99a2-086305e58516 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.017478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ce11757b-121b-4860-a867-c3bd3f338d04 req-10a328cb-d7ba-45b6-99a2-086305e58516 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.046600 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ce11757b-121b-4860-a867-c3bd3f338d04 req-10a328cb-d7ba-45b6-99a2-086305e58516 service nova] Creating event network-vif-plugged:9251dc32-040f-40eb-95a7-22f9f242aedb for instance 255f02d9-1a66-4536-a9c4-4535832be9ea on n-h1-841089-2 May 10 02:22:40.053360 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ce11757b-121b-4860-a867-c3bd3f338d04 req-10a328cb-d7ba-45b6-99a2-086305e58516 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075002 May 10 02:22:40.054571 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1449/2966] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:22:40.214434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:40.215977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:40.230490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.231264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.232219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.235078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:40.237023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.258460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:40.260172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:40.261375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e43ed5b5-8e23-40e4-8b6a-c6c428515ef4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.347519 May 10 02:22:40.262252 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1518/2967] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:39 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:22:40.359566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:40.360202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:40.371595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.374144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.375989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.375989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.773367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:40.782576 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af5dbdae-b583-4d5a-b4e1-7c14eaae26e5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.572435 May 10 02:22:40.793043 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1450/2968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:40 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:40.809776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:40.810401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:40.823594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:40.831859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-83af789a-be1c-4874-b2bc-ef6ae0c56841 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.476131 May 10 02:22:40.833007 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1519/2969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:40 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:40.842744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.843487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.845003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.846421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.859104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:40.859728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:40.875417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.875876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:40.876676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:40.877642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:41.383998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:41.393753 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92708815-2d0d-4411-a1f3-1f01659f7665 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.599128 May 10 02:22:41.394904 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1451/2970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:40 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:41.409650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:41.410382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:41.417701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:41.418405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:41.419346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:41.419786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:41.422992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:41.432370 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1ba3a610-4fc5-4eef-bb2d-e2d77309a952 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.577319 May 10 02:22:41.442593 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1520/2971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:40 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:41.447683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:41.448424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:41.454655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:41.455328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:41.456238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:41.456788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.322549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:42.334349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:42.335903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:42.351328 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57c60c6b-0ea9-4977-85f4-6c3f62b12c0f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.899368 May 10 02:22:42.352337 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1521/2972] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:41 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:42.372842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:42.373729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:42.374688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:42.382279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-01ec9857-d63a-47c3-b994-af90f0074ff8 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.986044 May 10 02:22:42.386939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.387436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.388812 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1452/2973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:41 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:42.389746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.390690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.395764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:42.399948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:42.419317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.419878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.420765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.421294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.885037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:42.895272 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d682e46d-32b4-4009-a67a-760bd0b11759 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.541350 May 10 02:22:42.901564 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1522/2974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:42 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:42.904118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:42.917707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7805eb9-dfba-43bb-ab91-eb0cda8eef7e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.528160 May 10 02:22:42.918840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8b9f73e2-1fd1-4699-86dd-b22e5ffdb1af req-093f2bd1-aebe-41b9-8c45-0701d379b81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c39c22-4838-4b6b-8166-11627cded45c", "name": "network-vif-plugged", "status": "completed", "tag": "957b1852-a0da-4bcd-9397-df8e7a46fd7f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:42.932010 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1453/2975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:42 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:42.951741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b9f73e2-1fd1-4699-86dd-b22e5ffdb1af req-093f2bd1-aebe-41b9-8c45-0701d379b81d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.952871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b9f73e2-1fd1-4699-86dd-b22e5ffdb1af req-093f2bd1-aebe-41b9-8c45-0701d379b81d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.971928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:42.973170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:42.987199 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8b9f73e2-1fd1-4699-86dd-b22e5ffdb1af req-093f2bd1-aebe-41b9-8c45-0701d379b81d service nova] Creating event network-vif-plugged:957b1852-a0da-4bcd-9397-df8e7a46fd7f for instance 15c39c22-4838-4b6b-8166-11627cded45c on n-h2-841089-2 May 10 02:22:42.987644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.988349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:42.989372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:42.990082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:43.007845 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8b9f73e2-1fd1-4699-86dd-b22e5ffdb1af req-093f2bd1-aebe-41b9-8c45-0701d379b81d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103539 May 10 02:22:43.009046 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1523/2976] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:43.017002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:43.018527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:43.050408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:43.070217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:43.071568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:43.074422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:43.871307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:43.880015 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eacd3cdf-0b2f-4ab3-899c-5196465d534c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.932464 May 10 02:22:43.891262 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1454/2977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:42 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:43.896845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:43.897407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:43.911399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:43.911867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:43.912664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:43.913112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:43.990159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:44.004664 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5e91769-cbb9-4835-bcdf-0a19604497e5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.993364 May 10 02:22:44.005243 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1524/2978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:43 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:44.009957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:44.013888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:44.037124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.037897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:44.039818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.040462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:44.435458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:44.445170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:44.446986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:44.448394 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04e71679-6720-4084-ba33-a6317ae1bcb0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.556091 May 10 02:22:44.459232 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1455/2979] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:43 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:44.464366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-844a6ee0-46c2-4ad4-8186-e42c751fbca0 req-1f829262-8f3b-455a-93ee-b674c4b018ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd028c9-ba76-40cb-86e3-89b3ec197d5d", "tag": "4365c1b8-2727-46a0-84b3-cb1e856a1552"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:44.473639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-844a6ee0-46c2-4ad4-8186-e42c751fbca0 req-1f829262-8f3b-455a-93ee-b674c4b018ab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.474351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-844a6ee0-46c2-4ad4-8186-e42c751fbca0 req-1f829262-8f3b-455a-93ee-b674c4b018ab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:44.486801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-844a6ee0-46c2-4ad4-8186-e42c751fbca0 req-1f829262-8f3b-455a-93ee-b674c4b018ab service nova] Creating event network-changed:4365c1b8-2727-46a0-84b3-cb1e856a1552 for instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d on n-h2-841089-2 May 10 02:22:44.491959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-844a6ee0-46c2-4ad4-8186-e42c751fbca0 req-1f829262-8f3b-455a-93ee-b674c4b018ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031145 May 10 02:22:44.493100 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1456/2980] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:44.498420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:44.499435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:44.506610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.507444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:44.508482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.509145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:44.540965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:44.553983 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9cf9e7b-1562-4fdf-b7ec-cba0ca0a7222 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.547457 May 10 02:22:44.555318 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1525/2981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:44 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:44.560547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:44.566821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:44.579693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.580575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:44.581614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:44.582288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.029682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:45.049969 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e84de2a-d615-47a1-998e-7d927c13aecc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.555434 May 10 02:22:45.053270 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1457/2982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:44 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:45.069875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:45.073876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:45.083633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:45.094883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-169d445f-4f5f-4dd1-8315-27d31fd0a01c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1318 microversion: 2.1 time: 0.538230 May 10 02:22:45.101305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.104677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.107713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1526/2983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:44 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:45.111593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.112143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.131014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:45.132918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:45.151404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.156199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.160611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.161507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.702702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:45.714326 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c753467-239d-4c32-9857-866cb9dc1a78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.593210 May 10 02:22:45.725679 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1527/2984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:45 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:45.740029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:45.740939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:45.753743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.754427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.759042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.759783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.929092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:45.943431 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cd023649-e3a3-42a9-8324-d9f98ecd42ae tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.885999 May 10 02:22:45.944817 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1458/2985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:45 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:45.952007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:45.954447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:45.967496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.971867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:45.973061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:45.973667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.096528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:46.118457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:46.123347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:46.129625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4ea6258-5482-49ce-aa88-83584e7c2905 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.402067 May 10 02:22:46.141284 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1528/2986] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:45 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:46.155530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:46.156896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:46.169954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.172346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.176095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.176760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.315833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:46.331387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3760657b-4d10-4317-a61b-4c8ee8b73983 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.382963 May 10 02:22:46.338247 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1459/2987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:45 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:46.351890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:46.360852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:46.375985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.376750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.381827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.382782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.571754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:46.584431 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e066c82-4340-47c8-a2ad-5ae74431f507 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.441636 May 10 02:22:46.585043 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1529/2988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:46 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:46.637424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fe66eaa6-dffd-4494-9690-50018366af37 req-902582ad-219e-4ea4-8166-214724799e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "name": "network-vif-plugged", "status": "completed", "tag": "a84ac88c-2929-40c2-8767-ad081523d466"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:46.649751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fe66eaa6-dffd-4494-9690-50018366af37 req-902582ad-219e-4ea4-8166-214724799e57 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.650241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fe66eaa6-dffd-4494-9690-50018366af37 req-902582ad-219e-4ea4-8166-214724799e57 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.654619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:46.664640 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-557d6223-6197-4f70-8a9f-f06867513b2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1467 microversion: 2.1 time: 0.324971 May 10 02:22:46.666034 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1460/2989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:46 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1467 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:46.680557 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fe66eaa6-dffd-4494-9690-50018366af37 req-902582ad-219e-4ea4-8166-214724799e57 service nova] Creating event network-vif-plugged:a84ac88c-2929-40c2-8767-ad081523d466 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:46.685385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:46.685744 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fe66eaa6-dffd-4494-9690-50018366af37 req-902582ad-219e-4ea4-8166-214724799e57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051968 May 10 02:22:46.686695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1530/2990] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:46.692289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:46.705170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.705634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.706418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.709185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.744371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:46.745269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:46.754790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.755436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:46.757056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:46.757907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.009336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:47.019733 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19e5ba99-d0c6-475b-85fa-d2af33d73634 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 200 len: 1318 microversion: 2.1 time: 0.338424 May 10 02:22:47.020354 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1461/2991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:46 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:47.027348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:47.040036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:47.048203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.050526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.052193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.052668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.067042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:47.075512 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-27b50e9d-1f7c-4ce4-be31-890427285bf0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.340946 May 10 02:22:47.077149 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1531/2992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:46 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:47.150543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:47.152102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:47.160339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.161107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.162163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.162803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.712134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:47.721007 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-35974059-eaab-4cdc-90ec-c5c829c6606c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.697283 May 10 02:22:47.722103 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1462/2993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:47 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:47.729432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:47.731405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:47.739484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.740015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.740740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.742306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.744491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:47.756752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:47.760246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:47.762144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc6661a2-1c00-4a17-9a38-b6eef94445b2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.617399 May 10 02:22:47.773312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1532/2994] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:47 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:22:47.773312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:47.773834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:47.780464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.781186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:47.782180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:47.782395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.026286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:48.037306 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ca23640-8eb6-4df7-9078-635d7e360da7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.312896 May 10 02:22:48.038271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1463/2995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:47 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:48.044886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:48.045662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:48.053395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:48.056990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.057529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.058399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.058921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.062141 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ecfd340a-82d1-476f-b983-ec752ae6a9d4 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.295113 May 10 02:22:48.062750 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1533/2996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:47 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:48.097440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:48.098078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:48.104675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.105214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.106371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.107109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.364901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:48.370830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:48.372610 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-456dc0ff-dbf1-4660-b8ca-b96f7fda0b10 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 200 len: 1467 microversion: 2.1 time: 0.332865 May 10 02:22:48.373782 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1464/2997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:48 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:48.389668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:48.389869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38e78793-5051-4b73-9a94-09589b074a96 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.300652 May 10 02:22:48.395119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:48.396891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Searching by: {'reservation_id': 'r-vki74qjc', 'deleted': False, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:22:48.399194 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1534/2998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:48 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:48.403494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.403949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.404752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.405192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.498488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.multi_cell_list [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=118717) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:22:48.564984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:48.571463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.571924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.701446 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-52a3aef6-0769-4468-aebf-37c5f5aa3a9f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-vki74qjc" status: 200 len: 2927 microversion: 2.1 time: 0.316041 May 10 02:22:48.701610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e6ce5c42-60ff-4cf9-bda1-9ffae6077457 req-51903e87-f4b5-4ad9-94ac-b6ef1aa81708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "name": "network-vif-plugged", "status": "completed", "tag": "5697ea60-aabd-4aa8-9db0-1ec1c3efab59"}, {"server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "name": "network-vif-plugged", "status": "completed", "tag": "b35538e5-7022-4777-80ca-32b6af2d1cb5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:48.702206 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1465/2999] 10.222.0.52 () {58 vars in 1196 bytes} [Tue May 10 02:22:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vki74qjc => generated 2927 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:48.711707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e6ce5c42-60ff-4cf9-bda1-9ffae6077457 req-51903e87-f4b5-4ad9-94ac-b6ef1aa81708 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.712160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e6ce5c42-60ff-4cf9-bda1-9ffae6077457 req-51903e87-f4b5-4ad9-94ac-b6ef1aa81708 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.719853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5954148a-cf19-4867-8064-b18ef896c222 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:48.723767 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e6ce5c42-60ff-4cf9-bda1-9ffae6077457 req-51903e87-f4b5-4ad9-94ac-b6ef1aa81708 service nova] Creating event network-vif-plugged:5697ea60-aabd-4aa8-9db0-1ec1c3efab59 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:48.724279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e6ce5c42-60ff-4cf9-bda1-9ffae6077457 req-51903e87-f4b5-4ad9-94ac-b6ef1aa81708 service nova] Creating event network-vif-plugged:b35538e5-7022-4777-80ca-32b6af2d1cb5 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:48.729367 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e6ce5c42-60ff-4cf9-bda1-9ffae6077457 req-51903e87-f4b5-4ad9-94ac-b6ef1aa81708 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031600 May 10 02:22:48.730231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1535/3000] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:48.734395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.server_groups [None req-5954148a-cf19-4867-8064-b18ef896c222 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Querying cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) for 2 instances {{(pid=118717) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 10 02:22:48.735495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5954148a-cf19-4867-8064-b18ef896c222 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.735953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5954148a-cf19-4867-8064-b18ef896c222 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.739862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:48.740727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:48.767755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.768257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.768940 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5954148a-cf19-4867-8064-b18ef896c222 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/7d4bd606-5bd9-4756-aa38-890298eebcd9" status: 200 len: 269 microversion: 2.1 time: 0.053257 May 10 02:22:48.769341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.771133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1466/3001] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:22:48 2022] GET /compute/v2.1/os-server-groups/7d4bd606-5bd9-4756-aa38-890298eebcd9 => generated 269 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:48.771273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.781870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:48.782800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:48.789897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.790357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:48.791174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:48.791819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.027331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.038567 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4fef8de1-7382-4e9a-9044-14e499501a1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.303342 May 10 02:22:49.039482 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1536/3002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:48 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:49.042800 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-431f3039-f1f6-43ea-96e4-1b0b3788c8d2 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 200 len: 1618 microversion: 2.1 time: 0.264724 May 10 02:22:49.044007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:49.044560 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1467/3003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:48 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 1618 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:49.055379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:49.060715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:49.061810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.062274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.063024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:49.063175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.063517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.073046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.073753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.075196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.075725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.296624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.305727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.315552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.317285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd72d025-15d2-4372-a7a2-9beca9e0b852 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.276814 May 10 02:22:49.318225 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1537/3004] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:49 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:49.335295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:49.336294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:49.342587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.343055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.343850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.344902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.345494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.356303 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18d08297-68db-46ed-b652-625819ed99a4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.304738 May 10 02:22:49.358539 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1468/3005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:49 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:49.364169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:49.364977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:49.375431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.376129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.377151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.378296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.614059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62c1b77b-7f90-4b67-a06a-8b659cedde14 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 200 len: 1618 microversion: 2.1 time: 0.294465 May 10 02:22:49.617003 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1538/3006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:49 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 1618 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:49.628199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:49.642029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:49.655222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.657662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.658869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.659854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:49.660443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:49.661930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28ed23c9-2632-4d19-825f-ac47e8cd339f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1354 microversion: 2.1 time: 0.302052 May 10 02:22:49.662532 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1469/3007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:49 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:49.747268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1365286275", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4f391397-d509-4342-b1fc-5864a0c80873"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:49.803034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:22:49.813818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:49.822443 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72b808a0-22d1-4b5c-8e02-fae5a414f250 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.204394 May 10 02:22:49.823724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1539/3008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:49 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:50.024903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:22:50.025494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:22:50.026079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:22:50.026675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:22:50.027195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:22:50.037438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.037958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.038827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.039371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.056106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:50.057048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:50.066532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.067335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.069664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.071390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.073589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:22:50.084997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:22:50.109484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:22:50.115295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:22:50.191326 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec6a8786-d746-43bf-8489-f3f66fa09dcb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447858 May 10 02:22:50.198948 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1470/3009] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:22:50.205601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0478ee73-6e27-45a1-b766-74799da3eed3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:50.209526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0478ee73-6e27-45a1-b766-74799da3eed3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:50.441208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0478ee73-6e27-45a1-b766-74799da3eed3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:50.452043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0478ee73-6e27-45a1-b766-74799da3eed3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1217 microversion: 2.1 time: 0.251583 May 10 02:22:50.464829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:50.467259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1471/3010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:50 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:50.476204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:50.476403 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc513d85-5724-42f6-a1b1-c0976063e3d7 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1499 microversion: 2.1 time: 0.423785 May 10 02:22:50.476857 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1540/3011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:50 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:50.478224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:50.500468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:50.503914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:50.510781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.514610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.516092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.517112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.518195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.522943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.523968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.524566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.795954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:50.808624 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a1a7852-ce24-434c-a642-286ea9e8d9f7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.330261 May 10 02:22:50.810311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1541/3012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:50 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:50.817867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:50.818453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:50.819448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:50.832776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.835771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.838514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.840119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.848276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:50.850217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:50.851653 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07104005-7fa9-494f-8952-3d222e236a40 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.380342 May 10 02:22:50.852379 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1472/3013] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:50 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:50.857262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:50.859170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:50.880740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.881457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:50.882550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:50.883201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.137506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:51.137848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:51.147362 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8345adab-27f0-4c9b-96b1-ff29dfffd294 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.293418 May 10 02:22:51.148030 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1473/3014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:50 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:51.148704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a2661c4-91f3-4c37-b459-151a2bb09e5e tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1803 microversion: 2.1 time: 0.335966 May 10 02:22:51.149387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1542/3015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:50 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1803 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:51.165363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.165853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.171932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.172381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.173145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.173701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.198743 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5253d4a0-4a39-474d-a29c-da45566f45d6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7/ips" status: 200 len: 217 microversion: 2.1 time: 0.037019 May 10 02:22:51.199351 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1474/3016] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:22:51 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7/ips => generated 217 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:51.209594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.210183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.217135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.218055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.219152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.219724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.247105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:22:51.324244 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c66698d9-a6e3-4140-a7a2-842159252c72 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "DELETE /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 204 len: 0 microversion: 2.1 time: 0.118233 May 10 02:22:51.327199 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1543/3017] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:22:51 2022] DELETE /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:22:51.333755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.334483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.340771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.341223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.341988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.342547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.470985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.471680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.477695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.478140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.479140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.479581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.497322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:51.504619 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-93de59ff-6b44-4862-8837-39934bd53396 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1809 microversion: 2.1 time: 0.175293 May 10 02:22:51.505401 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1475/3018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:51 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:51.520004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.520646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.527096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.527550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.528615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.529118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.549795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:51.558044 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f0827fb-8d88-426e-8267-d20f6c8895a1 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1277 microversion: 2.1 time: 0.091584 May 10 02:22:51.558641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1544/3019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:51 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:51.666428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:51.673891 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-979dc7f8-8761-44fe-bdb1-7c14b8a93991 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 200 len: 1476 microversion: 2.1 time: 0.158715 May 10 02:22:51.674560 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1476/3020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:51 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:51.689895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-921583600"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:51.690999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.696932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.697387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.698149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.698587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.826293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.826975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.834167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.834621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.835443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.835883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.973382 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2b897fe-b8fe-49e1-b55c-ccd345e61bc4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f/action" status: 202 len: 0 microversion: 2.1 time: 0.287085 May 10 02:22:51.975112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1545/3021] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:22:51 2022] POST /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:22:51.979562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:51.980280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:51.987100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.987288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:51.988009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:51.988507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.008603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.016031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72b116b6-b4fc-4b8b-b32e-018cbc9d2f84 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.193972 May 10 02:22:52.016732 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1477/3022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:51 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:52.029592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bea16cab-0d6c-44fc-bd5d-250bfe42c71d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d3604ee50>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:52.087020 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bea16cab-0d6c-44fc-bd5d-250bfe42c71d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.068227 May 10 02:22:52.092566 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1478/3023] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:22:52 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:52.128911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.137560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.139060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.140240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6c2a746-fb74-417e-b2d9-7a39699372f8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.165021 May 10 02:22:52.141106 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1546/3024] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:51 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:52.164911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:52.165441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:52.171527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.171983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.172751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.173375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.248245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3047a813-2aef-41c8-bba8-df61a5dc248d req-74c4a3c1-5176-486d-93d0-66ec0fbb78fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd028c9-ba76-40cb-86e3-89b3ec197d5d", "name": "network-vif-plugged", "status": "completed", "tag": "4365c1b8-2727-46a0-84b3-cb1e856a1552"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:52.267973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3047a813-2aef-41c8-bba8-df61a5dc248d req-74c4a3c1-5176-486d-93d0-66ec0fbb78fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.269068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3047a813-2aef-41c8-bba8-df61a5dc248d req-74c4a3c1-5176-486d-93d0-66ec0fbb78fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.285082 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3047a813-2aef-41c8-bba8-df61a5dc248d req-74c4a3c1-5176-486d-93d0-66ec0fbb78fe service nova] Creating event network-vif-plugged:4365c1b8-2727-46a0-84b3-cb1e856a1552 for instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d on n-h2-841089-2 May 10 02:22:52.291546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3047a813-2aef-41c8-bba8-df61a5dc248d req-74c4a3c1-5176-486d-93d0-66ec0fbb78fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051677 May 10 02:22:52.293475 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1547/3025] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:22:52.321175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.328611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b16141c-8259-46ac-822b-505a5dc77e44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.167684 May 10 02:22:52.329185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1479/3026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:52 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:52.522532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:52.523201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:52.529473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.529927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.530700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.531441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.575446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:52.576070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:52.583428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.583876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.584646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:52.585081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:52.671919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.680418 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc3d3412-ce9d-41f2-8b98-51e333b838ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1277 microversion: 2.1 time: 0.108818 May 10 02:22:52.681319 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1480/3027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:52 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:52.706372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:52.713760 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55ebb35a-8870-4aec-a1ae-c27c9375ba8f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1809 microversion: 2.1 time: 0.195647 May 10 02:22:52.714336 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1548/3028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:52 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:53.034141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:53.034900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:53.048921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.050308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.051697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.052294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.101761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c09bfbe6-7fec-46b7-a568-d439114519d4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d363b0ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:53.158565 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c09bfbe6-7fec-46b7-a568-d439114519d4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.060999 May 10 02:22:53.160471 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1549/3029] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:22:53 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:22:53.166081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:53.166861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:53.173369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.173969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.174889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.175464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.532370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:53.540705 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a58d167-a088-4e89-9a83-7eca987fcf60 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.511329 May 10 02:22:53.541395 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1481/3030] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:53 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:53.548111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:53.549545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:53.555779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.556498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.557497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.558142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.642246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:53.651081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:53.652729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:53.654121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eea1935e-4003-43fd-8178-ec27df56a429 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.492464 May 10 02:22:53.666694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1550/3031] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:53 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:53.700596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:53.701688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:53.709367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.710069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.711317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.711974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.842688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:53.853451 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a092cfb-75a1-450c-a57c-8cad9a2823af tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1275 microversion: 2.1 time: 0.159605 May 10 02:22:53.854891 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1551/3032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:53 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:53.867829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:53.868463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:53.871242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:53.878382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.878941 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a897165-4701-4a50-8b8a-eb5510766c70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.336139 May 10 02:22:53.879562 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1482/3033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:53 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:53.880197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:53.881404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:53.882068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:54.172494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da3cf177-375b-4fd9-aaf3-7a46c44d7d1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d360b79d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:54.219533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:54.225845 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da3cf177-375b-4fd9-aaf3-7a46c44d7d1b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.057247 May 10 02:22:54.227058 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1483/3034] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:22:54 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:54.235189 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65c342c9-7358-41d9-9af0-9132aefc6c48 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1809 microversion: 2.1 time: 0.378700 May 10 02:22:54.236712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1552/3035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:53 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1809 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:54.558280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:54.559110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:54.572570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:54.576092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:54.577141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:54.581279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:54.674177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:54.674846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:54.684223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:54.684694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:54.685496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:54.685946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:55.210031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:55.217597 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b14b3632-66c7-4964-a492-e14ab765147a tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1316 microversion: 2.1 time: 0.663769 May 10 02:22:55.225134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1484/3036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:54 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:55.238123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-280942db-fb51-453a-8d87-051e3fe9452b req-4156e861-8872-4c4a-873f-c2b31b8418eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "name": "network-vif-deleted", "tag": "5697ea60-aabd-4aa8-9db0-1ec1c3efab59"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:55.259448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-280942db-fb51-453a-8d87-051e3fe9452b req-4156e861-8872-4c4a-873f-c2b31b8418eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:55.260179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-280942db-fb51-453a-8d87-051e3fe9452b req-4156e861-8872-4c4a-873f-c2b31b8418eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:55.280335 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-280942db-fb51-453a-8d87-051e3fe9452b req-4156e861-8872-4c4a-873f-c2b31b8418eb service nova] Creating event network-vif-deleted:5697ea60-aabd-4aa8-9db0-1ec1c3efab59 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:55.295371 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-280942db-fb51-453a-8d87-051e3fe9452b req-4156e861-8872-4c4a-873f-c2b31b8418eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068069 May 10 02:22:55.296645 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1485/3037] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:55.302162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:55.302875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:55.309481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:55.310230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:55.311411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:55.312047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:55.402461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:55.414712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:55.416285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:55.417485 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e44a3d35-c64e-4be1-b44e-06d40e69602a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.747534 May 10 02:22:55.425378 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1553/3038] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:54 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:22:55.430575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:55.438199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:55.451111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:55.451807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:55.452750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:55.453356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:55.886579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:55.895719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-be4eb13c-55cc-4c24-a97a-e3908ff5974d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.598210 May 10 02:22:55.896493 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1486/3039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:55 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:55.901656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1183250-cb53-4a7e-9e41-7126a0950f65 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35fa49d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:55.945980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:55.969107 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1183250-cb53-4a7e-9e41-7126a0950f65 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.071118 May 10 02:22:55.969726 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1487/3040] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:22:55 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:55.973692 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41c149b5-ed0a-4bf4-90cd-3b007b3c5df5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.546809 May 10 02:22:55.988207 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1554/3041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:55 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:55.996780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:55.998360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:56.007519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.008152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.009105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.009742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.242643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:56.243436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:56.252631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.255301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.257815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.263669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.291124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:56.298571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa1a7977-7f79-468a-bf05-50095b79fd2a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1674 microversion: 2.1 time: 0.327813 May 10 02:22:56.299170 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1488/3042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:55 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1674 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:56.443152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:56.443778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:56.452892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.453581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.456371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.456772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.786165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:56.797367 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-149bf82f-4d0f-4ab0-8a9e-c2f6ff22eeff tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1505 microversion: 2.1 time: 0.560084 May 10 02:22:56.800749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1555/3043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:56 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:56.820289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:56.821053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:56.833885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.835370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.838001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.839512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.922728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:56.927382 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cf611d56-856e-4199-b870-a32a657f6af4 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d/os-instance-actions/req-f54bbb3f-0f35-479d-8846-58bbc4633494" status: 200 len: 313 microversion: 2.1 time: 0.111379 May 10 02:22:56.929326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1556/3044] 10.222.0.52 () {58 vars in 1418 bytes} [Tue May 10 02:22:56 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d/os-instance-actions/req-f54bbb3f-0f35-479d-8846-58bbc4633494 => generated 313 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:56.942369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:56.951131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:56.958859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.959617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:56.960579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:56.961330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:57.211875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:57.231509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:57.236581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:57.247676 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a921fad2-04c4-4bf8-9a89-7b423cadd9b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.805530 May 10 02:22:57.260198 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1489/3045] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:56 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:22:57.271585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:57.272798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:57.288368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:57.288926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:57.289942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:57.292435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:57.441442 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b446c13-6d65-4984-8e91-0952e41e6d4b tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "POST /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d/action" status: 202 len: 0 microversion: 2.1 time: 0.178743 May 10 02:22:57.442846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1490/3046] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:22:57 2022] POST /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:22:57.447036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:57.449923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0dadae1e-57fe-447d-8fe4-a94f1bc8a4bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d360c9160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:57.476357 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-915742f5-eed4-410b-aa5b-d423af8af589 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.542716 May 10 02:22:57.490859 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1557/3047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:56 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:57.514815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:57.521145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:57.529617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:57.531431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:57.532639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:57.533848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:57.534308 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0dadae1e-57fe-447d-8fe4-a94f1bc8a4bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.089969 May 10 02:22:57.538860 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1491/3048] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:22:57 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:57.557414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:57.569015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:57.584323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:57.584839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:57.585751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:57.586451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:58.254588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:58.263259 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8522a395-569c-44b8-b79c-e15b619ce9f5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1653 microversion: 2.1 time: 0.716439 May 10 02:22:58.273262 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1492/3049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:57 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1653 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:58.278890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7a2fb567-fa98-4923-9700-f007b3ed049a req-65743050-8bae-4a47-8b81-4d8aab756b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "name": "network-vif-deleted", "tag": "a84ac88c-2929-40c2-8767-ad081523d466"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:58.303865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7a2fb567-fa98-4923-9700-f007b3ed049a req-65743050-8bae-4a47-8b81-4d8aab756b93 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:58.304483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7a2fb567-fa98-4923-9700-f007b3ed049a req-65743050-8bae-4a47-8b81-4d8aab756b93 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:58.319472 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7a2fb567-fa98-4923-9700-f007b3ed049a req-65743050-8bae-4a47-8b81-4d8aab756b93 service nova] Creating event network-vif-deleted:a84ac88c-2929-40c2-8767-ad081523d466 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:22:58.326378 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7a2fb567-fa98-4923-9700-f007b3ed049a req-65743050-8bae-4a47-8b81-4d8aab756b93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051237 May 10 02:22:58.327894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1493/3050] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:58.335665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:58.337802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:58.349458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:58.350316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:58.351370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:58.352018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:58.375859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:58.387823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75b531c7-f00e-479d-a8df-37d68f365d89 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.894004 May 10 02:22:58.391146 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1558/3051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:57 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:58.397568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:58.401658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:58.416559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:58.418576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:58.420320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:58.421819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.329244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:59.344920 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-32fc9baa-5bd0-4f29-8b9b-dcd2aff1fe76 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1507 microversion: 2.1 time: 1.014297 May 10 02:22:59.346206 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1494/3052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:58 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1507 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:59.360880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d0502ee9-0292-4c7d-853b-713c1c36758c req-aa0a6b51-5082-4ae6-9e0a-f1d9671cb9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4054a3-0198-45f3-8869-b8f39181090f", "name": "network-vif-plugged", "status": "completed", "tag": "30c3473a-9334-49c5-8e24-25b29fbba44a"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:22:59.375113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d0502ee9-0292-4c7d-853b-713c1c36758c req-aa0a6b51-5082-4ae6-9e0a-f1d9671cb9f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.375996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d0502ee9-0292-4c7d-853b-713c1c36758c req-aa0a6b51-5082-4ae6-9e0a-f1d9671cb9f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.397854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d0502ee9-0292-4c7d-853b-713c1c36758c req-aa0a6b51-5082-4ae6-9e0a-f1d9671cb9f9 service nova] Creating event network-vif-plugged:30c3473a-9334-49c5-8e24-25b29fbba44a for instance 5d4054a3-0198-45f3-8869-b8f39181090f on n-h2-841089-2 May 10 02:22:59.405376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d0502ee9-0292-4c7d-853b-713c1c36758c req-aa0a6b51-5082-4ae6-9e0a-f1d9671cb9f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057084 May 10 02:22:59.406942 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1495/3053] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:22:59.417038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:59.418028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:59.430832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.434084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.436232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.437193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.561337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:59.572311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:59.579187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:59.583489 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18f17528-0708-4052-842d-9ca17dc7963a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 1.188843 May 10 02:22:59.586182 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1559/3054] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:22:58 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:22:59.597432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-933f431c-afcb-426e-8106-f4dfb75d5a3b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d3636dca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:59.669112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-933f431c-afcb-426e-8106-f4dfb75d5a3b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.080246 May 10 02:22:59.670085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1560/3055] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:22:59 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:59.681205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:59.682630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:59.691651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.692778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.695015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.695702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.723824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:59.732944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-93e5598b-d945-4ec8-841b-7d4144f9d1e3 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.324329 May 10 02:22:59.753096 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1496/3056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:59 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:22:59.758817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:22:59.759467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:22:59.769166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.771117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.771741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.772527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:22:59.773222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.776465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:22:59.776942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lazy-loading 'fault' on Instance uuid 04e161dd-cca1-49b1-9e6f-6868ff2965c7 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:22:59.976193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:22:59.990286 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a634219b-b9af-4bb7-9c9a-7c80128663fe tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 200 len: 1302 microversion: 2.1 time: 0.317301 May 10 02:22:59.992126 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1561/3057] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:59 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 1302 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:00.189975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:00.201864 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7dc560c2-71cb-4137-abbe-be7191723d41 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.447022 May 10 02:23:00.203051 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1497/3058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:22:59 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:00.366661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:00.367823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:00.375990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.376925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.378357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.379179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.475808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-244877cc-4d52-4a7f-aff7-5a7884f5762b req-da2dee09-75ff-49bc-b513-c0c2a8bf3d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf83e8d2-4df2-45ea-82d7-6ed59e6821f0", "tag": "24e95e8c-34e8-42fb-b0d0-286b7c515ccb"}, {"server_uuid": "04e161dd-cca1-49b1-9e6f-6868ff2965c7", "name": "network-vif-deleted", "tag": "b35538e5-7022-4777-80ca-32b6af2d1cb5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:00.491031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-244877cc-4d52-4a7f-aff7-5a7884f5762b req-da2dee09-75ff-49bc-b513-c0c2a8bf3d27 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.491436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-244877cc-4d52-4a7f-aff7-5a7884f5762b req-da2dee09-75ff-49bc-b513-c0c2a8bf3d27 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.528528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-244877cc-4d52-4a7f-aff7-5a7884f5762b req-da2dee09-75ff-49bc-b513-c0c2a8bf3d27 service nova] Creating event network-changed:24e95e8c-34e8-42fb-b0d0-286b7c515ccb for instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 on n-h2-841089-2 May 10 02:23:00.529822 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-244877cc-4d52-4a7f-aff7-5a7884f5762b req-da2dee09-75ff-49bc-b513-c0c2a8bf3d27 service nova] Creating event network-vif-deleted:b35538e5-7022-4777-80ca-32b6af2d1cb5 for instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 on n-h2-841089-2 May 10 02:23:00.543097 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-244877cc-4d52-4a7f-aff7-5a7884f5762b req-da2dee09-75ff-49bc-b513-c0c2a8bf3d27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070206 May 10 02:23:00.544621 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1498/3059] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:00.590022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:00.602600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-289706aa-0d28-4ab7-a358-bf7c12a86d54 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1512 microversion: 2.1 time: 0.243845 May 10 02:23:00.603315 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1562/3060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:00 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:00.620098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:00.621087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:00.640695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.641455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.643186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.643705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.684485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4daabab-5d2b-41cd-afe9-87a3456b7deb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d364a90d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:00.737843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4daabab-5d2b-41cd-afe9-87a3456b7deb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.058769 May 10 02:23:00.738813 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1563/3061] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:00 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:00.760661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:00.761917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:00.769464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.769926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.770759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:00.771251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:00.903389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:00.939205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:00.941120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:00.942746 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-143681ed-5cbb-4059-9fb0-c0a82eeb5cec tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.340925 May 10 02:23:00.944234 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1499/3062] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:23:00 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:23:00.996493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:01.005045 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c45af61-516a-44c8-be1b-7fbe9d0096b8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.257940 May 10 02:23:01.009974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:01.011201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:01.014723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1564/3063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:00 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:01.019154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.019645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.020630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.021205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.037408 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] HTTP exception thrown: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Request method failure captured: May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 HTTP/1.1 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxDqx7lmHRSf7vi7D2xvuXK2fZngBtjwdRddhidvQBny1uUiUEmEInncZosa3ZdhFWf9WyOUUUJ8rSjvUC3ib7Wgp1tr-RthWmCcX85hdwey92s5tW5NTDEigs-nACR1EBox35Zjk3eptfm_MLwi8dUTc6n2kyR2sqm3oZ8FPuHZYs May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_90addb32e3db4346af6f860d63976eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/90addb32e3db4346af6f860d63976eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestMultiNic-2119962716 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2125b740188b47d290e25d2423cb84dc May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '04e161dd-cca1-49b1-9e6f-6868ff2965c7'} May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:01.039121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:01.042886 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:01.045576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Returning 404 to user: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:01.046448 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3239fe32-d846-4711-a1c6-31b0daa8041b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 404 len: 111 microversion: 2.1 time: 0.042143 May 10 02:23:01.047020 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1500/3064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:01 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:01.227824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:01.228478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:01.247918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.248679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.252862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.254146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.423770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ff610186-7f5a-478e-bda4-af020b10cd4c req-7efa19b1-f906-4940-81e7-3d789475213f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "name": "network-vif-plugged", "status": "completed", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:01.436435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff610186-7f5a-478e-bda4-af020b10cd4c req-7efa19b1-f906-4940-81e7-3d789475213f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.437266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff610186-7f5a-478e-bda4-af020b10cd4c req-7efa19b1-f906-4940-81e7-3d789475213f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.456219 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ff610186-7f5a-478e-bda4-af020b10cd4c req-7efa19b1-f906-4940-81e7-3d789475213f service nova] Creating event network-vif-plugged:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h1-841089-2 May 10 02:23:01.468417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ff610186-7f5a-478e-bda4-af020b10cd4c req-7efa19b1-f906-4940-81e7-3d789475213f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048441 May 10 02:23:01.489646 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1501/3065] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:23:01.622290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:01.623332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:01.634050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.640858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.642048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.644353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.810707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:01.819770 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-926e663d-6da4-4462-a4cf-0a89e76567da tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.603757 May 10 02:23:01.832662 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1565/3066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:01 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:01.837731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d973aada-c57a-4c09-94f1-45269dad5493 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d363f6f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:01.916464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d973aada-c57a-4c09-94f1-45269dad5493 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.082350 May 10 02:23:01.917070 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1566/3067] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:01 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:01.965719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:01.966437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:01.975885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.976353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:01.980713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:01.981229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:02.464340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:02.472825 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85789dd9-cf36-412e-aa11-accd2781afad tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1512 microversion: 2.1 time: 0.856066 May 10 02:23:02.491163 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1502/3068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:01 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1512 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:02.496243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:02.496870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:02.520237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:02.520689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:02.521484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:02.521923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:02.603032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:02.612350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:02.617488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:02.619851 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-122afeaf-6ff4-4e0e-95b2-c12868cdb222 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.658034 May 10 02:23:02.626238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1567/3069] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:23:01 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:23:02.853634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:02.855576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:02.877426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:02.880755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:02.882062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:02.887616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.192390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:03.211299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2411053-4fd4-43bd-84d9-60c3b352fb53 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.718837 May 10 02:23:03.212208 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1503/3070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:02 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:03.221417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-660c5078-0285-47e4-af38-7f97eccc3035 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f67dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:03.320756 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-660c5078-0285-47e4-af38-7f97eccc3035 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.103137 May 10 02:23:03.327534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1504/3071] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:03 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:03.368277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:03.378653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cdbf701a-7e8d-4bef-b259-40c108eab0c2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.533390 May 10 02:23:03.380766 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1568/3072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:02 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:03.490750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:03.491605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:03.501481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:03.503861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.506872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:03.507479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.644011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:03.644853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:03.655578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:03.656563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.657512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:03.658147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.819373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:03.828458 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b662e06-d83b-489c-b4e0-61eaa8f7bd32 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1505 microversion: 2.1 time: 0.342429 May 10 02:23:03.846929 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1505/3073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:03 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:03.861710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '.version_select at 0x7f3d36131f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:03.862418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:03.879613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:03.880694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.881722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:03.882385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:03.941763 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c9ec6196-bf44-483f-bb91-56c11a0eba33 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.093747 May 10 02:23:03.954117 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1506/3074] 10.222.0.52 () {58 vars in 1295 bytes} [Tue May 10 02:23:03 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d/os-instance-actions => generated 611 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:03.976207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:03.984243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:03.988931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:04.002903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.007519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:04.008965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.009945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.012278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.018426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:04.020262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f13b1f6a-a517-4ae2-8faa-af312ff9ebf7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.380083 May 10 02:23:04.034060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1569/3075] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:23:03 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:23:04.091422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:23:04.229366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:04.230531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:04.255906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.257031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.259501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.262743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.336716 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1692e057-7347-4edc-9f71-196100b620a6 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 204 len: 0 microversion: 2.1 time: 0.377936 May 10 02:23:04.340582 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1507/3076] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:03 2022] DELETE /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:04.365455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc1d77d7-cda5-47cd-818f-ebb49f86c462 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d360a74c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:04.591511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:04.600365 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06af6531-0f66-4e78-867b-2b97971d88b6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.376609 May 10 02:23:04.602200 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1570/3077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:04 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:04.607994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:04.608839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:04.616422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.617094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.618461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.619083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.829358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:04.840275 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc653b38-bdfe-42c0-b4b1-451c555f85b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1511 microversion: 2.1 time: 0.236411 May 10 02:23:04.852847 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1571/3078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:04 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:04.872717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:04.875342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:04.887714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.888394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.889429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:04.890190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:04.994191 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc4a87d1-7070-4039-bfab-84a2d242c36a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/ips" status: 200 len: 145 microversion: 2.1 time: 0.139703 May 10 02:23:04.995635 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1572/3079] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:23:04 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/ips => generated 145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:05.027523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:05.028447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:05.051089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:05.052368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:05.058187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:05.058672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:05.420667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:05.433592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5def5b98-b5d9-4929-8099-3557a3014aec tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1520 microversion: 2.1 time: 0.427223 May 10 02:23:05.436785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1573/3080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:05 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:05.455577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:05.461665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:05.480962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:05.487484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:05.489472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:05.494643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:05.930856 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc1d77d7-cda5-47cd-818f-ebb49f86c462 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 1.587836 May 10 02:23:05.945217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1508/3081] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:04 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:05.971060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:05.978384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:06.000224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:06.002403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:06.018042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:06.019418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:06.365316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:06.375950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:06.385769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:06.389059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9c5f83a-a614-4fd6-9e71-e47f0f669034 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1808 microversion: 2.20 time: 0.948173 May 10 02:23:06.391321 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1574/3082] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:23:05 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1808 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:23:06.399482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:06.402801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:06.417456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:06.418931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:06.420357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:06.422068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:07.394817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:07.412328 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f4315e9e-c033-4755-a9f2-d8ea3f369e6e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 1.464387 May 10 02:23:07.414837 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1509/3083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:05 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:07.435679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:07.438463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:07.467566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:07.469594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:07.476460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:07.477681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:07.665941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:07.673581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58992b69-6f25-4471-8fb6-a6afe20682b7 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1511 microversion: 2.1 time: 1.280773 May 10 02:23:07.679871 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1575/3084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:06 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1511 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:07.685494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d77c922f-79b5-4d67-bc94-999cce8473db tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d363f6d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:07.770193 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d77c922f-79b5-4d67-bc94-999cce8473db tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.088604 May 10 02:23:07.770879 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1576/3085] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:07 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:07.782551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:07.783275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:07.798332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:07.798844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:07.799703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:07.800162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:07.951323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:07.959562 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5cbda13c-3e3b-43df-925d-7dcf9d12f687 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1500 microversion: 2.1 time: 0.541327 May 10 02:23:07.960154 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1510/3086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:07 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1500 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:07.976274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:07.976964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:07.986019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:07.991158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:07.992358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:07.992993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:08.335110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:08.356341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:08.361181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:08.366059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3d0a63ed-adb3-4924-9753-560f6cabbcd4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1795 microversion: 2.20 time: 0.591720 May 10 02:23:08.383120 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1577/3087] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:23:07 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1795 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:23:08.433667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:08.434576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:08.449970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:08.453375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:08.457284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:08.466527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:08.731167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:08.745377 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-10d3fbab-a143-4908-9e4c-3cf47c54700e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1514 microversion: 2.1 time: 0.771819 May 10 02:23:08.759143 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1511/3088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:07 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1514 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:08.764923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:08.766235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:08.781694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:08.782577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:08.788200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:08.790297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:09.274836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4317ec250efd47ac82e0d04a39f6ebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91cb529204ff4bfbb2e27402217ff248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:09.290537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-325898b1-3c2e-45bc-abaa-3832cdee1b66 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 200 len: 1511 microversion: 2.1 time: 0.528215 May 10 02:23:09.292655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:09.307629 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d4d35ef8-88c5-4061-867a-fd6fcc10933f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.875937 May 10 02:23:09.318150 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1578/3089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:08 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:09.325003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36d84426-7255-4307-89a5-91b104bcc3d8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:09.325481 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1512/3090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:08 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 1511 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:09.330567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-36d84426-7255-4307-89a5-91b104bcc3d8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:09.346715 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-36d84426-7255-4307-89a5-91b104bcc3d8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Instance 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889 could not be found. May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36d84426-7255-4307-89a5-91b104bcc3d8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889/action HTTP/1.1 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 14 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: {"rescue": {}} May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889 could not be found. May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889', 'body': {'rescue': {}}} May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889 could not be found. May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889 could not be found. May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:09.350860 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:09.355412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:09.355412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:09.355412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:09.355412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:09.355412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889 could not be found. May 10 02:23:09.355412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:09.357943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36d84426-7255-4307-89a5-91b104bcc3d8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 404 to user: Instance 4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:09.364884 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36d84426-7255-4307-89a5-91b104bcc3d8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889/action" status: 404 len: 111 microversion: 2.1 time: 0.045094 May 10 02:23:09.368319 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1579/3091] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:09 2022] POST /compute/v2.1/servers/4ce9bb4e-1b8d-4e16-b397-fcb5a1a5c889/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:09.382476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bfde0f45-626e-4420-ba58-f521d91b0b1a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36116820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:09.386577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-271054b1-4c70-4b03-b1ea-432a565e341b req-03d40c6e-7406-4b44-89f5-8ee991a635ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf83e8d2-4df2-45ea-82d7-6ed59e6821f0", "name": "network-vif-plugged", "status": "completed", "tag": "24e95e8c-34e8-42fb-b0d0-286b7c515ccb"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:09.456237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-271054b1-4c70-4b03-b1ea-432a565e341b req-03d40c6e-7406-4b44-89f5-8ee991a635ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:09.479464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-271054b1-4c70-4b03-b1ea-432a565e341b req-03d40c6e-7406-4b44-89f5-8ee991a635ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:09.542669 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bfde0f45-626e-4420-ba58-f521d91b0b1a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.212208 May 10 02:23:09.550388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1513/3092] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:09 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:09.555887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:09.556441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:09.565793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:09.566013 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-271054b1-4c70-4b03-b1ea-432a565e341b req-03d40c6e-7406-4b44-89f5-8ee991a635ae service nova] Creating event network-vif-plugged:24e95e8c-34e8-42fb-b0d0-286b7c515ccb for instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 on n-h2-841089-2 May 10 02:23:09.566627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:09.568703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:09.569172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:09.581770 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-271054b1-4c70-4b03-b1ea-432a565e341b req-03d40c6e-7406-4b44-89f5-8ee991a635ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211829 May 10 02:23:09.585753 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1580/3093] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:09.688576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1839975934", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "68634938-111f-4dbc-8f65-610d62b35981"}, {"uuid": "80e21a04-92e8-46ff-8a45-06c073129fd2"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:09.816440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] validate_networks() for [('68634938-111f-4dbc-8f65-610d62b35981', None, None, None, None, None), ('80e21a04-92e8-46ff-8a45-06c073129fd2', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:09.852075 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff333c02-0a9d-438a-9be5-7610323912d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action" status: 202 len: 0 microversion: 2.1 time: 0.299501 May 10 02:23:09.856534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1514/3094] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:09 2022] POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:23:09.871305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-372032f3-57e2-4c0a-b104-c08730921261 req-a08de004-5924-4b3b-ae6b-1bf269720f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd028c9-ba76-40cb-86e3-89b3ec197d5d", "name": "network-vif-deleted", "tag": "4365c1b8-2727-46a0-84b3-cb1e856a1552"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:09.887644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-372032f3-57e2-4c0a-b104-c08730921261 req-a08de004-5924-4b3b-ae6b-1bf269720f7a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:09.888463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-372032f3-57e2-4c0a-b104-c08730921261 req-a08de004-5924-4b3b-ae6b-1bf269720f7a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:09.909082 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-372032f3-57e2-4c0a-b104-c08730921261 req-a08de004-5924-4b3b-ae6b-1bf269720f7a service nova] Creating event network-vif-deleted:4365c1b8-2727-46a0-84b3-cb1e856a1552 for instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d on n-h2-841089-2 May 10 02:23:09.919352 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-372032f3-57e2-4c0a-b104-c08730921261 req-a08de004-5924-4b3b-ae6b-1bf269720f7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059660 May 10 02:23:09.921729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1515/3095] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:09.934888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:09.935969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:09.944139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:09.945205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:09.946324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:09.947166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:10.569452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:10.602298 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bda859d4-6422-4038-be10-a23e8c80c518 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1519 microversion: 2.1 time: 0.676735 May 10 02:23:10.612916 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1516/3096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:09 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1519 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:10.630609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ffd4412-cc24-41db-a1bd-b96e208109ab"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:10.641457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:10.666853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:10.667369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:10.668377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:10.673050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:11.130114 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3834d3a5-4b5a-4bc4-a24a-9037de384d83 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515793 May 10 02:23:11.137584 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1517/3097] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:23:10 2022] POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:11.143784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:11.144536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] [instance: 4dd028c9-ba76-40cb-86e3-89b3ec197d5d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:11.151452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:11.151917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:11.152714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:11.153402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:11.179344 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] HTTP exception thrown: Instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d could not be found. May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Request method failure captured: May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d HTTP/1.1 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxpx4AswcUV-A4vm8YhbP6xQvi3IbSbiqbJQQ6ZWm5rPigPjYkMQBhqCwKaa8zYtj97ZM7EagYauU3O6KcgqeoPtYYxtNCqe72Aj0NiQ7vkcclv0rEpE-F0ve9cokXzYQzULjhCpjlmGvRrKtGIZkulnbTfqsX7BMNUScyCX2ZjjRM May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 91cb529204ff4bfbb2e27402217ff248 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-InstanceActionsTestJSON-220835542 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91cb529204ff4bfbb2e27402217ff248", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91cb529204ff4bfbb2e27402217ff248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91cb529204ff4bfbb2e27402217ff248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91cb529204ff4bfbb2e27402217ff248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-InstanceActionsTestJSON-220835542 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 91cb529204ff4bfbb2e27402217ff248 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-InstanceActionsTestJSON-220835542 May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-InstanceActionsTestJSON-220835542-project May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4317ec250efd47ac82e0d04a39f6ebec May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-InstanceActionsTestJSON-220835542-project May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d could not be found. May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4dd028c9-ba76-40cb-86e3-89b3ec197d5d'} May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d could not be found. May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d could not be found. May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:11.184077 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d could not be found. May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] Returning 404 to user: Instance 4dd028c9-ba76-40cb-86e3-89b3ec197d5d could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:11.187631 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-48948e00-b939-4fd8-afaa-c9c751fd60a5 tempest-InstanceActionsTestJSON-220835542 tempest-InstanceActionsTestJSON-220835542-project] 10.222.0.52 "GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d" status: 404 len: 111 microversion: 2.1 time: 0.048276 May 10 02:23:11.190002 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1518/3098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:11 2022] GET /compute/v2.1/servers/4dd028c9-ba76-40cb-86e3-89b3ec197d5d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:11.196298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:11.197034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:11.208359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:11.208937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:11.209676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:11.210125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:12.085213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:12.093935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-55d010a0-f6a8-4ef4-b3d4-2d1117a395c6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1317 microversion: 2.1 time: 0.903104 May 10 02:23:12.098911 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1519/3099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:11 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1317 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:12.131889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0852432d-4738-48f9-9170-5859ee60a95a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36567700>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:12.249482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0852432d-4738-48f9-9170-5859ee60a95a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.146231 May 10 02:23:12.252431 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1520/3100] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:12 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:12.263365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:12.264744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:12.284192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:12.287389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:12.289407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:12.291113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.321421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:23:13.321829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:23:13.322324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:23:13.322923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:23:13.323560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:23:13.347203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.353291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.361729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.366822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.404737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:13.416789 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6a69958-0fab-4e9b-b02b-ff381cbaaf44 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1499 microversion: 2.1 time: 1.163019 May 10 02:23:13.420302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1521/3101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:12 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1499 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:13.436420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:13.437827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:13.446741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Getting quotas for project 90addb32e3db4346af6f860d63976eff. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:13.452815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.455733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.460191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.460868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.477018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Getting quotas for user 2125b740188b47d290e25d2423cb84dc and project 90addb32e3db4346af6f860d63976eff. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:13.500587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:23:13.505166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:13.591723 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab4f98fa-9fcc-4ef7-be65-fe823c9c8ce0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.907004 May 10 02:23:13.593764 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1581/3102] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:23:13.606749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf24709b-569e-4ec1-9008-9e5d103212d0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d363f24c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:13.728425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf24709b-569e-4ec1-9008-9e5d103212d0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.133372 May 10 02:23:13.734146 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1582/3103] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:13 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:13.769678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:13.772323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:13.805318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.805796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.806617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.807324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:13.879826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:13.891212 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f8e6c6e-d229-4a09-8c0d-2b4364674c5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1466 microversion: 2.1 time: 0.464022 May 10 02:23:13.895111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'flavor' on Instance uuid 69d467dd-f2fb-4d80-b26a-16fe06043cec {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:23:13.895633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1522/3104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:13 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1466 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:13.906038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3040dd92-54e7-461a-a53f-5f4d9656acd6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:13.911027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3040dd92-54e7-461a-a53f-5f4d9656acd6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:13.925905 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Cannot 'rescue' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state paused May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action HTTP/1.1 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 14 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: {"rescue": {}} May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: exception: Cannot 'rescue' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state paused May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '69d467dd-f2fb-4d80-b26a-16fe06043cec', 'body': {'rescue': {}}} May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec in vm_state paused. Cannot rescue while the instance is in this state. May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state paused May 10 02:23:13.954823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state paused May 10 02:23:13.958956 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:23:13.960590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 409 to user: Cannot 'rescue' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state paused {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:13.966398 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-30c1e2f3-4988-401b-9562-697cc03ee1f8 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action" status: 409 len: 144 microversion: 2.1 time: 0.219489 May 10 02:23:13.974529 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1583/3105] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:13 2022] POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action => generated 144 bytes in 233 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:23:13.979618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:13.981479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:13.995880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:13.997151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:14.000812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:14.006166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:14.073117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3040dd92-54e7-461a-a53f-5f4d9656acd6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:14.090276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3040dd92-54e7-461a-a53f-5f4d9656acd6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1213 microversion: 2.1 time: 0.189386 May 10 02:23:14.094649 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1523/3106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:13 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1213 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:14.103019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:14.107609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:14.134851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:14.146908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:14.148050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:14.150649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:14.404786 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62765495-b0df-45ac-b160-113711e8ff46 tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1617 microversion: 2.1 time: 0.428710 May 10 02:23:14.420553 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1584/3107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:13 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1617 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:14.497853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b769ec2c-9609-43f3-a3d3-47a5458e374d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action" status: 202 len: 0 microversion: 2.1 time: 0.371646 May 10 02:23:14.499796 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1524/3108] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:14 2022] POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:23:14.508512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:14.509384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:14.525948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:14.535204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:14.540774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:14.543931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:14.748192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc4df69c-1d13-4e32-a63e-9780ff9c912e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d360b7160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:14.844533 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bc4df69c-1d13-4e32-a63e-9780ff9c912e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.101461 May 10 02:23:14.845561 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1525/3109] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:14 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:14.871313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1593837067", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4f391397-d509-4342-b1fc-5864a0c80873"]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:14.978527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:15.594405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:15.605613 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75cd9e98-2f31-45d5-a393-a8d93e9968b9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1506 microversion: 2.1 time: 1.100985 May 10 02:23:15.612929 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1585/3110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:14 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1506 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:15.647989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:15.649709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:15.663430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:15.668278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:15.669415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:15.670023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:15.867292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:15.883825 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2882b089-c1af-4877-9ec4-ca05e5c43d33 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1265 microversion: 2.1 time: 0.266726 May 10 02:23:15.887556 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1586/3111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:15 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:15.906464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59b3bb42-5f5a-42f6-91c5-af3d2e914831 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36313ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:15.999551 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59b3bb42-5f5a-42f6-91c5-af3d2e914831 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.110653 May 10 02:23:16.000149 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1587/3112] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:15 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:16.062792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:23:16.064453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:23:16.064983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:23:16.065409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:23:16.065840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:23:16.081241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:16.081702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:16.082535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:16.082976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:16.161843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:16.181595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:16.213941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:23:16.216713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:16.325568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8bda0a2f-ba72-4b81-94fb-84f1475f5741 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462373 May 10 02:23:16.336770 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1526/3113] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:23:16.342540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b5dd19a-9c46-4d91-a3fb-d53d2070845d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:16.343259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b5dd19a-9c46-4d91-a3fb-d53d2070845d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:16.586212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b5dd19a-9c46-4d91-a3fb-d53d2070845d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:16.604476 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b5dd19a-9c46-4d91-a3fb-d53d2070845d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1217 microversion: 2.1 time: 0.266808 May 10 02:23:16.614876 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1588/3114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:16 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:16.641090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:16.641090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:16.656106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:16.657121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:16.670728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:16.671904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:16.904116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:16.905073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:16.915313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:16.918826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:16.922227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:16.925109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:17.261133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:17.269167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-872a779a-16d4-407e-a7a4-53c8381e87cf tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1514 microversion: 2.1 time: 0.643963 May 10 02:23:17.274693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:17.295668 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56a34e4e-a794-4e4d-9959-a5655f14fbf5 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1271 microversion: 2.1 time: 0.395589 May 10 02:23:17.296155 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1527/3115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:16 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1514 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:17.309310 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1589/3116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:16 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1271 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:17.312306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d556cb17-f1ee-4939-b2d9-2ee7f1af4a9b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f67670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:17.412968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d556cb17-f1ee-4939-b2d9-2ee7f1af4a9b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1413 microversion: 2.1 time: 0.115495 May 10 02:23:17.418683 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1528/3117] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:17 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:17.621619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:17.622223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:17.642139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:17.648360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:17.651253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:17.653615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:17.811428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:17.820634 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6d5e1a39-8b67-43ad-9f15-237d1d16198e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1213 microversion: 2.1 time: 0.202802 May 10 02:23:17.824599 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1590/3118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:17 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:18.321576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:18.322873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:18.354690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:18.355469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:18.358280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:18.360961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:18.838449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:18.848984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9fb6a394-9641-469b-99a4-051569d45555 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1313 microversion: 2.1 time: 0.536074 May 10 02:23:18.862379 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1529/3119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:18 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:18.867616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34990a3a-e218-4bcd-9882-6cc15c9cd799 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f67dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:18.945161 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34990a3a-e218-4bcd-9882-6cc15c9cd799 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1422 microversion: 2.1 time: 0.081479 May 10 02:23:18.947490 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1530/3120] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:18 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:18.967632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:18.971501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:18.983933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:18.984871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:18.987020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:18.988370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:19.041945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1465284005", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "4b1c8acc-2296-4709-9445-6057858be796"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:19.126719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] validate_networks() for [('4b1c8acc-2296-4709-9445-6057858be796', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:19.174327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:19.189929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94d7f868-99cd-4bc4-a047-bb6a14e039bf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1275 microversion: 2.1 time: 0.235784 May 10 02:23:19.204157 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1531/3121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:18 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:19.219849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6eea0ffa-148f-4913-85b2-fee6ad940c6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f67310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:19.299714 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6eea0ffa-148f-4913-85b2-fee6ad940c6f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 200 len: 1422 microversion: 2.1 time: 0.093895 May 10 02:23:19.320516 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1532/3122] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:19 2022] GET /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:19.343919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3302a82e-2350-40f1-9e3a-e3d30211cfb9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36170c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:20.115093 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3302a82e-2350-40f1-9e3a-e3d30211cfb9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 204 len: 0 microversion: 2.1 time: 0.791781 May 10 02:23:20.115718 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1533/3123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:19 2022] DELETE /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 0 bytes in 795 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:20.120624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:20.121248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:20.136844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:20.137946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:20.138994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:20.139476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.163307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:23:21.165041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:23:21.165638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:23:21.166313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:23:21.166950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:23:21.210386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.211839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.215097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.216097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.245217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Getting quotas for project df0e7c324d7745efa55830fb4a87dd7f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:21.251208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Getting quotas for user fbbe6ebb85cd4cf6b5b09a2defe3c54b and project df0e7c324d7745efa55830fb4a87dd7f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:21.267274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:21.285760 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4104a507-19fb-40be-8543-0ee427703be6 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 1.168935 May 10 02:23:21.288903 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1534/3124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:20 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:21.297763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Going to run 2 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:23:21.300033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:21.302847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:21.306418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:21.316472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.316931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.323935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.324850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.395571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:23:21.405225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=290fe2d2-a71c-4a2a-a861-0b76fe24ca3d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:21.592506 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2be07639-ae2e-4b1c-b2be-67499e624a06 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.174961 May 10 02:23:21.594967 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1591/3125] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:23:21.607944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:21.609318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:21.623989 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-300c5975-3d8d-455d-9b65-f3b489d2c254 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 204 len: 0 microversion: 2.1 time: 0.332543 May 10 02:23:21.624531 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1535/3126] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:21 2022] DELETE /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:21.630689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.631456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.635281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.636100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.639712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:21.641065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:21.662713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.663822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.664835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.665934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.718354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'flavor' on Instance uuid 69d467dd-f2fb-4d80-b26a-16fe06043cec {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:23:21.853070 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f31b6aaf-356f-4d94-94e9-2493a9c16344 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action" status: 200 len: 32 microversion: 2.1 time: 0.226008 May 10 02:23:21.860935 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1536/3127] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:21 2022] POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:23:21.872358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:21.882107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:21.883416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Searching by: {'deleted': False, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f'} {{(pid=118717) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:23:21.912630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.914642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.916023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.916745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.944134 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dc80110-e177-45c3-87c8-24eb460403a2 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.081402 May 10 02:23:21.945519 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1537/3128] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:23:21 2022] GET /compute/v2.1/servers => generated 677 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:21.951245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:21.952256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:21.959691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.960297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:21.961174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:21.961755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:22.167394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:22.177969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12970b4b-b43b-4cb3-89b3-81a6dacb6ea8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 0.579010 May 10 02:23:22.192362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1592/3129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:21 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:22.204202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1939467829", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "f68d8830-2b07-4e10-861f-42f50aa74911"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:22.342523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] validate_networks() for [('f68d8830-2b07-4e10-861f-42f50aa74911', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:22.345717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:22.359653 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c01c9a2e-f646-4ed2-8762-9a96f0f7bf77 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.408630 May 10 02:23:22.361345 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1538/3130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:21 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:22.373028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54775f05-b95f-4c97-8d3c-ee552cc30584 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:22.373900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54775f05-b95f-4c97-8d3c-ee552cc30584 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:22.552615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54775f05-b95f-4c97-8d3c-ee552cc30584 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:22.560975 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54775f05-b95f-4c97-8d3c-ee552cc30584 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1220 microversion: 2.1 time: 0.198326 May 10 02:23:22.562197 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1539/3131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:22 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1220 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:22.567780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:22.568940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:22.576664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:22.577381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:22.578409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:22.580318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:23.432649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:23.448541 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2c26e36-a7b0-472e-8ebd-30f8d9e9bc8c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.884969 May 10 02:23:23.451774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1540/3132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:22 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:23.457093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c651b4bf-8b15-4405-899a-e03180aff3a1 req-6b58e845-c900-4834-b59d-c76752ddc762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4054a3-0198-45f3-8869-b8f39181090f", "name": "network-vif-unplugged", "status": "completed", "tag": "30c3473a-9334-49c5-8e24-25b29fbba44a"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:23.470565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c651b4bf-8b15-4405-899a-e03180aff3a1 req-6b58e845-c900-4834-b59d-c76752ddc762 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:23.471833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c651b4bf-8b15-4405-899a-e03180aff3a1 req-6b58e845-c900-4834-b59d-c76752ddc762 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:23.514437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c651b4bf-8b15-4405-899a-e03180aff3a1 req-6b58e845-c900-4834-b59d-c76752ddc762 service nova] Creating event network-vif-unplugged:30c3473a-9334-49c5-8e24-25b29fbba44a for instance 5d4054a3-0198-45f3-8869-b8f39181090f on n-h2-841089-2 May 10 02:23:23.530952 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c651b4bf-8b15-4405-899a-e03180aff3a1 req-6b58e845-c900-4834-b59d-c76752ddc762 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077658 May 10 02:23:23.531891 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1541/3133] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:23.538179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:23.541388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:23.553153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:23.553621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:23.556931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:23.556931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:25.080326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:25.092672 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-edea61a8-94f9-471a-a740-d5e461c06d2b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 1.559188 May 10 02:23:25.093551 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1542/3134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:23 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:25.110730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:25.111601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:25.121214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:25.121695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:25.122507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:25.123344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:25.487001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:23:25.489368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:23:25.490602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:23:25.491344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:23:25.492004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:23:25.506375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:25.507053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:25.508329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:25.509409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:25.539566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:25.556667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for user 81137d6fb1bc4f75a706134b0c13ce63 and project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:25.581706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:23:25.584380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:25.662075 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f98c7be-98ad-44f2-9976-6b54600c8d4d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.467356 May 10 02:23:25.670659 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1593/3135] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:23:25.678592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:25.680701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:25.697821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:25.698299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:25.699111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:25.700678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:26.000363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:26.012078 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ef60e4e-71cb-4309-b79e-f300ee856e9f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.917449 May 10 02:23:26.014572 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1543/3136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:25 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:26.029271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7227e275-41dc-46c2-b09a-c14dd17b1b45 req-8adb5fc4-194e-498c-8f55-7ba8c82d8e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f802a3f-35d5-4e49-811d-39997645e7f4", "tag": "03cfc471-91c1-41c1-bf5d-b5907f36af34"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:26.036940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:26.042360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7227e275-41dc-46c2-b09a-c14dd17b1b45 req-8adb5fc4-194e-498c-8f55-7ba8c82d8e72 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:26.043515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7227e275-41dc-46c2-b09a-c14dd17b1b45 req-8adb5fc4-194e-498c-8f55-7ba8c82d8e72 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:26.051025 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c639cd0d-ed1f-4179-a55c-c7d031c7443d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1278 microversion: 2.1 time: 0.378758 May 10 02:23:26.051691 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1594/3137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:25 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:26.061388 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7227e275-41dc-46c2-b09a-c14dd17b1b45 req-8adb5fc4-194e-498c-8f55-7ba8c82d8e72 service nova] Creating event network-changed:03cfc471-91c1-41c1-bf5d-b5907f36af34 for instance 2f802a3f-35d5-4e49-811d-39997645e7f4 on n-h2-841089-2 May 10 02:23:26.063196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:26.064346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:26.069626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7227e275-41dc-46c2-b09a-c14dd17b1b45 req-8adb5fc4-194e-498c-8f55-7ba8c82d8e72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053451 May 10 02:23:26.071444 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1544/3138] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:26.072260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:26.072726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:26.073528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:26.073980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:26.095308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-845daeec-705d-4f0c-ba45-4bd6ef60224b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:26.097023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-845daeec-705d-4f0c-ba45-4bd6ef60224b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:26.349939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-845daeec-705d-4f0c-ba45-4bd6ef60224b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:26.363948 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-845daeec-705d-4f0c-ba45-4bd6ef60224b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1208 microversion: 2.1 time: 0.287773 May 10 02:23:26.364866 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1545/3139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:26 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1208 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:26.396211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:26.398779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:26.411321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:26.412222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:26.413414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:26.414360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:26.780198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:26.790040 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32e42954-26c2-4641-918a-7604d868a33a tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.737126 May 10 02:23:26.790723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1595/3140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:26 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:26.948267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:26.955820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-345d3d13-5ad5-48ef-9c99-1d58cdc7f1bd tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 0.589723 May 10 02:23:26.956403 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1546/3141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:26 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:27.031673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:27.032303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:27.043752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.045360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.050584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.051754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.067596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:27.068226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:27.085597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.096282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.097796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.098400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.421394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:27.445019 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f20cc2a5-e384-4f49-9724-4f00f2e9b43c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1278 microversion: 2.1 time: 0.381089 May 10 02:23:27.458709 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1547/3142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:27 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:27.474676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:27.476747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:27.501277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.501906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.502556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.502995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.671830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:27.683227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99c93392-66f9-4238-af81-24e6f996fce4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.657177 May 10 02:23:27.695872 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1596/3143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:27 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:27.716925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:27.724556 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5947d1e-b030-4a9d-a040-e7779ffb9a82 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1278 microversion: 2.1 time: 0.264368 May 10 02:23:27.725140 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1548/3144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:27 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:27.809291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:27.810818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:27.824242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.826935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.828148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.831247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.974186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:27.975925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:27.983002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.985015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:27.986498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:27.987060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:28.784981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:28.796080 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f43bc6a-69b6-481f-9fd5-7b3f1679db59 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.992174 May 10 02:23:28.796716 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1597/3145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:27 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:28.801859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:28.802464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:28.823943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:28.825770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:28.826736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:28.828541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.066540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:29.079147 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-988f5e05-68d0-4b02-872d-38a785510942 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 1.108301 May 10 02:23:29.088739 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1549/3146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:27 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:29.096110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f288d72a-ea31-4716-98c1-74f6e1ffc348", "tag": "8e9ff947-6d97-4af3-8f6d-5e99f490dfc6"}, {"server_uuid": "5d4054a3-0198-45f3-8869-b8f39181090f", "name": "network-vif-deleted", "tag": "30c3473a-9334-49c5-8e24-25b29fbba44a"}, {"name": "network-changed", "server_uuid": "2f802a3f-35d5-4e49-811d-39997645e7f4", "tag": "b305155d-ba0c-4a79-b30e-07bae7dc1a9d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:29.107229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.108033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.124715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] Creating event network-changed:8e9ff947-6d97-4af3-8f6d-5e99f490dfc6 for instance f288d72a-ea31-4716-98c1-74f6e1ffc348 on n-h2-841089-2 May 10 02:23:29.125545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] Creating event network-vif-deleted:30c3473a-9334-49c5-8e24-25b29fbba44a for instance 5d4054a3-0198-45f3-8869-b8f39181090f on n-h2-841089-2 May 10 02:23:29.126235 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] Creating event network-changed:b305155d-ba0c-4a79-b30e-07bae7dc1a9d for instance 2f802a3f-35d5-4e49-811d-39997645e7f4 on n-h2-841089-2 May 10 02:23:29.136090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f306ec1a-5a77-41b9-9252-8313be0053b0 req-d529cacc-196d-4aa1-8202-9d80049a5a2b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.044860 May 10 02:23:29.137840 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1550/3147] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:29.146528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:29.147553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:29.155453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.156802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.158670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.159602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.592232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:29.604388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e46f9e91-97a0-4bea-9b05-2099f6fe3153 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.806558 May 10 02:23:29.605429 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1598/3148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:28 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:29.612641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:29.613683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:29.631180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.632168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.633275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.639898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.908305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:29.920491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-63aaad42-fb68-4c53-8d01-c299983b46ae tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.779191 May 10 02:23:29.921231 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1551/3149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:29 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:29.927486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8829d841-5dd1-4b08-b384-260c8887580d req-6b5f9779-fb39-4199-8e99-124edb63ab74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64bf23ff-a012-485c-a83a-3b8e2246db23", "tag": "2d433f8c-37f2-4e92-91d3-0a5e48458f8e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:29.940178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8829d841-5dd1-4b08-b384-260c8887580d req-6b5f9779-fb39-4199-8e99-124edb63ab74 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.940841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8829d841-5dd1-4b08-b384-260c8887580d req-6b5f9779-fb39-4199-8e99-124edb63ab74 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.952261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8829d841-5dd1-4b08-b384-260c8887580d req-6b5f9779-fb39-4199-8e99-124edb63ab74 service nova] Creating event network-changed:2d433f8c-37f2-4e92-91d3-0a5e48458f8e for instance 64bf23ff-a012-485c-a83a-3b8e2246db23 on n-h1-841089-2 May 10 02:23:29.958798 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8829d841-5dd1-4b08-b384-260c8887580d req-6b5f9779-fb39-4199-8e99-124edb63ab74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035699 May 10 02:23:29.959664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1552/3150] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:29.967559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:29.968573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:29.975333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.975920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:29.979364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:29.979364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:30.316166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:30.336590 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6cdfe164-7287-43eb-842c-7e03716e79ad tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1308 microversion: 2.1 time: 0.727020 May 10 02:23:30.351138 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1599/3151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:29 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:30.358554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:30.359534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:30.368220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:30.369496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:30.370696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:30.372078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:30.604165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:30.618267 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e37d2b97-6a46-4ea7-ae0c-6c0155526dde tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.656867 May 10 02:23:30.619266 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1553/3152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:29 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:30.627944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:30.629482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:30.642676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:30.643233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:30.644034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:30.644460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:31.277339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:31.300709 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5ff8560-3a18-4719-bc18-c43e54ae1c2a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 0.947683 May 10 02:23:31.301660 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1600/3153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:30 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:31.319223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:31.321535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:31.332613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:31.333847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:31.335096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:31.336171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:31.556568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:31.569884 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a7b2673-fb4b-48a4-ae2f-1d2552fd6d8c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.948457 May 10 02:23:31.570890 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1554/3154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:30 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:31.585988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:31.586619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:31.605831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:31.606448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:31.607100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:31.607897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:31.958975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:31.966969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a06dde83-44a8-44e5-a100-2cbf8ee1dc81 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.663914 May 10 02:23:31.967820 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1601/3155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:31 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:31.972744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:31.973060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:31.979156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:31.979692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:31.980753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:31.981263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.097940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:32.106939 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23f9f281-1136-4f45-98e8-3768a48bc9bc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1308 microversion: 2.1 time: 0.525075 May 10 02:23:32.107851 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1555/3156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:31 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1308 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:32.284537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-026fa4ad-5cce-4dc8-97ab-c9d75100d9a5 req-3ccec189-ff62-4a8a-bc3d-287bd1c2d043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b779c421-9168-403c-871a-bbb93fd0495e", "tag": "20cd0611-cdc4-40c3-80c8-079fc5ad9dd0"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:32.302030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-026fa4ad-5cce-4dc8-97ab-c9d75100d9a5 req-3ccec189-ff62-4a8a-bc3d-287bd1c2d043 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.302946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-026fa4ad-5cce-4dc8-97ab-c9d75100d9a5 req-3ccec189-ff62-4a8a-bc3d-287bd1c2d043 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.324036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-026fa4ad-5cce-4dc8-97ab-c9d75100d9a5 req-3ccec189-ff62-4a8a-bc3d-287bd1c2d043 service nova] Creating event network-changed:20cd0611-cdc4-40c3-80c8-079fc5ad9dd0 for instance b779c421-9168-403c-871a-bbb93fd0495e on n-h1-841089-2 May 10 02:23:32.332268 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-026fa4ad-5cce-4dc8-97ab-c9d75100d9a5 req-3ccec189-ff62-4a8a-bc3d-287bd1c2d043 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056097 May 10 02:23:32.334047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1556/3157] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:23:32.344472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:32.346215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:32.355059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.356206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.358109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.358579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.382768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:32.406200 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f6ea1c1-2f6b-4e8a-ac1a-03b11fdd0897 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.437395 May 10 02:23:32.410122 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1602/3158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:31 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:32.487024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-44c45848-0367-4229-a68c-7d664166a057 req-412ae22e-2ddd-4323-a809-e1cebdeddba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f288d72a-ea31-4716-98c1-74f6e1ffc348", "name": "network-vif-plugged", "status": "completed", "tag": "8e9ff947-6d97-4af3-8f6d-5e99f490dfc6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:32.498155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-44c45848-0367-4229-a68c-7d664166a057 req-412ae22e-2ddd-4323-a809-e1cebdeddba0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.498657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-44c45848-0367-4229-a68c-7d664166a057 req-412ae22e-2ddd-4323-a809-e1cebdeddba0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.511311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-44c45848-0367-4229-a68c-7d664166a057 req-412ae22e-2ddd-4323-a809-e1cebdeddba0 service nova] Creating event network-vif-plugged:8e9ff947-6d97-4af3-8f6d-5e99f490dfc6 for instance f288d72a-ea31-4716-98c1-74f6e1ffc348 on n-h2-841089-2 May 10 02:23:32.519150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-44c45848-0367-4229-a68c-7d664166a057 req-412ae22e-2ddd-4323-a809-e1cebdeddba0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038706 May 10 02:23:32.520401 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1603/3159] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:23:32.588168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:32.589540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:32.600005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.600793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.603057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.603938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.752909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:32.761767 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb04ca88-9392-405b-9d65-74e82b483228 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 0.425238 May 10 02:23:32.762969 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1557/3160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:32 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:32.937613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:32.951786 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae9d5f6b-1e7b-4e46-b42f-c5dc833ed096 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.367790 May 10 02:23:32.953642 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1604/3161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:32 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:32.982957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:32.983599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:32.989630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.990103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:32.990886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:32.991392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.125063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:33.127194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:33.134760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.135667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.136907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.137517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.255206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:33.265984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed72fa88-8a7c-4832-8699-a7c440dff819 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.286757 May 10 02:23:33.266934 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1558/3162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:32 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:33.406894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:33.416820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2bcf678e-5ba7-4747-bc4f-3b2fbb3152b1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1308 microversion: 2.1 time: 0.295587 May 10 02:23:33.417411 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1605/3163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:33 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:33.431427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:33.432132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:33.439049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.439896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.440755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.441390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.629406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:33.637284 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89073a6d-fbb4-40cc-a18a-8e0dd0bfceb0 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.209581 May 10 02:23:33.637804 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1559/3164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:33 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:33.780841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:33.782029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:33.789263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.790198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.790996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.791478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.969924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:33.971817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:33.978164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.978706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:33.979661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:33.980378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:34.005396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:34.013728 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b956d21-1627-4337-bd70-0efdc34f9129 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1317 microversion: 2.1 time: 0.237803 May 10 02:23:34.014319 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1606/3165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:33 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:34.131711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:34.139151 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80d1a600-11dc-4198-be2d-a97653130139 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.173278 May 10 02:23:34.139740 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1560/3166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:33 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:34.285228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:34.285883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:34.292212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:34.292670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:34.293468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:34.293909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:34.360981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-657b08aa-b3e0-4f91-80f7-5cbcaf4d9c8b req-2d7cf4ad-bb01-4499-9be5-46e273ce2df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290fe2d2-a71c-4a2a-a861-0b76fe24ca3d", "tag": "7afa4a61-77de-435e-9c53-61d64238a871"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:34.369605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-657b08aa-b3e0-4f91-80f7-5cbcaf4d9c8b req-2d7cf4ad-bb01-4499-9be5-46e273ce2df7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:34.370066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-657b08aa-b3e0-4f91-80f7-5cbcaf4d9c8b req-2d7cf4ad-bb01-4499-9be5-46e273ce2df7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:34.383954 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-657b08aa-b3e0-4f91-80f7-5cbcaf4d9c8b req-2d7cf4ad-bb01-4499-9be5-46e273ce2df7 service nova] Creating event network-changed:7afa4a61-77de-435e-9c53-61d64238a871 for instance 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d on n-h1-841089-2 May 10 02:23:34.390517 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-657b08aa-b3e0-4f91-80f7-5cbcaf4d9c8b req-2d7cf4ad-bb01-4499-9be5-46e273ce2df7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 May 10 02:23:34.391401 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1561/3167] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:34.433902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:34.434629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:34.442664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:34.443176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:34.443947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:34.444396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.058107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:35.085285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-172b4cc6-596d-4a76-9261-58f19cc03af4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.802819 May 10 02:23:35.101122 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1607/3168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:34 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:35.109382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:35.119602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:35.122751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:35.126655 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3e2bc3e-3e89-4c98-974a-44afc8ade558 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1308 microversion: 2.1 time: 0.697167 May 10 02:23:35.127337 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1562/3169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:34 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:35.132252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ae358d7d-b518-4686-8153-583cefa1e4c1 req-abf5949b-2c03-4c17-b2ec-5e5d13d85ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bf23ff-a012-485c-a83a-3b8e2246db23", "name": "network-vif-plugged", "status": "completed", "tag": "2d433f8c-37f2-4e92-91d3-0a5e48458f8e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:35.135654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.136734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.145671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.146175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.154901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ae358d7d-b518-4686-8153-583cefa1e4c1 req-abf5949b-2c03-4c17-b2ec-5e5d13d85ba4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.155695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ae358d7d-b518-4686-8153-583cefa1e4c1 req-abf5949b-2c03-4c17-b2ec-5e5d13d85ba4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.179337 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ae358d7d-b518-4686-8153-583cefa1e4c1 req-abf5949b-2c03-4c17-b2ec-5e5d13d85ba4 service nova] Creating event network-vif-plugged:2d433f8c-37f2-4e92-91d3-0a5e48458f8e for instance 64bf23ff-a012-485c-a83a-3b8e2246db23 on n-h1-841089-2 May 10 02:23:35.196993 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ae358d7d-b518-4686-8153-583cefa1e4c1 req-abf5949b-2c03-4c17-b2ec-5e5d13d85ba4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068413 May 10 02:23:35.197698 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1563/3170] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:35.205137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:35.205854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:35.223561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.224024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.224825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.225382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.546856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:35.557295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:35.558620 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49e62f01-0b78-4a39-a01a-7357a89de54c tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.455806 May 10 02:23:35.559374 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1608/3171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:35 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:35.564758 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e006004-7476-4275-8c31-2165abf547fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1466 microversion: 2.1 time: 0.364693 May 10 02:23:35.565331 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1564/3172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:35 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1466 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:35.575218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:35.576509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:35.585204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:35.586107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:35.588193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.589139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.589460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.589918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.592367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.593222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.594179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.596990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.974842 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc03c182-426c-4c8a-acdd-faff09ee4b2a tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1617 microversion: 2.1 time: 0.394010 May 10 02:23:35.975627 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1565/3173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:35 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1617 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:35.980100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b085aae-18df-4ee1-82c1-42efe5b78e3c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:35.986137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b085aae-18df-4ee1-82c1-42efe5b78e3c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:35.986591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b085aae-18df-4ee1-82c1-42efe5b78e3c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:35.997363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:36.005100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-167f98a5-4003-48a7-8961-de3a1b744fed tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.443598 May 10 02:23:36.005682 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1609/3174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:35 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:36.021622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b085aae-18df-4ee1-82c1-42efe5b78e3c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:23:36.068750 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b085aae-18df-4ee1-82c1-42efe5b78e3c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action" status: 202 len: 0 microversion: 2.1 time: 0.092065 May 10 02:23:36.069324 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1566/3175] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:35 2022] POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:23:36.077130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:36.077783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:36.084392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.084855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.085636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.086082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.103329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1184627767", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4f391397-d509-4342-b1fc-5864a0c80873"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:36.159745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:36.375366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:36.400869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46d375e1-ead2-4882-badc-5307c0023eea tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.327329 May 10 02:23:36.401786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1610/3176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:36 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:36.408771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:36.409778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:36.420458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.421575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.423662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.424417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.581497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:23:36.583225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:23:36.584988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:23:36.586936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:23:36.587957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:23:36.603207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.604129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.606173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.606844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.624431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:36.632296 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0005245d-94f5-40d3-9119-8d5fe3be1980 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.229344 May 10 02:23:36.640882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:36.641505 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1611/3177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:36 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:36.643244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Getting quotas for user 005c692ff37c43ddbe9aeb62da362006 and project ac70d73d5cf84464be5b7a3aeef01093. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:36.647895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:36.648710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:36.658137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.658797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.660294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.660901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.661839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:23:36.665083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:36.733329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b68c18bc-947a-4283-805b-620d12fbfc73 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635690 May 10 02:23:36.734006 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1567/3178] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:23:36.745277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:36.745772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:36.752915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.753449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.754315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:36.754837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:36.898637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:36.914708 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09fcc2b1-9803-4d0f-bf84-b3425a7d908c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1308 microversion: 2.1 time: 0.271854 May 10 02:23:36.920111 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1612/3179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:36 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:36.925584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b47f4e82-6548-4a31-9bd6-3aea196cfdf6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:36.935730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b47f4e82-6548-4a31-9bd6-3aea196cfdf6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:36.974144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:36.994478 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-111018ca-9c6f-41e6-881e-6188360e3331 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.259396 May 10 02:23:36.996518 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1568/3180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:36 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:37.025930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:37.026710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:37.032042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b47f4e82-6548-4a31-9bd6-3aea196cfdf6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:37.034298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.034761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.035797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.036241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.038712 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b47f4e82-6548-4a31-9bd6-3aea196cfdf6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1217 microversion: 2.1 time: 0.117376 May 10 02:23:37.039685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1613/3181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:36 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:37.210744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:37.218419 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5817c6d-074e-4255-91a3-b98fdb9f2b77 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.196377 May 10 02:23:37.219004 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1569/3182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:37 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:37.248571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c7f59fcf-6144-4652-af70-15233918ce07 req-28a2e8dd-fd51-4e1d-950c-d79e48684d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b779c421-9168-403c-871a-bbb93fd0495e", "name": "network-vif-plugged", "status": "completed", "tag": "20cd0611-cdc4-40c3-80c8-079fc5ad9dd0"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:37.257931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c7f59fcf-6144-4652-af70-15233918ce07 req-28a2e8dd-fd51-4e1d-950c-d79e48684d2d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.258780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c7f59fcf-6144-4652-af70-15233918ce07 req-28a2e8dd-fd51-4e1d-950c-d79e48684d2d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.275974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c7f59fcf-6144-4652-af70-15233918ce07 req-28a2e8dd-fd51-4e1d-950c-d79e48684d2d service nova] Creating event network-vif-plugged:20cd0611-cdc4-40c3-80c8-079fc5ad9dd0 for instance b779c421-9168-403c-871a-bbb93fd0495e on n-h1-841089-2 May 10 02:23:37.281432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c7f59fcf-6144-4652-af70-15233918ce07 req-28a2e8dd-fd51-4e1d-950c-d79e48684d2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036816 May 10 02:23:37.285882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1614/3183] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:37.418714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:37.419500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:37.437194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.437801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.439213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.439749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.582591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:37.591398 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44cc13ff-6edc-4b40-b2d7-de12c4f48622 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.176471 May 10 02:23:37.592081 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1570/3184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:37 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:37.649982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:37.650702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:37.657218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.657678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.658457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.659019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.843732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:37.852822 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3578019-3118-4654-be04-b2e2938d69ef tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.207494 May 10 02:23:37.853491 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1615/3185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:37 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:37.937265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:37.938301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:37.954372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.954927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:37.955941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:37.956613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.012287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:38.012830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.021864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.022484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.023470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.024019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.300702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:38.308537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41ab8190-4a11-4c84-a7cf-11748deec249 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1489 microversion: 2.1 time: 0.375474 May 10 02:23:38.309339 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1571/3186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:37 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1489 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:38.319343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:38.319343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.324383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.324836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.325860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.326308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.329558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:38.337390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26484f46-d53d-40b0-b657-4ad4c910e8fc tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.329758 May 10 02:23:38.338047 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1616/3187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:38 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:38.342568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:38.343310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.350068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.350601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.351605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.352508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.402892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:38.414763 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e0094f73-c505-43ae-b55e-a6d60b5b528c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1269 microversion: 2.1 time: 0.104370 May 10 02:23:38.415483 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1572/3188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:38 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:38.420572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:38.421515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.430178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.430635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.431952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.432390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.462701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lazy-loading 'flavor' on Instance uuid 64bf23ff-a012-485c-a83a-3b8e2246db23 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:23:38.541762 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4c9157a-4e10-4bd6-a1b4-ac5fac2d24d9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23/action" status: 202 len: 0 microversion: 2.1 time: 0.124523 May 10 02:23:38.542326 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1573/3189] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:38 2022] POST /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:23:38.551355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:38.552076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.558625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.559208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.559992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.560804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.694797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:38.721097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d10e9a1-5efc-4bb0-ae7b-0f4961199eef tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.380122 May 10 02:23:38.722255 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1617/3190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:38 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:38.736374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:38.736997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.749192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.750062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.751376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.752165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.790374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:38.798196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7cbaa49-f1e6-4098-8dbe-bb403b90530b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1497 microversion: 2.1 time: 0.251502 May 10 02:23:38.801730 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1574/3191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:38 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:38.869843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:38.870572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:38.878248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.883411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.884525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:38.885223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:38.978912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:38.995165 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05ae1d31-3420-4cf3-a50b-8348c0221596 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.268680 May 10 02:23:38.996434 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1618/3192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:38 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:39.156178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:39.167042 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2f945b4-d184-411c-a18a-7b87697088ac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.301031 May 10 02:23:39.168033 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1575/3193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:38 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:39.311335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8449fd60-20ae-493f-b06f-363d9e10c9f1 req-85d1f04d-4c33-413e-8313-549d02bbc579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f802a3f-35d5-4e49-811d-39997645e7f4", "name": "network-vif-plugged", "status": "completed", "tag": "03cfc471-91c1-41c1-bf5d-b5907f36af34"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:39.320200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8449fd60-20ae-493f-b06f-363d9e10c9f1 req-85d1f04d-4c33-413e-8313-549d02bbc579 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.320894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8449fd60-20ae-493f-b06f-363d9e10c9f1 req-85d1f04d-4c33-413e-8313-549d02bbc579 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.333888 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8449fd60-20ae-493f-b06f-363d9e10c9f1 req-85d1f04d-4c33-413e-8313-549d02bbc579 service nova] Creating event network-vif-plugged:03cfc471-91c1-41c1-bf5d-b5907f36af34 for instance 2f802a3f-35d5-4e49-811d-39997645e7f4 on n-h2-841089-2 May 10 02:23:39.339538 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8449fd60-20ae-493f-b06f-363d9e10c9f1 req-85d1f04d-4c33-413e-8313-549d02bbc579 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 May 10 02:23:39.340786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1619/3194] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:39.355833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:39.357054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:39.363382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.364091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.365340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.365954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.436433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:39.437216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:39.443871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.444326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.445876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.446808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.551932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:39.563630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:39.565982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a8e6bfd-7353-415a-8e1c-dd84fca27377 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1275 microversion: 2.1 time: 0.135956 May 10 02:23:39.568397 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1620/3195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:39 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:39.580218 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f2a7511-8315-410e-89db-39adc28a3fba tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.228489 May 10 02:23:39.580683 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1576/3196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:39 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:39.740370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:39.741778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:39.755390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.756334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.760211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.760833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.818894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:39.819758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:39.831538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.835936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:39.837129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:39.838276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.122885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:40.130821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:40.137468 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07f47305-dff2-4bee-9927-c25acd760c2c tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1320 microversion: 2.1 time: 0.403445 May 10 02:23:40.149317 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1621/3197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:39 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:40.149439 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-007dc924-211a-4e1b-aa03-6af67a7993ff tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1497 microversion: 2.1 time: 0.331216 May 10 02:23:40.155576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:40.155821 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1577/3198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:39 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1497 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:40.156392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:40.185070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:40.187790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:40.190262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.192330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.196725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.197373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.201251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.203571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.204556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.206919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.676302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:40.689010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5af75dc-d951-43ae-aee9-9f3ce84aaf22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.543778 May 10 02:23:40.689609 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1622/3199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:40 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:40.703007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:40.703651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:40.719750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:40.724270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.725139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.726579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.727674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.730953 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d0a7185-2e0c-47a8-87a5-539f96acf525 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.549713 May 10 02:23:40.731583 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1578/3200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:40 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:40.746539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:40.749745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:40.765629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.771721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:40.772760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:40.773361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.022312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:41.028880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:41.030661 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff475877-e475-4123-8a81-e6ad2cbef845 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.339715 May 10 02:23:41.034963 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1623/3201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:40 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:41.043626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b11d925-9995-4268-b8ad-2da49c92b71b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.296968 May 10 02:23:41.043626 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1579/3202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:40 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:41.045231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3194fae3-8688-41d0-b240-4bf84a92117c req-7a244dae-8542-4470-bff8-d40681978061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48086e6-7c2d-4b3d-857a-f02209d1fc89", "tag": "ba81873e-e155-40fe-8c4f-cd68e54602cc"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:41.058973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3194fae3-8688-41d0-b240-4bf84a92117c req-7a244dae-8542-4470-bff8-d40681978061 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.059857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3194fae3-8688-41d0-b240-4bf84a92117c req-7a244dae-8542-4470-bff8-d40681978061 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.084699 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3194fae3-8688-41d0-b240-4bf84a92117c req-7a244dae-8542-4470-bff8-d40681978061 service nova] Creating event network-changed:ba81873e-e155-40fe-8c4f-cd68e54602cc for instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 on n-h1-841089-2 May 10 02:23:41.091086 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3194fae3-8688-41d0-b240-4bf84a92117c req-7a244dae-8542-4470-bff8-d40681978061 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049122 May 10 02:23:41.091864 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1580/3203] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:41.157938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:41.158962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:41.166756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.167506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.167632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:41.168670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.168792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:41.169461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.177343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.177808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.178662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.179130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.394581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:41.405282 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7330aa0-6662-4f67-bca5-50385e45bdc3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 200 len: 1508 microversion: 2.1 time: 0.252162 May 10 02:23:41.408502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1624/3204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:41 2022] GET /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:41.415166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5ce0f340-10ae-421b-b1b8-e246df6869d6 req-4b90a67b-3293-4691-9d98-27114e6d39f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f802a3f-35d5-4e49-811d-39997645e7f4", "name": "network-vif-plugged", "status": "completed", "tag": "b305155d-ba0c-4a79-b30e-07bae7dc1a9d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:41.430579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5ce0f340-10ae-421b-b1b8-e246df6869d6 req-4b90a67b-3293-4691-9d98-27114e6d39f3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.431331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5ce0f340-10ae-421b-b1b8-e246df6869d6 req-4b90a67b-3293-4691-9d98-27114e6d39f3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.438360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:41.446230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-251f3b60-9775-4a0a-8970-f0a8a4855288 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 200 len: 1480 microversion: 2.1 time: 0.287261 May 10 02:23:41.446827 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5ce0f340-10ae-421b-b1b8-e246df6869d6 req-4b90a67b-3293-4691-9d98-27114e6d39f3 service nova] Creating event network-vif-plugged:b305155d-ba0c-4a79-b30e-07bae7dc1a9d for instance 2f802a3f-35d5-4e49-811d-39997645e7f4 on n-h2-841089-2 May 10 02:23:41.447705 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1581/3205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:41 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 1480 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:41.452577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:41.453213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:41.460580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.460783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5ce0f340-10ae-421b-b1b8-e246df6869d6 req-4b90a67b-3293-4691-9d98-27114e6d39f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050674 May 10 02:23:41.461047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.461238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1625/3206] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:41.461980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.462436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.469568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-428692267"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:41.471769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:41.478606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.479335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.493387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.495308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.672061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:41.683884 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7bfcf9d2-cbc3-4039-8558-0968c3d8d886 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d" status: 200 len: 1320 microversion: 2.1 time: 0.233835 May 10 02:23:41.685159 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1582/3207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:41 2022] GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:41.709617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:41.711455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:41.722748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.723319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.724316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.724758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.872645 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26195150-ab5a-46e8-91e5-314af05efa74 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23/action" status: 202 len: 0 microversion: 2.1 time: 0.409555 May 10 02:23:41.873299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1626/3208] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:41 2022] POST /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:23:41.879097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:41.879815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:41.886036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.886501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.887362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:41.887772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:41.890641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:41.900325 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b21a60b0-632b-4e4f-bfb9-de450815d952 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.198243 May 10 02:23:41.900920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1583/3209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:41 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:41.906005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9943acfe-0f3d-4e09-a75a-cf1b1c63e072 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f47430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:41.951657 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9943acfe-0f3d-4e09-a75a-cf1b1c63e072 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.049287 May 10 02:23:41.952240 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1584/3210] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:41 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:42.040778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:42.051341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:42.053676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:42.058397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.058869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.059691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.060266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.061908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8294dc09-0b19-4bf9-ac06-362a5786e750 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.179959 May 10 02:23:42.062891 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1627/3211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:41 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:42.068374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:42.070721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:42.078958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.080281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.081336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.081938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.280209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:42.288167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:42.289349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7851be48-1944-4925-9952-f34b4b1acba0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.242102 May 10 02:23:42.295900 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79b57eb5-babb-4d61-9392-3a4758239846 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1334 microversion: 2.1 time: 0.231112 May 10 02:23:42.296491 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1628/3212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:42 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1334 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:42.300436 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1585/3213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:42 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:42.701733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:42.702362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:42.708716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.709230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.710017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.710464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.845454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:42.852747 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d72d9d6-9181-4997-9605-d1d74a686eec tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d" status: 200 len: 1320 microversion: 2.1 time: 0.155080 May 10 02:23:42.853331 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1629/3214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:42 2022] GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:42.917574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:42.918199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:42.925346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.926459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.927350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:42.927808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:42.965679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc8144b0-1725-4e84-9c16-61ed7223f3c8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36317430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.026208 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc8144b0-1725-4e84-9c16-61ed7223f3c8 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.064794 May 10 02:23:43.027332 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1630/3215] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:42 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:43.080678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.081683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.088615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.089088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.089808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:43.089940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.090319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.099202 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-376369d9-f6d7-4ebb-b6eb-2612e3b75488 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.185419 May 10 02:23:43.100123 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1586/3216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:42 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:43.244921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:43.252846 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79c3d23c-8ed7-40a8-912e-0a69aadca894 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1500 microversion: 2.1 time: 0.177818 May 10 02:23:43.253453 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1631/3217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:43 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1500 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:43.269946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8872df20-c7ad-4804-aaf5-0b6f25c83596"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:43.271159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.277661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.278712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.279540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.279988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.305479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Cannot 'attach_volume' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state rescued May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/os-volume_attachments HTTP/1.1 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 74 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: {"volumeAttachment": {"volumeId": "8872df20-c7ad-4804-aaf5-0b6f25c83596"}} May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'attach_volume' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state rescued May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '69d467dd-f2fb-4d80-b26a-16fe06043cec', 'body': {'volumeAttachment': {'volumeId': '8872df20-c7ad-4804-aaf5-0b6f25c83596'}}} May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 02:23:43.307460 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state rescued May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state rescued May 10 02:23:43.313020 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:43.314360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.314360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.319679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.320825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.322276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.322728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.328056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 409 to user: Cannot 'attach_volume' instance 69d467dd-f2fb-4d80-b26a-16fe06043cec while it is in vm_state rescued {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:43.329213 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab17d5cc-4240-48b6-97ea-fdc4b51cca01 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064075 May 10 02:23:43.329919 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1587/3218] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:23:43 2022] POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 02:23:43.343431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.351467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.361893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.362541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.363758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.364267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.535373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:43.543240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab202dd0-3f67-4886-aef8-9c5d1ed19e90 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.240434 May 10 02:23:43.544009 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1632/3219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:43 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:43.558593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:43.559168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.565594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.566056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.570146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:43.573366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.576559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.578513 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c95f06c3-1fcb-4b6c-97df-687d4ad52a8b tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1668 microversion: 2.1 time: 0.244630 May 10 02:23:43.579829 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1588/3220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:43 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:43.593910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-13831ee1-280f-4cbd-8026-32504e215c68 req-8c1f004c-8e17-40a6-867d-7277d86d8604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290fe2d2-a71c-4a2a-a861-0b76fe24ca3d", "name": "network-vif-plugged", "status": "completed", "tag": "7afa4a61-77de-435e-9c53-61d64238a871"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:43.607566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-13831ee1-280f-4cbd-8026-32504e215c68 req-8c1f004c-8e17-40a6-867d-7277d86d8604 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.608021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-13831ee1-280f-4cbd-8026-32504e215c68 req-8c1f004c-8e17-40a6-867d-7277d86d8604 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.621887 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-13831ee1-280f-4cbd-8026-32504e215c68 req-8c1f004c-8e17-40a6-867d-7277d86d8604 service nova] Creating event network-vif-plugged:7afa4a61-77de-435e-9c53-61d64238a871 for instance 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d on n-h1-841089-2 May 10 02:23:43.632892 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-13831ee1-280f-4cbd-8026-32504e215c68 req-8c1f004c-8e17-40a6-867d-7277d86d8604 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051399 May 10 02:23:43.637009 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1589/3221] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:43.656632 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d7863233-d5d6-4caf-a247-8188c5d93a67 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action" status: 202 len: 0 microversion: 2.1 time: 0.100850 May 10 02:23:43.656632 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1633/3222] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:23:43 2022] POST /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:23:43.669049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.669969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.677973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.678600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.679016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.679708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.679852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.680361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.696111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.698400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.699467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.700471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.727441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e26d3c3-944a-413c-ba63-120dc4c8aaa7 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4/ips" status: 200 len: 178 microversion: 2.1 time: 0.088972 May 10 02:23:43.734382 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1590/3223] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:23:43 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4/ips => generated 178 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:43.739696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.740448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.746954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.747445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.748224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.748806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.782069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:23:43.894783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e712e25a-769c-4e86-bedb-32580ba6b1ab tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 204 len: 0 microversion: 2.1 time: 0.155858 May 10 02:23:43.899159 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1591/3224] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:43 2022] DELETE /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:43.907296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:43.909331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:43.917926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.919396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:43.921283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:43.922093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.347264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:44.355764 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a6619c8-d6d9-46d2-98dc-57782580eb73 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1508 microversion: 2.1 time: 0.691389 May 10 02:23:44.357150 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1634/3225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:43 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1508 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:44.363383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:44.364421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:44.371335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:44.372188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.373374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:44.374031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.409630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:44.420219 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d919ce0a-b206-4cb0-b232-18649a2ce9d9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d" status: 200 len: 1320 microversion: 2.1 time: 0.518912 May 10 02:23:44.424156 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1592/3226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:43 2022] GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d => generated 1320 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:44.432443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ec7bec3-9b44-4ec6-ac80-47d02da68a60 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d366863a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:44.491122 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ec7bec3-9b44-4ec6-ac80-47d02da68a60 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.065413 May 10 02:23:44.491700 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1593/3227] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:44 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:44.499221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:44.499851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:44.506068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:44.506468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.507277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:44.507717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.596577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:44.604402 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-127ecd90-e27d-4700-92e2-ecc949974e65 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1674 microversion: 2.1 time: 0.245554 May 10 02:23:44.605173 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1635/3228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:44 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:44.616279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:44.616896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:44.622943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:44.623434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.627286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:44.627286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:44.699094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:44.713362 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db206083-e5f7-4eef-824d-7c1c5c2fd9d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.220461 May 10 02:23:44.713955 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1594/3229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:44 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:44.780512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:44.788639 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90f18fa3-e3c0-49af-91e0-3b4da65d4991 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.182035 May 10 02:23:44.789215 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1636/3230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:44 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:45.374538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:45.382961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:45.390768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.391202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.392005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.392674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.442053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:45.443296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:45.450627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.451091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.452141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.452780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.784025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:45.791626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f9eaef0-2eea-412b-a9d5-b8c6b6994ec9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1508 microversion: 2.1 time: 0.420906 May 10 02:23:45.792112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1595/3231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:45 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:45.798846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d65b7bac-063f-468b-be39-b685f71523e1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d366dd040>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:45.819446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:45.831632 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41338675-3f79-4848-ac3e-dd06fe6256dd tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d" status: 200 len: 1320 microversion: 2.1 time: 0.393384 May 10 02:23:45.832214 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1637/3232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:45 2022] GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:45.842875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:45.843544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:45.850875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.851574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.852543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.852992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.854808 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d65b7bac-063f-468b-be39-b685f71523e1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.061676 May 10 02:23:45.855738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1596/3233] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:45 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:45.860338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:45.862978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:45.869142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.869602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:45.870379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:45.870811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.160574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:46.164559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:46.169179 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2daac54-07bf-48bb-9eb6-9ec05ca5029b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.312366 May 10 02:23:46.174838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1597/3234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:45 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:46.174838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:46.175688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:46.181680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.182136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.182914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.183432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.189946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3cf20470-eb09-4236-9443-077fe43e5576 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1674 microversion: 2.1 time: 0.353401 May 10 02:23:46.191574 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1638/3235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:45 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1674 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:46.471495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0f22345d-3b8a-444a-b6c7-9607b34d92d6 req-92195699-52fa-4432-84b6-0970da3a4af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f802a3f-35d5-4e49-811d-39997645e7f4", "name": "network-vif-deleted", "tag": "03cfc471-91c1-41c1-bf5d-b5907f36af34"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:46.482742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:46.487767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0f22345d-3b8a-444a-b6c7-9607b34d92d6 req-92195699-52fa-4432-84b6-0970da3a4af3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.489301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0f22345d-3b8a-444a-b6c7-9607b34d92d6 req-92195699-52fa-4432-84b6-0970da3a4af3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.504972 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9a5f9911-3779-4ec6-8818-98b36b684a08 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.333688 May 10 02:23:46.505801 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1598/3236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:46 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:46.519623 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0f22345d-3b8a-444a-b6c7-9607b34d92d6 req-92195699-52fa-4432-84b6-0970da3a4af3 service nova] Creating event network-vif-deleted:03cfc471-91c1-41c1-bf5d-b5907f36af34 for instance 2f802a3f-35d5-4e49-811d-39997645e7f4 on n-h2-841089-2 May 10 02:23:46.529598 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0f22345d-3b8a-444a-b6c7-9607b34d92d6 req-92195699-52fa-4432-84b6-0970da3a4af3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058635 May 10 02:23:46.530566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1639/3237] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:23:46.810056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:46.815612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:46.826098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.828080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.832515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.834147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.852371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:46.854818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:46.874476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.875173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:46.877701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:46.878315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.148456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:47.157149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:47.160210 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-32e7a3f8-1478-427f-8b29-3ea78f46800f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1508 microversion: 2.1 time: 0.354775 May 10 02:23:47.162164 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1599/3238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:46 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:47.170521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64a67719-2cdd-4f6c-8b09-621c5084b6ab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d370e6f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.175418 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0eaef793-ea95-4027-88de-10349a94d1ae tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d" status: 200 len: 1508 microversion: 2.1 time: 0.330625 May 10 02:23:47.176015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1640/3239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:46 2022] GET /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:47.189190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.191587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.198112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.198886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.202753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.204079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.237581 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64a67719-2cdd-4f6c-8b09-621c5084b6ab tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.073879 May 10 02:23:47.238161 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1600/3240] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:47 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:47.248938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.249457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.255966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.256435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.257606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.258399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.289804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:23:47.431801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61665dbc-09e8-42da-8f9e-8d4bba8a8b2d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d" status: 204 len: 0 microversion: 2.1 time: 0.186216 May 10 02:23:47.435828 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1601/3241] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:47 2022] DELETE /compute/v2.1/servers/290fe2d2-a71c-4a2a-a861-0b76fe24ca3d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:47.445681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.446531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.455840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.456352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.457158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.457617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.528406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:47.540526 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-73f8cc33-076f-41df-bfe0-9b26f107f143 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.356980 May 10 02:23:47.541333 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1641/3242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:47 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:47.548159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.548853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.556674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.557426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.558417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.560165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.603291 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed7ea8e0-a54d-47a2-808b-aa097cdff91a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments/ddeb9bd6-d849-4eab-91ca-a55734696760" status: 200 len: 194 microversion: 2.20 time: 0.058977 May 10 02:23:47.604603 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1642/3243] 10.222.0.52 () {60 vars in 1453 bytes} [Tue May 10 02:23:47 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments/ddeb9bd6-d849-4eab-91ca-a55734696760 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:47.609651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.610913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.618974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.619721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.621077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.628922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.698401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: b779c421-9168-403c-871a-bbb93fd0495e] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:23:47.852154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2125b740188b47d290e25d2423cb84dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90addb32e3db4346af6f860d63976eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:47.859654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-64345cf8-5155-4ebe-b5b1-ea0291d14029 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e" status: 204 len: 0 microversion: 2.1 time: 0.253202 May 10 02:23:47.860824 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1643/3244] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:47 2022] DELETE /compute/v2.1/servers/b779c421-9168-403c-871a-bbb93fd0495e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:47.869951 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-03bf5eaa-6809-4864-8d19-ccac9f6537c9 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 200 len: 1496 microversion: 2.1 time: 0.432529 May 10 02:23:47.870552 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1602/3245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:47 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 1496 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:47.888124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.889321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.890623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:47.891235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:47.899016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.899939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.901195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.901943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.903664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.904133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:47.904931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:47.912104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:48.115985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lazy-loading 'services' on Instance uuid 62292e53-bc84-4672-ad76-e3f6f50ffd67 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:23:48.202156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:48.214839 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7d7ec26-0830-4fa2-a55c-b35c8bd0c82b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.341134 May 10 02:23:48.215995 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1644/3246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:47 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:48.221294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-244353643", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "4b1c8acc-2296-4709-9445-6057858be796"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:48.300315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2625e79e-8d19-4067-bcc4-b5ffdc422b76 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments/ddeb9bd6-d849-4eab-91ca-a55734696760" status: 202 len: 0 microversion: 2.20 time: 0.427753 May 10 02:23:48.301144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1603/3247] 10.222.0.52 () {60 vars in 1456 bytes} [Tue May 10 02:23:47 2022] DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments/ddeb9bd6-d849-4eab-91ca-a55734696760 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:23:48.307784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:48.308724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:48.317142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:48.318037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:48.319045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:48.319552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] validate_networks() for [('4b1c8acc-2296-4709-9445-6057858be796', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:48.319936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:48.607585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:48.633619 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d8d3c030-df05-4ffc-bf7c-6959497c36e1 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1514 microversion: 2.1 time: 0.320406 May 10 02:23:48.634648 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1604/3248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:48 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:48.640136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57b12b17-1df7-4c04-960d-df67bd1b0b00 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f09b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:48.792837 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57b12b17-1df7-4c04-960d-df67bd1b0b00 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.156844 May 10 02:23:48.808911 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1605/3249] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:48 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:48.816105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:48.817117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:48.836238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:48.836709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:48.849845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:48.852005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:48.950314 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-df379091-a19e-4785-aee2-d3d0973071af tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140204 May 10 02:23:48.950995 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1606/3250] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:48 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:48.978627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:48.979234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:48.993130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:48.993580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:48.997787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:48.998443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.434074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:49.443443 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdd4b0c4-6126-4a5c-a134-d074db2a4a22 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.482444 May 10 02:23:49.449632 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1607/3251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:48 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:49.465405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d88ce444-8f7e-4994-bf2f-64ff99c46322 req-708138de-b4ce-462c-bb4d-5ccd95a08134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f802a3f-35d5-4e49-811d-39997645e7f4", "name": "network-vif-deleted", "tag": "b305155d-ba0c-4a79-b30e-07bae7dc1a9d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:49.483435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d88ce444-8f7e-4994-bf2f-64ff99c46322 req-708138de-b4ce-462c-bb4d-5ccd95a08134 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.483817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d88ce444-8f7e-4994-bf2f-64ff99c46322 req-708138de-b4ce-462c-bb4d-5ccd95a08134 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.509437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d88ce444-8f7e-4994-bf2f-64ff99c46322 req-708138de-b4ce-462c-bb4d-5ccd95a08134 service nova] Creating event network-vif-deleted:b305155d-ba0c-4a79-b30e-07bae7dc1a9d for instance 2f802a3f-35d5-4e49-811d-39997645e7f4 on n-h2-841089-2 May 10 02:23:49.518482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d88ce444-8f7e-4994-bf2f-64ff99c46322 req-708138de-b4ce-462c-bb4d-5ccd95a08134 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066961 May 10 02:23:49.527029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1608/3252] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:49.533306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2f4f45e0-0e74-402c-9d32-944eb7bd0448 req-bd3cae15-5599-4c0b-b8f1-a8936480c951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48086e6-7c2d-4b3d-857a-f02209d1fc89", "name": "network-vif-plugged", "status": "completed", "tag": "ba81873e-e155-40fe-8c4f-cd68e54602cc"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:49.554682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2f4f45e0-0e74-402c-9d32-944eb7bd0448 req-bd3cae15-5599-4c0b-b8f1-a8936480c951 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.555239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2f4f45e0-0e74-402c-9d32-944eb7bd0448 req-bd3cae15-5599-4c0b-b8f1-a8936480c951 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.578676 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2f4f45e0-0e74-402c-9d32-944eb7bd0448 req-bd3cae15-5599-4c0b-b8f1-a8936480c951 service nova] Creating event network-vif-plugged:ba81873e-e155-40fe-8c4f-cd68e54602cc for instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 on n-h1-841089-2 May 10 02:23:49.590239 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2f4f45e0-0e74-402c-9d32-944eb7bd0448 req-bd3cae15-5599-4c0b-b8f1-a8936480c951 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061665 May 10 02:23:49.592939 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1609/3253] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:49.612008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:49.613023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:49.634324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.634790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.645363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.645824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.671698 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] HTTP exception thrown: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Request method failure captured: May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 HTTP/1.1 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxDqx7lmHRSf7vi7D2xvuXK2fZngBtjwdRddhidvQBny1uUiUEmEInncZosa3ZdhFWf9WyOUUUJ8rSjvUC3ib7Wgp1tr-RthWmCcX85hdwey92s5tW5NTDEigs-nACR1EBox35Zjk3eptfm_MLwi8dUTc6n2kyR2sqm3oZ8FPuHZYs May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_90addb32e3db4346af6f860d63976eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/90addb32e3db4346af6f860d63976eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestMultiNic-2119962716 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2125b740188b47d290e25d2423cb84dc May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2f802a3f-35d5-4e49-811d-39997645e7f4'} May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:49.673952 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:49.678725 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:49.680457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Returning 404 to user: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:49.681565 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38ea1e6b-b513-4bb2-8a06-2b6cc7eca316 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 404 len: 111 microversion: 2.1 time: 0.081175 May 10 02:23:49.696489 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1610/3254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:49 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:49.701806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:49.707899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:49.714688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:23:49.715457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:23:49.715604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:23:49.716406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:23:49.717348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:23:49.724536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.725121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.726003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.726673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.748194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.748658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.750144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:49.750960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:49.903621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Getting quotas for project df0e7c324d7745efa55830fb4a87dd7f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:49.925955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Getting quotas for user fbbe6ebb85cd4cf6b5b09a2defe3c54b and project df0e7c324d7745efa55830fb4a87dd7f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:49.957641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Going to run 2 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:23:49.972725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:49.984306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:49.995487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8fe46c1-5fea-47a3-83ea-465ad58f72fe tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.297411 May 10 02:23:50.008042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1611/3255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:49 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:50.009771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5face729-3278-4029-aebd-a55d41474961 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36673ca0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:50.044431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:23:50.111186 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5face729-3278-4029-aebd-a55d41474961 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.110975 May 10 02:23:50.118892 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1612/3256] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:49 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:50.132901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:50.136765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:50.152649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:50.155549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:50.156813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:50.159972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:50.185818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1dd9476b-e31d-4bc7-bda5-cbb843097939 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.968438 May 10 02:23:50.194213 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1645/3257] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 1977 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 10 02:23:50.202147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:50.232295 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f81abbd5-5df2-4114-bf9e-beb75bceeb83 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111036 May 10 02:23:50.239903 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1613/3258] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:50 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:50.243689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:50.247404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Searching by: {'deleted': False, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:23:50.290003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:50.290467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:50.308039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:50.309457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:50.422323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:23:50.468785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:50.469618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:50.486813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:50.489488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:50.491436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:50.491873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:50.552730 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-456e024c-f01d-4093-a2c6-80eec258dea3 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.354339 May 10 02:23:50.558900 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1646/3259] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 02:23:50 2022] GET /compute/v2.1/servers => generated 1335 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:50.563723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41746b6b-0d0f-4da5-9338-6d2092f493c6 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:50.569115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41746b6b-0d0f-4da5-9338-6d2092f493c6 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:50.737905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41746b6b-0d0f-4da5-9338-6d2092f493c6 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:50.746670 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41746b6b-0d0f-4da5-9338-6d2092f493c6 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1217 microversion: 2.1 time: 0.186699 May 10 02:23:50.750879 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1647/3260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:50 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:50.830137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:50.839723 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec828497-3daf-4117-b4b5-7e4eed22d938 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.375529 May 10 02:23:50.843376 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1614/3261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:50 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:51.026159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:51.028222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:51.045393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.047636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.052987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.053740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.126577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d52f29e2-91ec-4a8d-be59-28f3f3ad0816 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d365b0f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:51.214597 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d52f29e2-91ec-4a8d-be59-28f3f3ad0816 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.092270 May 10 02:23:51.222198 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1615/3262] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:51 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:51.262849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:51.268268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:51.284380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.285204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.287457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.290217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.403025 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-76738cf4-2a7d-484f-937d-5fd5eea5e152 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151138 May 10 02:23:51.415243 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1616/3263] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:51 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:51.612261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7881f452-aab9-4c72-91af-9014831cd0a6 req-e896e7f0-01f0-4782-83c4-c1ec2914cad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bf23ff-a012-485c-a83a-3b8e2246db23", "name": "network-vif-plugged", "status": "completed", "tag": "2d433f8c-37f2-4e92-91d3-0a5e48458f8e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:51.630475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7881f452-aab9-4c72-91af-9014831cd0a6 req-e896e7f0-01f0-4782-83c4-c1ec2914cad0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.633259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7881f452-aab9-4c72-91af-9014831cd0a6 req-e896e7f0-01f0-4782-83c4-c1ec2914cad0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.660680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7881f452-aab9-4c72-91af-9014831cd0a6 req-e896e7f0-01f0-4782-83c4-c1ec2914cad0 service nova] Creating event network-vif-plugged:2d433f8c-37f2-4e92-91d3-0a5e48458f8e for instance 64bf23ff-a012-485c-a83a-3b8e2246db23 on n-h1-841089-2 May 10 02:23:51.673422 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7881f452-aab9-4c72-91af-9014831cd0a6 req-e896e7f0-01f0-4782-83c4-c1ec2914cad0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063688 May 10 02:23:51.681095 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1617/3264] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:23:51.764616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:51.765604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:51.782318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.783703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.784841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.785528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.822923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:51.832993 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f6d5a8b-b9d5-44f3-9e8c-c5e9eadf98b5 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 0.816442 May 10 02:23:51.836311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1648/3265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:51 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:51.858643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:51.859633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:51.869295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.873756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.875137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:51.880136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:51.958274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:51.978095 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dac6f7b-cfcc-4b34-aa19-e23da5147309 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1221 microversion: 2.1 time: 0.217794 May 10 02:23:51.984008 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1618/3266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:51 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1221 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:52.229399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bbc1679-52f5-4065-81c0-4dc3fef48a6c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36eca4c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:52.361351 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1bbc1679-52f5-4065-81c0-4dc3fef48a6c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.136132 May 10 02:23:52.362184 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1619/3267] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:52 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:52.427270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:52.428342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:52.439785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:52.444072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:52.447622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:52.449971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:52.509635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f02be847-addf-4128-91ab-c4d3b7f4bdf1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087602 May 10 02:23:52.511529 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1620/3268] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:52 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:23:52.691443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-570a5122-6ef2-475a-a3e1-d515006e1a6d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'create', calling method: .version_select at 0x7f3d370e6c10>, body: {"keypair": {"name": "tempest-keypair-1818906510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJSgT8vVfxwjWu0aezgGUcUSnTPuasaLVqU0fDiODHAJ2/MH6uf0FBVXi4vtjwPpMYeEomUnUi0zWHVnKbFhGLNiD40d8rFxBx0Ykqqgh3UA2rEX174qnViowkcurdVYA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:52.731109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-570a5122-6ef2-475a-a3e1-d515006e1a6d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for project ea90205bb50b414890bf521c1182bcd5. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:23:52.744374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-570a5122-6ef2-475a-a3e1-d515006e1a6d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for user 0a2a71a6cd7c48bcb26383b5cece8a00 and project ea90205bb50b414890bf521c1182bcd5. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:23:52.805758 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-570a5122-6ef2-475a-a3e1-d515006e1a6d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132513 May 10 02:23:52.807231 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1621/3269] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:23:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:52.852891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:52.853808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:52.868144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:52.869584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:52.870895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:52.881874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:53.553930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:53.577737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9b5df261-5b70-40c0-a1f3-c278029b5680 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 1.719990 May 10 02:23:53.589502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1649/3270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:51 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:53.597257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:53.597894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:53.614403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:53.614862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:53.615690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:53.616138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:53.837267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:53.845832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9eebd0d4-f668-42bb-8239-001a58191bf9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1275 microversion: 2.1 time: 0.254120 May 10 02:23:53.848990 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1650/3271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:53 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:53.863373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80272f26-2888-4d14-8219-761c13eb2f88 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d363eac10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:53.977016 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80272f26-2888-4d14-8219-761c13eb2f88 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.124927 May 10 02:23:53.977738 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1651/3272] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:53 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:53.993088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:53.997850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:54.010368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:54.011218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:54.014707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:54.015437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:54.093234 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57108da1-bcf0-4d8b-8964-bd0812966b37 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114125 May 10 02:23:54.098128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1652/3273] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:53 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:54.561102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:54.575767 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2af11019-fcdd-497a-8774-ad7f8af39d83 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1317 microversion: 2.1 time: 1.727051 May 10 02:23:54.577279 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1622/3274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:52 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1317 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:54.597336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:54.598092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:54.613925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:54.614481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:54.615382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:54.615900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:54.871785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:54.872660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:54.899935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:54.900895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:54.903193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:54.903889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.281329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:55.309373 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fd467b7f-7b4f-4108-9339-4ccbcec74b24 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1275 microversion: 2.1 time: 0.440158 May 10 02:23:55.311221 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1623/3275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:54 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1275 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:55.350511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f329c9ee-746a-4e68-95e7-61f51764e154 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36ecadc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:55.476850 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f329c9ee-746a-4e68-95e7-61f51764e154 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.164225 May 10 02:23:55.477494 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1624/3276] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:55 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:55.482354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-092870b3-9f1e-4af9-bfc8-6f0355af6a99 req-c342ad9c-0773-48be-b655-eeef93d62109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290fe2d2-a71c-4a2a-a861-0b76fe24ca3d", "name": "network-vif-unplugged", "status": "completed", "tag": "7afa4a61-77de-435e-9c53-61d64238a871"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:55.497790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-092870b3-9f1e-4af9-bfc8-6f0355af6a99 req-c342ad9c-0773-48be-b655-eeef93d62109 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.497790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-092870b3-9f1e-4af9-bfc8-6f0355af6a99 req-c342ad9c-0773-48be-b655-eeef93d62109 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.535872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-092870b3-9f1e-4af9-bfc8-6f0355af6a99 req-c342ad9c-0773-48be-b655-eeef93d62109 service nova] Creating event network-vif-unplugged:7afa4a61-77de-435e-9c53-61d64238a871 for instance 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d on n-h1-841089-2 May 10 02:23:55.557839 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-092870b3-9f1e-4af9-bfc8-6f0355af6a99 req-c342ad9c-0773-48be-b655-eeef93d62109 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079078 May 10 02:23:55.562311 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1625/3277] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:55.580371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:55.581906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:55.590157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.603750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.604797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.605505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.644333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:55.653960 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3297d657-b182-4fb3-b2d4-525abc06a6a5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 1.060955 May 10 02:23:55.659402 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1653/3278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:54 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:55.664352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-df813766-bec2-4352-8a3e-3ace1813163d req-c22462c4-b25c-4991-979e-b87eb0f4fb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b779c421-9168-403c-871a-bbb93fd0495e", "name": "network-vif-deleted", "tag": "20cd0611-cdc4-40c3-80c8-079fc5ad9dd0"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:55.680051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60c40cb9-1b90-44d4-a862-feee5075abf0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115553 May 10 02:23:55.687096 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1626/3279] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:55 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:55.691283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-df813766-bec2-4352-8a3e-3ace1813163d req-c22462c4-b25c-4991-979e-b87eb0f4fb8d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.691745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-df813766-bec2-4352-8a3e-3ace1813163d req-c22462c4-b25c-4991-979e-b87eb0f4fb8d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.694430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:55.695223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:55.708182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.714727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.716699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.718382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.719098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-df813766-bec2-4352-8a3e-3ace1813163d req-c22462c4-b25c-4991-979e-b87eb0f4fb8d service nova] Creating event network-vif-deleted:20cd0611-cdc4-40c3-80c8-079fc5ad9dd0 for instance b779c421-9168-403c-871a-bbb93fd0495e on n-h1-841089-2 May 10 02:23:55.747960 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] HTTP exception thrown: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Request method failure captured: May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 HTTP/1.1 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxDqx7lmHRSf7vi7D2xvuXK2fZngBtjwdRddhidvQBny1uUiUEmEInncZosa3ZdhFWf9WyOUUUJ8rSjvUC3ib7Wgp1tr-RthWmCcX85hdwey92s5tW5NTDEigs-nACR1EBox35Zjk3eptfm_MLwi8dUTc6n2kyR2sqm3oZ8FPuHZYs May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_90addb32e3db4346af6f860d63976eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/90addb32e3db4346af6f860d63976eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestMultiNic-2119962716 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2125b740188b47d290e25d2423cb84dc May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2f802a3f-35d5-4e49-811d-39997645e7f4'} May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:55.751618 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.756160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.756932 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-df813766-bec2-4352-8a3e-3ace1813163d req-c22462c4-b25c-4991-979e-b87eb0f4fb8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088279 May 10 02:23:55.756932 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1654/3280] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:55.760810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Returning 404 to user: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:55.762421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db5a1315-4006-4688-bfce-03a9e45810ac tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 404 len: 111 microversion: 2.1 time: 0.073720 May 10 02:23:55.763703 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1627/3281] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:55 2022] DELETE /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:55.770013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:55.770735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:55.791630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:55.793257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 2f802a3f-35d5-4e49-811d-39997645e7f4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:55.794406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.794828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.795666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.796103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.810728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.812454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.830378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.831510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.886548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] HTTP exception thrown: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Request method failure captured: May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 HTTP/1.1 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxDqx7lmHRSf7vi7D2xvuXK2fZngBtjwdRddhidvQBny1uUiUEmEInncZosa3ZdhFWf9WyOUUUJ8rSjvUC3ib7Wgp1tr-RthWmCcX85hdwey92s5tW5NTDEigs-nACR1EBox35Zjk3eptfm_MLwi8dUTc6n2kyR2sqm3oZ8FPuHZYs May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_90addb32e3db4346af6f860d63976eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/90addb32e3db4346af6f860d63976eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestMultiNic-2119962716 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2125b740188b47d290e25d2423cb84dc May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2f802a3f-35d5-4e49-811d-39997645e7f4'} May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:55.906674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Returning 404 to user: Instance 2f802a3f-35d5-4e49-811d-39997645e7f4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:55.913569 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3f27d91-172d-4f6e-9b61-406e12d3dac2 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4" status: 404 len: 111 microversion: 2.1 time: 0.140111 May 10 02:23:55.921807 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1628/3282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:55 2022] GET /compute/v2.1/servers/2f802a3f-35d5-4e49-811d-39997645e7f4 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:55.932405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:55.932834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:55.963766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.964228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:55.965040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:55.965486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:56.008466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] HTTP exception thrown: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Request method failure captured: May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 HTTP/1.1 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxDqx7lmHRSf7vi7D2xvuXK2fZngBtjwdRddhidvQBny1uUiUEmEInncZosa3ZdhFWf9WyOUUUJ8rSjvUC3ib7Wgp1tr-RthWmCcX85hdwey92s5tW5NTDEigs-nACR1EBox35Zjk3eptfm_MLwi8dUTc6n2kyR2sqm3oZ8FPuHZYs May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_90addb32e3db4346af6f860d63976eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/90addb32e3db4346af6f860d63976eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestMultiNic-2119962716 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2125b740188b47d290e25d2423cb84dc May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '04e161dd-cca1-49b1-9e6f-6868ff2965c7'} May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:56.010074 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Returning 404 to user: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1857aa42-8716-4d2b-ae79-3f57b766e294 tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "DELETE /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 404 len: 111 microversion: 2.1 time: 0.088650 May 10 02:23:56.013637 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1629/3283] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:23:55 2022] DELETE /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:56.033436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:56.034620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] [instance: 04e161dd-cca1-49b1-9e6f-6868ff2965c7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:56.050044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:56.050500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:56.055595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:56.058220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:56.100850 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] HTTP exception thrown: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Request method failure captured: May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 HTTP/1.1 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxDqx7lmHRSf7vi7D2xvuXK2fZngBtjwdRddhidvQBny1uUiUEmEInncZosa3ZdhFWf9WyOUUUJ8rSjvUC3ib7Wgp1tr-RthWmCcX85hdwey92s5tW5NTDEigs-nACR1EBox35Zjk3eptfm_MLwi8dUTc6n2kyR2sqm3oZ8FPuHZYs May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_90addb32e3db4346af6f860d63976eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/90addb32e3db4346af6f860d63976eff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/90addb32e3db4346af6f860d63976eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestMultiNic-2119962716 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 90addb32e3db4346af6f860d63976eff May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestMultiNic-2119962716 May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2125b740188b47d290e25d2423cb84dc May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestMultiNic-2119962716-project May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '04e161dd-cca1-49b1-9e6f-6868ff2965c7'} May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:23:56.104741 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:23:56.108525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] Returning 404 to user: Instance 04e161dd-cca1-49b1-9e6f-6868ff2965c7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:23:56.109037 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d9104b9-e3f8-4875-890a-87d3def1b40f tempest-ServersTestMultiNic-2119962716 tempest-ServersTestMultiNic-2119962716-project] 10.222.0.52 "GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7" status: 404 len: 111 microversion: 2.1 time: 0.086235 May 10 02:23:56.111517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1630/3284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:56 2022] GET /compute/v2.1/servers/04e161dd-cca1-49b1-9e6f-6868ff2965c7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:23:56.331111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:56.332628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:56.349937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:56.350680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:56.352680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:56.354172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:56.555976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:56.569305 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5478e964-0f31-49d0-a149-1c81932e31a5 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1275 microversion: 2.1 time: 0.244763 May 10 02:23:56.578303 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1631/3285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:56 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:23:56.586228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ed4c458-236c-4ca7-86e7-e8ab51e0d32d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36e89550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:56.711995 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ed4c458-236c-4ca7-86e7-e8ab51e0d32d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.131028 May 10 02:23:56.712971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1632/3286] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:56 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:56.717813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:56.722784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:56.738076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:56.738076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:56.750172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:56.750900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:57.248495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:57.261982 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-068bf7ca-c524-4a04-bcdb-810e4af130f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 0.547606 May 10 02:23:57.268102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1633/3287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:56 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:57.275860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:57.278202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:57.290981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:57.303167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:57.304183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:57.304777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:57.308355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:57.330197 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63cf2d9a-1303-4e76-8ccc-42a0e112123a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1467 microversion: 2.1 time: 1.572249 May 10 02:23:57.338112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1655/3288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:55 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1467 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:57.364635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-becdecb9-0d34-4424-8176-abd554e05f12 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095134 May 10 02:23:57.369297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1248263098", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82cff4a3-2ea6-4f0d-ab9b-dd9f65750280"}], "security_groups": [{"name": "tempest-securitygroup--719307364"}], "key_name": "tempest-keypair-1818906510", "user_data": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:57.370668 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1634/3289] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:23:57 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:23:57.379641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:57.380626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:57.395834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:57.396594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:57.397628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:57.398324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:58.494631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] validate_networks() for [('82cff4a3-2ea6-4f0d-ab9b-dd9f65750280', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:23:58.716299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb897c5f-f2ff-45ba-8e5e-07332f8e831e tempest-ServersOnMultiNodesTest-1152117490 tempest-ServersOnMultiNodesTest-1152117490-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1618 microversion: 2.1 time: 1.344042 May 10 02:23:58.731207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1635/3290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:57 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1618 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:58.740010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:58.741912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:58.748886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:58.749602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:58.751605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:58.752216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:59.257688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:23:59.269917 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38ad9b39-ef5e-4226-9f97-1d496547c643 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.536594 May 10 02:23:59.271846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1636/3291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:58 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:59.288162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7fbfce90-eed5-494c-88dc-58057834ebb5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36df6ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:59.354766 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7fbfce90-eed5-494c-88dc-58057834ebb5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.080871 May 10 02:23:59.363502 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1637/3292] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:23:59 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:23:59.372859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4dd2bc9f-c024-411f-98f1-3ed78556ab4e req-a19ce436-9cc3-4490-988b-863c3971708e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290fe2d2-a71c-4a2a-a861-0b76fe24ca3d", "name": "network-vif-deleted", "tag": "7afa4a61-77de-435e-9c53-61d64238a871"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:23:59.393131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4dd2bc9f-c024-411f-98f1-3ed78556ab4e req-a19ce436-9cc3-4490-988b-863c3971708e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:59.395198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4dd2bc9f-c024-411f-98f1-3ed78556ab4e req-a19ce436-9cc3-4490-988b-863c3971708e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:59.416499 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4dd2bc9f-c024-411f-98f1-3ed78556ab4e req-a19ce436-9cc3-4490-988b-863c3971708e service nova] Creating event network-vif-deleted:7afa4a61-77de-435e-9c53-61d64238a871 for instance 290fe2d2-a71c-4a2a-a861-0b76fe24ca3d on n-h1-841089-2 May 10 02:23:59.422302 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4dd2bc9f-c024-411f-98f1-3ed78556ab4e req-a19ce436-9cc3-4490-988b-863c3971708e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055910 May 10 02:23:59.424104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1638/3293] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:23:59.449681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:23:59.451161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:23:59.463356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:59.467634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:23:59.469870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:23:59.471572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:00.884490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:00.896275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb2cb5b1-b1d1-464f-8412-45d9570a7f75 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1721 microversion: 2.1 time: 1.470622 May 10 02:24:00.896810 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1639/3294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:23:59 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1721 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:00.911109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:00.913340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:00.929954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:00.931519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:00.932344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:00.944546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.007322 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ade2d3c1-5133-4181-9271-653bcc31c669 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108680 May 10 02:24:01.011563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1640/3295] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:24:00 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:24:01.016556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:01.023370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:01.041736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.042625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.043956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.044643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.090339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:01.273771 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a19b279f-7fa2-49a9-9d01-aabca5d7ef93 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 204 len: 0 microversion: 2.1 time: 0.259811 May 10 02:24:01.276325 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1641/3296] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:01 2022] DELETE /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:01.292696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:01.296900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:01.318119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.319274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.323149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.325748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.688738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:24:01.689743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:24:01.690427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:24:01.691012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:24:01.692840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:24:01.724149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.724617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.725576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.726037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.765094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for project ea90205bb50b414890bf521c1182bcd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:01.784470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Getting quotas for user 0a2a71a6cd7c48bcb26383b5cece8a00 and project ea90205bb50b414890bf521c1182bcd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:01.811519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:24:01.814489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:24:01.824357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:01.832089 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc6b4b64-0d25-4ff6-bdea-6352c1271a9e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.548385 May 10 02:24:01.832681 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1642/3297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:01 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:01.842640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-115bbec8-e421-4389-89a1-37d12372e7a4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36567d30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:01.922341 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-115bbec8-e421-4389-89a1-37d12372e7a4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.088603 May 10 02:24:01.928756 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1643/3298] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:01 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:01.934533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:01.935187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:01.951259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.951719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.952519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:01.952964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:01.955620 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d9f56442-6e3e-48a4-8941-1af644009fcc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.614113 May 10 02:24:01.957980 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1656/3299] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:23:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 4618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:24:01.972410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:01.975643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:02.015835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:02.019241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:02.023794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:02.024561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:02.764818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:02.775921 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4801a8d-89b8-4847-bde6-ac285ea8fa96 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1473 microversion: 2.1 time: 0.845512 May 10 02:24:02.796011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1644/3300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:01 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1473 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:02.801047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:02.801679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:02.825754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:02.830865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:02.831764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:02.832233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.069198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:03.076732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d3145964-f399-4fe2-b24c-d68f2c91e338 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1250 microversion: 2.1 time: 0.279531 May 10 02:24:03.077341 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1645/3301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:02 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1250 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:03.091767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:03.092999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:03.096241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:03.107536 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3246565-2e8f-4439-bf76-38030d1eda38 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1698 microversion: 2.1 time: 1.147383 May 10 02:24:03.108371 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1657/3302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:01 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1698 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:03.118779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.119527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.120363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:03.120771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.121384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.123263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:03.147366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.148986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.149912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.151827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.226297 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c61e58c-31ba-45ad-b2fd-13217440f99c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144792 May 10 02:24:03.232120 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1646/3303] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:24:03 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:24:03.245300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5bc4278-f6b6-4e2e-b859-ea03339c2a41 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d37e668b0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:03.333411 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5bc4278-f6b6-4e2e-b859-ea03339c2a41 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.090019 May 10 02:24:03.336833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1647/3304] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:03 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:03.352559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35e9f2ae-52e0-43c0-9963-e194dc8383b1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:03.370823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35e9f2ae-52e0-43c0-9963-e194dc8383b1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.383269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35e9f2ae-52e0-43c0-9963-e194dc8383b1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.422553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-35e9f2ae-52e0-43c0-9963-e194dc8383b1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Going to try to start instance {{(pid=118717) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 02:24:03.507252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-35e9f2ae-52e0-43c0-9963-e194dc8383b1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action" status: 202 len: 0 microversion: 2.1 time: 0.168818 May 10 02:24:03.510440 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1648/3305] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:24:03 2022] POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:24:03.520885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:03.524031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:03.547932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.562745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:03.564535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:03.565214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:05.286306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:05.325027 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3ccf480-da79-413f-bda5-dad6150954e9 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 2.211118 May 10 02:24:05.325705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1658/3306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:03 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:05.363826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:05.364698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:05.406008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:05.406609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:05.414633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:05.419823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:06.160808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:06.192513 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f48e628-7d5e-46d2-8ea8-8fda585922b2 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 200 len: 1431 microversion: 2.1 time: 0.857831 May 10 02:24:06.197079 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1659/3307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:05 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 1431 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:06.208397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fdf0977f-bd79-411d-8b64-f80257a0d15d req-d73017e8-6709-432f-aeb0-6d998b49b94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "346bcea0-fdc8-4b94-9679-b36d93302a3a", "tag": "210c3e35-aea1-48cb-aa1a-c6f04fe5e390"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:06.252264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fdf0977f-bd79-411d-8b64-f80257a0d15d req-d73017e8-6709-432f-aeb0-6d998b49b94e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:06.256740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fdf0977f-bd79-411d-8b64-f80257a0d15d req-d73017e8-6709-432f-aeb0-6d998b49b94e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:06.301568 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fdf0977f-bd79-411d-8b64-f80257a0d15d req-d73017e8-6709-432f-aeb0-6d998b49b94e service nova] Creating event network-changed:210c3e35-aea1-48cb-aa1a-c6f04fe5e390 for instance 346bcea0-fdc8-4b94-9679-b36d93302a3a on n-h2-841089-2 May 10 02:24:06.314122 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fdf0977f-bd79-411d-8b64-f80257a0d15d req-d73017e8-6709-432f-aeb0-6d998b49b94e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113849 May 10 02:24:06.319192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1660/3308] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:06.343250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:06.349829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:06.364711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:06.367611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:06.368635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:06.370174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:06.765773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:06.773973 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-114a3681-5376-420d-a6a8-ee7aedbd7bc8 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1707 microversion: 2.1 time: 3.260652 May 10 02:24:06.786692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1649/3309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:03 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1707 bytes in 3274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:06.800891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:06.802461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:06.860900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:06.863264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:06.864294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:06.868289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:06.973465 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2448bc7c-397c-4fc6-8892-194f39e28e25 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.185571 May 10 02:24:06.977119 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1650/3310] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:24:06 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:24:06.987823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d954f2f-e79d-4687-8825-3b5934e8ec03 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d35f09280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:07.105815 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d954f2f-e79d-4687-8825-3b5934e8ec03 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.127275 May 10 02:24:07.107433 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1651/3311] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:06 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:07.132485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:07.134997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:07.151996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:07.152873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:07.153911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:07.158466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:07.991891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:08.000969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f52dd303-169c-42a4-99c6-b4c0e82ae6ea tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 1.679955 May 10 02:24:08.007815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1661/3312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:06 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:08.013161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:08.020229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: c48086e6-7c2d-4b3d-857a-f02209d1fc89] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:08.027990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.031866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.033884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.034556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.100507 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 could not be found. May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 HTTP/1.1 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 could not be found. May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'c48086e6-7c2d-4b3d-857a-f02209d1fc89'} May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 could not be found. May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 could not be found. May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:08.102919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 could not be found. May 10 02:24:08.106625 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:08.120052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:08.120968 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65910443-6edc-4ff1-8512-17ce4c3d7fa0 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89" status: 404 len: 111 microversion: 2.1 time: 0.111588 May 10 02:24:08.131424 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1662/3313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:08 2022] GET /compute/v2.1/servers/c48086e6-7c2d-4b3d-857a-f02209d1fc89 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:08.136677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:08.137306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:08.154992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.155489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.156284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.156732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.590537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:08.599460 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2a55c73-dca7-4560-8ba9-4af19ec824d7 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 1.488292 May 10 02:24:08.601172 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1652/3314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:07 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:08.606702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:08.607896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:08.616279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.616994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.618578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.619237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.653991 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13d8261d-0cde-46da-a3ac-859a8526d2cf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051355 May 10 02:24:08.654845 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1653/3315] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:24:08 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:24:08.663312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fafe8dc-63d4-4341-ad35-9d4c2e95823a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36fa3280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:08.735519 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0fafe8dc-63d4-4341-ad35-9d4c2e95823a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.079246 May 10 02:24:08.736643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1654/3316] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:08 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:08.741726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:08.742510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:08.749137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.749833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.750828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.751465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.778063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:08.898745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:08.912733 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8946d143-b08a-4fc2-b4b8-79122da86000 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1707 microversion: 2.1 time: 0.779927 May 10 02:24:08.913630 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1663/3317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:08 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1707 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:08.924059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-87ff3f08-6ff4-4e95-ba5b-bfbe71d445e1 req-a33a8cb0-28a6-4455-9c2d-9963787bf1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01", "tag": "33ce1e86-b337-4461-a698-5f57b2b4f9d7"}, {"server_uuid": "c48086e6-7c2d-4b3d-857a-f02209d1fc89", "name": "network-vif-deleted", "tag": "ba81873e-e155-40fe-8c4f-cd68e54602cc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:08.926991 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c82d8fba-86da-41a4-8ad0-0b69f4cc417f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 204 len: 0 microversion: 2.1 time: 0.188880 May 10 02:24:08.927924 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1655/3318] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:08 2022] DELETE /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:08.939606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:08.940796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:08.950953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.951572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-87ff3f08-6ff4-4e95-ba5b-bfbe71d445e1 req-a33a8cb0-28a6-4455-9c2d-9963787bf1aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.952301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.952438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-87ff3f08-6ff4-4e95-ba5b-bfbe71d445e1 req-a33a8cb0-28a6-4455-9c2d-9963787bf1aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:08.955776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:08.956427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.002517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-87ff3f08-6ff4-4e95-ba5b-bfbe71d445e1 req-a33a8cb0-28a6-4455-9c2d-9963787bf1aa service nova] Creating event network-changed:33ce1e86-b337-4461-a698-5f57b2b4f9d7 for instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 on n-h2-841089-2 May 10 02:24:09.003097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-87ff3f08-6ff4-4e95-ba5b-bfbe71d445e1 req-a33a8cb0-28a6-4455-9c2d-9963787bf1aa service nova] Creating event network-vif-deleted:ba81873e-e155-40fe-8c4f-cd68e54602cc for instance c48086e6-7c2d-4b3d-857a-f02209d1fc89 on n-h1-841089-2 May 10 02:24:09.020008 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-87ff3f08-6ff4-4e95-ba5b-bfbe71d445e1 req-a33a8cb0-28a6-4455-9c2d-9963787bf1aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.104128 May 10 02:24:09.020893 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1664/3319] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:09.028186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:09.028828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:09.068289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.068768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.069612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.070062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.203025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:09.212536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7603c886-8e88-43ba-b380-91a9f39c6599 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1472 microversion: 2.1 time: 0.280346 May 10 02:24:09.214319 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1656/3320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:08 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:09.552400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:09.562187 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e06f0a19-1840-443a-9540-bb0e0f6b8b29 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.540063 May 10 02:24:09.566957 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1665/3321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:09 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:09.617237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:09.617874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:09.649463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.650068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.650933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.651418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.667886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:09.669940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:09.695623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.696163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.697015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.697464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.856658 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-123b5772-108b-477d-9a62-3ad7c05680d2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.192821 May 10 02:24:09.858188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1666/3322] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:24:09 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:24:09.869779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5be2e2de-534a-455b-9964-b635651e3b29 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d362998b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:09.951729 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5be2e2de-534a-455b-9964-b635651e3b29 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1439 microversion: 2.1 time: 0.092067 May 10 02:24:09.952328 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1667/3323] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:09 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:09.973591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:09.974245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:09.993283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:09.993754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:09.995310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.001433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.183593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:10.193261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f9ffe7a3-81a5-461a-828d-08cac566f8eb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.580041 May 10 02:24:10.204692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1657/3324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:09 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:10.214209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-86675b3c-acfd-4a75-89b9-b33146e693ea req-defe1558-2513-4fd0-a277-4d12abe4ff52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747ed73f-82a0-4f2b-b1c8-1ddbf6020e83", "tag": "e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:10.233117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-86675b3c-acfd-4a75-89b9-b33146e693ea req-defe1558-2513-4fd0-a277-4d12abe4ff52 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.233833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-86675b3c-acfd-4a75-89b9-b33146e693ea req-defe1558-2513-4fd0-a277-4d12abe4ff52 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.252533 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-86675b3c-acfd-4a75-89b9-b33146e693ea req-defe1558-2513-4fd0-a277-4d12abe4ff52 service nova] Creating event network-changed:e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf for instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 on n-h2-841089-2 May 10 02:24:10.264020 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-86675b3c-acfd-4a75-89b9-b33146e693ea req-defe1558-2513-4fd0-a277-4d12abe4ff52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057977 May 10 02:24:10.267774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1658/3325] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:10.273663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:10.274552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:10.281476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.282500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.283563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.284160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.661018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:10.670226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43f3a606-ff69-495b-bb2c-9d4ffd03fe25 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1711 microversion: 2.1 time: 0.716887 May 10 02:24:10.670895 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1668/3326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:09 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1711 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:10.676617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:10.677468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:10.683796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.684546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.685401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.685931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.831784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:10.840646 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-785a5f34-1b3f-4312-97ab-e3e60497336c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1472 microversion: 2.1 time: 0.571472 May 10 02:24:10.841476 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1659/3327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:10 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1472 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:10.863105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:10.871362 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3af17ae-01ee-4de7-87b7-72a97ed52786 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.199008 May 10 02:24:10.871660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:10.872258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1669/3328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:10 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:10.873064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:10.883865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.884331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.896205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:10.896993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:10.960110 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a0e6bed-1f0a-433a-ba16-b4f76d16b31d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.095383 May 10 02:24:10.960779 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1660/3329] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:24:10 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:10.972838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56cc7a7c-a513-4dea-8f87-a02340c86d36 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d3796d0d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.040457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56cc7a7c-a513-4dea-8f87-a02340c86d36 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1448 microversion: 2.1 time: 0.078867 May 10 02:24:11.041660 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1670/3330] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:10 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1448 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:11.046355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.046869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:11.053368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.053836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.054697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.055175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.060195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79988965-61de-4bd9-90e1-06047b0654cb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d362f10d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.103057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:11.113952 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79988965-61de-4bd9-90e1-06047b0654cb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 200 len: 1448 microversion: 2.1 time: 0.057495 May 10 02:24:11.114529 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1671/3331] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:11 2022] GET /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 1448 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:11.127466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51771447-e612-407a-90f2-eaf2ff84d25f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36373a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.192623 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5c6ee5c-cc48-4629-b8ed-04cd6ab1dad4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 204 len: 0 microversion: 2.20 time: 0.149831 May 10 02:24:11.193896 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1661/3332] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:24:11 2022] DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:24:11.203414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.204928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:11.212732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.213435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.214421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.215093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.386127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:11.397483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:11.415037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:11.416502 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-245b27ad-544d-4bb1-98fd-b9b75b687c7d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.218078 May 10 02:24:11.417431 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1662/3333] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:11 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:11.426382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.427565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:11.441635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.443405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.444214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.444661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.612605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:11.621816 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68099d42-9985-4e20-9108-84b17f30ff0d tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.200226 May 10 02:24:11.622750 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1663/3334] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:11 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:11.749820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51771447-e612-407a-90f2-eaf2ff84d25f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 204 len: 0 microversion: 2.1 time: 0.627661 May 10 02:24:11.750399 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1672/3335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:11 2022] DELETE /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:24:11.761025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.761025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:11.765774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.766229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.767008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.767485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.793335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:11.859183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.860039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:11.867586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.868606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.869931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.870651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.888241 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f4a6c0b-cb9c-406c-b5b7-2341a1e15cfb tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 204 len: 0 microversion: 2.1 time: 0.132720 May 10 02:24:11.889588 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1664/3336] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:11 2022] DELETE /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:11.897392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:11.898317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:11.904886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.905603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:11.908096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:11.908725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:12.098343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:12.108550 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a52dc5c3-34e6-40f3-8861-78a697bc50ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1472 microversion: 2.1 time: 0.254358 May 10 02:24:12.119844 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1673/3337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:11 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:12.125204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-934506576", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "f68d8830-2b07-4e10-861f-42f50aa74911"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:12.130484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:12.148270 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7144876b-f944-432a-9e79-4e8678a5d094 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.257152 May 10 02:24:12.148911 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1665/3338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:11 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:12.208825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] validate_networks() for [('f68d8830-2b07-4e10-861f-42f50aa74911', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:24:12.436193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:12.437248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:12.457916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:12.458819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:12.460606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:12.464294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:13.052906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:13.071704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:13.073734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:13.075294 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-177e17e8-7b07-4a3d-931d-53fe9f4362f2 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.643425 May 10 02:24:13.076087 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1666/3339] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:12 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:13.205767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-173816522", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "dfe981b2-b403-4e11-94d3-1f78b8cf5486"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:13.257044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] validate_networks() for [('dfe981b2-b403-4e11-94d3-1f78b8cf5486', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:24:13.992852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:24:13.994408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:24:13.995328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:24:13.995938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:24:13.996657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:24:14.015289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.017410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.018249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.018696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.038279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:14.047050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Getting quotas for user 81137d6fb1bc4f75a706134b0c13ce63 and project db0eb5a5004949188f761747944b8948. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:14.064357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:24:14.073960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:24:14.136906 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4be68dee-d128-467c-9818-7a4c98e0fa7f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.015736 May 10 02:24:14.138148 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1674/3340] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:24:14.144367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:14.145247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:14.153752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.154402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.155560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.156705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.809888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:14.818066 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e57c8dac-d855-4c9a-91e1-06f4f43bc283 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.678505 May 10 02:24:14.818655 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1675/3341] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:14 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:14.826058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:14.826930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:14.838096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.838903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.840439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.841358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.893017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:14.893608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:14.894114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lazy-loading 'fault' on Instance uuid f288d72a-ea31-4716-98c1-74f6e1ffc348 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:15.005851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.013618 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee111bc6-67eb-4218-9fe9-6a1c11034f8e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1307 microversion: 2.1 time: 0.191175 May 10 02:24:15.013736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:24:15.014158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:24:15.014572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:24:15.015090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:24:15.015518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:24:15.023844 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1676/3342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:14 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:15.026272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.026734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.027742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.028344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.028815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:15.029457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:15.037224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.038649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.040649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.041230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.055447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Getting quotas for project d3953e390e894d28860f382f55aae9e1. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:15.063030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Getting quotas for user 51d89a609e06424f96d43fcc5b426e1a and project d3953e390e894d28860f382f55aae9e1. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:15.077575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:24:15.080486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:24:15.127197 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-531da168-cd4d-4264-b9aa-178983a4245f tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.049614 May 10 02:24:15.132882 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1667/3343] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:24:15.134743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-42384f51-b3ef-4d96-b83d-cd81e4a643d8 req-535f6328-97a4-4a22-a477-68e61e47b58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "346bcea0-fdc8-4b94-9679-b36d93302a3a", "name": "network-vif-plugged", "status": "completed", "tag": "210c3e35-aea1-48cb-aa1a-c6f04fe5e390"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:15.145773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42384f51-b3ef-4d96-b83d-cd81e4a643d8 req-535f6328-97a4-4a22-a477-68e61e47b58f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.146799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42384f51-b3ef-4d96-b83d-cd81e4a643d8 req-535f6328-97a4-4a22-a477-68e61e47b58f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.162264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-42384f51-b3ef-4d96-b83d-cd81e4a643d8 req-535f6328-97a4-4a22-a477-68e61e47b58f service nova] Creating event network-vif-plugged:210c3e35-aea1-48cb-aa1a-c6f04fe5e390 for instance 346bcea0-fdc8-4b94-9679-b36d93302a3a on n-h2-841089-2 May 10 02:24:15.167463 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-42384f51-b3ef-4d96-b83d-cd81e4a643d8 req-535f6328-97a4-4a22-a477-68e61e47b58f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038063 May 10 02:24:15.168090 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1668/3344] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:15.173706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:15.174417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:15.180882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.181343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.182130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.182584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.448579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.460998 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e52efc0c-319a-4d49-a0d8-fbcd59a07a8b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.431761 May 10 02:24:15.472300 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1677/3345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:15 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:15.491921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:15.493734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:15.510647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.514127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.517523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.520386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.574736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.585900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.590141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.592306 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a39dbae0-81a8-42de-9081-b54359014d3c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1723 microversion: 2.20 time: 0.423129 May 10 02:24:15.604876 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1669/3346] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:15 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:15.613322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4f3f306a-a14b-479c-af87-cfc9b7be7af1 req-1efe3a17-a75a-4dd8-b13c-c93bed0a5b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f288d72a-ea31-4716-98c1-74f6e1ffc348", "name": "network-vif-deleted", "tag": "8e9ff947-6d97-4af3-8f6d-5e99f490dfc6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:15.623394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4f3f306a-a14b-479c-af87-cfc9b7be7af1 req-1efe3a17-a75a-4dd8-b13c-c93bed0a5b9e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.625046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4f3f306a-a14b-479c-af87-cfc9b7be7af1 req-1efe3a17-a75a-4dd8-b13c-c93bed0a5b9e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.638116 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4f3f306a-a14b-479c-af87-cfc9b7be7af1 req-1efe3a17-a75a-4dd8-b13c-c93bed0a5b9e service nova] Creating event network-vif-deleted:8e9ff947-6d97-4af3-8f6d-5e99f490dfc6 for instance f288d72a-ea31-4716-98c1-74f6e1ffc348 on n-h2-841089-2 May 10 02:24:15.644500 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4f3f306a-a14b-479c-af87-cfc9b7be7af1 req-1efe3a17-a75a-4dd8-b13c-c93bed0a5b9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036907 May 10 02:24:15.645653 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1670/3347] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:15.651056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5320147e-bb05-4213-bc5f-291015ed2524 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:15.651858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5320147e-bb05-4213-bc5f-291015ed2524 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:15.874373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5320147e-bb05-4213-bc5f-291015ed2524 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.882409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5320147e-bb05-4213-bc5f-291015ed2524 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.884394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5320147e-bb05-4213-bc5f-291015ed2524 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.885628 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5320147e-bb05-4213-bc5f-291015ed2524 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1258 microversion: 2.21 time: 0.238655 May 10 02:24:15.886752 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1671/3348] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:15 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:15.892528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:15.908650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c892453-b186-4c0e-b0af-8f860376727a tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1277 microversion: 2.1 time: 0.431433 May 10 02:24:15.909886 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1678/3349] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:15 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1277 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:15.910990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:15.911799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:15.921267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.921947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:15.923532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:15.924313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.041640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:16.042458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:16.058385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.058898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.061007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.071627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.117780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.118662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.119451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lazy-loading 'fault' on Instance uuid f288d72a-ea31-4716-98c1-74f6e1ffc348 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:16.226066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:16.235305 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21f7495d-e6c8-4966-b4a1-4a79bb673502 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 200 len: 1307 microversion: 2.1 time: 0.207406 May 10 02:24:16.245786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:16.251698 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1679/3350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:16 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:16.254118 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aca2f4c7-dea5-4a97-a699-e0329cbccfdc tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.365749 May 10 02:24:16.254703 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1672/3351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:15 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:16.480146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:16.481249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:16.489365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.490149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.490951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.491439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.615567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:16.616221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:16.622291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.622746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.623551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.624452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.821022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:16.847054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:16.850550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:16.852430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d33501db-3575-43cd-9a1c-dcf5e39e670e tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1655 microversion: 2.20 time: 0.240703 May 10 02:24:16.854062 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1673/3352] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:16 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1655 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:16.903741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:16.904644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:16.913941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.914865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:16.917109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:16.917897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.085489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:17.097559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:17.099105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:17.100252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe3c298b-cbe7-4562-a0a7-8e7c79385c62 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1316 microversion: 2.21 time: 0.200991 May 10 02:24:17.101030 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1674/3353] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:16 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:17.108667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:17.117464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:17.118588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:17.133596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dd100fe5-5fe5-4961-9c90-fd1629c222eb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.659403 May 10 02:24:17.136672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.137256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.138085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.138519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.147481 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1680/3354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:16 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:17.168623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-70f9039e-d329-4476-b292-31004f376151 req-27cac2ee-cb23-4be5-87ae-f53fa47de358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2aa38e-ed27-4fe3-a454-db0ad5af02d4", "tag": "69845f96-bc46-4f4d-8280-df4e1a739913"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:17.177891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-70f9039e-d329-4476-b292-31004f376151 req-27cac2ee-cb23-4be5-87ae-f53fa47de358 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.179117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-70f9039e-d329-4476-b292-31004f376151 req-27cac2ee-cb23-4be5-87ae-f53fa47de358 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.193419 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-70f9039e-d329-4476-b292-31004f376151 req-27cac2ee-cb23-4be5-87ae-f53fa47de358 service nova] Creating event network-changed:69845f96-bc46-4f4d-8280-df4e1a739913 for instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 on n-h1-841089-2 May 10 02:24:17.199343 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-70f9039e-d329-4476-b292-31004f376151 req-27cac2ee-cb23-4be5-87ae-f53fa47de358 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050175 May 10 02:24:17.200196 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1681/3355] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:17.206972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-36c6ff75-d324-4e0c-af3e-27acd5f256b5 req-8b904045-1efa-447f-b6b9-fc9f442489cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bf23ff-a012-485c-a83a-3b8e2246db23", "name": "network-vif-unplugged", "status": "completed", "tag": "2d433f8c-37f2-4e92-91d3-0a5e48458f8e"}, {"server_uuid": "29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01", "name": "network-vif-plugged", "status": "completed", "tag": "33ce1e86-b337-4461-a698-5f57b2b4f9d7"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:17.216517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-36c6ff75-d324-4e0c-af3e-27acd5f256b5 req-8b904045-1efa-447f-b6b9-fc9f442489cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.217304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-36c6ff75-d324-4e0c-af3e-27acd5f256b5 req-8b904045-1efa-447f-b6b9-fc9f442489cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.232969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-36c6ff75-d324-4e0c-af3e-27acd5f256b5 req-8b904045-1efa-447f-b6b9-fc9f442489cf service nova] Creating event network-vif-unplugged:2d433f8c-37f2-4e92-91d3-0a5e48458f8e for instance 64bf23ff-a012-485c-a83a-3b8e2246db23 on n-h1-841089-2 May 10 02:24:17.233480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-36c6ff75-d324-4e0c-af3e-27acd5f256b5 req-8b904045-1efa-447f-b6b9-fc9f442489cf service nova] Creating event network-vif-plugged:33ce1e86-b337-4461-a698-5f57b2b4f9d7 for instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 on n-h2-841089-2 May 10 02:24:17.244009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-36c6ff75-d324-4e0c-af3e-27acd5f256b5 req-8b904045-1efa-447f-b6b9-fc9f442489cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.041502 May 10 02:24:17.245155 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1682/3356] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:17.255288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:17.256614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: f288d72a-ea31-4716-98c1-74f6e1ffc348] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:17.265684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.267387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.268773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.269561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.289754 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance f288d72a-ea31-4716-98c1-74f6e1ffc348 could not be found. May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 HTTP/1.1 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f288d72a-ea31-4716-98c1-74f6e1ffc348 could not be found. May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f288d72a-ea31-4716-98c1-74f6e1ffc348'} May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f288d72a-ea31-4716-98c1-74f6e1ffc348 could not be found. May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f288d72a-ea31-4716-98c1-74f6e1ffc348 could not be found. May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:17.292026 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f288d72a-ea31-4716-98c1-74f6e1ffc348 could not be found. May 10 02:24:17.298430 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:17.301639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance f288d72a-ea31-4716-98c1-74f6e1ffc348 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:17.302748 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b8f1544f-fefe-4eb0-a4af-66b05e833219 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348" status: 404 len: 111 microversion: 2.1 time: 0.053803 May 10 02:24:17.303925 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1683/3357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:17 2022] GET /compute/v2.1/servers/f288d72a-ea31-4716-98c1-74f6e1ffc348 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:17.309918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:17.311216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:17.317715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.318710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.319911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.320614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.547403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:17.557881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3b288bc-d6e3-40cb-86d0-b1f24843470b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1307 microversion: 2.1 time: 0.444150 May 10 02:24:17.568091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1675/3358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:17 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:17.573805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:17.575340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:17.583505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.584748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.587566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.588326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.619217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:17.743376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:17.752251 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16f39165-9667-4a57-842b-6ef1ad624d33 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.446939 May 10 02:24:17.759740 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1684/3359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:17 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:17.764843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a3b5b21e-4c02-4a81-99d0-c6fb442629d0 req-8826543a-2302-487e-86ee-67dc8624ca1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bf23ff-a012-485c-a83a-3b8e2246db23", "name": "network-vif-deleted", "tag": "2d433f8c-37f2-4e92-91d3-0a5e48458f8e"}, {"server_uuid": "62292e53-bc84-4672-ad76-e3f6f50ffd67", "name": "network-vif-deleted", "tag": "6629677b-fb1f-4f4d-b27f-00c2ea84bd6b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:17.775543 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ded990f-8aa3-4792-8d02-d9d82a50d3b4 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 204 len: 0 microversion: 2.1 time: 0.205509 May 10 02:24:17.776570 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1676/3360] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:17 2022] DELETE /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:17.781675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a3b5b21e-4c02-4a81-99d0-c6fb442629d0 req-8826543a-2302-487e-86ee-67dc8624ca1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.785042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a3b5b21e-4c02-4a81-99d0-c6fb442629d0 req-8826543a-2302-487e-86ee-67dc8624ca1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.786804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:17.787855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:17.794849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.795684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.796695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.797341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.828636 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a3b5b21e-4c02-4a81-99d0-c6fb442629d0 req-8826543a-2302-487e-86ee-67dc8624ca1b service nova] Creating event network-vif-deleted:2d433f8c-37f2-4e92-91d3-0a5e48458f8e for instance 64bf23ff-a012-485c-a83a-3b8e2246db23 on n-h1-841089-2 May 10 02:24:17.830154 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a3b5b21e-4c02-4a81-99d0-c6fb442629d0 req-8826543a-2302-487e-86ee-67dc8624ca1b service nova] Creating event network-vif-deleted:6629677b-fb1f-4f4d-b27f-00c2ea84bd6b for instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 on n-h1-841089-2 May 10 02:24:17.837898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a3b5b21e-4c02-4a81-99d0-c6fb442629d0 req-8826543a-2302-487e-86ee-67dc8624ca1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076531 May 10 02:24:17.838520 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1685/3361] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:17.873052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:17.873779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:17.881318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.883054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.884517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.885334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.965499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:17.966277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:17.967664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lazy-loading 'fault' on Instance uuid 62292e53-bc84-4672-ad76-e3f6f50ffd67 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:18.071156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.081462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.083289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.084570 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fbb4dc7d-d9c5-4110-a959-086833ed93dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 200 len: 1371 microversion: 2.20 time: 0.216717 May 10 02:24:18.085601 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1686/3362] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:17 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:18.119778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.121190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:18.123094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:18.130358 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85e811f4-4ba2-4592-9e29-5e6bb9ba4935 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1472 microversion: 2.1 time: 0.348414 May 10 02:24:18.140287 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1677/3363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:17 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:18.142489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.142984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.143819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.144269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.153731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:18.155369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:18.162909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.163822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.165151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.166471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.284944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.293080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.295489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.296808 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1cf47e14-adab-4360-aebc-6f0b2b08d955 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1316 microversion: 2.21 time: 0.180975 May 10 02:24:18.298079 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1687/3364] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:18 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:18.392097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.401039 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af866df4-c7a8-41d1-be8e-eb3d93655f4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.252554 May 10 02:24:18.401849 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1678/3365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:18 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:18.574910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:18.575606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:18.581769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.582438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.583270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.583722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.718073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.726570 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae0be10e-fa51-4081-b91d-cef04fc7510f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1307 microversion: 2.1 time: 0.155556 May 10 02:24:18.727188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1688/3366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:18 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:18.776442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:18.777063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:18.783863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.784324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.785103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:18.785544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:18.917678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:18.925476 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b7423b6d-c2d0-4b48-a911-bb7f5c9827d4 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1317 microversion: 2.1 time: 0.152914 May 10 02:24:18.926055 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1679/3367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:18 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:19.102650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.103740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:19.109598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.110077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.110978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.111445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.126878 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] HTTP exception thrown: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Request method failure captured: May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 HTTP/1.1 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvTi2sbgr_6737NAyRrPO7-vLIWbdc0OkcQIF4bDZs4McQ8aydFZPs9LLLyxZcFO3N3jqddzoRs_S19bUR0uQZBiaM_omc_6-Owm5ONOQ4f1gwW7FEP8SDeNmZWAacYQr5wktrkz9XhXBXxXXQEnbRKt0R2KeQNAp-F_VTVQhTEnks May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.20 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_049d7523d65a466e9129bdd3842b3002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1b4983326cda4029b72134cf8f2ee832 May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '62292e53-bc84-4672-ad76-e3f6f50ffd67'} May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:19.129330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:24:19.133934 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:19.135481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Returning 404 to user: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:19.136929 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6df5ce9b-a3ff-4575-bdd1-e61c8e643926 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 404 len: 111 microversion: 2.20 time: 0.038227 May 10 02:24:19.137672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1689/3368] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:19 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:24:19.148048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3439020-d4df-44de-ab35-0f90515faeaa tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '.version_select at 0x7f3d3703e280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.156965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.158156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:19.165942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.166768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.167893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.168660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.178945 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3439020-d4df-44de-ab35-0f90515faeaa tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072034563" status: 204 len: 0 microversion: 2.20 time: 0.035381 May 10 02:24:19.179691 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1680/3369] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072034563 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:24:19.316979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.318176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:19.331949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.345442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.348867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.349658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.540171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:19.566072 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b5abb19-082c-4c8a-86c1-a4c2af961ff8 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1472 microversion: 2.1 time: 0.413026 May 10 02:24:19.568060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1690/3370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:19 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:19.574679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.575611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:19.586266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.587921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.588965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.589632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.687634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:19.701980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:19.735860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:19.738196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9910693f-a77a-436d-ab43-01ac43bfb495 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.426108 May 10 02:24:19.739579 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1681/3371] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:19 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:19.748024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-96a821ff-6aa2-4251-8ffc-9dcd77acfc51 req-230d1fb4-16b0-41a5-bcea-9bdcb3cd9e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747ed73f-82a0-4f2b-b1c8-1ddbf6020e83", "name": "network-vif-plugged", "status": "completed", "tag": "e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:19.758660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-96a821ff-6aa2-4251-8ffc-9dcd77acfc51 req-230d1fb4-16b0-41a5-bcea-9bdcb3cd9e60 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.758984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-96a821ff-6aa2-4251-8ffc-9dcd77acfc51 req-230d1fb4-16b0-41a5-bcea-9bdcb3cd9e60 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.774735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-96a821ff-6aa2-4251-8ffc-9dcd77acfc51 req-230d1fb4-16b0-41a5-bcea-9bdcb3cd9e60 service nova] Creating event network-vif-plugged:e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf for instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 on n-h2-841089-2 May 10 02:24:19.779692 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-96a821ff-6aa2-4251-8ffc-9dcd77acfc51 req-230d1fb4-16b0-41a5-bcea-9bdcb3cd9e60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037412 May 10 02:24:19.781512 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1682/3372] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:19.788267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.789312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:19.795915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.796758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.797765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.798376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.848566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:19.856590 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b239c9f8-419e-4e1c-9dc5-61d64c332047 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.287199 May 10 02:24:19.857182 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1691/3373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:19 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:19.948188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:19.950053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:19.962159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.963543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:19.964517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:19.965201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:20.353702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:20.366643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61982f2c-9d13-4c5c-baf4-e500d23dc5c9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1307 microversion: 2.1 time: 0.583048 May 10 02:24:20.378646 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1683/3374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:19 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:20.385465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-467fcb6f-13da-4547-9ceb-48aa89f04a4b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'create', calling method: .version_select at 0x7f3d365670d0>, body: {"keypair": {"name": "tempest-keypair-1017331091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQB26s1LHNwu9q+Pr33oygJnsCT6lRF7ZxSnXRLs7xzFpctibWA6iNkPVD611uOy7KWZwT//mU3nKPmiASMRu7mv2wvCN+yeLNL1Tj2aMts3CDZ5ZonFPCpzAkmso40Qg=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:20.405374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-467fcb6f-13da-4547-9ceb-48aa89f04a4b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for project 049d7523d65a466e9129bdd3842b3002. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:20.412976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-467fcb6f-13da-4547-9ceb-48aa89f04a4b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for user 1b4983326cda4029b72134cf8f2ee832 and project 049d7523d65a466e9129bdd3842b3002. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:20.461592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-467fcb6f-13da-4547-9ceb-48aa89f04a4b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.081534 May 10 02:24:20.462469 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1684/3375] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:24:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:24:20.482633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:20.491148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b4e329f-4fbf-4ef4-b8a5-6025b2187a40 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1505 microversion: 2.1 time: 0.552987 May 10 02:24:20.494644 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1692/3376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:19 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:20.512286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:20.513335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:20.525198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:20.525777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:20.529231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:20.530520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:20.583779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:20.584579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:20.592736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:20.594617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:20.595756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:20.596441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.293916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:21.304405 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1959c108-97b8-4cb6-a2d4-7bcb285aab5e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1472 microversion: 2.1 time: 0.725070 May 10 02:24:21.305719 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1693/3377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:20 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1472 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:21.318648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:21.323917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:21.326728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:21.339328 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e469cc1d-2509-4ef5-8dc1-ead768dd4f8b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 200 len: 1506 microversion: 2.1 time: 0.831950 May 10 02:24:21.346384 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1685/3378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:20 2022] GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:21.353864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:21.355424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:21.357241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.357795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.360172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.360729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.364631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.365321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.367612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.368323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.755133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:21.764390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:21.765907 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6333e9c2-7f1b-4c51-aab0-eb3f76ec0bba tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1371 microversion: 2.1 time: 0.418217 May 10 02:24:21.767478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1686/3379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:21 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:21.772463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ffef196e-1241-464a-b74e-699fcaa2a745 req-ca9dfef9-e27e-4aeb-b88b-6070a7972ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5", "tag": "fe0633e8-3ab4-4082-bdc0-4974df03c2a6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:21.784186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:21.785849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:21.787394 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f3c15f4-db87-4b5f-851c-fe3e27cbc567 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.470966 May 10 02:24:21.798005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1694/3380] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:21 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:21.802960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:21.803729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:21.809840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ffef196e-1241-464a-b74e-699fcaa2a745 req-ca9dfef9-e27e-4aeb-b88b-6070a7972ebb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.810316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ffef196e-1241-464a-b74e-699fcaa2a745 req-ca9dfef9-e27e-4aeb-b88b-6070a7972ebb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.810459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.811093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.812048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.812649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.851197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:21.852366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ffef196e-1241-464a-b74e-699fcaa2a745 req-ca9dfef9-e27e-4aeb-b88b-6070a7972ebb service nova] Creating event network-changed:fe0633e8-3ab4-4082-bdc0-4974df03c2a6 for instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 on n-h1-841089-2 May 10 02:24:21.863435 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ffef196e-1241-464a-b74e-699fcaa2a745 req-ca9dfef9-e27e-4aeb-b88b-6070a7972ebb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094488 May 10 02:24:21.865793 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1687/3381] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:21.887433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:21.888546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:21.906932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.917500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.918392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.918861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.969628 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4fbcba90-2741-4eb0-82bf-ed2c472d2b2e tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 204 len: 0 microversion: 2.1 time: 0.169704 May 10 02:24:21.970573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1695/3382] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:21 2022] DELETE /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:21.976218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-818c4e6a-7221-41af-b6c9-949ac7d5a5a4 req-b3b0c6ff-17fe-43a9-a5f6-fddc87cb4d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf83e8d2-4df2-45ea-82d7-6ed59e6821f0", "name": "network-vif-unplugged", "status": "completed", "tag": "24e95e8c-34e8-42fb-b0d0-286b7c515ccb"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:21.985786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-818c4e6a-7221-41af-b6c9-949ac7d5a5a4 req-b3b0c6ff-17fe-43a9-a5f6-fddc87cb4d44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:21.986450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-818c4e6a-7221-41af-b6c9-949ac7d5a5a4 req-b3b0c6ff-17fe-43a9-a5f6-fddc87cb4d44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:21.997881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-818c4e6a-7221-41af-b6c9-949ac7d5a5a4 req-b3b0c6ff-17fe-43a9-a5f6-fddc87cb4d44 service nova] Creating event network-vif-unplugged:24e95e8c-34e8-42fb-b0d0-286b7c515ccb for instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 on n-h2-841089-2 May 10 02:24:22.003571 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-818c4e6a-7221-41af-b6c9-949ac7d5a5a4 req-b3b0c6ff-17fe-43a9-a5f6-fddc87cb4d44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031386 May 10 02:24:22.004686 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1696/3383] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:22.010735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1500111005", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47646f85-70a4-465a-9fdf-3faefd756bbd"}], "security_groups": [{"name": "tempest-securitygroup--610521626"}], "key_name": "tempest-keypair-1017331091", "user_data": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:22.234324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:22.243900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] validate_networks() for [('47646f85-70a4-465a-9fdf-3faefd756bbd', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:24:22.250948 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74db01a3-25d0-49e9-b181-16d62b3d2c2c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1307 microversion: 2.1 time: 0.379083 May 10 02:24:22.266104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1688/3384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:21 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1307 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:22.271974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:22.272162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:22.278162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.278620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.279462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.279958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.319399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:22.416977 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f9dd1ee0-06cd-4cd3-a15d-f674ca8182b1 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 204 len: 0 microversion: 2.1 time: 0.148917 May 10 02:24:22.418426 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1689/3385] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:22 2022] DELETE /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:22.425757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:22.426717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:22.432975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.433630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.434494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.434950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.534583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:22.543308 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c32274e-f613-4b66-9423-99fd7b3e607f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1302 microversion: 2.1 time: 0.123333 May 10 02:24:22.544012 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1690/3386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:22 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:22.549146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:22.549769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:22.556567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.557260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.558458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.558909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.780712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:22.791275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc8b22c4-ca4b-4340-8da2-ad0acd813a37 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 200 len: 1512 microversion: 2.1 time: 0.246119 May 10 02:24:22.792277 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1691/3387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:22 2022] GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:22.798933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:22.799579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:22.805586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.806222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.807027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.807673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.824917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:24:22.825428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:24:22.825806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:24:22.826213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:24:22.826624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:24:22.837378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.837952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.839157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.839681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.861711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for project 049d7523d65a466e9129bdd3842b3002. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:22.867431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Getting quotas for user 1b4983326cda4029b72134cf8f2ee832 and project 049d7523d65a466e9129bdd3842b3002. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:22.879677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:24:22.882051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:24:22.929018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5498f76d-6cf6-40f8-943b-31c277ef9c23 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.922958 May 10 02:24:22.934648 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1697/3388] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:24:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:24:22.934648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:22.935173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:22.942239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.942705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.943535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:22.943984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:22.956942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:22.971538 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b2f72d1-72db-475f-9789-b9257541f169 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1563 microversion: 2.1 time: 0.177845 May 10 02:24:22.972472 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1692/3389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:22 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:22.976778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43024fa6-90d0-4807-aefc-7b4e4af4f526 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:22.977602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43024fa6-90d0-4807-aefc-7b4e4af4f526 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:23.044902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43024fa6-90d0-4807-aefc-7b4e4af4f526 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.053155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43024fa6-90d0-4807-aefc-7b4e4af4f526 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.054643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43024fa6-90d0-4807-aefc-7b4e4af4f526 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.055803 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43024fa6-90d0-4807-aefc-7b4e4af4f526 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1282 microversion: 2.20 time: 0.082620 May 10 02:24:23.057830 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1693/3390] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:22 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:23.061364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:23.061888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:23.068839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.069304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.070083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.070529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.126160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.135092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.136647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.137775 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71ca37b7-03e7-4bea-944f-30d4062007b6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.206839 May 10 02:24:23.138350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1698/3391] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:22 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:23.162184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3670f1a7-96c7-4ecd-80b0-07a79570a621 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104541 May 10 02:24:23.162833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1694/3392] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:24:23 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:23.269453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:23.270639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:23.276931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.277393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.278177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.278818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.560426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:23.561857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:23.569005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.569465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.570460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.570915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.605015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.605475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.605932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lazy-loading 'fault' on Instance uuid bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:23.633256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.641338 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e95adff-50a7-4939-9424-fa4ec8eb8c5f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1307 microversion: 2.1 time: 0.376600 May 10 02:24:23.642286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1699/3393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:23 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:23.677206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:23.684905 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4cfba621-5031-4ddc-91d4-9d3bd9156ebf tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1307 microversion: 2.1 time: 0.128629 May 10 02:24:23.686075 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1695/3394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:23 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:23.808048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:23.808672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:23.815093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.815554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:23.816335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:23.816777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.020341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ed68c095-b070-4856-8242-9dc1a7c46dcd req-a8d66cbb-89b6-4892-b08f-821f6594c2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2aa38e-ed27-4fe3-a454-db0ad5af02d4", "name": "network-vif-plugged", "status": "completed", "tag": "69845f96-bc46-4f4d-8280-df4e1a739913"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:24.029377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ed68c095-b070-4856-8242-9dc1a7c46dcd req-a8d66cbb-89b6-4892-b08f-821f6594c2a7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.029836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ed68c095-b070-4856-8242-9dc1a7c46dcd req-a8d66cbb-89b6-4892-b08f-821f6594c2a7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.052537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ed68c095-b070-4856-8242-9dc1a7c46dcd req-a8d66cbb-89b6-4892-b08f-821f6594c2a7 service nova] Creating event network-vif-plugged:69845f96-bc46-4f4d-8280-df4e1a739913 for instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 on n-h1-841089-2 May 10 02:24:24.061115 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ed68c095-b070-4856-8242-9dc1a7c46dcd req-a8d66cbb-89b6-4892-b08f-821f6594c2a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044569 May 10 02:24:24.062078 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1696/3395] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:24:24.075183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:24.075971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:24.087866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.088327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.089173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.089627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.337793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.346407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.347970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.349106 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bee0ff09-8a1b-48bc-b9cc-f06f7ae5bb3b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1334 microversion: 2.20 time: 0.278514 May 10 02:24:24.349881 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1697/3396] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:24 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1334 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:24.354143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:24.354755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:24.361221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.361743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.362536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.363105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.746905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.756258 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ede3b57-9134-434f-928b-ea64375e636f tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 200 len: 1512 microversion: 2.1 time: 0.952209 May 10 02:24:24.756853 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1700/3397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:23 2022] GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 1512 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:24.761434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d5bd84ab-062c-4361-b505-2e4ce04548f9 req-840aef56-cfcd-4000-a52c-d3c0617e5e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf83e8d2-4df2-45ea-82d7-6ed59e6821f0", "name": "network-vif-deleted", "tag": "24e95e8c-34e8-42fb-b0d0-286b7c515ccb"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:24.770319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d5bd84ab-062c-4361-b505-2e4ce04548f9 req-840aef56-cfcd-4000-a52c-d3c0617e5e0b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.771327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d5bd84ab-062c-4361-b505-2e4ce04548f9 req-840aef56-cfcd-4000-a52c-d3c0617e5e0b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.786840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d5bd84ab-062c-4361-b505-2e4ce04548f9 req-840aef56-cfcd-4000-a52c-d3c0617e5e0b service nova] Creating event network-vif-deleted:24e95e8c-34e8-42fb-b0d0-286b7c515ccb for instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 on n-h2-841089-2 May 10 02:24:24.793257 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d5bd84ab-062c-4361-b505-2e4ce04548f9 req-840aef56-cfcd-4000-a52c-d3c0617e5e0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035022 May 10 02:24:24.793894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1701/3398] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:24.799099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:24.799810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:24.805868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.806307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.807337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.807782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.913281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.937519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.940659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:24.942888 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43602340-a0fb-4112-bce0-5d831ebb5f89 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.591855 May 10 02:24:24.954036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1698/3399] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:24 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:24.960038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:24.960959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:24.996332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.996798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:24.997609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:24.998060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.041332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.042056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.042922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lazy-loading 'fault' on Instance uuid bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:25.243962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:25.252163 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-003dfeec-4fc7-4352-b423-f326069de3b9 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 200 len: 1307 microversion: 2.1 time: 0.296516 May 10 02:24:25.252764 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1699/3400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:24 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:25.345693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:25.354824 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28ce8b01-a2ee-42b9-a9d4-37c22966f08c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1307 microversion: 2.1 time: 0.559653 May 10 02:24:25.373432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:25.374537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:25.380597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1702/3401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:24 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1307 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:25.382522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.383236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.384185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.384833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.774418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:25.775045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:25.782152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.782916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.783746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.784367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.868203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:25.880038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:25.882240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:25.883831 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbf3a5ce-cffa-4a9e-905f-8804dfd0de2f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.515614 May 10 02:24:25.884704 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1700/3402] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:25 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:25.961303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:25.962614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:25.969923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.970690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:25.971681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:25.972285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.652531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:26.662878 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8ee767e-a1d0-40d9-b04d-3e111e9ba0b0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 200 len: 1512 microversion: 2.1 time: 0.893331 May 10 02:24:26.682301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1703/3403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:25 2022] GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 1512 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:26.688637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:26.689591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: bf83e8d2-4df2-45ea-82d7-6ed59e6821f0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:26.698120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.699698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.700736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.701473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.721836 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 could not be found. May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 HTTP/1.1 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 could not be found. May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'bf83e8d2-4df2-45ea-82d7-6ed59e6821f0'} May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 could not be found. May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 could not be found. May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:26.724228 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 could not be found. May 10 02:24:26.730257 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:26.732016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:26.732967 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8db7346e-dfed-46e5-9426-97adae35ac4f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0" status: 404 len: 111 microversion: 2.1 time: 0.049284 May 10 02:24:26.733367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:26.733514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1704/3404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:26 2022] GET /compute/v2.1/servers/bf83e8d2-4df2-45ea-82d7-6ed59e6821f0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:26.738591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:26.739277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:26.744859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:26.746374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:26.747540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fed1159d-7080-4a76-ac41-97a3e9195648 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.790581 May 10 02:24:26.748425 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1701/3405] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:25 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:26.751993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.753121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.754831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.756115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.764915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-61a45dfa-b817-4b1d-aecb-55fccd6e2b14 req-2a39c562-9732-4880-b073-e8e770aca4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:26.781664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-61a45dfa-b817-4b1d-aecb-55fccd6e2b14 req-2a39c562-9732-4880-b073-e8e770aca4d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.783232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-61a45dfa-b817-4b1d-aecb-55fccd6e2b14 req-2a39c562-9732-4880-b073-e8e770aca4d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.802093 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-61a45dfa-b817-4b1d-aecb-55fccd6e2b14 req-2a39c562-9732-4880-b073-e8e770aca4d1 service nova] Creating event network-changed:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:24:26.814122 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-61a45dfa-b817-4b1d-aecb-55fccd6e2b14 req-2a39c562-9732-4880-b073-e8e770aca4d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062289 May 10 02:24:26.814993 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1702/3406] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:26.828591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:26.829753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:26.844401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.844820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.845611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:26.846054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:26.887892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:27.039828 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd18286e-89b8-4207-aa84-f2960132b67e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 204 len: 0 microversion: 2.1 time: 0.219084 May 10 02:24:27.040563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1703/3407] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:26 2022] DELETE /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:27.048654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:27.049362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:27.067219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.067682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.068458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.068901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.380789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:27.389747 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b63e0e6-af65-4659-995c-35b414d73515 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1488 microversion: 2.1 time: 0.655168 May 10 02:24:27.401760 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1705/3408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:26 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1488 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:27.407747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:27.408446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:27.426632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.427111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.428067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.428665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.457127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:27.458134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:27.467599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:27.469203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:27.471675 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41ee8765-8ded-4f53-b7b6-ef2bdfd53a03 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.427210 May 10 02:24:27.472260 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1704/3409] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:27 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:27.478174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-609a3384-1d16-4f3d-8d35-a054399ece65 req-3d6f0aeb-5613-4fb9-a860-99de96690c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747ed73f-82a0-4f2b-b1c8-1ddbf6020e83", "tag": "e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:27.490050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-609a3384-1d16-4f3d-8d35-a054399ece65 req-3d6f0aeb-5613-4fb9-a860-99de96690c22 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.490508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-609a3384-1d16-4f3d-8d35-a054399ece65 req-3d6f0aeb-5613-4fb9-a860-99de96690c22 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.504203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-609a3384-1d16-4f3d-8d35-a054399ece65 req-3d6f0aeb-5613-4fb9-a860-99de96690c22 service nova] Creating event network-changed:e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf for instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 on n-h2-841089-2 May 10 02:24:27.510094 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-609a3384-1d16-4f3d-8d35-a054399ece65 req-3d6f0aeb-5613-4fb9-a860-99de96690c22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036509 May 10 02:24:27.511357 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1705/3410] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:27.520367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-784060380"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:27.521817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:27.531279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.532921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.533940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.534654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.560578 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b69eb95-0317-4f95-b263-5f8f2c71829d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 204 len: 0 microversion: 2.1 time: 0.157282 May 10 02:24:27.564713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1706/3411] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:27 2022] DELETE /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:27.575027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:27.575873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:27.583919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.585267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.586820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.587522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.832757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:27.843290 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3108f075-51e4-4428-85b3-258e58fe0a51 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 200 len: 1473 microversion: 2.1 time: 0.275163 May 10 02:24:27.844424 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1707/3412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:27 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 1473 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:27.851101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:27.852162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:27.861813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.862662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.863708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.864364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.903912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da04a208-0858-4e0b-b39d-dcb3f903baf0 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "POST /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4/action" status: 202 len: 0 microversion: 2.1 time: 0.390857 May 10 02:24:27.905188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1706/3413] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:24:27 2022] POST /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 02:24:27.912207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:27.913318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:27.914909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.915405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.915876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lazy-loading 'fault' on Instance uuid 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:27.920545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.921191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:27.922187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:27.923476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.000062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.011608 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e56feb2-2b1e-4679-9f5f-0386c6e077fb tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 200 len: 1307 microversion: 2.1 time: 0.165772 May 10 02:24:28.012206 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1708/3414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:27 2022] GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:28.017834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dddd517b-d0ec-428f-8108-e798301ef586 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d362f15e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.084063 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dddd517b-d0ec-428f-8108-e798301ef586 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a" status: 200 len: 1413 microversion: 2.1 time: 0.069754 May 10 02:24:28.085786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1709/3415] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:28 2022] GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:28.102135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4efe0ca3-61ee-4db8-a4b7-8c821079bec2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d362a18b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.138459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.147342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.151798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.152963 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a42d55b7-f23f-4c01-a9c1-bcbc603d2aae tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.246503 May 10 02:24:28.153525 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1707/3416] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:27 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:28.161814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-36cbb05b-d82e-4906-805b-12126b1c4cff req-eb89e3e1-d553-4bab-b52b-07781b5b4af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5", "name": "network-vif-plugged", "status": "completed", "tag": "fe0633e8-3ab4-4082-bdc0-4974df03c2a6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:28.171490 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4efe0ca3-61ee-4db8-a4b7-8c821079bec2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a" status: 200 len: 1413 microversion: 2.1 time: 0.077773 May 10 02:24:28.172953 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1710/3417] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:28 2022] GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:28.179353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-36cbb05b-d82e-4906-805b-12126b1c4cff req-eb89e3e1-d553-4bab-b52b-07781b5b4af6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.179353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-36cbb05b-d82e-4906-805b-12126b1c4cff req-eb89e3e1-d553-4bab-b52b-07781b5b4af6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.187246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4da5ba5-3275-4226-9514-2cbe060a175f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d362f18b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.192883 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-36cbb05b-d82e-4906-805b-12126b1c4cff req-eb89e3e1-d553-4bab-b52b-07781b5b4af6 service nova] Creating event network-vif-plugged:fe0633e8-3ab4-4082-bdc0-4974df03c2a6 for instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 on n-h1-841089-2 May 10 02:24:28.202337 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-36cbb05b-d82e-4906-805b-12126b1c4cff req-eb89e3e1-d553-4bab-b52b-07781b5b4af6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044027 May 10 02:24:28.203148 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1708/3418] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:28.365235 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4da5ba5-3275-4226-9514-2cbe060a175f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a" status: 204 len: 0 microversion: 2.1 time: 0.183608 May 10 02:24:28.365820 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1711/3419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:28 2022] DELETE /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:28.374410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4875a82-3221-4cee-9ce5-f6efd911d22b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d37007af0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.411363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d4875a82-3221-4cee-9ce5-f6efd911d22b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Image not found. May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4875a82-3221-4cee-9ce5-f6efd911d22b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a HTTP/1.1 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fe256358-7924-4cc0-a514-2a83e8f1da1a'} May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fe256358-7924-4cc0-a514-2a83e8f1da1a May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 10 02:24:28.414452 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe256358-7924-4cc0-a514-2a83e8f1da1a could not be found. May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4875a82-3221-4cee-9ce5-f6efd911d22b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4875a82-3221-4cee-9ce5-f6efd911d22b tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a" status: 404 len: 62 microversion: 2.1 time: 0.046139 May 10 02:24:28.421673 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1709/3420] 10.222.0.52 () {58 vars in 1232 bytes} [Tue May 10 02:24:28 2022] GET /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:24:28.426315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.426860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:28.435171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.435635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.436453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.438963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.491008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.492239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:28.503608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.503996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.504857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.505417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.686399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.704439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d47dbfed-09f4-440e-bf76-a5ecfce867c5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1500 microversion: 2.1 time: 0.282598 May 10 02:24:28.705132 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1712/3421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:28 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1500 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:28.729991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.738873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.740568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:28.741858 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45a7d502-1d26-4efb-8247-ad91df40bb24 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.255077 May 10 02:24:28.742548 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1710/3422] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:28 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:28.860165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:28.860917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:28.867680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.868211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:28.869005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:28.869537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.029922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:29.038203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:29.045502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.045960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.046773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.047248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.061731 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] HTTP exception thrown: Instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 could not be found. May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Request method failure captured: May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 HTTP/1.1 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecyVqlDIQFnVSzB_rm5PG1Z_gIedF3v7b81eMkBLZFFFYpKOSqNtAVaEF4-SG-U8vRxE5QLnf_-Ifa1yiUrrECBeFiU09QNJ8EUJ_hWq0mhX5mCspUjQ2drY-skl7vXpPs8dRmU46rhNh2vYSR4LFuBvaJT5Yh6NcDqhwPc4fEyRTMA May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: df0e7c324d7745efa55830fb4a87dd7f May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MultipleCreateTestJSON-1029017650 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df0e7c324d7745efa55830fb4a87dd7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df0e7c324d7745efa55830fb4a87dd7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df0e7c324d7745efa55830fb4a87dd7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df0e7c324d7745efa55830fb4a87dd7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MultipleCreateTestJSON-1029017650 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: df0e7c324d7745efa55830fb4a87dd7f May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1029017650 May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MultipleCreateTestJSON-1029017650-project May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fbbe6ebb85cd4cf6b5b09a2defe3c54b May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MultipleCreateTestJSON-1029017650-project May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 could not be found. May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01'} May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 could not be found. May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 could not be found. May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:29.065795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 could not be found. May 10 02:24:29.069909 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:29.087079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Returning 404 to user: Instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:29.088669 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c19a8ef1-5da0-4784-ac54-fccabf1166d0 tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01" status: 404 len: 111 microversion: 2.1 time: 0.063782 May 10 02:24:29.089883 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1711/3423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:29 2022] GET /compute/v2.1/servers/29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:24:29.099878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:29.101384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:29.102011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:29.108582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-824770f5-8c9e-4e52-abae-33bddb43e55b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 200 len: 1473 microversion: 2.1 time: 0.252038 May 10 02:24:29.109685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1713/3424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:28 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 1473 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:29.110924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.111415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.112378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.113275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.149735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.150918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.151613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lazy-loading 'fault' on Instance uuid 346bcea0-fdc8-4b94-9679-b36d93302a3a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:29.173187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:29.174233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:29.180739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.181658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.182451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.183015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.198922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbe6ebb85cd4cf6b5b09a2defe3c54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0e7c324d7745efa55830fb4a87dd7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:29.207444 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e35694dd-6386-49b8-be6b-4ecc4aaf3fda tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 200 len: 1307 microversion: 2.1 time: 0.113146 May 10 02:24:29.208314 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1712/3425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:29 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:29.319246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:29.329683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:29.331254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:29.332435 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bb0dab66-cd8d-474d-9d44-332a164ad8c2 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.163384 May 10 02:24:29.333014 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1714/3426] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:29 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:29.525265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-435048f7-badb-4bee-b0f5-484442a1507d req-a2213be9-8087-4d58-b91a-0f29fb9d7652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01", "name": "network-vif-deleted", "tag": "33ce1e86-b337-4461-a698-5f57b2b4f9d7"}, {"server_uuid": "346bcea0-fdc8-4b94-9679-b36d93302a3a", "name": "network-vif-deleted", "tag": "210c3e35-aea1-48cb-aa1a-c6f04fe5e390"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:29.534296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-435048f7-badb-4bee-b0f5-484442a1507d req-a2213be9-8087-4d58-b91a-0f29fb9d7652 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.534752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-435048f7-badb-4bee-b0f5-484442a1507d req-a2213be9-8087-4d58-b91a-0f29fb9d7652 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.548164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-435048f7-badb-4bee-b0f5-484442a1507d req-a2213be9-8087-4d58-b91a-0f29fb9d7652 service nova] Creating event network-vif-deleted:33ce1e86-b337-4461-a698-5f57b2b4f9d7 for instance 29ffb3f5-aab8-4e71-b2ab-6dbe49e93b01 on n-h2-841089-2 May 10 02:24:29.548924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-435048f7-badb-4bee-b0f5-484442a1507d req-a2213be9-8087-4d58-b91a-0f29fb9d7652 service nova] Creating event network-vif-deleted:210c3e35-aea1-48cb-aa1a-c6f04fe5e390 for instance 346bcea0-fdc8-4b94-9679-b36d93302a3a on n-h2-841089-2 May 10 02:24:29.555816 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-435048f7-badb-4bee-b0f5-484442a1507d req-a2213be9-8087-4d58-b91a-0f29fb9d7652 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034318 May 10 02:24:29.556842 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1713/3427] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:29.736672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:29.739541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:29.757096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.758034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.758836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.759479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.762886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:29.763802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:29.777140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.777863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:29.779998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:29.780623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.238521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.257969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b2c937e-8f54-444f-968f-bab86e6d9cd5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1500 microversion: 2.1 time: 0.540052 May 10 02:24:30.258890 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1715/3428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:29 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1500 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:30.263807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:30.264623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:30.280904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.281729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.284159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.284953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.304436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.316024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.317561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.319654 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3218f6af-87ce-4463-ba64-62e57c4acff7 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.563550 May 10 02:24:30.326963 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1714/3429] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:29 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:30.332664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:30.336044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] [instance: 346bcea0-fdc8-4b94-9679-b36d93302a3a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:30.350733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.351470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.352438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.353053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.386090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.390968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] HTTP exception thrown: Instance 346bcea0-fdc8-4b94-9679-b36d93302a3a could not be found. May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Request method failure captured: May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a HTTP/1.1 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecyVqlDIQFnVSzB_rm5PG1Z_gIedF3v7b81eMkBLZFFFYpKOSqNtAVaEF4-SG-U8vRxE5QLnf_-Ifa1yiUrrECBeFiU09QNJ8EUJ_hWq0mhX5mCspUjQ2drY-skl7vXpPs8dRmU46rhNh2vYSR4LFuBvaJT5Yh6NcDqhwPc4fEyRTMA May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: df0e7c324d7745efa55830fb4a87dd7f May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-MultipleCreateTestJSON-1029017650 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df0e7c324d7745efa55830fb4a87dd7f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df0e7c324d7745efa55830fb4a87dd7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df0e7c324d7745efa55830fb4a87dd7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df0e7c324d7745efa55830fb4a87dd7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-MultipleCreateTestJSON-1029017650 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: df0e7c324d7745efa55830fb4a87dd7f May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1029017650 May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-MultipleCreateTestJSON-1029017650-project May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: fbbe6ebb85cd4cf6b5b09a2defe3c54b May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-MultipleCreateTestJSON-1029017650-project May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 346bcea0-fdc8-4b94-9679-b36d93302a3a could not be found. May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '346bcea0-fdc8-4b94-9679-b36d93302a3a'} May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 346bcea0-fdc8-4b94-9679-b36d93302a3a could not be found. May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 346bcea0-fdc8-4b94-9679-b36d93302a3a could not be found. May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:30.395236 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 346bcea0-fdc8-4b94-9679-b36d93302a3a could not be found. May 10 02:24:30.399144 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:30.400346 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4fd3624-38f9-4f00-9757-70ea5a01150d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 200 len: 1303 microversion: 2.1 time: 0.139882 May 10 02:24:30.402439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1716/3430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:30 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:30.412805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] Returning 404 to user: Instance 346bcea0-fdc8-4b94-9679-b36d93302a3a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:30.413753 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b581c76-96bd-412b-b97a-28c9ed1ec75b tempest-MultipleCreateTestJSON-1029017650 tempest-MultipleCreateTestJSON-1029017650-project] 10.222.0.52 "GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a" status: 404 len: 111 microversion: 2.1 time: 0.085292 May 10 02:24:30.416304 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1715/3431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:30 2022] GET /compute/v2.1/servers/346bcea0-fdc8-4b94-9679-b36d93302a3a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:30.417513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0de67628-e4f5-4b75-9041-bdc5ea802539 req-72f8ce0c-ddfa-468f-af3e-81aceb736295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255f02d9-1a66-4536-a9c4-4535832be9ea", "name": "network-vif-deleted", "tag": "9251dc32-040f-40eb-95a7-22f9f242aedb"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:30.428367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0de67628-e4f5-4b75-9041-bdc5ea802539 req-72f8ce0c-ddfa-468f-af3e-81aceb736295 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.428828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0de67628-e4f5-4b75-9041-bdc5ea802539 req-72f8ce0c-ddfa-468f-af3e-81aceb736295 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.430148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:30.432469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:30.447474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.447938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.448791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:30.449234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:30.449490 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0de67628-e4f5-4b75-9041-bdc5ea802539 req-72f8ce0c-ddfa-468f-af3e-81aceb736295 service nova] Creating event network-vif-deleted:9251dc32-040f-40eb-95a7-22f9f242aedb for instance 255f02d9-1a66-4536-a9c4-4535832be9ea on n-h1-841089-2 May 10 02:24:30.459886 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0de67628-e4f5-4b75-9041-bdc5ea802539 req-72f8ce0c-ddfa-468f-af3e-81aceb736295 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053511 May 10 02:24:30.461400 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1717/3432] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:30.763813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.773306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.777134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:30.778472 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab80e79d-17a2-401f-9523-b0335fd5df8a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1358 microversion: 2.21 time: 0.358464 May 10 02:24:30.779659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1716/3433] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:30 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:31.279156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:31.279887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:31.292962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:31.320256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:31.321476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:31.321885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:31.346493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:31.347215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:31.359179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:31.359829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:31.361687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:31.362551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.126379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.137270 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a265961f-64f8-4958-b26d-f12ad2fd19c6 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1506 microversion: 2.1 time: 0.863420 May 10 02:24:32.138685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1718/3434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:31 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:32.149131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.149896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 255f02d9-1a66-4536-a9c4-4535832be9ea] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.160252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.160967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.162238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.162845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.163022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.171263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.173341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.174492 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e580efe-6e51-4b8d-9c83-187876c4caba tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.834068 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance 255f02d9-1a66-4536-a9c4-4535832be9ea could not be found. May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea HTTP/1.1 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 255f02d9-1a66-4536-a9c4-4535832be9ea could not be found. May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '255f02d9-1a66-4536-a9c4-4535832be9ea'} May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255f02d9-1a66-4536-a9c4-4535832be9ea could not be found. May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:32.185288 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255f02d9-1a66-4536-a9c4-4535832be9ea could not be found. May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255f02d9-1a66-4536-a9c4-4535832be9ea could not be found. May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance 255f02d9-1a66-4536-a9c4-4535832be9ea could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10e0916d-6531-489b-bb89-6e7986b297ed tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea" status: 404 len: 111 microversion: 2.1 time: 0.041821 May 10 02:24:32.189723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1719/3435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:32 2022] GET /compute/v2.1/servers/255f02d9-1a66-4536-a9c4-4535832be9ea => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:32.190748 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1717/3436] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:31 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:32.190868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.194931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.197697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-91646af3-dba0-4e2c-a427-10877f9809f1 req-2bfa3369-06c0-40cd-93c9-b301c9e884cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c39c22-4838-4b6b-8166-11627cded45c", "name": "network-vif-deleted", "tag": "957b1852-a0da-4bcd-9397-df8e7a46fd7f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:32.202522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.203197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.204182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.204790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.210838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-91646af3-dba0-4e2c-a427-10877f9809f1 req-2bfa3369-06c0-40cd-93c9-b301c9e884cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.212403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-91646af3-dba0-4e2c-a427-10877f9809f1 req-2bfa3369-06c0-40cd-93c9-b301c9e884cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.230262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-91646af3-dba0-4e2c-a427-10877f9809f1 req-2bfa3369-06c0-40cd-93c9-b301c9e884cc service nova] Creating event network-vif-deleted:957b1852-a0da-4bcd-9397-df8e7a46fd7f for instance 15c39c22-4838-4b6b-8166-11627cded45c on n-h2-841089-2 May 10 02:24:32.236897 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-91646af3-dba0-4e2c-a427-10877f9809f1 req-2bfa3369-06c0-40cd-93c9-b301c9e884cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052300 May 10 02:24:32.238155 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1720/3437] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:32.244789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.246536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 15c39c22-4838-4b6b-8166-11627cded45c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.256059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.257042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.258590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.259250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.283876 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance 15c39c22-4838-4b6b-8166-11627cded45c could not be found. May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c HTTP/1.1 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 15c39c22-4838-4b6b-8166-11627cded45c could not be found. May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '15c39c22-4838-4b6b-8166-11627cded45c'} May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c39c22-4838-4b6b-8166-11627cded45c could not be found. May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c39c22-4838-4b6b-8166-11627cded45c could not be found. May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:32.287197 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c39c22-4838-4b6b-8166-11627cded45c could not be found. May 10 02:24:32.292034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:32.293434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance 15c39c22-4838-4b6b-8166-11627cded45c could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:32.294438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-021e82be-0189-4603-8a5b-288d4a26db66 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c" status: 404 len: 111 microversion: 2.1 time: 0.054557 May 10 02:24:32.295678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1721/3438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:32 2022] GET /compute/v2.1/servers/15c39c22-4838-4b6b-8166-11627cded45c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:32.303880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c7a4897-5aa8-4fe1-b4df-0a2adc7ef8ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.349043 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c7a4897-5aa8-4fe1-b4df-0a2adc7ef8ac tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/7d4bd606-5bd9-4756-aa38-890298eebcd9" status: 204 len: 0 microversion: 2.1 time: 0.047842 May 10 02:24:32.353081 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1722/3439] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:24:32 2022] DELETE /compute/v2.1/os-server-groups/7d4bd606-5bd9-4756-aa38-890298eebcd9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:32.359667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.361014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.371405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.371865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.372665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.373177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.404136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:32.407887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.422465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.425483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:32.445905 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3cf00a1e-b773-4f7f-b9b3-26c1af42f040 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1551 microversion: 2.21 time: 0.258762 May 10 02:24:32.451464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1718/3440] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:32 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1551 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:32.468234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.469042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.478393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.479142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.480720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.485436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.522512 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cdd71c68-c58f-429b-aea5-c0cc867c354d tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 204 len: 0 microversion: 2.1 time: 0.168039 May 10 02:24:32.526484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1723/3441] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:32 2022] DELETE /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:32.534223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.535112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.542444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.543146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.544130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.544735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.575016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:32.604202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:32.689678 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0475e0c-a040-4d8a-8ca9-526e3cbecb69 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 204 len: 0 microversion: 2.1 time: 0.160933 May 10 02:24:32.691057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1724/3442] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:32 2022] DELETE /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:32.702605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.704159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.712162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.712989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.714075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.714810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.854693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a1434be-9a3d-40d5-b203-0fa962b4ed64 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 204 len: 0 microversion: 2.21 time: 0.390491 May 10 02:24:32.860920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1719/3443] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:24:32 2022] DELETE /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:24:32.867456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:32.869209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:32.885308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.885773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:32.886579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:32.887027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:33.050448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.069211 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4c4a559-d844-4feb-942f-5fd6dc28eb54 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1475 microversion: 2.1 time: 0.372993 May 10 02:24:33.080320 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1725/3444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:32 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:33.104933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.114058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.117038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.118387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4ea2039-71e1-4d6d-b1d1-0708c605a74b tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1557 microversion: 2.21 time: 0.256326 May 10 02:24:33.127609 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1720/3445] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:32 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1557 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:33.155326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:33.156291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:33.165202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:33.166083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:33.169337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:33.171684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:33.193147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:33.193711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:33.203742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:33.204210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:33.205009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:33.207380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:33.412802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.423924 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82247523-8b76-4991-83d8-dc763bb1708e tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1506 microversion: 2.1 time: 0.273040 May 10 02:24:33.424514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1726/3446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:33 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:33.453765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.462346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.463931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:33.465165 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24f9947c-a92b-49b9-b0a0-7a19105a1559 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.275985 May 10 02:24:33.465721 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1721/3447] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:33 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:34.087900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:34.088528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:34.096265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.097123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.098487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.099186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.139382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:34.140049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:34.148869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.149663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.150859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.151524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.414689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:34.421951 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a79e9140-fd4a-4950-9625-f021165c894a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1475 microversion: 2.1 time: 0.338519 May 10 02:24:34.422519 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1727/3448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:34 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1475 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:34.451388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:34.459846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:34.461515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:34.462698 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fdfb160b-9cf4-4a32-9d8c-1f956e6c687a tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1557 microversion: 2.21 time: 0.329018 May 10 02:24:34.463401 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1722/3449] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:34 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1557 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:34.478509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:34.479165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:34.485530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.485851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.486634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.487095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.562283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1341753244", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:34.619810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] validate_networks() for [('05788ec2-f81e-45cc-9901-7a75e3caacbb', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:24:34.793069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:34.804340 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dfed825-d0c7-48e9-8f83-49d7649ab211 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1506 microversion: 2.1 time: 0.329681 May 10 02:24:34.805408 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1723/3450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:34 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:34.810261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:34.810953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:34.817666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.818390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:34.819273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:34.819939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.125049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.133479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.135331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.136724 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98d466c0-0d89-405d-9a0c-006fb041578c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.330182 May 10 02:24:35.137491 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1724/3451] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:34 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:35.149614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c4a8342c-1825-4c7f-bdb0-6bf0a222f30d req-60229c0d-148a-4bc8-b5b8-e24f88e2f25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2aa38e-ed27-4fe3-a454-db0ad5af02d4", "name": "network-vif-plugged", "status": "completed", "tag": "69845f96-bc46-4f4d-8280-df4e1a739913"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:35.159150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c4a8342c-1825-4c7f-bdb0-6bf0a222f30d req-60229c0d-148a-4bc8-b5b8-e24f88e2f25a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.159761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c4a8342c-1825-4c7f-bdb0-6bf0a222f30d req-60229c0d-148a-4bc8-b5b8-e24f88e2f25a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.171658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c4a8342c-1825-4c7f-bdb0-6bf0a222f30d req-60229c0d-148a-4bc8-b5b8-e24f88e2f25a service nova] Creating event network-vif-plugged:69845f96-bc46-4f4d-8280-df4e1a739913 for instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 on n-h1-841089-2 May 10 02:24:35.178487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c4a8342c-1825-4c7f-bdb0-6bf0a222f30d req-60229c0d-148a-4bc8-b5b8-e24f88e2f25a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039661 May 10 02:24:35.179387 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1725/3452] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:35.249680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:24:35.250100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:24:35.250633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:24:35.251097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:24:35.251616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:24:35.260336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.260792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.261591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.262030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.278651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Getting quotas for project 1820a0611b744a2c9b9450fc9a43e219. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:35.284728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Getting quotas for user d0eedcac64ee4401a7fc1e0ae14b55d3 and project 1820a0611b744a2c9b9450fc9a43e219. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:35.297075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:24:35.299864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:24:35.344805 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-878ef1a8-bf6b-468a-8c5e-d3d9defc951b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920697 May 10 02:24:35.345800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1728/3453] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:24:35.355841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28da1178-9082-40ce-ba8f-16936ecb3886 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:35.357243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28da1178-9082-40ce-ba8f-16936ecb3886 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:35.419495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28da1178-9082-40ce-ba8f-16936ecb3886 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.427126 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28da1178-9082-40ce-ba8f-16936ecb3886 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1224 microversion: 2.1 time: 0.075569 May 10 02:24:35.428727 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1726/3454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:35 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:35.439647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:35.440280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:35.450037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.450869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.452068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.452678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.483406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:35.484192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:35.493823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.494397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.495580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.496229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.663538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.671447 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b4f33e5-951c-4c54-aa66-86f5f366525f tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1475 microversion: 2.1 time: 0.236075 May 10 02:24:35.681478 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1729/3455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:35 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:35.695787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.705794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.710842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.713072 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a9f65edc-be94-43e7-9096-39332d6ddf95 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1557 microversion: 2.21 time: 0.234740 May 10 02:24:35.713072 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1727/3456] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:35 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1557 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:35.822351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:35.823635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:35.831498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.832567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.833444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:35.833899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:35.977414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:35.986097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cde76a5d-c6cf-47ba-82d9-74394ed8a6b4 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1506 microversion: 2.1 time: 0.166904 May 10 02:24:35.987039 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1730/3457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:35 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:36.155099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:36.155882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:36.163015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.163616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.164501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.165070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.321528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:36.331411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:36.332622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:36.333756 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-038a1230-f07f-4b3b-be59-0ee51ef87548 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.182801 May 10 02:24:36.334672 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1728/3458] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:36 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:36.447707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:36.448471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:36.460094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.461308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.462132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.462602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.569478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:36.583134 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02b2073f-d1aa-4594-a11e-d382ef0c6973 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1284 microversion: 2.1 time: 0.138678 May 10 02:24:36.587439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1731/3459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:36 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:36.689219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:36.689840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:36.696230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.696681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.697449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.697889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.729708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:36.730329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:36.737578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.738031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:36.739586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:36.740219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:37.260114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:37.269058 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-81a5c344-1400-4383-bf07-6f0f9312127e tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1475 microversion: 2.1 time: 0.584130 May 10 02:24:37.269665 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1729/3460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:36 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:37.278566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:37.278566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:37.285678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:37.286551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:37.288419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:37.289171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:37.356963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:37.369158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:37.371043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51d89a609e06424f96d43fcc5b426e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3953e390e894d28860f382f55aae9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:37.372594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a15dcf1-2304-4041-ab84-4a65b900cc26 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 200 len: 1557 microversion: 2.21 time: 0.646688 May 10 02:24:37.373343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1732/3461] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:36 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 1557 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:37.391630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fbc5ff4f-ce46-4dc5-ac01-85bf50529075 req-d2f40d39-8262-4c32-b5c0-d1bc38844c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "name": "network-vif-plugged", "status": "completed", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:37.403320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fbc5ff4f-ce46-4dc5-ac01-85bf50529075 req-d2f40d39-8262-4c32-b5c0-d1bc38844c4f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:37.404003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fbc5ff4f-ce46-4dc5-ac01-85bf50529075 req-d2f40d39-8262-4c32-b5c0-d1bc38844c4f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:37.421462 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fbc5ff4f-ce46-4dc5-ac01-85bf50529075 req-d2f40d39-8262-4c32-b5c0-d1bc38844c4f service nova] Creating event network-vif-plugged:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:24:37.430344 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fbc5ff4f-ce46-4dc5-ac01-85bf50529075 req-d2f40d39-8262-4c32-b5c0-d1bc38844c4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042287 May 10 02:24:37.431329 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1733/3462] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:37.441472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:37.442792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:37.451179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:37.453158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:37.454248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:37.454822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.246995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:38.275026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:38.275692 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b56da4d3-f5f9-4415-86f1-e6e3bab3f37f tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1488 microversion: 2.1 time: 0.988568 May 10 02:24:38.276720 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1730/3463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:37 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1488 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:38.294267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a7c19789-6f29-4404-9d4a-1270000c58aa req-db1dcdfd-21ee-442b-ac64-3df330f98cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5", "name": "network-vif-deleted", "tag": "fe0633e8-3ab4-4082-bdc0-4974df03c2a6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:38.301429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:38.302958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:38.304357 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32838f72-c1b7-49dc-9035-e3d3c54227f1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.871576 May 10 02:24:38.305124 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1734/3464] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:37 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:38.311180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.312732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.317356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a7c19789-6f29-4404-9d4a-1270000c58aa req-db1dcdfd-21ee-442b-ac64-3df330f98cb1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.320329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.320526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a7c19789-6f29-4404-9d4a-1270000c58aa req-db1dcdfd-21ee-442b-ac64-3df330f98cb1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.321130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.322109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.322721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.339965 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a7c19789-6f29-4404-9d4a-1270000c58aa req-db1dcdfd-21ee-442b-ac64-3df330f98cb1 service nova] Creating event network-vif-deleted:fe0633e8-3ab4-4082-bdc0-4974df03c2a6 for instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 on n-h1-841089-2 May 10 02:24:38.347670 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a7c19789-6f29-4404-9d4a-1270000c58aa req-db1dcdfd-21ee-442b-ac64-3df330f98cb1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067149 May 10 02:24:38.354272 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1731/3465] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:38.361299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.362289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.370949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.372033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.373059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.373672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.505599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:38.516966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b7af950-233c-4ce7-b764-a41ab5b8b238 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1282 microversion: 2.1 time: 0.210525 May 10 02:24:38.518732 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1735/3466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:38 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:38.525910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.526711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.535708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.536430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.538327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.539837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.578021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:38.681756 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-036dd2c5-cee8-40bc-b997-7467212e03bf tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 204 len: 0 microversion: 2.1 time: 0.161475 May 10 02:24:38.685622 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1736/3467] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:38 2022] DELETE /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:38.695026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.696604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.704028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.704660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.705460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.705953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.719794 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] HTTP exception thrown: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Request method failure captured: May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 HTTP/1.1 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABieczMq7Wbdp3pWwrZvDfkOHtHPLuItU9AgW1L9dGrzPF_Myeq43auSlE4TYCuvne8uzkpPdMlp2pNdIldequ5lhXnKyk3KsCTguILV9V8x203l0OT_QBVXMAuSq69z8HrlJ6Zg71XTyVs2c7II-QRxDbkpzfliCIqtAXcovVx_CLdFbM May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.21 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: d3953e390e894d28860f382f55aae9e1 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3953e390e894d28860f382f55aae9e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: d3953e390e894d28860f382f55aae9e1 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-InstanceActionsV221TestJSON-396828457-project May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 51d89a609e06424f96d43fcc5b426e1a May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-InstanceActionsV221TestJSON-396828457-project May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5'} May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.721472 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Returning 404 to user: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88de2754-2c0e-4f43-b1ce-c21c02be18a6 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 404 len: 111 microversion: 2.21 time: 0.038790 May 10 02:24:38.726306 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1737/3468] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:38 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:24:38.728165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68386da2-9f1e-48a7-8f76-02ff64ca52d2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d36247c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.754994 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-68386da2-9f1e-48a7-8f76-02ff64ca52d2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Image not found. May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68386da2-9f1e-48a7-8f76-02ff64ca52d2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a HTTP/1.1 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: exception: Image not found. May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'fe256358-7924-4cc0-a514-2a83e8f1da1a'} May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fe256358-7924-4cc0-a514-2a83e8f1da1a to delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe256358-7924-4cc0-a514-2a83e8f1da1a could not be found. May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.757065 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68386da2-9f1e-48a7-8f76-02ff64ca52d2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Image not found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-68386da2-9f1e-48a7-8f76-02ff64ca52d2 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a" status: 404 len: 62 microversion: 2.1 time: 0.034959 May 10 02:24:38.764015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1738/3469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:38 2022] DELETE /compute/v2.1/images/fe256358-7924-4cc0-a514-2a83e8f1da1a => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:24:38.768697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '.version_select at 0x7f3d362bda60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.769587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.778260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.778946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.779794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.780242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.857978 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7ab7f6a-9c69-4442-968a-0c5fe0c0ef3e tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.096458 May 10 02:24:38.858566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1739/3470] 10.222.0.52 () {60 vars in 1336 bytes} [Tue May 10 02:24:38 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5/os-instance-actions => generated 611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:24:38.872073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.873077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.873751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:38.879635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.880099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.881070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.882019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.882658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abf074cd-0002-4eab-840e-bec99fba3aee tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1475 microversion: 2.1 time: 0.526747 May 10 02:24:38.883468 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1732/3471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:38 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:38.898051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.898563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.904603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.905253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.906225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.907396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.912466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:38.923787 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] HTTP exception thrown: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Request method failure captured: May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 HTTP/1.1 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieczMq7Wbdp3pWwrZvDfkOHtHPLuItU9AgW1L9dGrzPF_Myeq43auSlE4TYCuvne8uzkpPdMlp2pNdIldequ5lhXnKyk3KsCTguILV9V8x203l0OT_QBVXMAuSq69z8HrlJ6Zg71XTyVs2c7II-QRxDbkpzfliCIqtAXcovVx_CLdFbM May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.21 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d3953e390e894d28860f382f55aae9e1 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3953e390e894d28860f382f55aae9e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d3953e390e894d28860f382f55aae9e1 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-InstanceActionsV221TestJSON-396828457-project May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 51d89a609e06424f96d43fcc5b426e1a May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-InstanceActionsV221TestJSON-396828457-project May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5'} May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:38.925870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.930176 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.932400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Returning 404 to user: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:38.933771 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5fa8ee2d-dc19-4be4-b3f7-02a53644b207 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 404 len: 111 microversion: 2.21 time: 0.039498 May 10 02:24:38.934434 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1733/3472] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:24:38 2022] DELETE /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:24:38.942606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.943557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] [instance: e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.950779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.951295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.953043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.953629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:38.971451 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] HTTP exception thrown: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Request method failure captured: May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 HTTP/1.1 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieczMq7Wbdp3pWwrZvDfkOHtHPLuItU9AgW1L9dGrzPF_Myeq43auSlE4TYCuvne8uzkpPdMlp2pNdIldequ5lhXnKyk3KsCTguILV9V8x203l0OT_QBVXMAuSq69z8HrlJ6Zg71XTyVs2c7II-QRxDbkpzfliCIqtAXcovVx_CLdFbM May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.21 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d3953e390e894d28860f382f55aae9e1 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3953e390e894d28860f382f55aae9e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3953e390e894d28860f382f55aae9e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d3953e390e894d28860f382f55aae9e1 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-396828457 May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-InstanceActionsV221TestJSON-396828457-project May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 51d89a609e06424f96d43fcc5b426e1a May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-InstanceActionsV221TestJSON-396828457-project May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5'} May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.973026 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] Returning 404 to user: Instance e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8b7c7f7-5212-46c4-9246-78442ed721a3 tempest-InstanceActionsV221TestJSON-396828457 tempest-InstanceActionsV221TestJSON-396828457-project] 10.222.0.52 "GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5" status: 404 len: 111 microversion: 2.21 time: 0.035869 May 10 02:24:38.976931 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1734/3473] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:38 2022] GET /compute/v2.1/servers/e78c4bcd-ab1a-4695-abc8-dfb8e3f5ace5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 02:24:38.977616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.compute.api [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Instance is already in deleting state, ignoring this request May 10 02:24:38.978398 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f91b111-dd21-4cd6-92aa-4a37b937d05d tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 204 len: 0 microversion: 2.1 time: 0.118418 May 10 02:24:38.978759 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1740/3474] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:38 2022] DELETE /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:38.988115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:38.988984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:38.998360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:38.999236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.000001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.000795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.256574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4a1fb299-2260-41b2-a5af-571c53e73f44 req-77ae5c1f-7395-45a4-ad8f-1e5a61e47962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3614adc7-3fb7-40b5-a21b-19d2a5965cf4", "name": "network-vif-deleted", "tag": "eb921274-3ef4-4970-bd64-994ae32503ea"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:39.268496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4a1fb299-2260-41b2-a5af-571c53e73f44 req-77ae5c1f-7395-45a4-ad8f-1e5a61e47962 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.269918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4a1fb299-2260-41b2-a5af-571c53e73f44 req-77ae5c1f-7395-45a4-ad8f-1e5a61e47962 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.284899 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4a1fb299-2260-41b2-a5af-571c53e73f44 req-77ae5c1f-7395-45a4-ad8f-1e5a61e47962 service nova] Creating event network-vif-deleted:eb921274-3ef4-4970-bd64-994ae32503ea for instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 on n-h1-841089-2 May 10 02:24:39.292508 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4a1fb299-2260-41b2-a5af-571c53e73f44 req-77ae5c1f-7395-45a4-ad8f-1e5a61e47962 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039204 May 10 02:24:39.293407 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1741/3475] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:24:39.326845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:39.327614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:39.339747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.340136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.340922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.341366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.690873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:39.698997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-252aa16f-1b6f-49a9-aa85-2b6942612475 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1494 microversion: 2.1 time: 0.716373 May 10 02:24:39.711598 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1735/3476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:38 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1494 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:39.721432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:39.722640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:39.731575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.732733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.734392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.735046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.804564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:39.815464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:39.817004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:39.818184 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4064175d-a97f-4b8d-8043-e0711c5ff6e4 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1407 microversion: 2.20 time: 0.498235 May 10 02:24:39.819390 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1742/3477] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:39 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:24:39.900785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:39.901529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:39.908269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.908730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:39.909515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:39.910227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:40.036385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:40.044684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:40.052191 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9479e51-97ce-408a-913a-34277055009b tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1324 microversion: 2.1 time: 0.339268 May 10 02:24:40.055793 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-efb19724-d078-46eb-b6e7-9080aef3258b tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1433 microversion: 2.1 time: 0.159497 May 10 02:24:40.055996 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1736/3478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:39 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:40.056995 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1743/3479] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:39 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1433 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:40.676207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b78be354-c270-4121-9506-d5c7b20220a9 req-40aa87ae-146c-43e6-b18f-0876014e6736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2aa38e-ed27-4fe3-a454-db0ad5af02d4", "name": "network-vif-unplugged", "status": "completed", "tag": "69845f96-bc46-4f4d-8280-df4e1a739913"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:40.686026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b78be354-c270-4121-9506-d5c7b20220a9 req-40aa87ae-146c-43e6-b18f-0876014e6736 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:40.692455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b78be354-c270-4121-9506-d5c7b20220a9 req-40aa87ae-146c-43e6-b18f-0876014e6736 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:40.718863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:40.720114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:40.738540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:40.741379 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b78be354-c270-4121-9506-d5c7b20220a9 req-40aa87ae-146c-43e6-b18f-0876014e6736 service nova] Creating event network-vif-unplugged:69845f96-bc46-4f4d-8280-df4e1a739913 for instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 on n-h1-841089-2 May 10 02:24:40.755659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:40.757156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:40.757920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:40.775724 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b78be354-c270-4121-9506-d5c7b20220a9 req-40aa87ae-146c-43e6-b18f-0876014e6736 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099257 May 10 02:24:40.786782 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1737/3480] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:40.846082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:40.847311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:40.878270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:40.879640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:40.883199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:40.883808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.220513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:41.228230 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d306c05e-a93f-4ead-bc20-074e73b7306c tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1494 microversion: 2.1 time: 0.513259 May 10 02:24:41.238020 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1744/3481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:40 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1494 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:41.240358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:41.240981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:41.247491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:41.247979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.249085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:41.249988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.316983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:41.326770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:41.334090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:41.339091 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-667f916b-581f-47f5-abd6-e0b44e56ce32 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1599 microversion: 2.20 time: 0.504664 May 10 02:24:41.339708 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1738/3482] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:24:40 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1599 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:24:41.349949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:41.350782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:41.372238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:41.372698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.373483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:41.373926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.466816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:41.467291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.467751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lazy-loading 'fault' on Instance uuid 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:41.929189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:41.936049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-176bc57c-443d-4a5e-b05d-808614894132 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 200 len: 1309 microversion: 2.1 time: 0.589729 May 10 02:24:41.947368 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1739/3483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:41 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 1309 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:41.952986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-26c5e324-036f-4cf8-ac48-e121079364f1 req-82432d82-b147-43b9-848f-dd08cf4bab9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdbd3e7-471a-4d74-a8d9-ed0878906f69", "name": "network-vif-deleted", "tag": "f89a9543-6bb6-4959-9e21-247da8114beb"}, {"name": "network-changed", "server_uuid": "58580062-a086-419b-bd9e-24f992476b7c", "tag": "405cba44-391f-49dd-a7d0-114dd6a2c3e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:41.963894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-26c5e324-036f-4cf8-ac48-e121079364f1 req-82432d82-b147-43b9-848f-dd08cf4bab9d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:41.964708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-26c5e324-036f-4cf8-ac48-e121079364f1 req-82432d82-b147-43b9-848f-dd08cf4bab9d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:41.980290 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-26c5e324-036f-4cf8-ac48-e121079364f1 req-82432d82-b147-43b9-848f-dd08cf4bab9d service nova] Creating event network-vif-deleted:f89a9543-6bb6-4959-9e21-247da8114beb for instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 on n-h1-841089-2 May 10 02:24:41.981018 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-26c5e324-036f-4cf8-ac48-e121079364f1 req-82432d82-b147-43b9-848f-dd08cf4bab9d service nova] Creating event network-changed:405cba44-391f-49dd-a7d0-114dd6a2c3e3 for instance 58580062-a086-419b-bd9e-24f992476b7c on n-h2-841089-2 May 10 02:24:41.994188 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-26c5e324-036f-4cf8-ac48-e121079364f1 req-82432d82-b147-43b9-848f-dd08cf4bab9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043555 May 10 02:24:41.995255 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1740/3484] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:42.002203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:42.002896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:42.009860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:42.011298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:42.012326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:42.013246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:42.138096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:42.150248 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db44eeb5-b9ec-4d31-bcbe-8adb71855adb tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1324 microversion: 2.1 time: 0.913041 May 10 02:24:42.163762 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1745/3485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:41 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1324 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:42.183779 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2de5d683-5d10-4325-9d76-b7f3812ae36a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.186817 May 10 02:24:42.188101 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1741/3486] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:24:41 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:24:42.247340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:42.248687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:42.256067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:42.257562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:42.258855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:42.259869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:42.480143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81137d6fb1bc4f75a706134b0c13ce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0eb5a5004949188f761747944b8948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:42.494579 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98e1fcfb-507f-4da0-81e9-8c9f069e68c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 200 len: 1494 microversion: 2.1 time: 0.252273 May 10 02:24:42.508153 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1746/3487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:42 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:42.955491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:42.956778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 3614adc7-3fb7-40b5-a21b-19d2a5965cf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:42.964878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:42.965642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:42.966660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:42.967118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:42.985430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 could not be found. May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 HTTP/1.1 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 could not be found. May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3614adc7-3fb7-40b5-a21b-19d2a5965cf4'} May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 could not be found. May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 could not be found. May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:42.987319 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 could not be found. May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance 3614adc7-3fb7-40b5-a21b-19d2a5965cf4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8642f47e-3115-48ba-9edd-425c2717d0be tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4" status: 404 len: 111 microversion: 2.1 time: 0.039275 May 10 02:24:42.993131 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1742/3488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:42 2022] GET /compute/v2.1/servers/3614adc7-3fb7-40b5-a21b-19d2a5965cf4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:42.997983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:42.999147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: dfdbd3e7-471a-4d74-a8d9-ed0878906f69] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:43.009825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.010323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.011117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.011570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.026835 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 could not be found. May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 HTTP/1.1 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 could not be found. May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'dfdbd3e7-471a-4d74-a8d9-ed0878906f69'} May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 could not be found. May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 could not be found. May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.028595 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 could not be found. May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance dfdbd3e7-471a-4d74-a8d9-ed0878906f69 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4616cb05-aa1c-4f7f-9f22-0150a9f56f1c tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69" status: 404 len: 111 microversion: 2.1 time: 0.036164 May 10 02:24:43.036470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1747/3489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:42 2022] GET /compute/v2.1/servers/dfdbd3e7-471a-4d74-a8d9-ed0878906f69 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:43.042560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb711ca9-f1e5-40e6-8282-ebdb71c975fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.077930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb711ca9-f1e5-40e6-8282-ebdb71c975fb tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/3f5c0835-6a51-4402-b3db-7c7efc8b0e8b" status: 204 len: 0 microversion: 2.1 time: 0.039312 May 10 02:24:43.082042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1743/3490] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:24:43 2022] DELETE /compute/v2.1/os-server-groups/3f5c0835-6a51-4402-b3db-7c7efc8b0e8b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:43.087276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.087975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:43.094667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.095175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.095972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.096424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.129566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:43.170810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.179967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:43.197147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.206627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.208963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.210866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.289632 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-882ce771-21cd-4545-8e7f-86d58c5858ef tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 204 len: 0 microversion: 2.1 time: 0.206012 May 10 02:24:43.290214 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1748/3491] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:43 2022] DELETE /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:43.302635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.304663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:43.315246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.315982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.317079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.317781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.790633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:43.799419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:43.804303 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a84b344f-394b-4916-935a-b22465a674e7 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1324 microversion: 2.1 time: 0.638974 May 10 02:24:43.805560 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1744/3492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:43 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1324 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:43.808560 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-120df1ee-2b5e-4c30-a609-23394b5fa7d6 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1473 microversion: 2.1 time: 0.512147 May 10 02:24:43.811643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.813238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1749/3493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:43 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:43.824243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: ba2aa38e-ed27-4fe3-a454-db0ad5af02d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:43.831917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.832659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.834685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.835328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.855292 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 could not be found. May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 HTTP/1.1 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 could not be found. May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ba2aa38e-ed27-4fe3-a454-db0ad5af02d4'} May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 could not be found. May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 could not be found. May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.857935 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.863114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:43.863114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:43.863114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:43.863114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:43.863114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 could not be found. May 10 02:24:43.863114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.865391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:43.866725 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ea3c5bc0-a7b9-4eb9-9a9a-53566fb79821 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4" status: 404 len: 111 microversion: 2.1 time: 0.059796 May 10 02:24:43.867854 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1745/3494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:43 2022] GET /compute/v2.1/servers/ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:43.873669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7b1f9b6c-665e-48c6-a55a-80dbf7f2e6cb req-7f22a227-d247-4ff9-b60b-b890ba870d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:43.886569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7b1f9b6c-665e-48c6-a55a-80dbf7f2e6cb req-7f22a227-d247-4ff9-b60b-b890ba870d97 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:43.887380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7b1f9b6c-665e-48c6-a55a-80dbf7f2e6cb req-7f22a227-d247-4ff9-b60b-b890ba870d97 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:43.906187 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7b1f9b6c-665e-48c6-a55a-80dbf7f2e6cb req-7f22a227-d247-4ff9-b60b-b890ba870d97 service nova] Creating event network-changed:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:24:43.919373 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7b1f9b6c-665e-48c6-a55a-80dbf7f2e6cb req-7f22a227-d247-4ff9-b60b-b890ba870d97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050001 May 10 02:24:43.923259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1746/3495] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:43.937197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14b14ea8-c9b4-4caa-8003-6274c9bb8a52 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d37007280>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.970111 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-14b14ea8-c9b4-4caa-8003-6274c9bb8a52 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Image not found. May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14b14ea8-c9b4-4caa-8003-6274c9bb8a52 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 HTTP/1.1 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3c732d57-e091-4848-a5c2-6cd99782d139'} May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c732d57-e091-4848-a5c2-6cd99782d139 to delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c732d57-e091-4848-a5c2-6cd99782d139 could not be found. May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.972820 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:24:43.977608 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:43.980854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14b14ea8-c9b4-4caa-8003-6274c9bb8a52 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:43.981923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-14b14ea8-c9b4-4caa-8003-6274c9bb8a52 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139" status: 404 len: 62 microversion: 2.1 time: 0.057285 May 10 02:24:43.982694 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1747/3496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:43 2022] DELETE /compute/v2.1/images/3c732d57-e091-4848-a5c2-6cd99782d139 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:24:43.995630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:43.997645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.017099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.017674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.018577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.020484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.058489 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 HTTP/1.1 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '64bf23ff-a012-485c-a83a-3b8e2246db23'} May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:44.060119 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5f85148-0c95-4798-9959-7360e5f276c1 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 404 len: 111 microversion: 2.1 time: 0.071281 May 10 02:24:44.070745 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1748/3497] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:43 2022] DELETE /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:44.075353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-27ecfd6c-e34d-443b-863d-976aab969427 req-a42a9de9-e7d8-4dcb-95d6-bcaaf81d4107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2aa38e-ed27-4fe3-a454-db0ad5af02d4", "name": "network-vif-deleted", "tag": "69845f96-bc46-4f4d-8280-df4e1a739913"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:44.084174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-27ecfd6c-e34d-443b-863d-976aab969427 req-a42a9de9-e7d8-4dcb-95d6-bcaaf81d4107 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.084633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-27ecfd6c-e34d-443b-863d-976aab969427 req-a42a9de9-e7d8-4dcb-95d6-bcaaf81d4107 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.099851 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-27ecfd6c-e34d-443b-863d-976aab969427 req-a42a9de9-e7d8-4dcb-95d6-bcaaf81d4107 service nova] Creating event network-vif-deleted:69845f96-bc46-4f4d-8280-df4e1a739913 for instance ba2aa38e-ed27-4fe3-a454-db0ad5af02d4 on n-h1-841089-2 May 10 02:24:44.105204 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-27ecfd6c-e34d-443b-863d-976aab969427 req-a42a9de9-e7d8-4dcb-95d6-bcaaf81d4107 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 May 10 02:24:44.105875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1749/3498] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:44.113331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.115878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 64bf23ff-a012-485c-a83a-3b8e2246db23] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.126672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.131215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.132338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.133088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.139502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2106028640", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "1a87c668-4748-468b-9595-6a8acd78a480"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:44.208584 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 HTTP/1.1 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '64bf23ff-a012-485c-a83a-3b8e2246db23'} May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.215788 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.224504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance 64bf23ff-a012-485c-a83a-3b8e2246db23 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.225488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54c7a3d9-5da6-42fc-8a07-5caeca70bf89 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23" status: 404 len: 111 microversion: 2.1 time: 0.112211 May 10 02:24:44.225488 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1750/3499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:44 2022] GET /compute/v2.1/servers/64bf23ff-a012-485c-a83a-3b8e2246db23 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:44.233944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7559d424-36ef-4d18-adc0-a57867240b69 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d3712c4c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.251314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] validate_networks() for [('1a87c668-4748-468b-9595-6a8acd78a480', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:24:44.276853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7559d424-36ef-4d18-adc0-a57867240b69 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Image not found. May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7559d424-36ef-4d18-adc0-a57867240b69 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd HTTP/1.1 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '07225b20-7b21-4a24-83aa-eee5231cbacd'} May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 07225b20-7b21-4a24-83aa-eee5231cbacd to delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07225b20-7b21-4a24-83aa-eee5231cbacd could not be found. May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.283153 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:24:44.288276 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.294253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7559d424-36ef-4d18-adc0-a57867240b69 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.295558 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7559d424-36ef-4d18-adc0-a57867240b69 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd" status: 404 len: 62 microversion: 2.1 time: 0.065661 May 10 02:24:44.296269 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1751/3500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:44 2022] DELETE /compute/v2.1/images/07225b20-7b21-4a24-83aa-eee5231cbacd => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 02:24:44.310453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.311390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.321575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.323129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.324333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.325256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.346972 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f HTTP/1.1 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5d4054a3-0198-45f3-8869-b8f39181090f'} May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:44.349013 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.354142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.357208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.359567 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7aab9b7b-6a91-438f-94e9-fb07edfd36fc tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 404 len: 111 microversion: 2.1 time: 0.058211 May 10 02:24:44.361197 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1752/3501] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:44 2022] DELETE /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:44.372870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.374087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: 5d4054a3-0198-45f3-8869-b8f39181090f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.380110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.380732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.381702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.382310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.399811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f HTTP/1.1 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5d4054a3-0198-45f3-8869-b8f39181090f'} May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.401516 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance 5d4054a3-0198-45f3-8869-b8f39181090f could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d80f7d75-721e-45d5-b867-f937f9ef52a5 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f" status: 404 len: 111 microversion: 2.1 time: 0.037905 May 10 02:24:44.412690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1753/3502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:44 2022] GET /compute/v2.1/servers/5d4054a3-0198-45f3-8869-b8f39181090f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:44.415212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4551ff8-8b40-465b-9a7b-9c2af92cd5f9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '.version_select at 0x7f3d37133c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.435728 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c4551ff8-8b40-465b-9a7b-9c2af92cd5f9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Image not found. May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4551ff8-8b40-465b-9a7b-9c2af92cd5f9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c HTTP/1.1 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: exception: Image not found. May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c'} May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c to delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c could not be found. May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.437513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4551ff8-8b40-465b-9a7b-9c2af92cd5f9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Image not found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.442475 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4551ff8-8b40-465b-9a7b-9c2af92cd5f9 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c" status: 404 len: 62 microversion: 2.1 time: 0.030982 May 10 02:24:44.444479 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1754/3503] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:44 2022] DELETE /compute/v2.1/images/ca9f5231-0c19-41e5-8ce4-fd3e4f67a58c => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:24:44.449513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.450028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.458905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.459609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.460742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.461351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.487684 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 HTTP/1.1 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd59b3116-5ef4-4ade-8cb5-ef09f7266e62'} May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:44.489267 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.493856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.499955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.501417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1bf3e5d4-2b76-4dcb-8b64-47f05d48fc02 tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 404 len: 111 microversion: 2.1 time: 0.055662 May 10 02:24:44.503273 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1755/3504] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:44 2022] DELETE /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:44.512638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.514212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] [instance: d59b3116-5ef4-4ade-8cb5-ef09f7266e62] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.526269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.527990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.533042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.533819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.565801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] HTTP exception thrown: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Request method failure captured: May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 HTTP/1.1 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwJ6-RGNiKKgrlO04XZryPCVB_EdkboP-O3MIM3iGzwyrxiOE9o85X4XVL0iira6o_irHmkz_Bw1mcqVW2C_T1D_0_iIy4tWrm24e7B1T068pJnfFmPEV78Pq_m9j8R_GyCyFNUqbxnMF6zigu2SMKyNE_kWC_qK1FmWjzf4qbMCyU May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db0eb5a5004949188f761747944b8948", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db0eb5a5004949188f761747944b8948"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db0eb5a5004949188f761747944b8948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: db0eb5a5004949188f761747944b8948 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesTestJSON-2123032056 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 81137d6fb1bc4f75a706134b0c13ce63 May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesTestJSON-2123032056-project May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd59b3116-5ef4-4ade-8cb5-ef09f7266e62'} May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.567739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:44.571595 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:44.571595 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:44.571595 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:44.571595 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:44.571595 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. May 10 02:24:44.571595 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:44.573642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] Returning 404 to user: Instance d59b3116-5ef4-4ade-8cb5-ef09f7266e62 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:44.574774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d56c0f87-a795-4fdc-8b74-9e2b498d46bd tempest-ImagesTestJSON-2123032056 tempest-ImagesTestJSON-2123032056-project] 10.222.0.52 "GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62" status: 404 len: 111 microversion: 2.1 time: 0.068157 May 10 02:24:44.576042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1756/3505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:44 2022] GET /compute/v2.1/servers/d59b3116-5ef4-4ade-8cb5-ef09f7266e62 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:44.822751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:44.823428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:44.835412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.837318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:44.839735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:44.840969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:45.384036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:24:45.384568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:24:45.384944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:24:45.385365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:24:45.385787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:24:45.398590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:45.399385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:45.400212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:45.400664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:45.425911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Getting quotas for project b9e110cb87094716ad23d59390e00d32. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:45.431704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Getting quotas for user 7c897122b78a40ae9482db6d80b11153 and project b9e110cb87094716ad23d59390e00d32. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:45.445184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:24:45.449400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:24:45.454503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:45.461905 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f6c325d6-05db-48cd-9b96-3563b648a308 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1324 microversion: 2.1 time: 0.643881 May 10 02:24:45.471228 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1757/3506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:44 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1324 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:45.477501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:45.478641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:45.487504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:45.488284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:45.490234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:45.490961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:45.553371 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f194b64-e618-4850-a44e-61ce2cc3c4ff tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738524 May 10 02:24:45.554816 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1750/3507] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:24:45.567791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-973a0521-7d92-4191-9773-66008e1b17b7 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:45.568876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-973a0521-7d92-4191-9773-66008e1b17b7 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:45.733172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-973a0521-7d92-4191-9773-66008e1b17b7 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:45.742415 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-973a0521-7d92-4191-9773-66008e1b17b7 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1225 microversion: 2.1 time: 0.181659 May 10 02:24:45.756625 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1751/3508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:45 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:45.793503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-cd4d72b4-3150-4da0-808e-a7f06a9e05e5 req-508c127b-59b8-4e13-b9fc-419b500dd9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58580062-a086-419b-bd9e-24f992476b7c", "name": "network-vif-plugged", "status": "completed", "tag": "405cba44-391f-49dd-a7d0-114dd6a2c3e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:45.805294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cd4d72b4-3150-4da0-808e-a7f06a9e05e5 req-508c127b-59b8-4e13-b9fc-419b500dd9f8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:45.805745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cd4d72b4-3150-4da0-808e-a7f06a9e05e5 req-508c127b-59b8-4e13-b9fc-419b500dd9f8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:45.826737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-cd4d72b4-3150-4da0-808e-a7f06a9e05e5 req-508c127b-59b8-4e13-b9fc-419b500dd9f8 service nova] Creating event network-vif-plugged:405cba44-391f-49dd-a7d0-114dd6a2c3e3 for instance 58580062-a086-419b-bd9e-24f992476b7c on n-h2-841089-2 May 10 02:24:45.838325 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-cd4d72b4-3150-4da0-808e-a7f06a9e05e5 req-508c127b-59b8-4e13-b9fc-419b500dd9f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049656 May 10 02:24:45.839760 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1752/3509] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:46.362948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005c692ff37c43ddbe9aeb62da362006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac70d73d5cf84464be5b7a3aeef01093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:46.376081 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5b93a65-7264-4ba9-9587-92762b58341a tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 200 len: 1473 microversion: 2.1 time: 0.900980 May 10 02:24:46.377091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1758/3510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:45 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 1473 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:46.479410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:46.482005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:46.490785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.491810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.492887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.493526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.744377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:46.752370 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb46cb39-6ecd-44b6-93e5-8a78c535c861 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1324 microversion: 2.1 time: 0.277607 May 10 02:24:46.755408 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1753/3511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:46 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:46.769695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-93794dc2-a722-445b-ac38-d364b424b8ae req-ac1fac56-9b59-4b3d-8219-15d00a99003e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f391397-d509-4342-b1fc-5864a0c80873", "name": "network-vif-deleted", "tag": "441629e8-5491-45ab-9aa8-5227678dd069"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:46.781046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-93794dc2-a722-445b-ac38-d364b424b8ae req-ac1fac56-9b59-4b3d-8219-15d00a99003e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.781538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-93794dc2-a722-445b-ac38-d364b424b8ae req-ac1fac56-9b59-4b3d-8219-15d00a99003e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.805282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Calling method '.version_select at 0x7f3d370140d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:46.806189 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:24:46.806189 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:24:46.807413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.807871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.812563 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-93794dc2-a722-445b-ac38-d364b424b8ae req-ac1fac56-9b59-4b3d-8219-15d00a99003e service nova] Creating event network-vif-deleted:441629e8-5491-45ab-9aa8-5227678dd069 for instance 4f391397-d509-4342-b1fc-5864a0c80873 on n-h1-841089-2 May 10 02:24:46.831662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-93794dc2-a722-445b-ac38-d364b424b8ae req-ac1fac56-9b59-4b3d-8219-15d00a99003e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074653 May 10 02:24:46.833209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1754/3512] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:46.845641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.846155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.852219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:46.854713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:46.861896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.862614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.864766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.865231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:46.865649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.865778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:46.873883 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c97f773-4964-4eab-b9bb-606fbd117a66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1935304952-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.321046 May 10 02:24:46.874861 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1759/3513] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:24:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:47.036648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:47.058542 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a9948d88-d2c7-4f86-9c97-5fd9298d21b9 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1285 microversion: 2.1 time: 0.213952 May 10 02:24:47.070668 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1755/3514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:46 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:47.394984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:47.395737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] [instance: 4f391397-d509-4342-b1fc-5864a0c80873] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:47.404118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:47.404572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:47.405512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:47.406327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:47.423802 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] HTTP exception thrown: Instance 4f391397-d509-4342-b1fc-5864a0c80873 could not be found. May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Request method failure captured: May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 HTTP/1.1 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecwMlbacf9iHCWxguCEggvyDWFDC453PSKB6GcW4DWB1M41844nC67hEjmtL5aaMoSMBJWCJlVdB56gH0FCnAWFzt84zQhREKKSd9gA1zszZ5Qr6DcZTDuzcBXPMrbCbQecbwYdjNy7vjiseKFqwlnI9yqszIu3dCoY8Hl2701ieoII May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac70d73d5cf84464be5b7a3aeef01093", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac70d73d5cf84464be5b7a3aeef01093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ac70d73d5cf84464be5b7a3aeef01093 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-123590363 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 005c692ff37c43ddbe9aeb62da362006 May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersOnMultiNodesTest-123590363-project May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4f391397-d509-4342-b1fc-5864a0c80873 could not be found. May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4f391397-d509-4342-b1fc-5864a0c80873'} May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f391397-d509-4342-b1fc-5864a0c80873 could not be found. May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f391397-d509-4342-b1fc-5864a0c80873 could not be found. May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:47.426121 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f391397-d509-4342-b1fc-5864a0c80873 could not be found. May 10 02:24:47.430731 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:47.432597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] Returning 404 to user: Instance 4f391397-d509-4342-b1fc-5864a0c80873 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:47.433651 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2b186fef-ae3c-4ad2-9984-7fb856f74d19 tempest-ServersOnMultiNodesTest-123590363 tempest-ServersOnMultiNodesTest-123590363-project] 10.222.0.52 "GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873" status: 404 len: 111 microversion: 2.1 time: 0.043423 May 10 02:24:47.434232 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1760/3515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:47 2022] GET /compute/v2.1/servers/4f391397-d509-4342-b1fc-5864a0c80873 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:47.774425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:47.775629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:47.793804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:47.798007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:47.799751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:47.802111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:48.099793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:48.133673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44776524-8b17-4de3-adfe-87a8e5e287e1 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1521 microversion: 2.1 time: 0.352209 May 10 02:24:48.134572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1756/3516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:47 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:48.140138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.140769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:48.147880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:48.148586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:48.149854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:48.150819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:48.227174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8cea0d35-74ca-4404-8b01-d517eb19a3fe tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d37880d30>, body: {"keypair": {"name": "tempest-keypair-828776786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJxneCMBYbZN7d8TQTWRlPKhuD8uZD6BoRFaffa8e56Mn25+LHvx3QZyRDqdy9G2ET1P7wY62/nw7+FZs6nDmCU3iTxMtis2C8Fb9uB/gEqYOBs6aO/J+hSe5dMuMY8tQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.243155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-8cea0d35-74ca-4404-8b01-d517eb19a3fe tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:48.254551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-8cea0d35-74ca-4404-8b01-d517eb19a3fe tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:48.305397 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8cea0d35-74ca-4404-8b01-d517eb19a3fe tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.261130 May 10 02:24:48.312698 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1761/3517] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 268 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 10 02:24:48.319119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8471da3b-11be-4e8d-acd1-558a91de4a41 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d37642a60>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.329907 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8471da3b-11be-4e8d-acd1-558a91de4a41 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-828776786" status: 200 len: 512 microversion: 2.2 time: 0.015261 May 10 02:24:48.337093 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1762/3518] 10.222.0.52 () {60 vars in 1254 bytes} [Tue May 10 02:24:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-828776786 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:48.342587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6d36eb3-8642-4a22-9492-3c610a3bbe4d tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-666280042", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6d36eb3-8642-4a22-9492-3c610a3bbe4d tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 242 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-666280042", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-666280042', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '05788ec2-f81e-45cc-9901-7a75e3caacbb'}]}}} May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:24:48.346658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.351136 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.353429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6d36eb3-8642-4a22-9492-3c610a3bbe4d tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.354454 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c6d36eb3-8642-4a22-9492-3c610a3bbe4d tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016284 May 10 02:24:48.355515 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1763/3519] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:24:48.364548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4452262b-e00e-4fc0-a0bd-461ac040887c tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d3746d430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.383530 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4452262b-e00e-4fc0-a0bd-461ac040887c tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828776786" status: 204 len: 0 microversion: 2.2 time: 0.026784 May 10 02:24:48.384371 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1764/3520] 10.222.0.52 () {60 vars in 1257 bytes} [Tue May 10 02:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828776786 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:48.392992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07b1e2ba-36f0-4b0b-9484-e7ab4b704fd0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.393507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07b1e2ba-36f0-4b0b-9484-e7ab4b704fd0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 8062f662-c4f5-4fcc-aa6f-455338d76d0f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:48.399997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-07b1e2ba-36f0-4b0b-9484-e7ab4b704fd0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] HTTP exception thrown: Instance 8062f662-c4f5-4fcc-aa6f-455338d76d0f could not be found. May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07b1e2ba-36f0-4b0b-9484-e7ab4b704fd0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/8062f662-c4f5-4fcc-aa6f-455338d76d0f/metadata HTTP/1.1 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 8062f662-c4f5-4fcc-aa6f-455338d76d0f could not be found. May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '8062f662-c4f5-4fcc-aa6f-455338d76d0f'} May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8062f662-c4f5-4fcc-aa6f-455338d76d0f could not be found. May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8062f662-c4f5-4fcc-aa6f-455338d76d0f could not be found. May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.401965 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8062f662-c4f5-4fcc-aa6f-455338d76d0f could not be found. May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07b1e2ba-36f0-4b0b-9484-e7ab4b704fd0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 404 to user: Instance 8062f662-c4f5-4fcc-aa6f-455338d76d0f could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07b1e2ba-36f0-4b0b-9484-e7ab4b704fd0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/8062f662-c4f5-4fcc-aa6f-455338d76d0f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.018415 May 10 02:24:48.405928 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1765/3521] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:24:48 2022] GET /compute/v2.1/servers/8062f662-c4f5-4fcc-aa6f-455338d76d0f/metadata => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:48.416443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8fac263c-e897-4f11-a126-b13c405163db tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d3717f940>, body: {"keypair": {"name": "tempest-keypair-1298108688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1OUHSejZ0a0DIDTp3MXoSrdaloxqJ4q6AqIh2Dj9xCU/BofniuJqttOwEkTFFFBmHP/pLgTvmVKXVgopX0uIKGOelrNWWrLyPxUHXq/1A+ZzduiLbclFdHyGGd4BzYeA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.458844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-8fac263c-e897-4f11-a126-b13c405163db tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:48.464537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:48.466080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-8fac263c-e897-4f11-a126-b13c405163db tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:48.473217 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-777b6754-955e-49d4-894a-6c9c02e92192 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1325 microversion: 2.1 time: 0.336793 May 10 02:24:48.475706 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1757/3522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:48 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:48.498558 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8fac263c-e897-4f11-a126-b13c405163db tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.092737 May 10 02:24:48.506026 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1766/3523] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 10 02:24:48.510764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a2b8642-626c-47b7-b783-6a20984ff804 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d3627cee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.537826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-460ee23b-8008-43cb-a59b-9bc3dba87aae tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-92840513", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.539278 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9a2b8642-626c-47b7-b783-6a20984ff804 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298108688" status: 204 len: 0 microversion: 2.2 time: 0.032639 May 10 02:24:48.540060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1758/3524] 10.222.0.52 () {60 vars in 1260 bytes} [Tue May 10 02:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298108688 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-460ee23b-8008-43cb-a59b-9bc3dba87aae tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 497 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-92840513", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-92840513', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '05788ec2-f81e-45cc-9901-7a75e3caacbb'}]}}} May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:24:48.546240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-460ee23b-8008-43cb-a59b-9bc3dba87aae tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.550490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-460ee23b-8008-43cb-a59b-9bc3dba87aae tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.016078 May 10 02:24:48.555713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e561da87-6293-4873-a77c-98e4dbc727e5 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d362999d0>, body: {"keypair": {"name": "tempest-keypair-1225933781", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.557334 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1767/3525] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/servers => generated 687 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:24:48.569482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e561da87-6293-4873-a77c-98e4dbc727e5 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:48.575747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e561da87-6293-4873-a77c-98e4dbc727e5 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:48.601222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8c3397d-0c20-4d0b-9d10-660a00b812f0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1310603256", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8c3397d-0c20-4d0b-9d10-660a00b812f0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 500 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1310603256", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1310603256', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '05788ec2-f81e-45cc-9901-7a75e3caacbb'}]}}} May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:24:48.604328 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8c3397d-0c20-4d0b-9d10-660a00b812f0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8c3397d-0c20-4d0b-9d10-660a00b812f0 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012205 May 10 02:24:48.607719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1768/3526] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:24:48.616683 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e561da87-6293-4873-a77c-98e4dbc727e5 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.071464 May 10 02:24:48.618398 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1759/3527] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 10 02:24:48.632531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33e4f224-02bd-4aa4-91dd-8dbd4af22147 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d36e41790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.669811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eabd308d-f240-462f-94a4-a47b9bec6e3c tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1633324619", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.672122 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33e4f224-02bd-4aa4-91dd-8dbd4af22147 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225933781" status: 204 len: 0 microversion: 2.2 time: 0.047952 May 10 02:24:48.673805 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1769/3528] 10.222.0.52 () {60 vars in 1260 bytes} [Tue May 10 02:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225933781 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eabd308d-f240-462f-94a4-a47b9bec6e3c tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 754 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1633324619", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1633324619', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '05788ec2-f81e-45cc-9901-7a75e3caacbb'}]}}} May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:24:48.674014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:24:48.680754 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:24:48.683160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.683160 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:48.683160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eabd308d-f240-462f-94a4-a47b9bec6e3c tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.683160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eabd308d-f240-462f-94a4-a47b9bec6e3c tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010654 May 10 02:24:48.683160 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1760/3529] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 10 02:24:48.691769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fef1ba8f-7967-44c1-a8df-bd5332950124 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d37691310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-435677194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8UVPGE35m7+E4whgR7HIaR4K/WPhKt1yAyxs+tgdmW1x6R7JDSvyo7gS08RyHFLgWiwIzxGbMtCuTP5GnxzmkBJf5v5jNKUz1TQi5gwA8K5wbGZBDGhuUkVrZ/2yCqoQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.709340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fef1ba8f-7967-44c1-a8df-bd5332950124 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:48.716159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fef1ba8f-7967-44c1-a8df-bd5332950124 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:48.745640 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fef1ba8f-7967-44c1-a8df-bd5332950124 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.064770 May 10 02:24:48.746668 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1770/3530] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 10 02:24:48.759425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4ba838e-77dd-477c-a051-5dcb64422a46 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d363018b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1528228072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRxTnpYCqgA1ao9O3i4u0eEZ7fnmgjReRx/zeYodD9qPnFP8w531gS0w/kMAfRlGv+4+oFzDvisdBqYovOanCyA/fBY1HWkA992EjBvoSMMb+P4N3TG5qMbR0tsvSHw5g=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.777755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c4ba838e-77dd-477c-a051-5dcb64422a46 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:48.786208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c4ba838e-77dd-477c-a051-5dcb64422a46 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:48.805578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4632dbc-3356-455d-ba25-586784729df4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911451150", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4632dbc-3356-455d-ba25-586784729df4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 1266 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911451150", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "05788ec2-f81e-45cc-9901-7a75e3caacbb"}]}} May 10 02:24:48.809942 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1911451150', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '05788ec2-f81e-45cc-9901-7a75e3caacbb'}]}}} May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.812166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:24:48.813287 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:24:48.815034 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 10 02:24:48.815034 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.817068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4632dbc-3356-455d-ba25-586784729df4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.818779 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4632dbc-3356-455d-ba25-586784729df4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018026 May 10 02:24:48.819247 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1771/3531] 10.222.0.52 () {60 vars in 1147 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 10 02:24:48.828652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4ba838e-77dd-477c-a051-5dcb64422a46 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.072714 May 10 02:24:48.830767 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1761/3532] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 10 02:24:48.831439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9843c551-f3fa-40fa-922f-f56b7525dbbf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.832171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9843c551-f3fa-40fa-922f-f56b7525dbbf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 618518c2-e666-4f1c-8578-92396095b4a1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:48.840024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9843c551-f3fa-40fa-922f-f56b7525dbbf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] HTTP exception thrown: Instance 618518c2-e666-4f1c-8578-92396095b4a1 could not be found. May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9843c551-f3fa-40fa-922f-f56b7525dbbf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/618518c2-e666-4f1c-8578-92396095b4a1/metadata/test2 HTTP/1.1 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 618518c2-e666-4f1c-8578-92396095b4a1 could not be found. May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '618518c2-e666-4f1c-8578-92396095b4a1', 'id': 'test2'} May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618518c2-e666-4f1c-8578-92396095b4a1 could not be found. May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618518c2-e666-4f1c-8578-92396095b4a1 could not be found. May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:48.841765 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:48.846231 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:48.846231 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:48.846231 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618518c2-e666-4f1c-8578-92396095b4a1 could not be found. May 10 02:24:48.846231 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:48.846231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9843c551-f3fa-40fa-922f-f56b7525dbbf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 404 to user: Instance 618518c2-e666-4f1c-8578-92396095b4a1 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:48.846571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bb54a51-8429-42b1-bb4c-91aaaa949d7e tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d362bd670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1126407596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC0nYW5aHDNz00b3KcTU3vjY7/VuWxMAhsdyF2uTgB1QqhcHwWyx1l/APaQ8HY6NVGBO5GcdykY1uG1ue5cTLRdWJoe62yKgBr9MqOYJnLUbMfATY+eG5l9EO6TSN8EsQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:48.846671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9843c551-f3fa-40fa-922f-f56b7525dbbf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/618518c2-e666-4f1c-8578-92396095b4a1/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016558 May 10 02:24:48.846671 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1772/3533] 10.222.0.52 () {58 vars in 1280 bytes} [Tue May 10 02:24:48 2022] GET /compute/v2.1/servers/618518c2-e666-4f1c-8578-92396095b4a1/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:48.861218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.862211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:48.868807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3bb54a51-8429-42b1-bb4c-91aaaa949d7e tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:48.870401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:48.871127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:48.872195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:48.873355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:48.874115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3bb54a51-8429-42b1-bb4c-91aaaa949d7e tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:48.903749 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3bb54a51-8429-42b1-bb4c-91aaaa949d7e tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.064420 May 10 02:24:48.904857 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1762/3534] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:48 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 10 02:24:48.905981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:48.914720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c926bd6-e1c5-48d3-81b9-10a8240d025a tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d363a59d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.921582 n-d-841089-2 devstack@n-api.service[118716]: WARNING oslo_db.sqlalchemy.utils [None req-1c926bd6-e1c5-48d3-81b9-10a8240d025a tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Unique keys not in sort_keys. The sorting order may be unstable. May 10 02:24:48.932439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c926bd6-e1c5-48d3-81b9-10a8240d025a tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.021533 May 10 02:24:48.933375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1763/3535] 10.222.0.52 () {60 vars in 1176 bytes} [Tue May 10 02:24:48 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:48.944506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bac7a438-f835-4470-bcf7-1c8b39b138d4 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d3633d430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:48.977132 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bac7a438-f835-4470-bcf7-1c8b39b138d4 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1126407596" status: 204 len: 0 microversion: 2.2 time: 0.035928 May 10 02:24:48.978206 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1764/3536] 10.222.0.52 () {60 vars in 1320 bytes} [Tue May 10 02:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1126407596 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:48.988143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6220b9f4-e2dd-43fc-90be-49c02f4d4d3c tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d36328160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.012461 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6220b9f4-e2dd-43fc-90be-49c02f4d4d3c tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1528228072" status: 204 len: 0 microversion: 2.2 time: 0.029937 May 10 02:24:49.013591 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1765/3537] 10.222.0.52 () {60 vars in 1320 bytes} [Tue May 10 02:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1528228072 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:49.039625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-377f7c8f-4ff8-4862-8e5b-9642bcd14de1 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d363a5ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.047620 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-181537e4-adc3-4d85-a360-53d4f9fb4645 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 204 len: 0 microversion: 2.1 time: 0.190415 May 10 02:24:49.048498 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1773/3538] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:48 2022] DELETE /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:49.064023 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-377f7c8f-4ff8-4862-8e5b-9642bcd14de1 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-435677194" status: 204 len: 0 microversion: 2.2 time: 0.035695 May 10 02:24:49.064608 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1766/3539] 10.222.0.52 () {60 vars in 1317 bytes} [Tue May 10 02:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-435677194 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:49.076397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-45be759a-bfb3-4550-9da1-9762f59cf668 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d363f68b0>, body: {"keypair": {"name": "tempest-keypair-1471321153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoSPErgoteVrhFHnf6f28tsXXxT78gWacD1iAMvCRWEQ/fdjtWGvpquLzw3MPPuzcyaTSgK62IEIR7MCloiCvCM0BjY5G0tXx5hqVLf8yUd3kAom8Fch3AIRhia0JFERw=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:49.084241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.085057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:49.093279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-45be759a-bfb3-4550-9da1-9762f59cf668 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:49.098940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:49.100262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-45be759a-bfb3-4550-9da1-9762f59cf668 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:49.103019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:49.103885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:49.108108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:49.131803 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-45be759a-bfb3-4550-9da1-9762f59cf668 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.059396 May 10 02:24:49.135477 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1767/3540] 10.222.0.52 () {62 vars in 1198 bytes} [Tue May 10 02:24:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 10 02:24:49.145591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a54cff4-1ef9-4692-8c00-7497df1797bb tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d3645b820>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.160668 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a54cff4-1ef9-4692-8c00-7497df1797bb tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1471321153" status: 200 len: 513 microversion: 2.2 time: 0.019600 May 10 02:24:49.162181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1768/3541] 10.222.0.52 () {60 vars in 1257 bytes} [Tue May 10 02:24:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1471321153 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:24:49.173083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eab46758-cf5c-4df4-9c1a-956dee7b4376 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d363f6940>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.176837 n-d-841089-2 devstack@n-api.service[118716]: WARNING oslo_db.sqlalchemy.utils [None req-eab46758-cf5c-4df4-9c1a-956dee7b4376 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Unique keys not in sort_keys. The sorting order may be unstable. May 10 02:24:49.184719 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eab46758-cf5c-4df4-9c1a-956dee7b4376 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016254 May 10 02:24:49.185887 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1769/3542] 10.222.0.52 () {60 vars in 1176 bytes} [Tue May 10 02:24:49 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:24:49.198136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff63a4c5-b0ce-4a84-b5f9-c124b439b4f6 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d363a54c0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.233353 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff63a4c5-b0ce-4a84-b5f9-c124b439b4f6 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471321153" status: 204 len: 0 microversion: 2.2 time: 0.041432 May 10 02:24:49.233963 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1770/3543] 10.222.0.52 () {60 vars in 1260 bytes} [Tue May 10 02:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471321153 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:24:49.245571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Action: 'create', calling method: .version_select at 0x7f3d3796d0d0>, body: {"keypair": {"name": "tempest-keypair-327006858", "type": "x509"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:49.263624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:49.270187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:49.290207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.processutils [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpvcgkzcte/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpvcgkzcte/temp.key -subj /CN=67467f132e1146f8aecd1207378f7714 -extensions v3_req_client {{(pid=118716) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 10 02:24:49.305340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:49.318144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3298c67d-9e42-4990-a122-38a2c3a36caf tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1527 microversion: 2.1 time: 0.263569 May 10 02:24:49.332428 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1774/3544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:49 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1527 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:49.492243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:49.493419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:49.506565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:49.507098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:49.508272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:49.509153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:49.829570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:49.843774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f6430d3e-932d-4a7a-a933-cce393ad8e2a tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1325 microversion: 2.1 time: 0.351795 May 10 02:24:49.853154 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1775/3545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:49 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:49.863777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d3ebcaa1-f912-49e4-9cfa-0ac541e72c58 req-ea527c70-8862-42bf-9041-224986f599bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896f1725-a13e-4313-8353-470d893b8b30", "tag": "7076f477-ed9b-4c71-b7fa-059db2a4886d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:49.889541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d3ebcaa1-f912-49e4-9cfa-0ac541e72c58 req-ea527c70-8862-42bf-9041-224986f599bf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:49.892314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d3ebcaa1-f912-49e4-9cfa-0ac541e72c58 req-ea527c70-8862-42bf-9041-224986f599bf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:49.916647 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d3ebcaa1-f912-49e4-9cfa-0ac541e72c58 req-ea527c70-8862-42bf-9041-224986f599bf service nova] Creating event network-changed:7076f477-ed9b-4c71-b7fa-059db2a4886d for instance 896f1725-a13e-4313-8353-470d893b8b30 on n-h1-841089-2 May 10 02:24:49.925369 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d3ebcaa1-f912-49e4-9cfa-0ac541e72c58 req-ea527c70-8862-42bf-9041-224986f599bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070799 May 10 02:24:49.926369 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1776/3546] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:49.995721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.processutils [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpvcgkzcte/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpvcgkzcte/temp.key -subj /CN=67467f132e1146f8aecd1207378f7714 -extensions v3_req_client" returned: 0 in 0.705s {{(pid=118716) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 10 02:24:49.997652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.processutils [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpvcgkzcte/temp.key -password pass: {{(pid=118716) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 10 02:24:50.039528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.processutils [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpvcgkzcte/temp.key -password pass:" returned: 0 in 0.041s {{(pid=118716) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 10 02:24:50.092086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:24:50.098140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Getting quotas for user 67467f132e1146f8aecd1207378f7714 and project 028299594cfd4c2ea5e2bfc7ad58636f. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:24:50.119117 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b24200d-aac2-4511-80f8-671db68ee4ee tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.877702 May 10 02:24:50.120584 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1771/3547] 10.222.0.52 () {62 vars in 1197 bytes} [Tue May 10 02:24:49 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 881 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:50.131326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f807190-4c71-4ada-9340-d553ead5a29b tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d37880c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:50.140033 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f807190-4c71-4ada-9340-d553ead5a29b tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-327006858" status: 200 len: 1533 microversion: 2.2 time: 0.012897 May 10 02:24:50.141636 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1777/3548] 10.222.0.52 () {60 vars in 1254 bytes} [Tue May 10 02:24:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-327006858 => generated 1533 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:50.152857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6f7b7cf-f7e4-40e9-ad7b-cc0dc6cf4028 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d3633d5e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:50.156576 n-d-841089-2 devstack@n-api.service[118716]: WARNING oslo_db.sqlalchemy.utils [None req-c6f7b7cf-f7e4-40e9-ad7b-cc0dc6cf4028 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Unique keys not in sort_keys. The sorting order may be unstable. May 10 02:24:50.162643 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6f7b7cf-f7e4-40e9-ad7b-cc0dc6cf4028 tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.014707 May 10 02:24:50.163821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1772/3549] 10.222.0.52 () {60 vars in 1176 bytes} [Tue May 10 02:24:50 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:50.173256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34adca18-3bbe-4625-94ac-cb1743dee57e tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] Calling method '.version_select at 0x7f3d3712cc10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:50.195329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34adca18-3bbe-4625-94ac-cb1743dee57e tempest-KeyPairsV22TestJSON-1457002690 tempest-KeyPairsV22TestJSON-1457002690-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327006858" status: 204 len: 0 microversion: 2.2 time: 0.025876 May 10 02:24:50.196346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1778/3550] 10.222.0.52 () {60 vars in 1257 bytes} [Tue May 10 02:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327006858 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:50.337415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:50.339033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:50.352913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:50.361520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:50.365275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:50.365785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:50.776087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:50.788919 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9169816f-f100-4b9a-a16b-350c617202b4 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1527 microversion: 2.1 time: 0.455562 May 10 02:24:50.789894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1773/3551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:50 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1527 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:50.864094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:50.866518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:50.883407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:50.883407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:50.883407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:50.883407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:51.223738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:51.242508 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e1393f93-a8f2-4e15-9f2b-f37be4aba6f0 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1325 microversion: 2.1 time: 0.384306 May 10 02:24:51.245005 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1779/3552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:50 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:51.806098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:51.807978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:51.816239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:51.817075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:51.818342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:51.819151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:51.840618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:51.841475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:51.853179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:51.853643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:51.854446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:51.854897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:51.900088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:51.901112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:51.901988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lazy-loading 'fault' on Instance uuid 58580062-a086-419b-bd9e-24f992476b7c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:51.976071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lazy-loading 'services' on Instance uuid eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:24:52.023890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0eedcac64ee4401a7fc1e0ae14b55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1820a0611b744a2c9b9450fc9a43e219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:52.036955 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d3c836c-8966-4023-8e5b-ddfd03c4f7ba tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 200 len: 1314 microversion: 2.1 time: 0.235005 May 10 02:24:52.042739 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1774/3553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:51 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:52.062444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9bc11e5d-7013-45a8-9f22-9c9238850cb3 req-c456448a-71ed-45a6-bf28-55ddb271d465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58580062-a086-419b-bd9e-24f992476b7c", "name": "network-vif-deleted", "tag": "405cba44-391f-49dd-a7d0-114dd6a2c3e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:52.094061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9bc11e5d-7013-45a8-9f22-9c9238850cb3 req-c456448a-71ed-45a6-bf28-55ddb271d465 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:52.095006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9bc11e5d-7013-45a8-9f22-9c9238850cb3 req-c456448a-71ed-45a6-bf28-55ddb271d465 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:52.107054 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5371136f-bb1b-4404-b8b2-2cd875a2b064 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-volume_attachments/8ffd4412-cc24-41db-a1bd-b96e208109ab" status: 202 len: 0 microversion: 2.1 time: 0.271745 May 10 02:24:52.112921 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1780/3554] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:24:51 2022] DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-volume_attachments/8ffd4412-cc24-41db-a1bd-b96e208109ab => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:24:52.123130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9bc11e5d-7013-45a8-9f22-9c9238850cb3 req-c456448a-71ed-45a6-bf28-55ddb271d465 service nova] Creating event network-vif-deleted:405cba44-391f-49dd-a7d0-114dd6a2c3e3 for instance 58580062-a086-419b-bd9e-24f992476b7c on n-h2-841089-2 May 10 02:24:52.130097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9bc11e5d-7013-45a8-9f22-9c9238850cb3 req-c456448a-71ed-45a6-bf28-55ddb271d465 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081637 May 10 02:24:52.131421 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1775/3555] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:52.264207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:52.265250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:52.277615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:52.278455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:52.279928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:52.282301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:53.060158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:53.061506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] [instance: 58580062-a086-419b-bd9e-24f992476b7c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:53.069651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:53.070531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:53.071594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:53.072271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:53.088128 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] HTTP exception thrown: Instance 58580062-a086-419b-bd9e-24f992476b7c could not be found. May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Request method failure captured: May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c HTTP/1.1 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecziHrm_gRo7Q36X2hrWAuUXHO3LsstxtcD6fw-Oxayqw9-rWVHL1Nas-ZDiOKYwhxEbVa1ZktAoxVoxdZOcFv1TXycwixFs5sKM8_4k3AugpXFjrM6zvJXqnfUg5ZNuuI3uO6yqdu36LFMfvzX4Zu7NTUmbRG7_TKjrr_2MABQRXgk May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1820a0611b744a2c9b9450fc9a43e219", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1820a0611b744a2c9b9450fc9a43e219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1820a0611b744a2c9b9450fc9a43e219 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-898614559 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: d0eedcac64ee4401a7fc1e0ae14b55d3 May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-898614559-project May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 58580062-a086-419b-bd9e-24f992476b7c could not be found. May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '58580062-a086-419b-bd9e-24f992476b7c'} May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58580062-a086-419b-bd9e-24f992476b7c could not be found. May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58580062-a086-419b-bd9e-24f992476b7c could not be found. May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:53.090343 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58580062-a086-419b-bd9e-24f992476b7c could not be found. May 10 02:24:53.094761 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:24:53.097868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] Returning 404 to user: Instance 58580062-a086-419b-bd9e-24f992476b7c could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:53.099311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c301dc0-1728-41c2-a194-00f65b2f3c25 tempest-ServerMetadataNegativeTestJSON-898614559 tempest-ServerMetadataNegativeTestJSON-898614559-project] 10.222.0.52 "GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c" status: 404 len: 111 microversion: 2.1 time: 0.044411 May 10 02:24:53.104701 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1776/3556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:53 2022] GET /compute/v2.1/servers/58580062-a086-419b-bd9e-24f992476b7c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:53.187140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:53.200232 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44bbbc97-21a7-4e4c-8d10-fbba8b0ba4ef tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1325 microversion: 2.1 time: 0.939339 May 10 02:24:53.201854 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1781/3557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:52 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1325 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:54.217751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:54.219312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:54.228130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:54.229012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:54.230095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:54.230816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:54.850967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:54.862908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36150c53-b127-4ddb-aeba-c939b96946f2 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1325 microversion: 2.1 time: 0.644690 May 10 02:24:54.863610 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1777/3558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:54 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1325 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:54.966472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fd0146e2-c310-43d8-86a2-d8cb360410b6 req-dc78890b-de87-4ea5-8c71-dec51afd2484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896f1725-a13e-4313-8353-470d893b8b30", "name": "network-vif-plugged", "status": "completed", "tag": "7076f477-ed9b-4c71-b7fa-059db2a4886d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:54.986669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fd0146e2-c310-43d8-86a2-d8cb360410b6 req-dc78890b-de87-4ea5-8c71-dec51afd2484 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:54.987175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fd0146e2-c310-43d8-86a2-d8cb360410b6 req-dc78890b-de87-4ea5-8c71-dec51afd2484 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:55.034141 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fd0146e2-c310-43d8-86a2-d8cb360410b6 req-dc78890b-de87-4ea5-8c71-dec51afd2484 service nova] Creating event network-vif-plugged:7076f477-ed9b-4c71-b7fa-059db2a4886d for instance 896f1725-a13e-4313-8353-470d893b8b30 on n-h1-841089-2 May 10 02:24:55.052983 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fd0146e2-c310-43d8-86a2-d8cb360410b6 req-dc78890b-de87-4ea5-8c71-dec51afd2484 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090053 May 10 02:24:55.053604 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1782/3559] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:55.740810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-667a7ea3-c500-4b6a-95d8-e4c3d8d1307b tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d363e9f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-655824144", "description": "tempest-description-1840008062"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:55.880705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:55.881273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:55.891588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:55.894292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:55.906601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:55.907346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:56.238963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-667a7ea3-c500-4b6a-95d8-e4c3d8d1307b tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.765338 May 10 02:24:56.239906 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1778/3560] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:24:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:56.252119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc025176-e463-4e1f-803e-97dcd852b722 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d3627c4c0>, body: {"security_group_rule": {"parent_group_id": "91d089d7-fe44-4f51-a321-c234fafd7a85", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:56.467191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:56.481002 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdf76b1a-ab74-4111-b598-4e3cdf36713e tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1325 microversion: 2.1 time: 0.604567 May 10 02:24:56.499717 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1783/3561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:55 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1325 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:56.802953 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc025176-e463-4e1f-803e-97dcd852b722 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.555101 May 10 02:24:56.814676 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1779/3562] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:24:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:56.817897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59d10a04-09d2-4a6b-a5f4-bcb0698f9da3 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d370d3ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-710098022", "description": "tempest-description-280703440"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:57.143912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59d10a04-09d2-4a6b-a5f4-bcb0698f9da3 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.332336 May 10 02:24:57.144771 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1784/3563] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:24:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:57.156039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3f07df9-410d-4d78-9dae-556687cce5c4 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d3645b790>, body: {"security_group_rule": {"parent_group_id": "27e7bacf-c64e-43c7-a041-08168f09fa26", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:57.497595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:57.498228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:57.501504 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3f07df9-410d-4d78-9dae-556687cce5c4 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.349394 May 10 02:24:57.502379 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1780/3564] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:24:57 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:24:57.513579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b87256a8-d7be-4fcb-a5ca-382898a5ede9 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d363f6b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-562104177", "description": "tempest-description-1260115590"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:57.526790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:57.527266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:57.528608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:57.529655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:58.274600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:58.290421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f58399eb-f296-43c5-a9fb-1015b6f64d53 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1522 microversion: 2.1 time: 0.791905 May 10 02:24:58.291140 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1785/3565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:57 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1522 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:24:58.316378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:58.317513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:58.325890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:58.326700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:58.330519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:58.339664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:58.414653 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] HTTP exception thrown: Action 999 not found May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Request method failure captured: May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30/os-instance-actions/999 HTTP/1.1 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieczrjN6IiC6mqx3amDSv1hE0udwuVJfLaDLCy9qCdLsI8vlL6oawyfluRWumS4QhvIZFMJVMMzY4tf3MvLPkPGZ3vraNp1a9pK1pyxDYcmWEcv7ckNAfPcH8v4_2mV4-Zg5_sIRTCo3TbQB9WF2kwZ3qcujgvKPEv4WjRWvai6HmE5Y May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b9e110cb87094716ad23d59390e00d32 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9e110cb87094716ad23d59390e00d32", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b9e110cb87094716ad23d59390e00d32 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-InstanceActionsNegativeTestJSON-1354531933-project May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 7c897122b78a40ae9482db6d80b11153 May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1354531933-project May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: exception: Action 999 not found May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '896f1725-a13e-4313-8353-470d893b8b30', 'id': '999'} May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 10 02:24:58.430645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.437025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Returning 404 to user: Action 999 not found {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:58.438685 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c27d0eac-73b7-4d34-93a6-2f149aff1d6f tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.128490 May 10 02:24:58.445755 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1786/3566] 10.222.0.52 () {58 vars in 1307 bytes} [Tue May 10 02:24:58 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30/os-instance-actions/999 => generated 66 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:24:58.463315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79b40d52-137f-438b-81f8-93b7af4df7bc tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '.version_select at 0x7f3d36651ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:58.471112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-79b40d52-137f-438b-81f8-93b7af4df7bc tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 2174725a-7aac-4e0d-b59a-54a3b1842618] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:58.481691 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b87256a8-d7be-4fcb-a5ca-382898a5ede9 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.971294 May 10 02:24:58.483418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1781/3567] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:24:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:58.497798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c2cbd78-bca0-4733-838f-fdcc328a5ba3 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d3624a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1571040069", "description": "tempest-description-1685930345"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:58.518368 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-79b40d52-137f-438b-81f8-93b7af4df7bc tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] HTTP exception thrown: Instance 2174725a-7aac-4e0d-b59a-54a3b1842618 could not be found. May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79b40d52-137f-438b-81f8-93b7af4df7bc tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Request method failure captured: May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/2174725a-7aac-4e0d-b59a-54a3b1842618/os-instance-actions HTTP/1.1 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABieczrjN6IiC6mqx3amDSv1hE0udwuVJfLaDLCy9qCdLsI8vlL6oawyfluRWumS4QhvIZFMJVMMzY4tf3MvLPkPGZ3vraNp1a9pK1pyxDYcmWEcv7ckNAfPcH8v4_2mV4-Zg5_sIRTCo3TbQB9WF2kwZ3qcujgvKPEv4WjRWvai6HmE5Y May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b9e110cb87094716ad23d59390e00d32 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9e110cb87094716ad23d59390e00d32", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b9e110cb87094716ad23d59390e00d32 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-InstanceActionsNegativeTestJSON-1354531933-project May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 7c897122b78a40ae9482db6d80b11153 May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1354531933-project May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2174725a-7aac-4e0d-b59a-54a3b1842618 could not be found. May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '2174725a-7aac-4e0d-b59a-54a3b1842618'} May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2174725a-7aac-4e0d-b59a-54a3b1842618 could not be found. May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:24:58.525390 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2174725a-7aac-4e0d-b59a-54a3b1842618 could not be found. May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2174725a-7aac-4e0d-b59a-54a3b1842618 could not be found. May 10 02:24:58.529362 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:24:58.533951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79b40d52-137f-438b-81f8-93b7af4df7bc tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Returning 404 to user: Instance 2174725a-7aac-4e0d-b59a-54a3b1842618 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:24:58.535549 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-79b40d52-137f-438b-81f8-93b7af4df7bc tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/2174725a-7aac-4e0d-b59a-54a3b1842618/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.081542 May 10 02:24:58.536692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1787/3568] 10.222.0.52 () {58 vars in 1295 bytes} [Tue May 10 02:24:58 2022] GET /compute/v2.1/servers/2174725a-7aac-4e0d-b59a-54a3b1842618/os-instance-actions => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:24:58.551083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:58.552549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:58.565140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:58.566017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:58.567609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:58.568279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:58.615270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:24:58.739634 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-837a3219-e9bf-40db-8d84-769dd809dc84 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "DELETE /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 204 len: 0 microversion: 2.1 time: 0.189459 May 10 02:24:58.741836 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1788/3569] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:24:58 2022] DELETE /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:24:58.757980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:24:58.760675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:24:58.782391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:58.784001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:58.785890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:24:58.787418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:24:59.058454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c2cbd78-bca0-4733-838f-fdcc328a5ba3 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.566863 May 10 02:24:59.059085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1782/3570] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:24:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:59.071649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-be197891-fdcc-485d-98a2-3fb6727be8b3 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d363a5670>, body: {"security_group_rule": {"parent_group_id": "66f8d2fa-78ff-4c6c-862a-2774b8be8f56", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1a839bcb-011b-49f2-8789-6ccbab3ff0f6"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:24:59.172101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:24:59.193879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75dcaa48-caea-4500-9ce0-9bb38f4505a1 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1528 microversion: 2.1 time: 0.446725 May 10 02:24:59.196465 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1789/3571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:24:58 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1528 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:24:59.897456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-be197891-fdcc-485d-98a2-3fb6727be8b3 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.830636 May 10 02:24:59.898192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1783/3572] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:24:59 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:24:59.911853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a90abe6-c977-4c5b-942f-75fc9f674bb2 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d37458700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-191265529", "description": "tempest-description-1277901744"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:00.212766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:00.213807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:00.223677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:00.224336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:00.225717 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a90abe6-c977-4c5b-942f-75fc9f674bb2 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.318036 May 10 02:25:00.226323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1790/3573] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:24:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:00.226854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:00.231032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:00.238550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da9a9389-6f14-471c-8f10-0e399e9ca6dd tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d3712c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1422960370", "description": "tempest-description-684658997"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:00.856066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c897122b78a40ae9482db6d80b11153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9e110cb87094716ad23d59390e00d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:00.872020 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07a16654-51bd-4973-9df5-239249ab1d82 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 200 len: 1528 microversion: 2.1 time: 0.660312 May 10 02:25:00.873668 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1784/3574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:00 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 1528 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:01.140426 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da9a9389-6f14-471c-8f10-0e399e9ca6dd tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.906937 May 10 02:25:01.143953 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1791/3575] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:25:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:25:01.155023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45130da5-6de3-42de-8291-4c014d145aac tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d377b63a0>, body: {"security_group_rule": {"parent_group_id": "8cbb6dc4-9d2a-4cc2-a048-ff623ae68d87", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5c0176e2-842e-44f5-a508-744be94ed052"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:01.187388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1715853378", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:01.286442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] validate_networks() for [('544152f2-1965-429f-8d0a-33756737e75a', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:25:02.202405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:25:02.203889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:25:02.204285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:25:02.205484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:25:02.205949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:25:02.224905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.226518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.228666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.230070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.247964 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45130da5-6de3-42de-8291-4c014d145aac tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.098222 May 10 02:25:02.251817 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1792/3576] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:25:01 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:25:02.298591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Getting quotas for project 547c652992a84f43bb35fbf17dbb9244. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:02.311953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Getting quotas for user 4ebf77f83f4d4ca689a3c2384ebc6b82 and project 547c652992a84f43bb35fbf17dbb9244. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:02.349193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:25:02.356371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:25:02.465581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3a25688-b0c2-43c7-9434-c16e5293a0c4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589712 May 10 02:25:02.466620 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1785/3577] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:25:02.485930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7ff2c9d7-3cb3-45bd-b8e8-802c8a2fe52a req-6e7d0240-d564-499a-a3fa-a2beb581ec50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896f1725-a13e-4313-8353-470d893b8b30", "name": "network-vif-deleted", "tag": "7076f477-ed9b-4c71-b7fa-059db2a4886d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:02.505986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7ff2c9d7-3cb3-45bd-b8e8-802c8a2fe52a req-6e7d0240-d564-499a-a3fa-a2beb581ec50 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.507526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7ff2c9d7-3cb3-45bd-b8e8-802c8a2fe52a req-6e7d0240-d564-499a-a3fa-a2beb581ec50 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.534936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7ff2c9d7-3cb3-45bd-b8e8-802c8a2fe52a req-6e7d0240-d564-499a-a3fa-a2beb581ec50 service nova] Creating event network-vif-deleted:7076f477-ed9b-4c71-b7fa-059db2a4886d for instance 896f1725-a13e-4313-8353-470d893b8b30 on n-h1-841089-2 May 10 02:25:02.540438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7ff2c9d7-3cb3-45bd-b8e8-802c8a2fe52a req-6e7d0240-d564-499a-a3fa-a2beb581ec50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066315 May 10 02:25:02.541353 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1786/3578] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:02.547956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:02.548965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] [instance: 896f1725-a13e-4313-8353-470d893b8b30] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:02.557165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.557843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.559463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.560078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.575585 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] HTTP exception thrown: Instance 896f1725-a13e-4313-8353-470d893b8b30 could not be found. May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Request method failure captured: May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 HTTP/1.1 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABieczrjN6IiC6mqx3amDSv1hE0udwuVJfLaDLCy9qCdLsI8vlL6oawyfluRWumS4QhvIZFMJVMMzY4tf3MvLPkPGZ3vraNp1a9pK1pyxDYcmWEcv7ckNAfPcH8v4_2mV4-Zg5_sIRTCo3TbQB9WF2kwZ3qcujgvKPEv4WjRWvai6HmE5Y May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b9e110cb87094716ad23d59390e00d32 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b9e110cb87094716ad23d59390e00d32", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b9e110cb87094716ad23d59390e00d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b9e110cb87094716ad23d59390e00d32 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1354531933 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-InstanceActionsNegativeTestJSON-1354531933-project May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 7c897122b78a40ae9482db6d80b11153 May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1354531933-project May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 896f1725-a13e-4313-8353-470d893b8b30 could not be found. May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '896f1725-a13e-4313-8353-470d893b8b30'} May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896f1725-a13e-4313-8353-470d893b8b30 could not be found. May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896f1725-a13e-4313-8353-470d893b8b30 could not be found. May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:02.577489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896f1725-a13e-4313-8353-470d893b8b30 could not be found. May 10 02:25:02.582598 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:02.583844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] Returning 404 to user: Instance 896f1725-a13e-4313-8353-470d893b8b30 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:25:02.584852 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4285cf89-4f7e-4fc1-a11b-54ac79245826 tempest-InstanceActionsNegativeTestJSON-1354531933 tempest-InstanceActionsNegativeTestJSON-1354531933-project] 10.222.0.52 "GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30" status: 404 len: 111 microversion: 2.1 time: 0.041641 May 10 02:25:02.585869 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1787/3579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:02 2022] GET /compute/v2.1/servers/896f1725-a13e-4313-8353-470d893b8b30 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:25:02.590907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a5ae927-dfc0-4467-9f7e-e449f2db3c42 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d363f65e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:02.671510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Calling method '.version_select at 0x7f3d37a073a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:02.672653 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:25:02.672653 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:25:02.673847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.674299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.704698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.705161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.731456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:02.733935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:02.746977 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abf76522-e204-443e-b7f1-a51343ccf1c3 tempest-PortsAdminExtendedAttrsTestJSON-1406622225 tempest-PortsAdminExtendedAttrsTestJSON-1406622225-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.493718 May 10 02:25:02.750930 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1793/3580] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 02:25:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:02.760414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ad214dc-d722-4756-9ffc-c6a179e3a01a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:02.764506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ad214dc-d722-4756-9ffc-c6a179e3a01a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:03.316063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ad214dc-d722-4756-9ffc-c6a179e3a01a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:03.324689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ad214dc-d722-4756-9ffc-c6a179e3a01a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1217 microversion: 2.1 time: 0.572502 May 10 02:25:03.341300 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1794/3581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:02 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1217 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:03.363100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "043b05c4-a3ba-4e44-b366-f587c732d4fd"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:03.366044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:03.395616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:03.397636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:03.401424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:03.402200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:03.871325 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a2731373-c111-493e-a3fc-5beb9c6c27bc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528188 May 10 02:25:03.875971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1795/3582] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:25:03 2022] POST /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:04.349290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:04.350073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:04.371261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:04.371780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:04.374726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:04.375316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:04.519428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a5ae927-dfc0-4467-9f7e-e449f2db3c42 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5c0176e2-842e-44f5-a508-744be94ed052" status: 202 len: 0 microversion: 2.1 time: 1.932304 May 10 02:25:04.520541 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1788/3583] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:02 2022] DELETE /compute/v2.1/os-security-groups/5c0176e2-842e-44f5-a508-744be94ed052 => generated 0 bytes in 1934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:04.529262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b3aa16a-a337-434d-a380-103f63c3fa94 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d36247a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:04.799037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:04.806412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02d56ad3-6990-4436-9717-313138ba0ffb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1275 microversion: 2.1 time: 0.464270 May 10 02:25:04.807011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1796/3584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:04 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1275 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:05.040438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b3aa16a-a337-434d-a380-103f63c3fa94 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/8cbb6dc4-9d2a-4cc2-a048-ff623ae68d87" status: 200 len: 247 microversion: 2.1 time: 0.515495 May 10 02:25:05.041211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1789/3585] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:25:04 2022] GET /compute/v2.1/os-security-groups/8cbb6dc4-9d2a-4cc2-a048-ff623ae68d87 => generated 247 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:05.053833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0437cf15-fce5-4df1-91e7-3f7c89f422c7 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d375a1670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1845195388", "description": "tempest-description-892420437"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:05.826606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:05.828071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:05.853817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:05.854226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:05.857271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:05.857760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:07.277386 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0437cf15-fce5-4df1-91e7-3f7c89f422c7 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.227241 May 10 02:25:07.284495 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1797/3586] 10.222.0.52 () {60 vars in 1179 bytes} [Tue May 10 02:25:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:07.296622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80566bc2-c32c-4b6d-bcdb-f57c6fd1ea3c tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d377b63a0>, body: {"security_group_rule": {"parent_group_id": "05bf27ab-dbff-4ad3-8f24-81da714c2fd8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:08.056546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:08.074898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-20ea1612-f0aa-4869-ab6b-e71ba90b0913 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 2.254450 May 10 02:25:08.078272 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1790/3587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:05 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:08.839092 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80566bc2-c32c-4b6d-bcdb-f57c6fd1ea3c tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.552933 May 10 02:25:08.839902 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1798/3588] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:25:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:08.851900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-463c97db-0439-4588-b7ad-ccebe9b0ca03 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Action: 'create', calling method: .version_select at 0x7f3d3644a700>, body: {"security_group_rule": {"parent_group_id": "05bf27ab-dbff-4ad3-8f24-81da714c2fd8", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:09.095819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:09.096985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:09.112202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:09.113111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:09.116418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:09.118667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:09.627578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:09.638551 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-567aeaea-1d60-4da7-8ecb-ccbecea58345 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 0.548091 May 10 02:25:09.639465 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1799/3589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:09 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:09.650864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4651e4af-882f-461a-a20b-d80ae615418e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:09.670839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4651e4af-882f-461a-a20b-d80ae615418e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:09.672037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4651e4af-882f-461a-a20b-d80ae615418e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:09.718466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4651e4af-882f-461a-a20b-d80ae615418e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:25:09.828688 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4651e4af-882f-461a-a20b-d80ae615418e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action" status: 202 len: 0 microversion: 2.1 time: 0.186524 May 10 02:25:09.835461 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1800/3590] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:25:09 2022] POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:09.842103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:09.858799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:09.879846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:09.888953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:09.891522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:09.896315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:10.722948 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-463c97db-0439-4588-b7ad-ccebe9b0ca03 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.874236 May 10 02:25:10.729885 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1791/3591] 10.222.0.52 () {60 vars in 1194 bytes} [Tue May 10 02:25:08 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:10.736514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:10.737469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:10.769299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:10.769930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:10.771928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:10.775660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:11.413995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:11.440260 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43b8a77d-da9a-4bc2-8b70-e7722337c286 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1675 microversion: 2.1 time: 1.603096 May 10 02:25:11.448987 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1801/3592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:09 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1675 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:11.466740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b74e2f51-e0b0-4acd-9081-4fcf65b84023 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d36d0d5e0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:12.220425 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b74e2f51-e0b0-4acd-9081-4fcf65b84023 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/05bf27ab-dbff-4ad3-8f24-81da714c2fd8" status: 200 len: 664 microversion: 2.1 time: 0.769919 May 10 02:25:12.221031 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1802/3593] 10.222.0.52 () {58 vars in 1268 bytes} [Tue May 10 02:25:11 2022] GET /compute/v2.1/os-security-groups/05bf27ab-dbff-4ad3-8f24-81da714c2fd8 => generated 664 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:12.226191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c07b9dd4-fc25-44ed-8c28-065d9e48cd84 req-78a9afa7-7e08-416c-8d5f-2ee1f233b3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4512ed-540a-4c7f-884c-22e2f619a635", "tag": "67f6d200-7310-4466-bd94-c656886c7d53"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:12.254711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c07b9dd4-fc25-44ed-8c28-065d9e48cd84 req-78a9afa7-7e08-416c-8d5f-2ee1f233b3d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:12.262944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c07b9dd4-fc25-44ed-8c28-065d9e48cd84 req-78a9afa7-7e08-416c-8d5f-2ee1f233b3d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:12.290851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:12.309566 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c07b9dd4-fc25-44ed-8c28-065d9e48cd84 req-78a9afa7-7e08-416c-8d5f-2ee1f233b3d1 service nova] Creating event network-changed:67f6d200-7310-4466-bd94-c656886c7d53 for instance 2e4512ed-540a-4c7f-884c-22e2f619a635 on n-h1-841089-2 May 10 02:25:12.331782 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6687cef0-2db1-40e7-9858-fe7aaa56fdd8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 1.598728 May 10 02:25:12.333977 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c07b9dd4-fc25-44ed-8c28-065d9e48cd84 req-78a9afa7-7e08-416c-8d5f-2ee1f233b3d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111701 May 10 02:25:12.334475 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1792/3594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:10 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:12.336532 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1803/3595] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:12.341661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed5a8d73-f6bf-484e-bdc3-7d9feb908409 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d363f6670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:12.470525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:12.471476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:12.480016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:12.480655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:12.481647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:12.482257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:12.822318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:12.845164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-86797b55-bf15-4eb5-94d0-093aaa1f91dd tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1675 microversion: 2.1 time: 0.387973 May 10 02:25:12.845825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1804/3596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:12 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1675 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:13.274043 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed5a8d73-f6bf-484e-bdc3-7d9feb908409 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/e0882aa6-cae1-4fb6-af5b-1a498a9e527e" status: 202 len: 0 microversion: 2.1 time: 0.938122 May 10 02:25:13.275457 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1793/3597] 10.222.0.52 () {58 vars in 1286 bytes} [Tue May 10 02:25:12 2022] DELETE /compute/v2.1/os-security-group-rules/e0882aa6-cae1-4fb6-af5b-1a498a9e527e => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:13.286223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-874962ed-f389-46a0-904d-7440d6d3da1c tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d37108dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:13.352499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:13.353750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:13.367663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:13.369117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:13.371811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:13.373506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:13.817150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:13.826094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1cb14ac6-09a1-4005-86d2-a199e50dcc3b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 0.479800 May 10 02:25:13.830417 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1794/3598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:13.862709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:13.864143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:13.875377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:13.875848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:13.877307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:13.877779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:14.793337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:14.800924 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7eac07b5-6dc6-4a8f-87f0-712a4d660e19 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1675 microversion: 2.1 time: 0.943055 May 10 02:25:14.806531 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1795/3599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:13 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1675 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:14.818472 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-874962ed-f389-46a0-904d-7440d6d3da1c tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/05bf27ab-dbff-4ad3-8f24-81da714c2fd8" status: 202 len: 0 microversion: 2.1 time: 1.537180 May 10 02:25:14.822356 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1805/3600] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:13 2022] DELETE /compute/v2.1/os-security-groups/05bf27ab-dbff-4ad3-8f24-81da714c2fd8 => generated 0 bytes in 1539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:14.828948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d3633d280>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:14.845679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:14.846471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:14.855996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:14.856507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:14.857272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:14.857721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:15.118469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG neutronclient.v2_0.client [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist", "detail": ""}} {{(pid=118716) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:25:15.119459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.security_group_api [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Neutron security group 5c0176e2-842e-44f5-a508-744be94ed052 not found {{(pid=118716) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 10 02:25:15.120362 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] HTTP exception thrown: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.120362 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Request method failure captured: May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-security-groups/5c0176e2-842e-44f5-a508-744be94ed052 HTTP/1.1 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz3PUKwd0Uohx1Qh-9hrEq5JilVtYl_mRiJWnDMsxkpwkN0mttMXGK9rXZgofAmvyNYtDvAxnozhmwjNOY6XkloeQZsP3I8LLs045ApF8XANOfQKNGz_G6Un7hKl3Vy65WObC9C4shSodzNnOJavVI-TAbyo0THOmQ-f04DDl5B68c May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 40ede451fe7e43689b6cd00d141392b0 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1366193597 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_40ede451fe7e43689b6cd00d141392b0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ede451fe7e43689b6cd00d141392b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/40ede451fe7e43689b6cd00d141392b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/40ede451fe7e43689b6cd00d141392b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1366193597 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 40ede451fe7e43689b6cd00d141392b0 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1366193597 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-SecurityGroupRulesTestJSON-1366193597-project May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: c60a0004f629443890d72721be73da49 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1366193597-project May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: exception: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '5c0176e2-842e-44f5-a508-744be94ed052'} May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:25:15.122799 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] May 10 02:25:15.128592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:25:15.135008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Returning 404 to user: Security group 5c0176e2-842e-44f5-a508-744be94ed052 does not exist May 10 02:25:15.135008 n-d-841089-2 devstack@n-api.service[118716]: Neutron server returns request_ids: ['req-f033cb13-b5af-48bc-93b3-6fab759838ca'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:25:15.136314 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3eb54794-67d7-4e4d-8e84-219f5e56b3e5 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5c0176e2-842e-44f5-a508-744be94ed052" status: 404 len: 194 microversion: 2.1 time: 0.312903 May 10 02:25:15.137439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1796/3601] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:14 2022] DELETE /compute/v2.1/os-security-groups/5c0176e2-842e-44f5-a508-744be94ed052 => generated 194 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:25:15.150288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58a37b74-0e2b-4f79-956c-77014c601369 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d36442670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:15.405605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:15.417495 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46a6c77d-14d4-4bbf-9b98-cf8d7a1a2dbf tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 0.572952 May 10 02:25:15.418331 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1806/3602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:14 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:15.825180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:15.827091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:15.839228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:15.840673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:15.841629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:15.845970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:16.411659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:16.432128 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c2e61f78-af1a-478d-a4d6-f0e12eaaad93 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1675 microversion: 2.1 time: 0.612412 May 10 02:25:16.433542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1807/3603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:15 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1675 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:16.440340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:16.443887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:16.449975 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58a37b74-0e2b-4f79-956c-77014c601369 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8cbb6dc4-9d2a-4cc2-a048-ff623ae68d87" status: 202 len: 0 microversion: 2.1 time: 1.307797 May 10 02:25:16.450961 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1797/3604] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:15 2022] DELETE /compute/v2.1/os-security-groups/8cbb6dc4-9d2a-4cc2-a048-ff623ae68d87 => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:16.451895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:16.452765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:16.454245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:16.454866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:16.458904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5054a54a-268a-487d-8516-7072f2989ed2 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d363a59d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:16.836087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:16.844906 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cae1eaf3-86fd-4792-a89a-7fc986516d90 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 0.409692 May 10 02:25:16.854941 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1808/3605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:16 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:17.450083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:17.450625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:17.476913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:17.484045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:17.485970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:17.489665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:17.941091 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5054a54a-268a-487d-8516-7072f2989ed2 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1a839bcb-011b-49f2-8789-6ccbab3ff0f6" status: 202 len: 0 microversion: 2.1 time: 1.485932 May 10 02:25:17.941678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1798/3606] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:16 2022] DELETE /compute/v2.1/os-security-groups/1a839bcb-011b-49f2-8789-6ccbab3ff0f6 => generated 0 bytes in 1487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:25:17.946471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:17.954396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:17.970187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:17.970908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:17.971892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:17.972518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:18.011247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:18.036130 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0dae5b09-f17c-4602-83f2-88450fed5549 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1675 microversion: 2.1 time: 0.589980 May 10 02:25:18.039488 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1809/3607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:17 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1675 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:18.053196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5137fdea-5969-4567-87ac-c0b939fd07b1 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d36e41790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:18.374131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:18.380550 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9b934cfe-fb44-482d-8efa-0ad962d3ad58 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 0.437652 May 10 02:25:18.384723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1799/3608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:17 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:18.685168 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5137fdea-5969-4567-87ac-c0b939fd07b1 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/66f8d2fa-78ff-4c6c-862a-2774b8be8f56" status: 202 len: 0 microversion: 2.1 time: 0.643199 May 10 02:25:18.685761 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1810/3609] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:18 2022] DELETE /compute/v2.1/os-security-groups/66f8d2fa-78ff-4c6c-862a-2774b8be8f56 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:19.077097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aaf168eb-a682-44d5-ae22-f1ad0f86d506 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'create', calling method: .version_select at 0x7f3d36542d30>, body: {"keypair": {"name": "tempest-keypair-1950939008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTMJ65gRTOjDSbJ75E7vheP+3QpVykZ6B5ltFLTmbMTmMi6yZKFh1zKgIeKvNAyYnJMCwduQUZyQbU3/+d2qS6GekbuyIDr6C1/RedijntQV+ClNxKx7egDYHroHERIxQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:19.117132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-aaf168eb-a682-44d5-ae22-f1ad0f86d506 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:19.119493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:19.120543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:19.128663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:19.129300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:19.130412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:19.131924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:19.142811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-aaf168eb-a682-44d5-ae22-f1ad0f86d506 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for user 2534074779504b4ca699312fdd4664cd and project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:19.194734 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32e51de0-e2f5-493e-867b-96e0ad7f29b0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/ips" status: 200 len: 152 microversion: 2.20 time: 0.656765 May 10 02:25:19.195908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1800/3610] 10.222.0.52 () {60 vars in 1288 bytes} [Tue May 10 02:25:18 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/ips => generated 152 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:25:19.201520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4d887dd-3c11-4c1a-8be1-ffdb33a08a8b tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d36247c10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:19.240002 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aaf168eb-a682-44d5-ae22-f1ad0f86d506 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.549197 May 10 02:25:19.244354 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1811/3611] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:25:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:19.271939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:19.282893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:19.316460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:19.321220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:19.322337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:19.324800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:20.004693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:20.028317 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1870eeac-1a9b-422e-af03-382bbe65d8eb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1675 microversion: 2.1 time: 0.776506 May 10 02:25:20.041213 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1812/3612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:19 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1675 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:20.094605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bd56b630-fcc6-46e6-801b-a381fa1510bb req-1d8bf84e-c1eb-40b0-86af-96f65c44d67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4512ed-540a-4c7f-884c-22e2f619a635", "name": "network-vif-plugged", "status": "completed", "tag": "67f6d200-7310-4466-bd94-c656886c7d53"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:20.123334 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4d887dd-3c11-4c1a-8be1-ffdb33a08a8b tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/27e7bacf-c64e-43c7-a041-08168f09fa26" status: 202 len: 0 microversion: 2.1 time: 0.916805 May 10 02:25:20.124017 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1801/3613] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:19 2022] DELETE /compute/v2.1/os-security-groups/27e7bacf-c64e-43c7-a041-08168f09fa26 => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:20.158872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:20.183417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bd56b630-fcc6-46e6-801b-a381fa1510bb req-1d8bf84e-c1eb-40b0-86af-96f65c44d67c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:20.183778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bd56b630-fcc6-46e6-801b-a381fa1510bb req-1d8bf84e-c1eb-40b0-86af-96f65c44d67c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:20.199057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:20.243735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:20.276864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:20.283974 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bd56b630-fcc6-46e6-801b-a381fa1510bb req-1d8bf84e-c1eb-40b0-86af-96f65c44d67c service nova] Creating event network-vif-plugged:67f6d200-7310-4466-bd94-c656886c7d53 for instance 2e4512ed-540a-4c7f-884c-22e2f619a635 on n-h1-841089-2 May 10 02:25:20.300678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:20.304509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:20.309389 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bd56b630-fcc6-46e6-801b-a381fa1510bb req-1d8bf84e-c1eb-40b0-86af-96f65c44d67c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265013 May 10 02:25:20.314084 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1813/3614] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:20.360393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0ca0fdf-9a6c-428f-b2eb-0df7b361f8e7 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] Calling method '.version_select at 0x7f3d37559550>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:21.691277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:21.699912 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58cf045b-1a6c-40a9-8123-8993b7bfc18a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1317 microversion: 2.1 time: 1.574761 May 10 02:25:21.719170 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1802/3615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:20 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1317 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:21.723536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:21.726863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:21.738108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:21.742409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:21.743539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:21.745392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:22.013715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0ca0fdf-9a6c-428f-b2eb-0df7b361f8e7 tempest-SecurityGroupRulesTestJSON-1366193597 tempest-SecurityGroupRulesTestJSON-1366193597-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/91d089d7-fe44-4f51-a321-c234fafd7a85" status: 202 len: 0 microversion: 2.1 time: 1.688805 May 10 02:25:22.015007 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1814/3616] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:25:20 2022] DELETE /compute/v2.1/os-security-groups/91d089d7-fe44-4f51-a321-c234fafd7a85 => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:22.667329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:22.727135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:22.727954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:22.742337 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44b2ebbe-4f8c-4f48-97ff-3fd42b0df3b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1652 microversion: 2.1 time: 1.029801 May 10 02:25:22.758436 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1803/3617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:21 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1652 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:22.773495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:22.774178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:22.775049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:22.775531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:22.776638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb657706-5e05-455a-b71f-03d8d5860662 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:22.786331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb657706-5e05-455a-b71f-03d8d5860662 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:22.787193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb657706-5e05-455a-b71f-03d8d5860662 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:22.852323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cb657706-5e05-455a-b71f-03d8d5860662 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Going to try to start instance {{(pid=118716) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 02:25:23.035738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cb657706-5e05-455a-b71f-03d8d5860662 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action" status: 202 len: 0 microversion: 2.1 time: 0.255872 May 10 02:25:23.044710 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1804/3618] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:25:22 2022] POST /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:25:23.073749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:23.078942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:23.101273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:23.105870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:23.107993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:23.135770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:24.103302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:24.113133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bc624888-56e9-4c43-90bd-96b121a52d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.389992 May 10 02:25:24.120090 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1815/3619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:22 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:24.445151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-659595227", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:24.564951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] validate_networks() for [('544152f2-1965-429f-8d0a-33756737e75a', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:25:25.173879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:25.183738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37f8db7c-c5c8-4f90-ba94-071f893a5d55 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1661 microversion: 2.1 time: 2.130660 May 10 02:25:25.196873 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1805/3620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:23 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1661 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:25.567636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-3095448", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a552ca0-79f9-47dd-adf9-5195fd4ca6cd"}], "security_groups": [{"name": "tempest-securitygroup--1617204989"}], "key_name": "tempest-keypair-1950939008", "user_data": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:25.914948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] validate_networks() for [('5a552ca0-79f9-47dd-adf9-5195fd4ca6cd', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:25:26.989383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:25:26.990528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:25:26.992020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:25:26.992684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:25:26.994082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:25:27.013314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:27.015859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:27.018481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:27.020514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:27.078497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Getting quotas for project 547c652992a84f43bb35fbf17dbb9244. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:27.094796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Getting quotas for user 4ebf77f83f4d4ca689a3c2384ebc6b82 and project 547c652992a84f43bb35fbf17dbb9244. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:27.137225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:25:27.143537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:25:27.385799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6d1f182-35b2-4852-b5ec-1a97c307e6b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.932597 May 10 02:25:27.386559 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1816/3621] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:25:27.412936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:27.471555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:27.513195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:27.513670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:27.534478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:27.541149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:27.681655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:25:27.682196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:25:27.682559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:25:27.682976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:25:27.696842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:25:27.700776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:27.701669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:27.702064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:27.716180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:27.783188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:27.783188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for user 2534074779504b4ca699312fdd4664cd and project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:27.829296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:25:27.831768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:25:28.022362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:28.034096 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1d0185da-0630-4c1c-b4c7-2cfdd9534747 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1661 microversion: 2.1 time: 0.645726 May 10 02:25:28.034962 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1817/3622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:27 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1661 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:28.054116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:28.055704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:28.056563 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f735aa66-25da-4bd2-a04c-0e38f6ec7ede tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.494137 May 10 02:25:28.063806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:28.064699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:28.065832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:28.066582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:28.075343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1806/3623] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:25:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:25:28.096230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a9e8dcd-9d15-4b37-81f0-d0f0713a6550 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:28.102279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lazy-loading 'flavor' on Instance uuid 3639a402-14be-4960-ab60-76c8ea5c120a {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:25:28.102802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a9e8dcd-9d15-4b37-81f0-d0f0713a6550 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:28.337879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a9e8dcd-9d15-4b37-81f0-d0f0713a6550 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:28.346774 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a9e8dcd-9d15-4b37-81f0-d0f0713a6550 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1216 microversion: 2.1 time: 0.266567 May 10 02:25:28.361922 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1807/3624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:28 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1216 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:28.376719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d609e86-6f07-416e-9f8f-225622bf94d6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:28.382598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d609e86-6f07-416e-9f8f-225622bf94d6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:28.607357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9d609e86-6f07-416e-9f8f-225622bf94d6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:28.615161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d609e86-6f07-416e-9f8f-225622bf94d6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1236 microversion: 2.1 time: 0.251557 May 10 02:25:28.617232 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1808/3625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:28 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1236 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:29.074579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:29.084833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:29.114643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:29.119714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:29.126292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:29.129054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:29.230826 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7b2e072-002a-4dc8-b87d-cd646d5110b9 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/action" status: 202 len: 0 microversion: 2.20 time: 1.193154 May 10 02:25:29.236946 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1818/3626] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:25:28 2022] POST /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/action => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:25:29.285373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:29.293800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:29.317409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:29.326080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:29.326080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:29.326080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:29.621249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:29.631787 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-195e5319-7d03-40f1-86c8-e9c514988d68 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1665 microversion: 2.1 time: 0.573289 May 10 02:25:29.637851 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1809/3627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:29 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1665 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:29.688552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:29.688552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:29.714574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:29.719552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:29.724353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:29.729332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:29.907951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:29.936558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:29.943340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:29.948777 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2f2fdd1-20ed-4d62-923b-176341f50a29 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 0.705474 May 10 02:25:29.949888 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1819/3628] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:29 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:29.975799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:29.977321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:30.009624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:30.014180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:30.016701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:30.018248 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b64fde42-3d93-48db-8fa8-ed14f1c2a446 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1212 microversion: 2.1 time: 0.368783 May 10 02:25:30.019436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:30.022408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:30.027268 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1810/3629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:29 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1212 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:30.175833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:30.192959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43c1b810-3e31-481e-aea5-d50689f58295 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1232 microversion: 2.1 time: 0.238598 May 10 02:25:30.197281 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1820/3630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:29 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1232 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:30.977238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:30.978215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:30.997075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:30.998250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:31.000521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:31.028299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:31.041963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:31.042578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:31.073886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:31.096769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:31.099700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:31.102049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:31.433762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:31.443257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d111529d-ab0d-4d00-ad8d-79ee3461f5ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1286 microversion: 2.1 time: 0.404951 May 10 02:25:31.454188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1821/3631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:31 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1286 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:31.474710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:31.478093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:31.498714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:31.499479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:31.501987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:31.503568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:31.793320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:31.798777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:31.807764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:31.808025 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-967ce45c-d94d-4407-a0d9-b112ddbba223 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1294 microversion: 2.1 time: 0.352407 May 10 02:25:31.808372 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1822/3632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:31 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1294 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:31.820198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:31.821683 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3dd19475-e316-4130-8fba-60e55499d8dd tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 0.853780 May 10 02:25:31.823021 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1811/3633] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:30 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:32.470081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:32.470690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:32.479817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:32.480751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:32.482980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:32.483699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:32.748077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:32.762568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2523d4fc-fbed-46da-b815-e10cf28e50a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1274 microversion: 2.1 time: 0.298155 May 10 02:25:32.763184 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1823/3634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:32 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1274 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:32.829111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:32.829833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:32.851433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:32.852126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:32.856332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:32.856801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:32.868773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:32.869623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:32.870097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:32.871273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:32.872155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:32.872606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:34.281950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:34.296679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:34.298231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:34.299487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1f505b5b-0558-4d4d-8318-97573ef34b6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 1.456304 May 10 02:25:34.300075 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1824/3635] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:32 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:34.315898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:34.316518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:34.322972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:34.323839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:34.324846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:34.325519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:34.388204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:34.413246 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59a7753c-aa5f-4113-ae15-22138546b13b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 1.592460 May 10 02:25:34.419800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1812/3636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:32 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:35.320465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:35.321541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:35.340166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:35.340936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:35.348240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:35.350484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:35.451830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:35.462442 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6eedff4-379f-4bba-a3fe-1efbc2ddd6a9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 1.150774 May 10 02:25:35.465166 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1825/3637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:34 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:35.483106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:35.485943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:35.509891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:35.516700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:35.517557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:35.521580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:36.162598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:36.179853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:36.183875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:36.190478 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a29288d-bdcf-4db5-98a2-6e833c089275 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 0.875746 May 10 02:25:36.206458 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1813/3638] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:35 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:36.486861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:36.487984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:36.500363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:36.519556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:36.525609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:36.528332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:36.668044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:36.677663 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ad5395f0-a1f7-4dce-82a3-63cb98fe5478 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 1.210038 May 10 02:25:36.681207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1826/3639] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:35 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:37.210720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:37.211584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:37.223910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.227060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:37.227981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.229221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:37.436132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:37.451130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-328780a0-8eb2-4bd3-96b7-6be729b1b1ea tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 0.969565 May 10 02:25:37.455713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1814/3640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:36 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:37.533673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e31907c1-32de-4e73-bbb1-5ef529761c84 req-3224b241-269f-4938-a85a-776a733a032e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d28bffe-ca57-4e7a-b709-155c20b52121", "tag": "ce7b6413-3593-48d5-bf63-0e2550889163"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:37.552440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e31907c1-32de-4e73-bbb1-5ef529761c84 req-3224b241-269f-4938-a85a-776a733a032e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.552902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e31907c1-32de-4e73-bbb1-5ef529761c84 req-3224b241-269f-4938-a85a-776a733a032e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:37.605887 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e31907c1-32de-4e73-bbb1-5ef529761c84 req-3224b241-269f-4938-a85a-776a733a032e service nova] Creating event network-changed:ce7b6413-3593-48d5-bf63-0e2550889163 for instance 4d28bffe-ca57-4e7a-b709-155c20b52121 on n-h2-841089-2 May 10 02:25:37.634984 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e31907c1-32de-4e73-bbb1-5ef529761c84 req-3224b241-269f-4938-a85a-776a733a032e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106716 May 10 02:25:37.636114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1815/3641] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:25:37.676663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:37.677760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:37.695911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.696652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:37.698212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.699986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:37.740424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'flavor' on Instance uuid 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:25:37.898272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:37.920096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:37.926311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:37.940184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c5f24405-c1ce-4dc4-abf9-e2ec92aa0336 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 0.728386 May 10 02:25:37.941446 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1827/3642] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:37 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:37.946763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:37.949932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:37.980619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.981533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:37.982657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:37.984434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:38.003753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb2c8259-62d6-4546-8730-c47456f3766e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/action" status: 200 len: 32 microversion: 2.1 time: 0.330056 May 10 02:25:38.012365 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1816/3643] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:25:37 2022] POST /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:25:38.020408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:38.022143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:38.032973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:38.033712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:38.034518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:38.035232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:39.169381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:39.243176 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29c9cf42-7761-44a3-babc-57a6db5fa452 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 1.300027 May 10 02:25:39.256284 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1828/3644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:37 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:39.271381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:39.272312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:39.284525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:39.285079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:39.287783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:39.288481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:39.720096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:39.730236 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c26eda27-2c09-480b-990f-61ef42ff9838 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 1.716289 May 10 02:25:39.737677 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1817/3645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:38 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:39.755695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:39.756512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:39.763286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:39.764049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:39.771140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:39.771827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:40.047586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:40.055545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db9a8255-e01c-457d-9b31-8100607dfe07 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 0.797768 May 10 02:25:40.063724 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1829/3646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:39 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:40.068562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8181c8d2-c03b-41e9-bf7c-556e0db05ff1 req-0442e1d5-6bf0-48ac-96a8-f7d391e3d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:40.087408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8181c8d2-c03b-41e9-bf7c-556e0db05ff1 req-0442e1d5-6bf0-48ac-96a8-f7d391e3d7ed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:40.088148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8181c8d2-c03b-41e9-bf7c-556e0db05ff1 req-0442e1d5-6bf0-48ac-96a8-f7d391e3d7ed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:40.113419 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8181c8d2-c03b-41e9-bf7c-556e0db05ff1 req-0442e1d5-6bf0-48ac-96a8-f7d391e3d7ed service nova] Creating event network-changed:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:25:40.125737 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8181c8d2-c03b-41e9-bf7c-556e0db05ff1 req-0442e1d5-6bf0-48ac-96a8-f7d391e3d7ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060217 May 10 02:25:40.126847 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1830/3647] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:40.264308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:40.265209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:40.271605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:40.281619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:40.282627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:40.283228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:40.608370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:40.620366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:40.625698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:40.627369 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c45f2c4-9700-4d7a-961b-336d07373ac6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 0.876017 May 10 02:25:40.630255 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1818/3648] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:39 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:40.758961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:40.761306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:40.798113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:40.800726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:40.801746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:40.805092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:40.890770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:40.898763 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba06eed3-08dc-4eed-a360-74b40c40ab01 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 0.638798 May 10 02:25:40.899418 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1831/3649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:40 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:41.080765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:41.081390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:41.093194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:41.097630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:41.098482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:41.098935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:41.244313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:41.257328 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0c2ee93-8a9e-476f-a699-30b8af5920d5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.503681 May 10 02:25:41.262660 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1819/3650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:40 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:41.574116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:41.582554 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04116991-3b03-407d-a938-249963b89dc6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 0.506168 May 10 02:25:41.595763 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1832/3651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:41 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:41.651926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:41.652919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:41.665758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:41.666613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:41.667695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:41.672061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:41.918229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:41.919264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:41.938345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:41.939383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:41.941076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:41.941769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:42.957571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:42.974587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:42.976705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:42.978360 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb252de7-4909-49c0-849f-23d3b4508298 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 1.333781 May 10 02:25:42.979459 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1820/3652] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:41 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:42.985373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:42.986342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:42.993323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:42.994605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:42.996783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:42.997417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:43.210575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:43.218026 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b88d866b-7734-4e1e-8dd2-e4dc229bce1c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 1.305374 May 10 02:25:43.219224 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1833/3653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:41 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:43.236062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:43.236928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:43.250865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:43.251627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:43.252590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:43.253196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:43.757154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:43.763205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:43.768430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3bd3d869-b29d-41f3-941d-4c63f572ef26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 0.548128 May 10 02:25:43.771949 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fea8d5f6-b825-470c-a42f-fbf5b01edbe5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.791077 May 10 02:25:43.775792 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1821/3654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:42 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:43.784460 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1834/3655] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:43 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:43.996546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:43.997340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:44.008867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:44.011217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:44.016984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:44.018950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:44.354225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db9d6b29-854c-4595-be67-7b1cd9999174 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Action: 'create', calling method: .version_select at 0x7f3d36fcd160>, body: {"keypair": {"name": "tempest-keypair-385217391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFSWFeQ6kpR5RPLK6CAqOuxvk1QYQioUNzdWMKcAKaFWO8Uv1dJE3bt6N/kSi/D0+6o5Szy3bOvv34nhKmNrHfxpY+CUHg1xzJzrD2jtd3lq3DaBnINN2Uf3gHeWZSqYw=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:44.385719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-db9d6b29-854c-4595-be67-7b1cd9999174 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Getting quotas for project cae69ae8f0254dc685572bdb1f9d6533. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:44.398383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-db9d6b29-854c-4595-be67-7b1cd9999174 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Getting quotas for user 1580117162994893ba8a33013d28fb5e and project cae69ae8f0254dc685572bdb1f9d6533. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:44.456111 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db9d6b29-854c-4595-be67-7b1cd9999174 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.299847 May 10 02:25:44.462680 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1835/3656] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:25:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:44.471478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:44.472291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:44.478591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:44.479430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:44.480430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:44.481174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:45.027334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:45.036106 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1eb3815-cf21-4210-af8c-cbcc246f4d0a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 0.571312 May 10 02:25:45.036703 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1836/3657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:44 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:45.063627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:45.064555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:45.066282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:45.078711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:45.079514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:45.082618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:45.084529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:45.085565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:45.093190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:45.098652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8959c2ec-8975-4235-8aa2-d94fa1003534 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 1.104505 May 10 02:25:45.100624 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1822/3658] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:43 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:45.107584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:45.108207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:45.127425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:45.127946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:45.128749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:45.129194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:45.676921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:45.685953 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e936f0d6-31ff-4599-b186-25a8b02da03b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 0.633426 May 10 02:25:45.686571 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1837/3659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:45 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:45.801467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:45.820103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-166ede5d-57f2-41e0-bcd1-5362a870ede9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.718266 May 10 02:25:45.830082 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1823/3660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:45 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:46.053442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:46.054270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:46.062762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.065996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.067825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.069452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.117840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:46.119322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:46.150340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.151144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.156514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.157174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.296891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:46.313939 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6ca693e2-90f3-4734-897f-7152aba8937e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 0.262061 May 10 02:25:46.315333 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1838/3661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:46.609907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:46.623327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:46.628623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:46.633493 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4b77618-f952-4b19-9b0f-69fdee704527 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1745 microversion: 2.20 time: 0.518150 May 10 02:25:46.645715 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1824/3662] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:46 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1745 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:25:46.703328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:46.703959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:46.715196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.715665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.729825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.730401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.846477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:46.855194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:46.888910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.889399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:46.890777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:46.904389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:47.360402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:47.385870 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8cbd44ed-a295-4ad4-8ce7-70df1f0fb4b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 0.685609 May 10 02:25:47.386558 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1839/3663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:46 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:47.394443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:47.395467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:47.403655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:47.404527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:47.406300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:47.407097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:47.584152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:47.592614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a16aecf0-b218-4f53-825d-5fd5000a3048 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.750633 May 10 02:25:47.593782 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1825/3664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:46 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:47.605377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "edd9dee0-e80f-4c6b-934c-df793e4de72c"}], "security_groups": [{"name": "tempest-securitygroup--243978912"}], "key_name": "tempest-keypair-385217391", "user_data": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:47.681176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:47.690276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6f434da-4866-4f69-8c21-1c243108bbd4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 0.301773 May 10 02:25:47.698585 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1840/3665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:47 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:47.707767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:47.715900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:47.740351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:47.741174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:47.743023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:47.747666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:47.889516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] validate_networks() for [('edd9dee0-e80f-4c6b-934c-df793e4de72c', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:25:48.328986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:48.354945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:48.362018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:48.368437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9bbc69e7-ae66-4ea9-9cd8-de1fc84fb3da tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 0.663431 May 10 02:25:48.372812 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1841/3666] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:47 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:48.410217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:48.411722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:48.424937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:48.425670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:48.426676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:48.427466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.406439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:25:49.406944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:25:49.407488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:25:49.407916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:25:49.408347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:25:49.431807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.432281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.438988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.445018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.494597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:49.507479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64409f94-fda1-40eb-a00f-a7b77e30fc7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 1.106710 May 10 02:25:49.523463 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1842/3667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:48 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:49.536090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Getting quotas for project cae69ae8f0254dc685572bdb1f9d6533. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:49.539663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:49.547272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:49.565509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Getting quotas for user 1580117162994893ba8a33013d28fb5e and project cae69ae8f0254dc685572bdb1f9d6533. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:49.569196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.569661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.570467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.570965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.606658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:25:49.610126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:25:49.742303 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e54cafc-9e11-4c04-9a4a-f663149df706 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.141325 May 10 02:25:49.743079 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1826/3668] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:25:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:25:49.764147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fd17836a-17a6-44db-9f69-a2c24fa7dcbb req-40a3d52a-afeb-4476-8b56-2a925e5b12fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d28bffe-ca57-4e7a-b709-155c20b52121", "name": "network-vif-plugged", "status": "completed", "tag": "ce7b6413-3593-48d5-bf63-0e2550889163"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:49.795265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fd17836a-17a6-44db-9f69-a2c24fa7dcbb req-40a3d52a-afeb-4476-8b56-2a925e5b12fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.795732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fd17836a-17a6-44db-9f69-a2c24fa7dcbb req-40a3d52a-afeb-4476-8b56-2a925e5b12fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.842097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fd17836a-17a6-44db-9f69-a2c24fa7dcbb req-40a3d52a-afeb-4476-8b56-2a925e5b12fe service nova] Creating event network-vif-plugged:ce7b6413-3593-48d5-bf63-0e2550889163 for instance 4d28bffe-ca57-4e7a-b709-155c20b52121 on n-h2-841089-2 May 10 02:25:49.862425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fd17836a-17a6-44db-9f69-a2c24fa7dcbb req-40a3d52a-afeb-4476-8b56-2a925e5b12fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118084 May 10 02:25:49.863683 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1827/3669] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:49.874941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:49.888052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:49.903097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.912215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.913102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:49.913569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:49.938923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:49.955600 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ddf041c5-9176-4151-96c8-2d3d9e069607 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.430636 May 10 02:25:49.971578 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1843/3670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:49 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:49.976627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:49.991941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:50.020785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:50.021259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:50.025201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:50.025683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:50.957527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:50.984033 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd4fd6a8-4686-4841-9928-6dd4542e1d45 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 1.115695 May 10 02:25:50.990075 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1828/3671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:49 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:50.995259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:51.010770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:51.024768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:51.025560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:51.027456 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34d57f43-a739-4dab-a758-516eadcec5bf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 1.054529 May 10 02:25:51.028922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:51.035447 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1844/3672] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:49 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:51.055968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:51.057057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:51.063178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:51.063706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:51.067036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:51.067788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:51.095027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:51.108385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:51.117251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:51.120417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:51.465172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:51.485592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f1327b33-039b-49a6-b456-7ebe4f35c726 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1229 microversion: 2.1 time: 0.493907 May 10 02:25:51.497008 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1829/3673] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:50 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1229 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:51.512942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:51.519491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:51.549150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:51.550603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:51.552020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:51.552733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:52.373398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:52.381608 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71e09b34-047f-43c9-ba94-2308ab0b31de tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1316 microversion: 2.1 time: 1.344682 May 10 02:25:52.402932 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1845/3674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:51 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1316 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:52.410067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:52.410996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:52.430909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:52.431918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:52.433343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:52.434162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:52.487687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:52.499852 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0bef44a4-8b7b-4bd4-b03a-e871841ba2f2 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 1.001270 May 10 02:25:52.504442 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1830/3675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:51 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:52.509651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-72da4e13-b10e-4660-8573-7e16afa1d343 req-0c3b1347-9466-4992-b48f-f8300669778b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-plugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}, {"server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "name": "network-vif-plugged", "status": "completed", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:52.520407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-72da4e13-b10e-4660-8573-7e16afa1d343 req-0c3b1347-9466-4992-b48f-f8300669778b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:52.521440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-72da4e13-b10e-4660-8573-7e16afa1d343 req-0c3b1347-9466-4992-b48f-f8300669778b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:52.539863 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-72da4e13-b10e-4660-8573-7e16afa1d343 req-0c3b1347-9466-4992-b48f-f8300669778b service nova] Creating event network-vif-plugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:25:52.540782 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-72da4e13-b10e-4660-8573-7e16afa1d343 req-0c3b1347-9466-4992-b48f-f8300669778b service nova] Creating event network-vif-plugged:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:25:52.551821 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-72da4e13-b10e-4660-8573-7e16afa1d343 req-0c3b1347-9466-4992-b48f-f8300669778b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045490 May 10 02:25:52.552797 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1831/3676] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:52.566667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:52.568192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:52.579004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:52.579794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:52.581027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:52.581727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:53.222016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:53.243496 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e1fd462d-2389-4419-9ab6-f285f18d81a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 0.839033 May 10 02:25:53.246827 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1846/3677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:52 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:53.254666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:53.255393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:53.262695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:53.264619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:53.272187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:53.273851 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4558f84-8fba-44f2-8f49-3291975099db tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 0.719469 May 10 02:25:53.274723 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1832/3678] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:52 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:53.288118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:53.291505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:53.294093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:53.294677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:53.578222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:53.588935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3918ab1-81be-443c-a461-d03d30180362 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1283 microversion: 2.1 time: 0.340064 May 10 02:25:53.589842 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1847/3679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:53 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1283 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:53.601656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:53.605144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:53.616220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29347381-2ab5-4de3-a254-c72c6f7b863b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Action: 'create', calling method: .version_select at 0x7f3d3645b940>, body: {"keypair": {"name": "tempest-keypair-98902076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDlcWZ5UGY4/f/jTA54ppJJ5hCziiR6u+RNocPZGQNLqFOFoRNBtxPqdhO4KaUwvWYJx3qteXJibjaZbhNr7ISqYtGCOf6iQzqljZn/E2GaqQYRJH9DX08CVRjMtNMcnQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:53.634032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:53.645360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:53.646585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:53.647212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:53.669341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-29347381-2ab5-4de3-a254-c72c6f7b863b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Getting quotas for project 7e2c55288ab4495c99a636b525230e31. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:53.675490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-29347381-2ab5-4de3-a254-c72c6f7b863b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Getting quotas for user bf50d046513b4e77b582feaf5dc353e4 and project 7e2c55288ab4495c99a636b525230e31. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:53.724833 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29347381-2ab5-4de3-a254-c72c6f7b863b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.350414 May 10 02:25:53.729950 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1833/3680] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:25:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:53.742066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:53.742925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:53.750484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:53.751231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:53.752381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:53.753654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.000809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:54.016510 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4208c02b-41cf-4daa-b8a3-e78d95652c22 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1506 microversion: 2.1 time: 0.424311 May 10 02:25:54.018881 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1848/3681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:53 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:54.038518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:54.040349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:54.049099 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eff76f3b-2299-429c-870d-a9e76628575e tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.317830 May 10 02:25:54.049926 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1834/3682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:53 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:54.076515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:54.088483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.089528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.091006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.092190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.125496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:25:54.261980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:54.262789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:54.276428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.276882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.277685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.278144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.283174 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a23ca5d5-76ac-48ae-989a-df0feb4ff7b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 204 len: 0 microversion: 2.1 time: 0.250503 May 10 02:25:54.284694 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1849/3683] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:25:54 2022] DELETE /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:25:54.301717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:54.302686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:54.329549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.330013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.330820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.333801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.767145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:54.775403 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fbd67b1f-defb-4b28-959c-9d0246e29d64 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1512 microversion: 2.1 time: 0.485656 May 10 02:25:54.781189 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1850/3684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:54 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:54.797803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:54.798676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:54.805248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.805805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:54.806610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:54.807090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:55.070761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:55.080380 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9afea1d8-6454-496a-ac82-467429d7da5b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1362 microversion: 2.1 time: 0.822280 May 10 02:25:55.090390 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1835/3685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:54 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1362 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:55.095745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:55.096681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:55.103220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:55.103984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:55.105047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:55.105762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:55.154611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:55.165864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:55.167757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:55.169125 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a9c0a45-0577-452d-b778-e8f5ca260dfb tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 0.386652 May 10 02:25:55.180665 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1851/3686] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:54 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:55.186358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:55.187832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:55.193991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:55.194663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:55.195679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:55.196288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:55.655326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:55.664246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2292bd98-5973-47b5-8370-fda1857d5228 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.482147 May 10 02:25:55.665133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1852/3687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:55 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:55.692991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:55.711974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7a6a576-d607-4650-803a-424164445cf0 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1350 microversion: 2.1 time: 0.619959 May 10 02:25:55.713955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1836/3688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:55 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1350 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:55.810199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:55.812668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:55.820129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:55.820863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:55.821881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:55.822539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:56.097592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:56.098238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:56.113633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:56.114102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:56.114914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:56.115399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:56.570725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:56.583587 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d551665c-d965-4465-b88a-f36a75bab622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1512 microversion: 2.1 time: 0.785846 May 10 02:25:56.585254 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1853/3689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:55 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1512 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:56.590484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:56.591580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:56.599231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:56.599810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:56.600699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:56.601348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:56.773889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:56.783468 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-897a3070-07fa-497b-b186-0129bdb64403 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1549 microversion: 2.1 time: 0.690596 May 10 02:25:56.784952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1837/3690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:56 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1549 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:25:56.790771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-244794632", "imageRef": "0725663d-14f5-41bf-b8f4-df47c9bbf4bf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "885b428f-6bb0-48a6-bf52-796fccf743e6"}], "security_groups": [{"name": "tempest-securitygroup--1074795900"}], "key_name": "tempest-keypair-98902076", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:57.522215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] validate_networks() for [('885b428f-6bb0-48a6-bf52-796fccf743e6', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:25:57.536508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:57.551118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:57.553381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:57.558508 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-228b87a8-ccd4-401c-9021-36547f1126ee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 0.972033 May 10 02:25:57.559235 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1854/3691] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:56 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:57.569782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:57.570930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:57.577775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:57.578548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:57.579680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:57.580334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:58.270782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:58.285326 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-86d54020-46f5-44ad-9005-80ee017b8e9b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.724712 May 10 02:25:58.285927 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1855/3692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:57 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:58.300113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:58.313833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:58.339819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:58.340303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:58.341151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:58.341602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:58.842592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:58.852377 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c2e6c0f-b5a9-4049-b553-6aaf6f1946fb tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1350 microversion: 2.1 time: 0.556078 May 10 02:25:58.853024 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1856/3693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:58 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1350 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:58.869090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:58.869884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:58.876962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:58.877692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:58.878657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:58.879465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.141866 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a42e9164-d618-431d-810c-2bd408a70121 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276342 May 10 02:25:59.142608 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1857/3694] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:25:58 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:59.148117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:59.151413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:59.173056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.176804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.177907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.178589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.210354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:25:59.211552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:25:59.214769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:25:59.215558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:25:59.216284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:25:59.234961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.238021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.239377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.240358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.269806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.270354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.270842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lazy-loading 'fault' on Instance uuid 4d28bffe-ca57-4e7a-b709-155c20b52121 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:25:59.290265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Getting quotas for project 7e2c55288ab4495c99a636b525230e31. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:25:59.312949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Getting quotas for user bf50d046513b4e77b582feaf5dc353e4 and project 7e2c55288ab4495c99a636b525230e31. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:25:59.340790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:25:59.343332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0725663d-14f5-41bf-b8f4-df47c9bbf4bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:25:59.399821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:59.407522 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74aba1cf-40dc-4132-9ef0-c7a7a89f047c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 200 len: 1306 microversion: 2.1 time: 0.263201 May 10 02:25:59.409466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1858/3695] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:59 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 1306 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:59.419806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-34d9a1f4-7b21-401b-b55e-c5b4f36113f7 req-a07e706b-c7fb-419f-bd99-4bde6bba982a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2372a766-c25a-4207-af11-0ba767798ec1", "tag": "128a123f-e71f-447a-92de-3141860e2c28"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:25:59.426433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a56fed83-dce5-484d-b206-b3be1b5775b2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.640129 May 10 02:25:59.431006 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1838/3696] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:25:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:25:59.447740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:59.448849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:59.459162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.459994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.461474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.462141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.473051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-34d9a1f4-7b21-401b-b55e-c5b4f36113f7 req-a07e706b-c7fb-419f-bd99-4bde6bba982a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.473605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-34d9a1f4-7b21-401b-b55e-c5b4f36113f7 req-a07e706b-c7fb-419f-bd99-4bde6bba982a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.506907 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-34d9a1f4-7b21-401b-b55e-c5b4f36113f7 req-a07e706b-c7fb-419f-bd99-4bde6bba982a service nova] Creating event network-changed:128a123f-e71f-447a-92de-3141860e2c28 for instance 2372a766-c25a-4207-af11-0ba767798ec1 on n-h1-841089-2 May 10 02:25:59.512076 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-34d9a1f4-7b21-401b-b55e-c5b4f36113f7 req-a07e706b-c7fb-419f-bd99-4bde6bba982a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099829 May 10 02:25:59.513221 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1859/3697] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:25:59.518611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:59.519578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:59.526321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.526988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.527978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.528589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.779294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:59.793572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ecc63f92-4180-4b64-9094-42cdd03ee77a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.278823 May 10 02:25:59.812243 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1860/3698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:59 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:25:59.825636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f88eef3a-e158-400e-8e78-76b3faec8356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:59.833079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f88eef3a-e158-400e-8e78-76b3faec8356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:59.898629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:59.922071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:59.927474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:25:59.932253 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2509c01-24c3-4ec1-9d0f-a471dc266279 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 0.492105 May 10 02:25:59.933593 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1839/3699] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:25:59 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:25:59.947776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:25:59.948882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:25:59.963166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.964011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:25:59.965038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:25:59.965646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.089924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f88eef3a-e158-400e-8e78-76b3faec8356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:00.107243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f88eef3a-e158-400e-8e78-76b3faec8356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1243 microversion: 2.1 time: 0.292388 May 10 02:26:00.109522 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1861/3700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:59 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1243 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:00.290565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:00.302219 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a913564-2326-4a7c-9d16-2e86ddb995f1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1350 microversion: 2.1 time: 0.367132 May 10 02:26:00.302823 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1840/3701] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:25:59 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1350 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:00.426796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:00.428206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:00.451377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:00.453885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.456788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:00.457804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.493527 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 HTTP/1.1 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4d28bffe-ca57-4e7a-b709-155c20b52121'} May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:00.513495 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:00.519541 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:00.521772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:00.523090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02149097-7529-4e7e-ae36-9fe4e8a1fb45 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 404 len: 111 microversion: 2.1 time: 0.101886 May 10 02:26:00.524225 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1862/3702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:00 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:00.533501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:00.534389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:00.553349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:00.554226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.555430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:00.556190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.825722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:00.826359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:00.849018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:00.849751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.850737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:00.853359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:00.976150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:01.005413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2a9d45b-31b0-41d1-832d-5f5310b062f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.467494 May 10 02:26:01.008033 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1841/3703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:00 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:01.020628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:01.021430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:01.032742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:01.033317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:01.035033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:01.035624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:01.353457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:01.362426 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9fb064ff-8cf7-4a0e-9624-f0c050e28dac tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.546694 May 10 02:26:01.372326 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1863/3704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:00 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:01.380010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:01.380655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:01.395025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:01.395525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:01.396379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:01.396829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:01.625459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:01.660984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3b1f6a4b-4eca-46cc-ae5e-463737c79476 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1301 microversion: 2.1 time: 0.287455 May 10 02:26:01.662297 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1864/3705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:01 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1301 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:01.674062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-823cfdb8-9a72-4414-873d-bf61d4365da0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-823cfdb8-9a72-4414-873d-bf61d4365da0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 163 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": 12345, "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 12345 May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:01.683371 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 10 02:26:01.689874 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:01.692732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-823cfdb8-9a72-4414-873d-bf61d4365da0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:01.694037 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-823cfdb8-9a72-4414-873d-bf61d4365da0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.029443 May 10 02:26:01.715407 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1865/3706] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:01 2022] POST /compute/v2.1/servers => generated 127 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:01.732531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:01.735362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:01.754045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:01.754520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:01.755423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:01.755843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:02.061118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:02.084455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:02.093635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:02.095577 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-134f7d2b-b9d7-4817-9b1c-3e0e02cf4840 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 1.086024 May 10 02:26:02.096399 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1842/3707] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:01 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:02.101286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:02.115658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:02.126829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:02.135914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:02.141907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:02.142722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:03.304976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:03.313468 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-213857df-cda3-4d54-8a90-91bb1c6a4ea3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1549 microversion: 2.1 time: 1.215683 May 10 02:26:03.314069 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1843/3708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:02 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1549 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:03.340290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-240e04cf-a295-4e76-9fa5-23ceb0935641 req-e8899fb4-e403-4215-beb1-bf1b96001fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:03.386097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-240e04cf-a295-4e76-9fa5-23ceb0935641 req-e8899fb4-e403-4215-beb1-bf1b96001fc3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:03.394359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-240e04cf-a295-4e76-9fa5-23ceb0935641 req-e8899fb4-e403-4215-beb1-bf1b96001fc3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:03.425185 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-240e04cf-a295-4e76-9fa5-23ceb0935641 req-e8899fb4-e403-4215-beb1-bf1b96001fc3 service nova] Creating event network-changed:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:26:03.438942 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-240e04cf-a295-4e76-9fa5-23ceb0935641 req-e8899fb4-e403-4215-beb1-bf1b96001fc3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102286 May 10 02:26:03.453962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1844/3709] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:03.469872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f510356c-2dca-4414-a18a-2c05b841547e req-0b21b2ab-b0b1-4403-8787-21480887432a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d28bffe-ca57-4e7a-b709-155c20b52121", "name": "network-vif-deleted", "tag": "ce7b6413-3593-48d5-bf63-0e2550889163"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:03.494247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f510356c-2dca-4414-a18a-2c05b841547e req-0b21b2ab-b0b1-4403-8787-21480887432a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:03.495613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f510356c-2dca-4414-a18a-2c05b841547e req-0b21b2ab-b0b1-4403-8787-21480887432a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:03.530061 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f510356c-2dca-4414-a18a-2c05b841547e req-0b21b2ab-b0b1-4403-8787-21480887432a service nova] Creating event network-vif-deleted:ce7b6413-3593-48d5-bf63-0e2550889163 for instance 4d28bffe-ca57-4e7a-b709-155c20b52121 on n-h2-841089-2 May 10 02:26:03.540935 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f510356c-2dca-4414-a18a-2c05b841547e req-0b21b2ab-b0b1-4403-8787-21480887432a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084393 May 10 02:26:03.545492 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1845/3710] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:03.554998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:03.556265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:03.565922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:03.566763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:03.571339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:03.581032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:03.596105 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afda1e14-96e3-4072-912e-e4aa2ab7ae6c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1350 microversion: 2.1 time: 1.876186 May 10 02:26:03.598811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:03.606424 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1866/3711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:01 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1350 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:03.614986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:03.633544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:03.656721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:03.657565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:03.658666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:03.659614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:04.823717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:04.841950 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-166020ff-9e5b-4e32-9d92-03899dd50b9c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.291637 May 10 02:26:04.848878 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1846/3712] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:03 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:04.857266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:04.864184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:04.884450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:04.885285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:04.886256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:04.886850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:04.959409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:04.967499 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2fe8bcd3-5481-4195-9a3e-65d19435fd66 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 1.359232 May 10 02:26:04.968700 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1867/3713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:03 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:04.993607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:04.994231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:05.026008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:05.026476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:05.027311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:05.027760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:05.176397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:05.195002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea3e56fd-5fb6-45af-8213-a963a207d9a1 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1301 microversion: 2.1 time: 0.344642 May 10 02:26:05.199114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1847/3714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:04 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1301 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:05.224984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:05.225782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:05.256971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:05.262457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:05.264513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:05.269203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.041431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:06.064069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:06.067738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:06.068934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ee794a5-c5f4-454d-8c09-5727bd069d98 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1740 microversion: 2.20 time: 1.079289 May 10 02:26:06.069719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1868/3715] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:04 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1740 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:06.097358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:06.098583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:06.119152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:06.119290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.120049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:06.120490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.224687 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ebeff09d-5669-4d3f-b9f0-ac71c29cdb86 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139678 May 10 02:26:06.225563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1869/3716] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:26:06 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:26:06.234987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:06.240483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:06.269893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:06.272749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.273634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:06.274098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.556954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:06.566104 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7cbf3061-91a9-4d7a-a2e8-095eaa18243e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1549 microversion: 2.1 time: 1.360915 May 10 02:26:06.579594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1848/3717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:05 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1549 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:06.600000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:06.600662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:06.618550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:06.619016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.633559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:06.641259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:06.984801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:06.996833 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bee792a8-fdbf-4258-a6b4-7fcd789d16d1 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1350 microversion: 2.1 time: 0.765507 May 10 02:26:07.012806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1870/3718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:06 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1350 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:07.017836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:07.018484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:07.033028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.033499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.034563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.035021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.053954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:07.066685 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-20cb13c2-040a-4b58-bb76-367d9763f854 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.485851 May 10 02:26:07.070962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1849/3719] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:06 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:07.079911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:07.085491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:07.119149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.119871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.121324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.121947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.693300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:07.710264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8ed2bfc6-28c8-43d9-ae6b-836c88b73065 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.696149 May 10 02:26:07.713292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1871/3720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:07 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:07.734324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:07.735094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:07.748655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.750862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.752832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.753777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.788059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:26:07.945535 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c8664a8-ab04-4b6e-bb86-a34cc4208181 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 204 len: 0 microversion: 2.1 time: 0.230523 May 10 02:26:07.953396 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1872/3721] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:26:07 2022] DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:26:07.969214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:07.974758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:07.992389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.993014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:07.994623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:07.995249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:08.127626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:08.137591 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82ea53ba-069a-4a15-a54a-104ce9bf15f5 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 1.065163 May 10 02:26:08.151145 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1850/3722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:07 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:08.156931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-80c12269-3cd7-439c-ae8d-2fb2d8293941 req-196ba0eb-926f-4113-b5d7-a6224e294b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2372a766-c25a-4207-af11-0ba767798ec1", "name": "network-vif-plugged", "status": "completed", "tag": "128a123f-e71f-447a-92de-3141860e2c28"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:08.182012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-80c12269-3cd7-439c-ae8d-2fb2d8293941 req-196ba0eb-926f-4113-b5d7-a6224e294b0d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:08.182725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-80c12269-3cd7-439c-ae8d-2fb2d8293941 req-196ba0eb-926f-4113-b5d7-a6224e294b0d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:08.209408 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-80c12269-3cd7-439c-ae8d-2fb2d8293941 req-196ba0eb-926f-4113-b5d7-a6224e294b0d service nova] Creating event network-vif-plugged:128a123f-e71f-447a-92de-3141860e2c28 for instance 2372a766-c25a-4207-af11-0ba767798ec1 on n-h1-841089-2 May 10 02:26:08.225884 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-80c12269-3cd7-439c-ae8d-2fb2d8293941 req-196ba0eb-926f-4113-b5d7-a6224e294b0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073031 May 10 02:26:08.240960 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1851/3723] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:08.250884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:08.253200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:08.265436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:08.265901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:08.266699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:08.267172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:08.339438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:08.351977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:08.355279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:08.357650 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04cec685-431b-499e-837c-2a8d9b9af46d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1722 microversion: 2.20 time: 0.399421 May 10 02:26:08.360251 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1873/3724] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:07 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:08.393197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:08.396026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:08.417329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:08.419989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:08.424141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:08.424779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:09.070484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:09.089510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dd072958-7f54-4652-80a6-c2c1bdd0a777 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.847027 May 10 02:26:09.091369 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1852/3725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:08 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:09.103433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:09.104330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:09.122737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:09.123481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:09.124527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:09.136651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:09.380986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:09.390623 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-971f0c8d-ae19-4c1b-96b5-7ec1660d52b2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1671 microversion: 2.1 time: 1.028827 May 10 02:26:09.406657 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1874/3726] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:08 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1671 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:09.412194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:09.424001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:09.430546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:09.431402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:09.432456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:09.434506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:09.759967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:09.769480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b19ecf85-d810-46c4-b29a-b0cf567b4b55 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1350 microversion: 2.1 time: 0.676828 May 10 02:26:09.774819 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1853/3727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:09 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1350 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:09.782855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:09.826359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:09.855875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:09.859603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:09.861774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:09.864507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:10.215232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:10.230438 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbcdb00b-1391-4f44-9fe3-4118788e046c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.822079 May 10 02:26:10.243420 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1875/3728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:09 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:10.253527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:10.254658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:10.262324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:10.263784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:10.265758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:10.266503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:10.598761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:10.626907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ba33576-ee46-4c21-9d2d-bd2d99047942 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.847811 May 10 02:26:10.627836 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1854/3729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:09 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:10.647857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:10.659770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:10.677591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:10.682407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:10.683628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:10.689369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:11.625883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:11.634943 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d8ace762-7cb4-410a-89b5-fda998393bec tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 1.389992 May 10 02:26:11.640343 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1876/3730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:10 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:11.666022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:11.667149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:11.712411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:11.722937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:11.727903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:11.728580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:11.774331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:11.792878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:11.794706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:11.796785 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-15df6d0f-626d-4ff6-84c2-9f98f41a9eb8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1722 microversion: 2.20 time: 1.161771 May 10 02:26:11.810470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1855/3731] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:10 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1722 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:11.816303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-557582bf-2de3-44ef-8a2a-f37a9e8c5321 req-31201042-a376-4c9b-8815-a170281b3375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e", "tag": "90b7d1ae-a4ce-465b-a887-a66acd33f032"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:11.824931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-557582bf-2de3-44ef-8a2a-f37a9e8c5321 req-31201042-a376-4c9b-8815-a170281b3375 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:11.825671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-557582bf-2de3-44ef-8a2a-f37a9e8c5321 req-31201042-a376-4c9b-8815-a170281b3375 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:11.837598 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-557582bf-2de3-44ef-8a2a-f37a9e8c5321 req-31201042-a376-4c9b-8815-a170281b3375 service nova] Creating event network-changed:90b7d1ae-a4ce-465b-a887-a66acd33f032 for instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e on n-h2-841089-2 May 10 02:26:11.843543 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-557582bf-2de3-44ef-8a2a-f37a9e8c5321 req-31201042-a376-4c9b-8815-a170281b3375 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030271 May 10 02:26:11.844761 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1856/3732] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:11.850403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-198310183"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:11.852003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:11.859757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:11.860557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:11.861625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:11.862335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.037727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:12.054834 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-09cd6c70-a505-49dc-aaf4-589df45ad193 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1604 microversion: 2.1 time: 0.405575 May 10 02:26:12.063271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1877/3733] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:11 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1604 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:12.080611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:12.083341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:12.105256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.113549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.114976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.115653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.404671 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21043041-060f-432f-9ea0-2e716726262a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.558162 May 10 02:26:12.406164 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1857/3734] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:11 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 10 02:26:12.425864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5358cdcb-c9f6-40f0-be43-16e374ed1134 req-5098ec16-5131-4bb3-89fc-3fcc63a95a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "name": "network-vif-unplugged", "status": "completed", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:12.436071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5358cdcb-c9f6-40f0-be43-16e374ed1134 req-5098ec16-5131-4bb3-89fc-3fcc63a95a3f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.441599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:12.442520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5358cdcb-c9f6-40f0-be43-16e374ed1134 req-5098ec16-5131-4bb3-89fc-3fcc63a95a3f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.460874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8818a89-df28-4601-818b-534bcee90a0c tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1540 microversion: 2.1 time: 0.396375 May 10 02:26:12.463492 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5358cdcb-c9f6-40f0-be43-16e374ed1134 req-5098ec16-5131-4bb3-89fc-3fcc63a95a3f service nova] Creating event network-vif-unplugged:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:26:12.465405 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1878/3735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:12 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1540 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:12.478422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5358cdcb-c9f6-40f0-be43-16e374ed1134 req-5098ec16-5131-4bb3-89fc-3fcc63a95a3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070659 May 10 02:26:12.479682 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1858/3736] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:12.482640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:12.483406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:12.487098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c82177b-8d5e-4cc5-9318-5f2fdec80ff4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-387157938", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c0b5620a-131e-4a8f-ae97-90540efa9e48", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:12.490726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.491296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.492251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.493130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.564507 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6c82177b-8d5e-4cc5-9318-5f2fdec80ff4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Block Device c0b5620a-131e-4a8f-ae97-90540efa9e48 is not bootable. May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c82177b-8d5e-4cc5-9318-5f2fdec80ff4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 357 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-387157938", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c0b5620a-131e-4a8f-ae97-90540efa9e48", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: exception: Block Device c0b5620a-131e-4a8f-ae97-90540efa9e48 is not bootable. May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-387157938', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c0b5620a-131e-4a8f-ae97-90540efa9e48'}], 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c0b5620a-131e-4a8f-ae97-90540efa9e48 is not bootable. May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:12.581231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c0b5620a-131e-4a8f-ae97-90540efa9e48 is not bootable. May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c0b5620a-131e-4a8f-ae97-90540efa9e48 is not bootable. May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c82177b-8d5e-4cc5-9318-5f2fdec80ff4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Block Device c0b5620a-131e-4a8f-ae97-90540efa9e48 is not bootable. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c82177b-8d5e-4cc5-9318-5f2fdec80ff4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.102086 May 10 02:26:12.586907 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1859/3737] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:12 2022] POST /compute/v2.1/servers => generated 110 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:12.616693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:12.620547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:12.656866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.662666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.663773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.665085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.808900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:12.820855 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f927373c-0ed5-4a41-918f-362c512f9f08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.354117 May 10 02:26:12.821147 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12553d7f-a57d-4e60-8b54-5e1c97217b27 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232113 May 10 02:26:12.822084 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1860/3738] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:26:12 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:12.822839 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1879/3739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:12 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:12.837294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:12.837925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:12.839559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:12.841766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:12.849643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.850107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.850905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.854556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.857049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.858098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:12.859931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:12.860731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.672610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:13.680231 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42fd37a4-259d-4b48-9dcd-6a1aef631c34 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 0.856116 May 10 02:26:13.680827 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1880/3740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:12 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:13.685424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:13.705665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:13.723124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:13.723951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.725662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:13.726004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:13.726561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.736101 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-64c7ed90-57d1-4f22-a45c-4116c5837b5e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.902725 May 10 02:26:13.753924 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1861/3741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:12 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:13.765666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c8ed09b4-3a6e-46f1-99a7-63f35fabcca4 req-859844d0-9eeb-4976-84f3-0e4c59c8c582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f", "name": "network-vif-deleted", "tag": "b4c87fe7-502a-4015-99c8-304fad130fc6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:13.806883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c8ed09b4-3a6e-46f1-99a7-63f35fabcca4 req-859844d0-9eeb-4976-84f3-0e4c59c8c582 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:13.812574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c8ed09b4-3a6e-46f1-99a7-63f35fabcca4 req-859844d0-9eeb-4976-84f3-0e4c59c8c582 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.855615 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c8ed09b4-3a6e-46f1-99a7-63f35fabcca4 req-859844d0-9eeb-4976-84f3-0e4c59c8c582 service nova] Creating event network-vif-deleted:b4c87fe7-502a-4015-99c8-304fad130fc6 for instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f on n-h1-841089-2 May 10 02:26:13.873213 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c8ed09b4-3a6e-46f1-99a7-63f35fabcca4 req-859844d0-9eeb-4976-84f3-0e4c59c8c582 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117813 May 10 02:26:13.884065 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1862/3742] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:13.890400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:13.891531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:13.907905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:13.908805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.910112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:13.910786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.978645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:13.979537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:13.980231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lazy-loading 'fault' on Instance uuid eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:26:14.214771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:14.235188 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-749836ba-e852-4262-b698-836aa0813af5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 200 len: 1326 microversion: 2.1 time: 0.349303 May 10 02:26:14.245357 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1863/3743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:13 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 1326 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:14.254415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:14.255473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:14.262427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:14.263219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:14.264354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:14.265599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:14.650528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:14.659478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:14.672944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:14.674502 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5578b0d-a0b9-408d-ba75-fdd124b01d61 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1725 microversion: 2.20 time: 0.992732 May 10 02:26:14.675291 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1881/3744] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:13 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1725 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:14.683137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:14.683979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:14.696979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:14.702905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:14.703986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:14.704632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:14.792503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:14.831764 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ff64e50-91a3-49af-9a87-b48546835608 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.584771 May 10 02:26:14.835477 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1864/3745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:14 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:14.853902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b0bc1af-dfe7-406a-a631-0292ee5f733a"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:14.859388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:14.873867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:14.875930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:14.878582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:14.879144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:15.363190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:15.417313 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-93c27ce6-5c2e-4bfd-8ac4-a04751878c04 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.737660 May 10 02:26:15.425466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1882/3746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:14 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:15.454634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:15.457549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:15.502749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:15.506051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:15.508406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:15.514165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:15.713467 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8fb9d0af-5fa5-4aca-88f4-a64f7341e7b5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.867936 May 10 02:26:15.714109 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1865/3747] 10.222.0.52 () {62 vars in 1363 bytes} [Tue May 10 02:26:14 2022] POST /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-volume_attachments => generated 188 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:26:15.738170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:15.738810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:15.761484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:15.761946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:15.772304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:15.783848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:15.861023 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] HTTP exception thrown: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Request method failure captured: May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f HTTP/1.1 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecw3w7Rk_2R3GrdT9k-QjXe1FcXkw9hIoh_9SUBgwsudEOtJnPaJUlBCPhzmkyH4hFfhm9Im568VLrGl1rHKMJ80kQ62e-NwSL9c9Bkj5OlSy1BgBajndTTXog5FZ-OkMGxoaL_s3AUsr3Z1Ss2ms2D__7aTOlRl_eb3XZKZeuRHdbE May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_300f71d3f6b34fa1a787c5e0f10788db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeTestJSON-1516735498 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1d0edd300fe34f92a9e265863d12718a May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f'} May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:15.870424 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:26:15.875558 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:15.882645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Returning 404 to user: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:15.890246 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6d57056-8441-4247-957e-aa84db3ab3da tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 404 len: 111 microversion: 2.1 time: 0.175034 May 10 02:26:15.896558 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1866/3748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:15 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:15.911968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25cf65a9-419c-46ed-8a85-f5ffec52af4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '.version_select at 0x7f3d364b8160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:15.971382 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25cf65a9-419c-46ed-8a85-f5ffec52af4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-741386144" status: 202 len: 0 microversion: 2.1 time: 0.073012 May 10 02:26:15.975598 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1867/3749] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-741386144 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:26:15.981271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:15.982141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:16.001597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:16.003632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:16.012434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:16.014652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:16.620307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a892b035-ef7a-4458-b6a8-36c96287051a tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-volume_attachments/8b0bc1af-dfe7-406a-a631-0292ee5f733a" status: 202 len: 0 microversion: 2.20 time: 0.641735 May 10 02:26:16.623894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1868/3750] 10.222.0.52 () {60 vars in 1456 bytes} [Tue May 10 02:26:15 2022] DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-volume_attachments/8b0bc1af-dfe7-406a-a631-0292ee5f733a => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:26:16.640356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:16.642980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:16.663504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:16.665993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:16.668620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:16.670634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:17.037573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:17.055707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bcdea4e3-bc50-4d54-bcba-badb8460bd45 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 1.626076 May 10 02:26:17.056325 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1883/3751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:15 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:17.076216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1aff163e-880f-48c5-8149-660be7031215 req-c10af0d7-1d22-4670-b141-7dfedcce4b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2372a766-c25a-4207-af11-0ba767798ec1", "tag": "128a123f-e71f-447a-92de-3141860e2c28"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:17.107200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1aff163e-880f-48c5-8149-660be7031215 req-c10af0d7-1d22-4670-b141-7dfedcce4b83 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:17.107679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1aff163e-880f-48c5-8149-660be7031215 req-c10af0d7-1d22-4670-b141-7dfedcce4b83 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:17.139030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1aff163e-880f-48c5-8149-660be7031215 req-c10af0d7-1d22-4670-b141-7dfedcce4b83 service nova] Creating event network-changed:128a123f-e71f-447a-92de-3141860e2c28 for instance 2372a766-c25a-4207-af11-0ba767798ec1 on n-h1-841089-2 May 10 02:26:17.145520 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1aff163e-880f-48c5-8149-660be7031215 req-c10af0d7-1d22-4670-b141-7dfedcce4b83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082136 May 10 02:26:17.150297 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1884/3752] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:17.157593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:17.158519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:17.165777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:17.166717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:17.167778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:17.168482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:17.292090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6286c2c3-96f3-4d1d-9c48-58e4f29c9771 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "POST /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/action" status: 202 len: 0 microversion: 2.20 time: 0.140162 May 10 02:26:17.294159 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1885/3753] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:26:17 2022] POST /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 02:26:17.304627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:17.311283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:17.328641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:17.331102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:17.333369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:17.334159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:17.806270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:17.813476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:17.817474 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1d7db9fe-6acb-4c87-b5d7-18a5bd25bd78 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 1.191351 May 10 02:26:17.832826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:17.834760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:17.835366 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1869/3754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:16 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:17.843997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49203942-8d47-4e7e-909a-d3dc2255de01 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1673 microversion: 2.20 time: 0.544380 May 10 02:26:17.856237 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1886/3755] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:17 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1673 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:26:18.074614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:18.076261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:18.091187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:18.091862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:18.092858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:18.095113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:18.368660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:18.377150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ca8e893-77dd-4714-856b-6d2c78399ff9 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 0.307538 May 10 02:26:18.397155 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1870/3756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:18 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:18.851973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:18.853286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:18.864400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:18.865322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:18.865626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:18.866386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:18.867392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:18.868133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:18.874085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:18.874549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:18.875818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:18.876448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:19.163851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:19.183182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:19.185339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:19.189102 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91e676a8-a40d-4f13-a688-24f2ac344ca0 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1673 microversion: 2.20 time: 0.329199 May 10 02:26:19.191418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1871/3757] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:18 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1673 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:26:19.206938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e2314c1-e603-4b8c-9de4-50843dd04622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-464700680", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "193324a5-9e6a-4320-a184-bbef949b550f", "destination_type": "local"}, {"source_type": "volume", "uuid": "b310f6b4-dbe2-4082-aacb-6444a68b6b68", "destination_type": "invalid"}], "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e2314c1-e603-4b8c-9de4-50843dd04622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 494 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-464700680", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "193324a5-9e6a-4320-a184-bbef949b550f", "destination_type": "local"}, {"source_type": "volume", "uuid": "b310f6b4-dbe2-4082-aacb-6444a68b6b68", "destination_type": "invalid"}], "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-464700680', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '193324a5-9e6a-4320-a184-bbef949b550f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b310f6b4-dbe2-4082-aacb-6444a68b6b68', 'destination_type': 'invalid'}], 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'invalid' May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:19.218540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e2314c1-e603-4b8c-9de4-50843dd04622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e2314c1-e603-4b8c-9de4-50843dd04622 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.026122 May 10 02:26:19.223020 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1872/3758] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:19 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:19.233257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:19.233892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:19.246390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:19.246851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:19.247811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:19.248278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:19.469572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:19.478671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a9b3f8b-282c-4f24-bb12-ec49dcada771 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1733 microversion: 2.1 time: 0.630508 May 10 02:26:19.491256 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1887/3759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:18 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1733 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:19.497690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:19.499286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:19.507803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:19.508444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:19.509345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:19.510003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:19.513871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:19.542321 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c479487-b3fa-4118-a2cc-5d5ac42b25b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.312801 May 10 02:26:19.544206 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1873/3760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:19 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:19.551192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0b0eb5c-89db-465c-aa05-eee2919f3fa9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: .version_select at 0x7f3d371d23a0>, body: {"keypair": {"name": "tempest-keypair-1123760646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvfvDudt6DUJZxIW8xuZsUYKYKTedc+TC8zOqUP5s1Q0SR3fGOMzIjNwxhVcQlaDMwAoTefzawwrLZoJjRq4vqZsySKQ5FnaBF1/yTadFd3gK+h/gcBOvgMjbaAuYJX5Q=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:19.592187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e0b0eb5c-89db-465c-aa05-eee2919f3fa9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:26:19.608420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e0b0eb5c-89db-465c-aa05-eee2919f3fa9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for user 1d0edd300fe34f92a9e265863d12718a and project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:26:19.683730 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0b0eb5c-89db-465c-aa05-eee2919f3fa9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137581 May 10 02:26:19.684832 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1874/3761] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:26:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:19.698974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:19.699908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:19.712543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:19.713573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:19.714443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:19.715095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:20.594948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:20.605909 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e176610c-0fbd-4040-a9af-667ed1a6bd05 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.914838 May 10 02:26:20.622967 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1875/3762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:19 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:20.622967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8b011681-e346-45aa-a915-23aed6834047 req-563fc556-dc40-4b62-b3a9-074903da754f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-plugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:20.639792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b011681-e346-45aa-a915-23aed6834047 req-563fc556-dc40-4b62-b3a9-074903da754f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:20.643354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8b011681-e346-45aa-a915-23aed6834047 req-563fc556-dc40-4b62-b3a9-074903da754f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:20.684149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8b011681-e346-45aa-a915-23aed6834047 req-563fc556-dc40-4b62-b3a9-074903da754f service nova] Creating event network-vif-plugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:26:20.691980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8b011681-e346-45aa-a915-23aed6834047 req-563fc556-dc40-4b62-b3a9-074903da754f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080441 May 10 02:26:20.692892 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1876/3763] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:20.699175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:20.700288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:20.734187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:20.734862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:20.735904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:20.736766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:20.850387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:20.868619 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c30ae483-6387-4ce1-be1f-22ec0678a34b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 1.367209 May 10 02:26:20.869743 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1888/3764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:19 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:20.887563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:20.890130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:20.905079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:20.905929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:20.906962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:20.907823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.482006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:21.505265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:21.507005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:21.508351 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0616a57-5c30-47c3-b675-306c26384fee tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.814100 May 10 02:26:21.508900 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1877/3765] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:20 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:21.520060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c00a464-7cae-4a99-83aa-934d1751c7a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-746181594", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:21.524782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c00a464-7cae-4a99-83aa-934d1751c7a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 491 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-746181594", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-746181594', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 10 02:26:21.533084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:21.537176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c00a464-7cae-4a99-83aa-934d1751c7a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:21.544021 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c00a464-7cae-4a99-83aa-934d1751c7a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.027075 May 10 02:26:21.544021 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1878/3766] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:21 2022] POST /compute/v2.1/servers => generated 624 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:21.544327 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a505f065-f3fc-4f5f-9467-b3cd60b670b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1713 microversion: 2.1 time: 0.669372 May 10 02:26:21.546144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1889/3767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:20 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1713 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:21.573965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:21.574970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:21.594916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.596050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.600229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.600948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.705835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:21.708737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:21.735100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.737559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.742083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.742777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.899721 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Cannot 'detach_volume' instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 while it is in vm_state rescued May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments/043b05c4-a3ba-4e44-b366-f587c732d4fd HTTP/1.1 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'detach_volume' instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 while it is in vm_state rescued May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '747ed73f-82a0-4f2b-b1c8-1ddbf6020e83', 'id': '043b05c4-a3ba-4e44-b366-f587c732d4fd'} May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 while it is in vm_state rescued May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:21.901887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 while it is in vm_state rescued May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 409 to user: Cannot 'detach_volume' instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 while it is in vm_state rescued {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d8c66d95-bb51-44ff-8845-0202be1eeb08 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments/043b05c4-a3ba-4e44-b366-f587c732d4fd" status: 409 len: 152 microversion: 2.1 time: 0.204372 May 10 02:26:21.908184 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1890/3768] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:26:21 2022] DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments/043b05c4-a3ba-4e44-b366-f587c732d4fd => generated 152 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 02:26:21.918209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:21.918848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:21.927253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:21.935474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.939351 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb0bba50-324f-457a-b63f-6d75f2f3b46d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.389232 May 10 02:26:21.943449 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1879/3769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:21 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:21.944770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.945747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.946216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.955910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:21.955910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:21.993706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:21.996726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:21.997702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.004667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:22.142588 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0bb6ffe8-0080-4878-b02e-6732edb7e485 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/action" status: 202 len: 0 microversion: 2.1 time: 0.195102 May 10 02:26:22.143578 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1880/3770] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:21 2022] POST /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:26:22.150304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:22.151007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:22.183605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.184169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:22.185323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.185875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:22.200153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:22.219525 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ebd3ffe3-7df2-468e-8025-ebcd51f5485a tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 0.307526 May 10 02:26:22.233301 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1891/3771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:21 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:22.246977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:22.247821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:22.266949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.267745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:22.268726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.269339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:22.672754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:22.696966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-786ed722-2088-460a-a30a-72ed44614ce2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.542886 May 10 02:26:22.699806 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1881/3772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:22 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:22.716459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:22.719811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:22.738804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.740411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:22.742442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:22.744432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:23.303525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:23.312690 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b766e677-e472-4a9f-92c0-7d6fcfe6d50b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1721 microversion: 2.1 time: 1.077582 May 10 02:26:23.313286 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1892/3773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:22 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1721 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:23.328002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37896be9-51c3-4911-866d-e00009f0a22d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37896be9-51c3-4911-866d-e00009f0a22d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 416 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:23.330613 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:26:23.334212 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:23.347306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37896be9-51c3-4911-866d-e00009f0a22d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:23.348348 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37896be9-51c3-4911-866d-e00009f0a22d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.034034 May 10 02:26:23.348942 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1893/3774] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:23 2022] POST /compute/v2.1/servers => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:23.367627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:23.370756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:23.399327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:23.402227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:23.406776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:23.410188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:23.797714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:23.815787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:23.817753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:23.818992 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5f269de-4296-48e8-8201-d20dedb39fd6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 1.117768 May 10 02:26:23.819597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1882/3775] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:22 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:23.834282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:23.835328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:23.843992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:23.844780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:23.845850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:23.846485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:24.149045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:24.157783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da94bc32-3b56-4476-bf13-e77706bd4a1b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 0.799843 May 10 02:26:24.158372 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1894/3776] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:23 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:24.172687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-362119126", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8682642c-6073-47d1-98e4-db33bce76423"}], "security_groups": [{"name": "tempest-securitygroup--766077638"}], "key_name": "tempest-keypair-1123760646", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:24.299693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:24.307462 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9afeb55f-480d-4171-b841-543fa6f8c338 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.483148 May 10 02:26:24.320210 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1883/3777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:23 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:24.325865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:24.326507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:24.339805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:24.340569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:24.341518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:24.342120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:24.715732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:24.726429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7af17e1-ba29-4a5a-a0a5-4ab97d42a6c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.404551 May 10 02:26:24.728531 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1884/3778] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:24 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:24.739447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:24.740326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:24.759234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:24.760084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:24.761111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:24.761722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.027388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:25.049692 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e69a133b-9af6-462d-9022-901b8d65ed65 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1721 microversion: 2.1 time: 0.319865 May 10 02:26:25.054769 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1885/3779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:24 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:25.060206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-dde69c61-ffd2-417a-9c59-b523d2273a26 req-e51bc39e-d526-44a8-8792-3b8d67987274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e", "name": "network-vif-plugged", "status": "completed", "tag": "90b7d1ae-a4ce-465b-a887-a66acd33f032"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:25.074945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-dde69c61-ffd2-417a-9c59-b523d2273a26 req-e51bc39e-d526-44a8-8792-3b8d67987274 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.075702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-dde69c61-ffd2-417a-9c59-b523d2273a26 req-e51bc39e-d526-44a8-8792-3b8d67987274 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.109776 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-dde69c61-ffd2-417a-9c59-b523d2273a26 req-e51bc39e-d526-44a8-8792-3b8d67987274 service nova] Creating event network-vif-plugged:90b7d1ae-a4ce-465b-a887-a66acd33f032 for instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e on n-h2-841089-2 May 10 02:26:25.120863 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-dde69c61-ffd2-417a-9c59-b523d2273a26 req-e51bc39e-d526-44a8-8792-3b8d67987274 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064445 May 10 02:26:25.122062 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1886/3780] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:25.136783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:25.137795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:25.152269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.153035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.154025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.154630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.456333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:25.470624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:25.472308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:25.473702 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-edc0a48a-4d90-4a30-8398-96c7403da995 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.350285 May 10 02:26:25.485480 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1887/3781] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:25 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:25.490947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2796b58-8206-484f-80ed-2a85addc222b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805018338", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": -1, "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:25.504226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f2796b58-8206-484f-80ed-2a85addc222b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Flavor -1 could not be found. May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2796b58-8206-484f-80ed-2a85addc222b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 205 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805018338", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": -1, "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: exception: Flavor -1 could not be found. May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-805018338', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': -1, 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:25.519036 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2796b58-8206-484f-80ed-2a85addc222b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2796b58-8206-484f-80ed-2a85addc222b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.034122 May 10 02:26:25.523042 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1888/3782] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:25 2022] POST /compute/v2.1/servers => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:26:25.532512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:25.533145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:25.549294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.549848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.550668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.556140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.745498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:25.758909 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8506b3a6-0673-4370-8124-0601352a43ce tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 0.232655 May 10 02:26:25.776854 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1889/3783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:25 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:25.788857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:25.792047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:25.810533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.813996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:25.817738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:25.818537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:26.099368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:26.111283 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9855f406-4147-47a1-86bc-831fb997a50a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.332147 May 10 02:26:26.111849 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1890/3784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:25 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:26.130594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:26.131331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:26.137626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:26.138095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:26.138896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:26.139463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:26.438266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:26.450211 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-560ba85e-841c-4272-b55e-c87f8f711fdd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1721 microversion: 2.1 time: 0.325139 May 10 02:26:26.464235 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1891/3785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:26 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:26.469691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:26.477799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:26.485120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:26.489782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:26.490920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:26.491634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:26.760034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:26.777981 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c6c0944-d7b8-4041-ba37-743180f880d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.312106 May 10 02:26:26.781996 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1892/3786] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:26 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:26.803571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:26.804256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:26.813402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:26.814086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:26.815434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:26.826521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:27.134064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:27.146052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:27.148405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:27.150030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf587a5e-71b9-478a-9c44-c5796c97fb11 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.363834 May 10 02:26:27.163596 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1893/3787] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:26 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:27.169453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:27.181195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:27.188808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:27.189627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:27.190685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:27.191892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:27.517022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:27.525750 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-588bf526-ab16-4770-8f79-686bb1e90fa2 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1369 microversion: 2.1 time: 0.360588 May 10 02:26:27.526354 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1894/3788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:27 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1369 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:27.543239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b47d7c76-ac9b-4250-b941-8e451bdf02e5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1509305744", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b47d7c76-ac9b-4250-b941-8e451bdf02e5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 173 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1509305744", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1509305744', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi -1 May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:27.546865 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b47d7c76-ac9b-4250-b941-8e451bdf02e5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b47d7c76-ac9b-4250-b941-8e451bdf02e5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.021025 May 10 02:26:27.553079 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1895/3789] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:27 2022] POST /compute/v2.1/servers => generated 145 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:27.567820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:27.577692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:27.601002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:27.601516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:27.602722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:27.603205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:27.862058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:27.875850 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-217e6a1f-aa6d-405d-9354-c20932039df3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1727 microversion: 2.1 time: 0.325851 May 10 02:26:27.876482 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1896/3790] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:27 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1727 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:27.902833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:27.903724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:27.925177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:27.928722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:27.930660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:27.932818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:28.954848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:28.985784 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e215283-60ab-46b6-b1e6-55a99fa2a7ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.088749 May 10 02:26:28.988004 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1897/3791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:27 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:28.994688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:28.995851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:29.008323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.009054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.010015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.010655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.116240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5e71b08-0ba6-49aa-99b3-9172381b0b6c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126914 May 10 02:26:29.122594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1898/3792] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:26:28 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:29.123055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:29.123794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:29.136096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.136559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.137367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.137816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.588708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:29.601745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:29.604666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:29.607031 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec0dd7db-fd52-4096-92ae-48acc4701b86 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.488366 May 10 02:26:29.608526 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1899/3793] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:29 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:29.615555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:29.616189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:29.641544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.642077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.642931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.643615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.945937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:29.958502 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cf1e8a77-efbe-4a94-84fe-84ada0ceb868 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1556 microversion: 2.1 time: 0.348800 May 10 02:26:29.959412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1900/3794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:29 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1556 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:29.964321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:29.965364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:29.983690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.984247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:29.985334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:29.988053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:30.388605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:30.408054 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-856edb50-72de-4b96-b273-8f5f5665ccf3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.447383 May 10 02:26:30.412616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1901/3795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:29 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:30.423335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:30.424266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:30.452882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:30.453365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:30.458019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:30.458642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:30.680319 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad6e7b1f-2f8b-4014-86c8-54016188972c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.266196 May 10 02:26:30.695269 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1902/3796] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:26:30 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:30.706258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c4dec13-0151-4b18-be4b-d760a39e1164 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1719519675", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:30.721518 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6c4dec13-0151-4b18-be4b-d760a39e1164 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c4dec13-0151-4b18-be4b-d760a39e1164 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 216 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1719519675", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1719519675', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:30.723576 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 10 02:26:30.727859 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:30.734485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c4dec13-0151-4b18-be4b-d760a39e1164 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:30.737022 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c4dec13-0151-4b18-be4b-d760a39e1164 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.039053 May 10 02:26:30.739286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1903/3797] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:30 2022] POST /compute/v2.1/servers => generated 123 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:30.750932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:30.756212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:30.779333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:30.781270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:30.786750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:30.788838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:31.225837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:31.243100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:31.250277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:31.253882 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db44921c-9a8a-4f5e-afb3-f22dcb716145 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.509478 May 10 02:26:31.257839 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1904/3798] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:30 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:31.272204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:31.274035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:31.313939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:31.315561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:31.319553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:31.320095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:31.821847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:31.836379 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-af3941b6-feb6-48b8-bed3-3407165b8b1d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.577122 May 10 02:26:31.843127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1905/3799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:31 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:31.848869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9bf62449-7643-4457-b8b7-7b2d6eb18624 req-9f249cbe-bb6c-417d-9740-211bc05557c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747ed73f-82a0-4f2b-b1c8-1ddbf6020e83", "tag": "e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:31.870989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9bf62449-7643-4457-b8b7-7b2d6eb18624 req-9f249cbe-bb6c-417d-9740-211bc05557c9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:31.871537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9bf62449-7643-4457-b8b7-7b2d6eb18624 req-9f249cbe-bb6c-417d-9740-211bc05557c9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:31.901201 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9bf62449-7643-4457-b8b7-7b2d6eb18624 req-9f249cbe-bb6c-417d-9740-211bc05557c9 service nova] Creating event network-changed:e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf for instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 on n-h2-841089-2 May 10 02:26:31.915690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9bf62449-7643-4457-b8b7-7b2d6eb18624 req-9f249cbe-bb6c-417d-9740-211bc05557c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071760 May 10 02:26:31.919099 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1906/3800] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:31.938542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:31.939450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:31.956396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:31.957891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:31.959269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:31.959776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:32.569336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:32.587268 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3bb58ec3-6506-43e0-89d2-3dc36feac94d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.666487 May 10 02:26:32.589094 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1907/3801] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:31 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:32.602754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:32.615279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:32.656662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:32.657233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:32.658544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:32.682701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:33.199194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:33.210593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:33.214431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:33.224383 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0259c81e-d6f2-44ca-8726-84114bf6185f tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.634177 May 10 02:26:33.225334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1908/3802] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:32 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:33.237509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-834d68ed-fe5e-4d31-a27c-e726b13504b9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561465202", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-key-1082695210", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:36.724840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-834d68ed-fe5e-4d31-a27c-e726b13504b9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] validate_networks() for [('544152f2-1965-429f-8d0a-33756737e75a', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:26:36.908378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] validate_networks() for [('8682642c-6073-47d1-98e4-db33bce76423', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:26:37.193373 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-834d68ed-fe5e-4d31-a27c-e726b13504b9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Invalid key_name provided. May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-834d68ed-fe5e-4d31-a27c-e726b13504b9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 246 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561465202", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-key-1082695210", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid key_name provided. May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-561465202', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'key_name': 'tempest-key-1082695210', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1082695210 not found for user 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:37.217778 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-834d68ed-fe5e-4d31-a27c-e726b13504b9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid key_name provided. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-834d68ed-fe5e-4d31-a27c-e726b13504b9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 3.989267 May 10 02:26:37.223038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1909/3803] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:33 2022] POST /compute/v2.1/servers => generated 70 bytes in 3993 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:26:37.229500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a94c7e69-43a8-40fd-a996-406d70d740bc req-fca2f47b-9d5d-4de6-9cb8-44b4a60da9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747ed73f-82a0-4f2b-b1c8-1ddbf6020e83", "tag": "e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:37.247396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a94c7e69-43a8-40fd-a996-406d70d740bc req-fca2f47b-9d5d-4de6-9cb8-44b4a60da9f0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:37.247857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a94c7e69-43a8-40fd-a996-406d70d740bc req-fca2f47b-9d5d-4de6-9cb8-44b4a60da9f0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:37.273399 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a94c7e69-43a8-40fd-a996-406d70d740bc req-fca2f47b-9d5d-4de6-9cb8-44b4a60da9f0 service nova] Creating event network-changed:e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf for instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 on n-h2-841089-2 May 10 02:26:37.280269 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a94c7e69-43a8-40fd-a996-406d70d740bc req-fca2f47b-9d5d-4de6-9cb8-44b4a60da9f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055720 May 10 02:26:37.285931 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1910/3804] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:37.295998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:37.296760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:37.329468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:37.330780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:37.333265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:37.333927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.185367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:38.214562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:38.219944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:38.225894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-521a6b9c-0bee-4c16-9339-063e2a458e6c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.936607 May 10 02:26:38.228944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1911/3805] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:37 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:38.237772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4668be98-2db9-41c7-87d0-74cf86c3620b req-a8cbfbf3-607a-47c3-a564-cfe3ef02b6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e", "tag": "90b7d1ae-a4ce-465b-a887-a66acd33f032"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:38.249751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4668be98-2db9-41c7-87d0-74cf86c3620b req-a8cbfbf3-607a-47c3-a564-cfe3ef02b6d8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.250860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4668be98-2db9-41c7-87d0-74cf86c3620b req-a8cbfbf3-607a-47c3-a564-cfe3ef02b6d8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.269353 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4668be98-2db9-41c7-87d0-74cf86c3620b req-a8cbfbf3-607a-47c3-a564-cfe3ef02b6d8 service nova] Creating event network-changed:90b7d1ae-a4ce-465b-a887-a66acd33f032 for instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e on n-h2-841089-2 May 10 02:26:38.279755 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4668be98-2db9-41c7-87d0-74cf86c3620b req-a8cbfbf3-607a-47c3-a564-cfe3ef02b6d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048310 May 10 02:26:38.280749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1912/3806] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:38.304395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:38.305485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:38.317222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.318134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.319217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.320059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.483294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:26:38.484367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:26:38.485062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:26:38.485703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:26:38.486451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:26:38.508015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.508721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.515251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.515821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.535634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:26:38.541622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Getting quotas for user 1d0edd300fe34f92a9e265863d12718a and project 300f71d3f6b34fa1a787c5e0f10788db. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:26:38.556085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:26:38.559619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:26:38.628254 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc7d387e-6ad2-4253-8b9f-264521aed9d0 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 14.460242 May 10 02:26:38.638016 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1895/3807] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 14471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:26:38.643032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:38.653187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:38.668751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.672023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.673062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.674859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.711898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:38.721101 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c209ec8-e936-4317-aad5-4f45e32c3176 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.438875 May 10 02:26:38.726846 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1913/3808] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:38 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:38.736996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d103406a-d3c9-453b-91e1-e7fb9fd620ec tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:38.737657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d103406a-d3c9-453b-91e1-e7fb9fd620ec tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:38.895730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d103406a-d3c9-453b-91e1-e7fb9fd620ec tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:38.910631 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d103406a-d3c9-453b-91e1-e7fb9fd620ec tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1237 microversion: 2.1 time: 0.183588 May 10 02:26:38.920974 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1914/3809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:38 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1237 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:38.938520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1160440841"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:38.939728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:38.956179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.956179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.956674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:38.957122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:38.976572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:38.989662 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8ca22517-ca88-4886-8e01-80131b8c1ab2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.350244 May 10 02:26:38.990850 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1896/3810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:38 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:39.012239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:39.012875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:39.039504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.040161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.041582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.043455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.398303 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-edf5b4a0-f4b1-4256-a831-20e7282aa2ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.471957 May 10 02:26:39.399920 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1915/3811] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:38 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 10 02:26:39.425616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:39.427477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:39.441128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.441798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.442643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.443110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.596730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:39.605065 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c3a5f4d1-8530-410f-9c57-a558d53d59f6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.598989 May 10 02:26:39.605659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1897/3812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:39 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:39.675821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:39.679447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-707309ce-6522-495e-a2ad-3e957b762e2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2083317877", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:39.685349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:39.687203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:39.688694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e542e531-e003-4570-980c-9554e97aea88 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.287289 May 10 02:26:39.689436 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1916/3813] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:39 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:39.777690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.security_group_api [None req-707309ce-6522-495e-a2ad-3e957b762e2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Neutron security group does_not_exist not found {{(pid=118717) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 10 02:26:39.778933 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-707309ce-6522-495e-a2ad-3e957b762e2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-707309ce-6522-495e-a2ad-3e957b762e2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 258 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2083317877", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: exception: Unable to find security_group with name or id 'does_not_exist' May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2083317877', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 10 02:26:39.796916 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._create_instance( May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:39.801775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-707309ce-6522-495e-a2ad-3e957b762e2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:39.806053 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-707309ce-6522-495e-a2ad-3e957b762e2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.123985 May 10 02:26:39.806053 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1898/3814] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:39 2022] POST /compute/v2.1/servers => generated 106 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:39.807365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:39.807981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:39.814749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.815508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.816490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.816945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.934659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:39.936409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:39.945275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.946852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.948009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:39.948730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:39.976226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:39.984264 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-84076941-0cd1-43d5-a7fa-be7c82be7b47 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.180846 May 10 02:26:39.984856 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1917/3815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:39 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:40.001815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.002726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.009062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.009526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.010326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.010774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.023491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.031735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4eedb5e9-bb4a-4598-8e7b-fbd2b46a956e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1289 microversion: 2.1 time: 0.107327 May 10 02:26:40.032329 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1899/3816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:39 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:40.144819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.152262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c6f9f03-70a7-451b-88f8-2f65b25cf1f7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.154432 May 10 02:26:40.152845 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1918/3817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:39 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:40.169445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd0a0f4d-8304-4fcf-a744-819c14101fc5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.170148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd0a0f4d-8304-4fcf-a744-819c14101fc5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: a00e5f52-a161-4d38-964f-523a42d4e296] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.175812 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-bd0a0f4d-8304-4fcf-a744-819c14101fc5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance a00e5f52-a161-4d38-964f-523a42d4e296 could not be found. May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd0a0f4d-8304-4fcf-a744-819c14101fc5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/a00e5f52-a161-4d38-964f-523a42d4e296 HTTP/1.1 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance a00e5f52-a161-4d38-964f-523a42d4e296 could not be found. May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'a00e5f52-a161-4d38-964f-523a42d4e296'} May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00e5f52-a161-4d38-964f-523a42d4e296 could not be found. May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00e5f52-a161-4d38-964f-523a42d4e296 could not be found. May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:40.177341 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00e5f52-a161-4d38-964f-523a42d4e296 could not be found. May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd0a0f4d-8304-4fcf-a744-819c14101fc5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance a00e5f52-a161-4d38-964f-523a42d4e296 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd0a0f4d-8304-4fcf-a744-819c14101fc5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a00e5f52-a161-4d38-964f-523a42d4e296" status: 404 len: 111 microversion: 2.1 time: 0.013553 May 10 02:26:40.185491 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1900/3818] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:26:40 2022] DELETE /compute/v2.1/servers/a00e5f52-a161-4d38-964f-523a42d4e296 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:40.191769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.192565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.200544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.201224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.202797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.203445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.353334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.363982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f32015d9-c43c-4bf7-b320-cb4bd1ef6ae8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.176089 May 10 02:26:40.364742 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1919/3819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:40 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:40.382411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.383380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.393268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.393727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.394636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.395116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.533464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.541258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-281da606-24b8-4790-8f7b-cc6064be875a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.163415 May 10 02:26:40.541985 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1901/3820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:40 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:40.557887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-897786c3-5c93-4279-b17e-9d8d749b8319 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.558443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-897786c3-5c93-4279-b17e-9d8d749b8319 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Failed to fetch instance by id 9223372036854775808 {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:26:40.558894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-897786c3-5c93-4279-b17e-9d8d749b8319 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-897786c3-5c93-4279-b17e-9d8d749b8319 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 9223372036854775808 could not be found. May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '9223372036854775808'} May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:40.560606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-897786c3-5c93-4279-b17e-9d8d749b8319 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-897786c3-5c93-4279-b17e-9d8d749b8319 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008828 May 10 02:26:40.565700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1920/3821] 10.222.0.52 () {58 vars in 1187 bytes} [Tue May 10 02:26:40 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 02:26:40.571306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.572094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.579824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.580283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.581100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.581546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.710617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.711445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.718091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.718644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.719562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.720199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.737489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.745930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a2fe1d71-a185-48ab-9c7e-a338439c848c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.178225 May 10 02:26:40.747395 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1902/3822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:40 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:40.769274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:40.770510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:40.779047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.779716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.780787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:40.781341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:40.963575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.974116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.975783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:40.977195 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e220ce5-594d-4061-9bd0-bc1184486e0c tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.271501 May 10 02:26:40.977864 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1921/3823] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:40 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:41.034628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:41.048125 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2b201e02-ca64-48b1-8604-f5463c931eb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.286753 May 10 02:26:41.049592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:41.050114 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1903/3824] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:40 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:41.050616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:41.056777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.058236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.059302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.060774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.069585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0c2dd07-968d-4938-8fd2-0df37aba3904 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:41.070906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0c2dd07-968d-4938-8fd2-0df37aba3904 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Failed to fetch instance by id -1 {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:26:41.071970 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a0c2dd07-968d-4938-8fd2-0df37aba3904 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance -1 could not be found. May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0c2dd07-968d-4938-8fd2-0df37aba3904 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance -1 could not be found. May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '-1'} May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:41.073760 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:41.078764 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:41.078764 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:41.078764 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 10 02:26:41.078764 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.080467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0c2dd07-968d-4938-8fd2-0df37aba3904 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance -1 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:41.081598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0c2dd07-968d-4938-8fd2-0df37aba3904 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018910 May 10 02:26:41.082458 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1904/3825] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:26:41 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 02:26:41.106700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:41.107515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:41.118255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.118715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.119538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.119984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.180801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:41.191662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37c084c5-eae5-405c-a8ca-6d035e6385fb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1295 microversion: 2.1 time: 0.146191 May 10 02:26:41.192647 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1922/3826] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:41 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1295 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:41.335283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:41.344678 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ce22d20-94e6-47e9-b71c-f909bd253bef tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.255845 May 10 02:26:41.345798 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1905/3827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:41 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:41.378248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:41.378878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:41.402302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.403689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.405403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.407051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.646480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:41.654711 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b123dc1b-5e7f-4dbb-b3c4-e58e8d282163 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.291892 May 10 02:26:41.660188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1923/3828] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:41 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:41.676199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c60c41a-18dc-4b98-90b5-e7cf2bb9b1f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:41.677102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c60c41a-18dc-4b98-90b5-e7cf2bb9b1f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:41.684300 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5c60c41a-18dc-4b98-90b5-e7cf2bb9b1f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa could not be found. May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c60c41a-18dc-4b98-90b5-e7cf2bb9b1f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa/action HTTP/1.1 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 19 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: {"forceDelete": {}} May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa could not be found. May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa', 'body': {'forceDelete': {}}} May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa could not be found. May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa could not be found. May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:41.694678 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa could not be found. May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c60c41a-18dc-4b98-90b5-e7cf2bb9b1f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c60c41a-18dc-4b98-90b5-e7cf2bb9b1f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa/action" status: 404 len: 111 microversion: 2.1 time: 0.025422 May 10 02:26:41.703415 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1906/3829] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:41 2022] POST /compute/v2.1/servers/0a72aa28-2b1a-475f-8eae-e8f7a37ad8aa/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:41.707627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:41.708095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:41.716593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.717110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.718886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:41.719353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:41.949493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:41.983374 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79dfedac-0345-4814-a52d-ecfbad338a13 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.281117 May 10 02:26:41.996392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:41.996907 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1924/3830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:41 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:41.997851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:42.007896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.008107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:42.008885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.009138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:42.010156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.010817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.016957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.017425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.018218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.018662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.368035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:42.381467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:42.381918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:42.383437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:42.384981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fdbe6545-8fdc-4a2c-b58a-6a19019a7897 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.392877 May 10 02:26:42.395505 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1907/3831] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:41 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:42.401561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:42.402466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:42.411445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.412088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.413057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.414489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.424821 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ad9a218-90a5-4ee9-a962-ad2eeb31b51c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.424614 May 10 02:26:42.440491 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1925/3832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:41 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:42.477524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4a433b6-97ea-42c8-af15-e77d18e7b84a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:42.492293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4a433b6-97ea-42c8-af15-e77d18e7b84a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 66c596b7-0a73-4a11-925f-e21971b64bec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:42.505116 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e4a433b6-97ea-42c8-af15-e77d18e7b84a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 66c596b7-0a73-4a11-925f-e21971b64bec could not be found. May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4a433b6-97ea-42c8-af15-e77d18e7b84a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/66c596b7-0a73-4a11-925f-e21971b64bec/action HTTP/1.1 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 39 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: {"os-getConsoleOutput": {"length": 10}} May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 66c596b7-0a73-4a11-925f-e21971b64bec could not be found. May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '66c596b7-0a73-4a11-925f-e21971b64bec', 'body': {'os-getConsoleOutput': {'length': 10}}} May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c596b7-0a73-4a11-925f-e21971b64bec could not be found. May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c596b7-0a73-4a11-925f-e21971b64bec could not be found. May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:42.511960 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:42.517543 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:42.517543 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:42.517543 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:42.517543 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:42.517543 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c596b7-0a73-4a11-925f-e21971b64bec could not be found. May 10 02:26:42.517543 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:42.520150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4a433b6-97ea-42c8-af15-e77d18e7b84a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 66c596b7-0a73-4a11-925f-e21971b64bec could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:42.521298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4a433b6-97ea-42c8-af15-e77d18e7b84a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/66c596b7-0a73-4a11-925f-e21971b64bec/action" status: 404 len: 111 microversion: 2.1 time: 0.079103 May 10 02:26:42.526955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1926/3833] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:42 2022] POST /compute/v2.1/servers/66c596b7-0a73-4a11-925f-e21971b64bec/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:42.533749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ac6ff56a-f095-466f-9655-603e9d558a44 req-65883262-1173-4649-b8a8-d05a10b5aad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6675fb3c-50fc-4c49-bd0f-e9f6f68f4467", "tag": "1575eff5-abd5-44f8-9e9b-2d8c882e85a6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:42.547417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ac6ff56a-f095-466f-9655-603e9d558a44 req-65883262-1173-4649-b8a8-d05a10b5aad9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.548102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ac6ff56a-f095-466f-9655-603e9d558a44 req-65883262-1173-4649-b8a8-d05a10b5aad9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.568042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ac6ff56a-f095-466f-9655-603e9d558a44 req-65883262-1173-4649-b8a8-d05a10b5aad9 service nova] Creating event network-changed:1575eff5-abd5-44f8-9e9b-2d8c882e85a6 for instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 on n-h1-841089-2 May 10 02:26:42.577823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ac6ff56a-f095-466f-9655-603e9d558a44 req-65883262-1173-4649-b8a8-d05a10b5aad9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049297 May 10 02:26:42.579496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1927/3834] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:42.587980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4c2bcb5e-ff92-4473-ae50-e415c249977f req-2cba85d9-33b9-4a51-bb70-96b5bec9311a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-unplugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:42.600920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4c2bcb5e-ff92-4473-ae50-e415c249977f req-2cba85d9-33b9-4a51-bb70-96b5bec9311a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.601387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4c2bcb5e-ff92-4473-ae50-e415c249977f req-2cba85d9-33b9-4a51-bb70-96b5bec9311a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.618326 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4c2bcb5e-ff92-4473-ae50-e415c249977f req-2cba85d9-33b9-4a51-bb70-96b5bec9311a service nova] Creating event network-vif-unplugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:26:42.627398 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4c2bcb5e-ff92-4473-ae50-e415c249977f req-2cba85d9-33b9-4a51-bb70-96b5bec9311a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045123 May 10 02:26:42.628356 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1928/3835] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:42.635931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:42.636651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:42.652132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.653522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.655013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.655945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.661402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:42.669278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a43c9d6-5ba5-4e00-97e1-6ab9a6f2f129 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1362 microversion: 2.1 time: 0.272614 May 10 02:26:42.669868 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1908/3836] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:42 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:42.893727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:42.901520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5216188-68f2-4ad9-bf8c-a40c2a884d77 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.271962 May 10 02:26:42.902111 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1929/3837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:42 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:42.923247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:42.924181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:42.933532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.934512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:42.935454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:42.935914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.148618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:43.158670 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-395fb33b-2fb7-48e8-9a7b-3170d3d01eda tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.241720 May 10 02:26:43.173097 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1909/3838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:42 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:43.176117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6fb2e825-f472-4eff-9d5b-46cae0cdd257 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:43.177224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6fb2e825-f472-4eff-9d5b-46cae0cdd257 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 3ea9550b-4755-4ea7-b2ac-a9213aabe16a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:43.186279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6fb2e825-f472-4eff-9d5b-46cae0cdd257 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 3ea9550b-4755-4ea7-b2ac-a9213aabe16a could not be found. May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6fb2e825-f472-4eff-9d5b-46cae0cdd257 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/3ea9550b-4755-4ea7-b2ac-a9213aabe16a HTTP/1.1 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 3ea9550b-4755-4ea7-b2ac-a9213aabe16a could not be found. May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '3ea9550b-4755-4ea7-b2ac-a9213aabe16a'} May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea9550b-4755-4ea7-b2ac-a9213aabe16a could not be found. May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea9550b-4755-4ea7-b2ac-a9213aabe16a could not be found. May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:43.192513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:43.197374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:43.197374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:43.197374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:43.197374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea9550b-4755-4ea7-b2ac-a9213aabe16a could not be found. May 10 02:26:43.197374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.204760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6fb2e825-f472-4eff-9d5b-46cae0cdd257 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 3ea9550b-4755-4ea7-b2ac-a9213aabe16a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:43.206321 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6fb2e825-f472-4eff-9d5b-46cae0cdd257 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/3ea9550b-4755-4ea7-b2ac-a9213aabe16a" status: 404 len: 111 microversion: 2.1 time: 0.034193 May 10 02:26:43.207480 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1930/3839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:43 2022] GET /compute/v2.1/servers/3ea9550b-4755-4ea7-b2ac-a9213aabe16a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:43.220521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:43.221313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:43.228674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.229291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.230276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.231149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.409150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:43.410521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:43.411574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:43.419178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29693b3f-ea55-4d42-8303-d03141dae1e7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.205009 May 10 02:26:43.420193 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1910/3840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:43 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:43.421464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.421921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.422877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.423341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.440327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:43.442325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:43.461006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.464804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.467784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.468294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.671841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:43.680238 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f5e23e5b-c1b4-4433-84d3-7af85e052f72 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.247929 May 10 02:26:43.681000 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1911/3841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:43 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:43.689556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:43.690168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:43.697585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:43.700132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.700770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.702805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.703446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.709121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:43.710792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:43.712315 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7cee246e-68e5-4e56-a083-95b85bb634d8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.310083 May 10 02:26:43.723812 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1931/3842] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:43 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:43.812674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcfead29-e5b6-4fe5-8a22-86e8dc628f74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-928486216", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcfead29-e5b6-4fe5-8a22-86e8dc628f74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 237 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-928486216", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-928486216', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:43.815813 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcfead29-e5b6-4fe5-8a22-86e8dc628f74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:43.820021 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bcfead29-e5b6-4fe5-8a22-86e8dc628f74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012404 May 10 02:26:43.821179 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1932/3843] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:26:43.833088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:43.835121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:43.849054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.849536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:43.850367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:43.853537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.012342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:44.021334 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-66e7f036-e719-47fe-86b0-c8527fb89ff9 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1362 microversion: 2.1 time: 0.337553 May 10 02:26:44.021916 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1912/3844] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:43 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:44.104341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:44.115805 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0576e07c-6feb-4252-b9bc-1cfa0e7cae55 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.288229 May 10 02:26:44.120247 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1933/3845] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:43 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:44.134786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:44.135446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:44.161123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.161870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.162819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.163303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.428141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:44.438081 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-17c8963e-3262-495f-a47f-cd5c0eceb905 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.307527 May 10 02:26:44.459167 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1913/3846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:44 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:44.616850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79fde774-cdb8-4215-bc2d-d418fad63a9f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1465775542", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79fde774-cdb8-4215-bc2d-d418fad63a9f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 235 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1465775542", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1465775542', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = func(instance) May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'notvalid' May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:44.649735 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 10 02:26:44.655266 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:44.660351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79fde774-cdb8-4215-bc2d-d418fad63a9f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:44.673335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c14c21b2-8570-4b16-a267-f86b9d8ac739 req-0f29f8b5-2e41-46e9-9bc4-c5bbf6342c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "name": "network-vif-plugged", "status": "completed", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:44.681482 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79fde774-cdb8-4215-bc2d-d418fad63a9f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.050750 May 10 02:26:44.691473 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1934/3847] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:26:44 2022] POST /compute/v2.1/servers => generated 133 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:26:44.703915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c14c21b2-8570-4b16-a267-f86b9d8ac739 req-0f29f8b5-2e41-46e9-9bc4-c5bbf6342c37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.704377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c14c21b2-8570-4b16-a267-f86b9d8ac739 req-0f29f8b5-2e41-46e9-9bc4-c5bbf6342c37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.708321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:44.709746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:44.739933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.743901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.746281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.747867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.756655 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c14c21b2-8570-4b16-a267-f86b9d8ac739 req-0f29f8b5-2e41-46e9-9bc4-c5bbf6342c37 service nova] Creating event network-vif-plugged:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:26:44.770194 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c14c21b2-8570-4b16-a267-f86b9d8ac739 req-0f29f8b5-2e41-46e9-9bc4-c5bbf6342c37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102470 May 10 02:26:44.770994 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1914/3848] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:26:44.793909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:44.794700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:44.826250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.826250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:44.827099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:44.827528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.087906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:45.102294 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8ca097c-647a-4838-8237-0e4723360cf8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.405646 May 10 02:26:45.103677 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1935/3849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:44 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:45.124762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:45.127664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:45.148141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:45.150855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.152056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:45.156433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.390969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:45.407576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:45.414317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:45.417048 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56cfb030-25ad-4834-8716-be9138004e1b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.645062 May 10 02:26:45.419268 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1915/3850] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:44 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:45.437868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:45.441556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:45.453846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:45.455126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.456758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:45.458064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.586108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:45.593981 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f32035bc-0d22-4555-b79e-496b85761795 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1362 microversion: 2.1 time: 0.488919 May 10 02:26:45.604175 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1936/3851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:45 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:45.692149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:45.699885 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2b96ae20-1e17-4ff1-b732-d8cd8edf9ed5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.278562 May 10 02:26:45.702745 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1916/3852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:45 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:45.718908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d328ca2-4c6b-4ecb-a872-9e14dc162ed0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:45.720190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d328ca2-4c6b-4ecb-a872-9e14dc162ed0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: f89e18af-c067-4dfd-9fdb-e703a029cb11] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:45.730039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2d328ca2-4c6b-4ecb-a872-9e14dc162ed0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance f89e18af-c067-4dfd-9fdb-e703a029cb11 could not be found. May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d328ca2-4c6b-4ecb-a872-9e14dc162ed0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/f89e18af-c067-4dfd-9fdb-e703a029cb11/action HTTP/1.1 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 13 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: {"pause": {}} May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f89e18af-c067-4dfd-9fdb-e703a029cb11 could not be found. May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f89e18af-c067-4dfd-9fdb-e703a029cb11', 'body': {'pause': {}}} May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f89e18af-c067-4dfd-9fdb-e703a029cb11 could not be found. May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f89e18af-c067-4dfd-9fdb-e703a029cb11 could not be found. May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:45.745871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f89e18af-c067-4dfd-9fdb-e703a029cb11 could not be found. May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d328ca2-4c6b-4ecb-a872-9e14dc162ed0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance f89e18af-c067-4dfd-9fdb-e703a029cb11 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d328ca2-4c6b-4ecb-a872-9e14dc162ed0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/f89e18af-c067-4dfd-9fdb-e703a029cb11/action" status: 404 len: 111 microversion: 2.1 time: 0.033160 May 10 02:26:45.753657 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1937/3853] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:45 2022] POST /compute/v2.1/servers/f89e18af-c067-4dfd-9fdb-e703a029cb11/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:45.759580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:45.760214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:45.768296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:45.768758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.769553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:45.770010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:45.993122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:46.019008 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-05dbdcd3-290e-4a51-ab6a-7b4136e76601 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.265423 May 10 02:26:46.019776 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1917/3854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:45 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:46.040419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:46.043888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:46.071526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.072067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.072924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.073446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.262340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:46.272290 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-87e12eed-6751-492f-a2d1-1ef566e3621d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.240397 May 10 02:26:46.273774 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1938/3855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:46 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:46.301013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:46.302107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:46.308532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.309205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.310164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.310628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.438763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:46.440195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:46.459274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.460556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.461654 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a51c8730-c2a2-426a-bd91-c0819e7d1e96 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 202 len: 0 microversion: 2.1 time: 0.175890 May 10 02:26:46.463082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.464130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.464691 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1918/3856] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:46 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:26:46.498307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:46.501535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:46.516528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.519917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.520744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.521190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.898754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:46.912097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:46.915762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:46.917186 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd30d49a-f2b0-47af-b0db-8a114f69276d tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.484440 May 10 02:26:46.917766 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1939/3857] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:46 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:26:46.928195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:46.928757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:46.946033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.946331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.947184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:46.947650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:46.964950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:46.974014 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-66b10404-6561-4e7c-a1f1-75829cf4516e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1511 microversion: 2.1 time: 0.494852 May 10 02:26:46.974602 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1919/3858] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:46 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:47.206817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-297e96cb-c70a-4bb0-8b6a-30d463b7959c req-47a9a7b9-c073-4e12-8970-bf2b77902846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-plugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:47.219409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:47.229989 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76d3c125-a382-4134-850b-bb9caaeb4b88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1362 microversion: 2.1 time: 0.309450 May 10 02:26:47.242359 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1940/3859] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:46 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:47.245386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-297e96cb-c70a-4bb0-8b6a-30d463b7959c req-47a9a7b9-c073-4e12-8970-bf2b77902846 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:47.247455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-297e96cb-c70a-4bb0-8b6a-30d463b7959c req-47a9a7b9-c073-4e12-8970-bf2b77902846 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:47.273049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-297e96cb-c70a-4bb0-8b6a-30d463b7959c req-47a9a7b9-c073-4e12-8970-bf2b77902846 service nova] Creating event network-vif-plugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:26:47.288139 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-297e96cb-c70a-4bb0-8b6a-30d463b7959c req-47a9a7b9-c073-4e12-8970-bf2b77902846 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302023 May 10 02:26:47.290238 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1920/3860] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:47.940218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:47.941368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:47.951005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:47.952366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:47.955030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:47.955533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:47.992131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:47.993566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:48.002574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.003701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.005043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.005694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.296648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:48.308948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:48.312512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:48.314226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59752a19-7607-4294-a6a4-3a9598f00e92 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1731 microversion: 2.20 time: 0.378391 May 10 02:26:48.316497 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1941/3861] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:47 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:26:48.335199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:48.343854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff80f248-d92a-4fbf-b2c5-7be166edfa26 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1491 microversion: 2.1 time: 0.356436 May 10 02:26:48.355323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1921/3862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:47 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1491 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:48.367102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:48.367586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:48.374666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.375336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.376134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.376756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.410054 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'pause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state paused May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 13 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: {"pause": {}} May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'pause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state paused May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'pause': {}}} May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state paused. Cannot pause while the instance is in this state. May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state paused May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:48.412634 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state paused May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'pause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state paused {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e816a39e-7c12-49f5-8e51-90d6ae3f71cb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 143 microversion: 2.1 time: 0.058062 May 10 02:26:48.424335 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1922/3863] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:48 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 143 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:26:48.427294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:48.427833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:48.445063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.445522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.446319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.446765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.503729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:48.505241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:48.513390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.514307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.515407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.516070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.555915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67ce5ae2-51fb-4ded-b7f8-1477d82a37db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 202 len: 0 microversion: 2.1 time: 0.133793 May 10 02:26:48.557037 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1923/3864] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:48 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:26:48.566133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:48.567193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:48.573864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.574669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.575726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:48.576425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:48.810249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:48.819097 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17b2b30a-23bf-4c8e-b578-6d2b6afd4dc6 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1362 microversion: 2.1 time: 0.501188 May 10 02:26:48.819695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1942/3865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:48 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:48.830587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:48.842222 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c1b884a-3051-45f8-9f80-f33344695eb7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1498 microversion: 2.1 time: 0.280923 May 10 02:26:48.851876 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1924/3866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:48 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1498 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:49.324696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c4a06aba-4487-478a-b807-159ad52e5811 req-1d708220-3ac3-40e0-8e4a-e1be2967d6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6675fb3c-50fc-4c49-bd0f-e9f6f68f4467", "name": "network-vif-plugged", "status": "completed", "tag": "1575eff5-abd5-44f8-9e9b-2d8c882e85a6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:49.333198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:49.334463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:49.344204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c4a06aba-4487-478a-b807-159ad52e5811 req-1d708220-3ac3-40e0-8e4a-e1be2967d6fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:49.348044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:49.348624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:49.349677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:49.350374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:49.354121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c4a06aba-4487-478a-b807-159ad52e5811 req-1d708220-3ac3-40e0-8e4a-e1be2967d6fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:49.370402 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c4a06aba-4487-478a-b807-159ad52e5811 req-1d708220-3ac3-40e0-8e4a-e1be2967d6fe service nova] Creating event network-vif-plugged:1575eff5-abd5-44f8-9e9b-2d8c882e85a6 for instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 on n-h1-841089-2 May 10 02:26:49.387038 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c4a06aba-4487-478a-b807-159ad52e5811 req-1d708220-3ac3-40e0-8e4a-e1be2967d6fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065948 May 10 02:26:49.388342 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1943/3867] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:49.837348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:49.838099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:49.850406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:49.850854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:49.851923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:49.852548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.123587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.134810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.144474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.148154 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3dba467e-8287-4ea2-998f-24d169df756b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1718 microversion: 2.20 time: 0.818794 May 10 02:26:50.152240 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1925/3868] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:26:49 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1718 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:26:50.174321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:50.175252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:50.191616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.194015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.195523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.196848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.230541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.243397 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6549b373-4e07-47f3-88fa-6c21c8dbff63 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1362 microversion: 2.1 time: 0.409542 May 10 02:26:50.244664 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1944/3869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:49 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:50.411601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.421389 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80c7ad58-cc6a-479b-a404-c7d8594ae301 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.267910 May 10 02:26:50.422714 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1926/3870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:50 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:50.441768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:50.442413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:50.449900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.450660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.452769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.453386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.633686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.643137 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d2777d7-6432-45dd-bba5-91011b4fdf50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.205358 May 10 02:26:50.643918 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1945/3871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:50 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:50.664887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:50.666202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:50.678173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.678173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.678173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.678173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.693704 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121/action HTTP/1.1 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 28 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: {"reboot": {"type": "SOFT"}} May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4d28bffe-ca57-4e7a-b709-155c20b52121', 'body': {'reboot': {'type': 'SOFT'}}} May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:50.695807 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:50.700821 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2f129cf2-43bb-4e93-993f-2c6907dc9c01 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121/action" status: 404 len: 111 microversion: 2.1 time: 0.038941 May 10 02:26:50.706956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:50.708316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:50.716116 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1927/3872] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:50 2022] POST /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:50.722488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.723401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.724448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:50.726134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:50.948587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:50.958631 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e689902-7386-402e-b166-dabc63796ea8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.255106 May 10 02:26:50.960276 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1946/3873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:50 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:50.985133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:50.990216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:51.006088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.012119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.013397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.014613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.288953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:51.304793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:51.333988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.336563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.344017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.349058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.361236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:51.376740 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-df670b5c-7e63-4af1-a721-503dca404ff9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.396457 May 10 02:26:51.392443 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1928/3874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:50 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:51.415904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-262038a4-aca7-4ad9-828d-cbd14b05c0bd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:51.417788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-262038a4-aca7-4ad9-828d-cbd14b05c0bd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:51.441877 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-262038a4-aca7-4ad9-828d-cbd14b05c0bd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed could not be found. May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-262038a4-aca7-4ad9-828d-cbd14b05c0bd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed/action HTTP/1.1 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 28 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: {"reboot": {"type": "SOFT"}} May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed could not be found. May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed', 'body': {'reboot': {'type': 'SOFT'}}} May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed could not be found. May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed could not be found. May 10 02:26:51.448903 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed could not be found. May 10 02:26:51.453162 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:51.470436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-262038a4-aca7-4ad9-828d-cbd14b05c0bd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:51.482261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-262038a4-aca7-4ad9-828d-cbd14b05c0bd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed/action" status: 404 len: 111 microversion: 2.1 time: 0.071195 May 10 02:26:51.484512 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1929/3875] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:51 2022] POST /compute/v2.1/servers/5f503d0d-7eab-418c-8aa5-3a94fe0bc1ed/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:26:51.510372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:51.521814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:51.556607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.558402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.559536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.561956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.708229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:51.716530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1f2782e-f8ab-4cd5-8759-e1854c63bb1c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1548 microversion: 2.1 time: 0.458136 May 10 02:26:51.718806 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1947/3876] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:51 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1548 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:51.735804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:51.736657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:51.745396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.749863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.750927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.763779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.802942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:26:51.936974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e2405d0-fbaa-4972-aa93-2cd1a35ca4d9 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 204 len: 0 microversion: 2.1 time: 0.206962 May 10 02:26:51.940765 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1948/3877] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:26:51 2022] DELETE /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:26:51.945224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:51.945893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:51.954599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.955154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.956029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:51.956541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:51.969955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:51.981451 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c10548e7-62fb-4afd-acde-9af3d4794012 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.488959 May 10 02:26:51.985123 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1930/3878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:51 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:52.001594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:52.002243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:52.015097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.015595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.016397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.019787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.104493 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf5b5a18-48e5-43b7-9daf-e3a60e9b79ce tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164950 May 10 02:26:52.111052 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1949/3879] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:26:51 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:52.111052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:52.111538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:52.135018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.135845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.141858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.142721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.568339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:52.583887 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eef6d09b-ac3b-43c8-9fe1-af9b7633948b tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1665 microversion: 2.1 time: 0.594557 May 10 02:26:52.588506 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1931/3880] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:51 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1665 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:52.691465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:52.701592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5b3384f-b6e5-4c69-b004-fd6e745c8ecb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.595320 May 10 02:26:52.703773 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1950/3881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:52 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:52.731230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:52.735393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:52.751926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.754065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.770759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.774329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.820810 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121/action HTTP/1.1 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 65 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4d28bffe-ca57-4e7a-b709-155c20b52121', 'body': {'rebuild': {'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f'}}} May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 10 02:26:52.825094 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:26:52.831870 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:52.837105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:52.838347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eccc7996-ee46-4a95-b061-00be41d37116 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121/action" status: 404 len: 111 microversion: 2.1 time: 0.118069 May 10 02:26:52.839275 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1932/3882] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:52 2022] POST /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121/action => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:52.851592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:52.852237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:52.860140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.860610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:52.863552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:52.867688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:53.178624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:53.187328 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d69e238-d355-49b0-b3d6-555c7157358a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.342869 May 10 02:26:53.191300 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1951/3883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:52 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:53.209838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:53.210738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:53.226694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:53.231237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:53.238582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:53.239284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:53.609159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:53.610206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:53.653875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:53.654323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:53.655679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:53.658220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:53.782740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:53.798509 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-598662e2-88d8-4843-a3dd-2d1aa1853d1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.592661 May 10 02:26:53.815258 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1933/3884] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:53 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:53.820560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ed86b24-ee65-4faa-b288-52f7730f841f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:53.832650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1ed86b24-ee65-4faa-b288-52f7730f841f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 76b42149-1918-4fb4-897d-03776763a970] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:53.838362 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-1ed86b24-ee65-4faa-b288-52f7730f841f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 76b42149-1918-4fb4-897d-03776763a970 could not be found. May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ed86b24-ee65-4faa-b288-52f7730f841f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/76b42149-1918-4fb4-897d-03776763a970/action HTTP/1.1 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 65 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 76b42149-1918-4fb4-897d-03776763a970 could not be found. May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '76b42149-1918-4fb4-897d-03776763a970', 'body': {'rebuild': {'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f'}}} May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76b42149-1918-4fb4-897d-03776763a970 could not be found. May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:26:53.840073 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76b42149-1918-4fb4-897d-03776763a970 could not be found. May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76b42149-1918-4fb4-897d-03776763a970 could not be found. May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ed86b24-ee65-4faa-b288-52f7730f841f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 76b42149-1918-4fb4-897d-03776763a970 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ed86b24-ee65-4faa-b288-52f7730f841f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/76b42149-1918-4fb4-897d-03776763a970/action" status: 404 len: 111 microversion: 2.1 time: 0.025016 May 10 02:26:53.845982 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1934/3885] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:53 2022] POST /compute/v2.1/servers/76b42149-1918-4fb4-897d-03776763a970/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:53.865895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:53.865895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:53.872827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:53.873543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:53.874100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:53.874537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:54.249394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:54.309778 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6abe28fb-04d6-4c64-ba6c-6f56bfefe04e tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1665 microversion: 2.1 time: 0.707503 May 10 02:26:54.310401 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1952/3886] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:53 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1665 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:54.897867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:54.922665 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-329b8ca3-ab39-463f-8ac9-82e3a60efc50 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.067268 May 10 02:26:54.923769 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1935/3887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:53 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:54.941409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:54.942162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:54.952970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:54.961266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:54.967102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:54.967731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:55.328005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:55.328953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:55.337586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:55.340515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:55.343634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:55.344356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:55.520295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:55.531144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee5b99df-90d3-41b6-bc47-f374a5e511c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.593575 May 10 02:26:55.532418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1953/3888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:54 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:55.549304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d23c6828-c6a5-4cfe-bca1-14a950e06b9e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:55.550800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d23c6828-c6a5-4cfe-bca1-14a950e06b9e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 51b2e3b1-97b2-4aee-9638-4cd909c5047a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:55.568172 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d23c6828-c6a5-4cfe-bca1-14a950e06b9e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 51b2e3b1-97b2-4aee-9638-4cd909c5047a could not be found. May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d23c6828-c6a5-4cfe-bca1-14a950e06b9e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/51b2e3b1-97b2-4aee-9638-4cd909c5047a/action HTTP/1.1 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 15 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: {"restore": {}} May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 51b2e3b1-97b2-4aee-9638-4cd909c5047a could not be found. May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '51b2e3b1-97b2-4aee-9638-4cd909c5047a', 'body': {'restore': {}}} May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b2e3b1-97b2-4aee-9638-4cd909c5047a could not be found. May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b2e3b1-97b2-4aee-9638-4cd909c5047a could not be found. May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:55.570383 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:55.575833 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:55.575833 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:55.575833 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b2e3b1-97b2-4aee-9638-4cd909c5047a could not be found. May 10 02:26:55.575833 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:55.578700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d23c6828-c6a5-4cfe-bca1-14a950e06b9e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 51b2e3b1-97b2-4aee-9638-4cd909c5047a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:55.579832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d23c6828-c6a5-4cfe-bca1-14a950e06b9e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/51b2e3b1-97b2-4aee-9638-4cd909c5047a/action" status: 404 len: 111 microversion: 2.1 time: 0.035025 May 10 02:26:55.580625 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1954/3889] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:55 2022] POST /compute/v2.1/servers/51b2e3b1-97b2-4aee-9638-4cd909c5047a/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:26:55.601885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:55.602792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:55.614608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:55.615413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:55.616402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:55.617027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:56.826962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:56.866436 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-876f053d-3eee-4bf4-8f3f-e1a27c1aabc8 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1665 microversion: 2.1 time: 1.542739 May 10 02:26:56.871902 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1936/3890] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:55 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1665 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:26:56.964363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-98cd9445-6502-41b9-a02a-228d06787ea8 req-9b1c0a37-cd62-4dbc-b710-e544967a052d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6675fb3c-50fc-4c49-bd0f-e9f6f68f4467", "tag": "1575eff5-abd5-44f8-9e9b-2d8c882e85a6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:56.978413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-98cd9445-6502-41b9-a02a-228d06787ea8 req-9b1c0a37-cd62-4dbc-b710-e544967a052d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:56.983020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-98cd9445-6502-41b9-a02a-228d06787ea8 req-9b1c0a37-cd62-4dbc-b710-e544967a052d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:56.990116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:56.998886 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61fad500-2707-4fad-8ae3-e3ad000b9adb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.410369 May 10 02:26:57.019095 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1955/3891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:55 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:57.029040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:57.030235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:57.054700 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-98cd9445-6502-41b9-a02a-228d06787ea8 req-9b1c0a37-cd62-4dbc-b710-e544967a052d service nova] Creating event network-changed:1575eff5-abd5-44f8-9e9b-2d8c882e85a6 for instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 on n-h1-841089-2 May 10 02:26:57.059222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.059738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.060619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.061081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.067744 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-98cd9445-6502-41b9-a02a-228d06787ea8 req-9b1c0a37-cd62-4dbc-b710-e544967a052d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191566 May 10 02:26:57.068413 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1937/3892] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:57.650587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:57.667582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-908bd077-b9f8-4260-862b-a3a60dfff274 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.642626 May 10 02:26:57.671774 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1956/3893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:57 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:57.690063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:57.691190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:57.717747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.720984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.722007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.724007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.789753 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'restore' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: {"restore": {}} May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'restore' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'restore': {}}} May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state active. Cannot restore while the instance is in this state. May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:57.793918 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'restore' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:57.798051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-004df272-d269-4116-9c6e-7f1f7b93c1a6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 145 microversion: 2.1 time: 0.112494 May 10 02:26:57.802102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1938/3894] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:57 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 145 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 02:26:57.808085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:57.808733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:57.818536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.819018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.820101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.833573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.885876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:57.888035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:57.903106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.904036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.905555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.907437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.963954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:57.964594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:57.965409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lazy-loading 'fault' on Instance uuid 2372a766-c25a-4207-af11-0ba767798ec1 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:26:58.054546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1580117162994893ba8a33013d28fb5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae69ae8f0254dc685572bdb1f9d6533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:58.092266 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7932f89-da3b-4054-801d-6d59cb2fb766 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 200 len: 1315 microversion: 2.1 time: 0.210535 May 10 02:26:58.108797 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1939/3895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:57 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:58.241572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:58.260042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3a22b40-68fd-4a2b-9f19-908ef532e6f0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.452224 May 10 02:26:58.261928 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1957/3896] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:57 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:58.281107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:58.282011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:58.296287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:58.298183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:58.299242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:58.300637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:58.634880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:58.662924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbd3f5ad-58cb-4f63-af75-b158d15ee2b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.368787 May 10 02:26:58.663665 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1940/3897] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:58 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:58.682862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d299ae1-1928-4f70-8ce4-3214e9b14d44 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:58.683823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d299ae1-1928-4f70-8ce4-3214e9b14d44 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 29b2abdf-5360-4563-a4b5-318264e268ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:58.692310 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8d299ae1-1928-4f70-8ce4-3214e9b14d44 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 29b2abdf-5360-4563-a4b5-318264e268ed could not be found. May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d299ae1-1928-4f70-8ce4-3214e9b14d44 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/29b2abdf-5360-4563-a4b5-318264e268ed/action HTTP/1.1 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 14 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: {"resume": {}} May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 29b2abdf-5360-4563-a4b5-318264e268ed could not be found. May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '29b2abdf-5360-4563-a4b5-318264e268ed', 'body': {'resume': {}}} May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b2abdf-5360-4563-a4b5-318264e268ed could not be found. May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b2abdf-5360-4563-a4b5-318264e268ed could not be found. May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:58.705212 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:58.711013 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:58.711013 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:58.711013 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b2abdf-5360-4563-a4b5-318264e268ed could not be found. May 10 02:26:58.711013 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:58.712962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d299ae1-1928-4f70-8ce4-3214e9b14d44 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 29b2abdf-5360-4563-a4b5-318264e268ed could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:58.714442 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d299ae1-1928-4f70-8ce4-3214e9b14d44 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/29b2abdf-5360-4563-a4b5-318264e268ed/action" status: 404 len: 111 microversion: 2.1 time: 0.036921 May 10 02:26:58.715917 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1958/3898] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:58 2022] POST /compute/v2.1/servers/29b2abdf-5360-4563-a4b5-318264e268ed/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:58.725443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:58.726398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:58.737567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:58.739145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:58.740816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:58.741409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:58.965397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:58.973902 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a69c16a-614a-465b-a88c-0f6013498cad tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.253662 May 10 02:26:58.974814 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1941/3899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:58 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:58.995472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:58.996043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:59.004865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.005632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.006886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.007513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.115898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:59.117674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] [instance: 2372a766-c25a-4207-af11-0ba767798ec1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:59.126888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.129806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.131275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.133730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.172746 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] HTTP exception thrown: Instance 2372a766-c25a-4207-af11-0ba767798ec1 could not be found. May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Request method failure captured: May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 HTTP/1.1 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec0oHWYQ6M0vL9R3fB6_tj8g5hdUNpzw0f0zctDTm7OJdX_QHqGX26tCx2hwTRuZKT4ZBePxLk1VcM6U9th080KnpIFzcV8zmf96CwiwigL5vNLuZtVLV7S0U8uruB5xaQnFaYsrLxxGuBydDNCfCYr2nSTzTRdH1epkn4oXyDJ5mao May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: cae69ae8f0254dc685572bdb1f9d6533 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestFqdnHostnames-1620975462 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cae69ae8f0254dc685572bdb1f9d6533", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cae69ae8f0254dc685572bdb1f9d6533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cae69ae8f0254dc685572bdb1f9d6533"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cae69ae8f0254dc685572bdb1f9d6533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestFqdnHostnames-1620975462 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: cae69ae8f0254dc685572bdb1f9d6533 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1620975462 May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestFqdnHostnames-1620975462-project May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1580117162994893ba8a33013d28fb5e May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestFqdnHostnames-1620975462-project May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2372a766-c25a-4207-af11-0ba767798ec1 could not be found. May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2372a766-c25a-4207-af11-0ba767798ec1'} May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2372a766-c25a-4207-af11-0ba767798ec1 could not be found. May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2372a766-c25a-4207-af11-0ba767798ec1 could not be found. May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:59.176542 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2372a766-c25a-4207-af11-0ba767798ec1 could not be found. May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Returning 404 to user: Instance 2372a766-c25a-4207-af11-0ba767798ec1 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:59.183010 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8eeae777-770b-4f18-83b1-64ba1de45721 tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1" status: 404 len: 111 microversion: 2.1 time: 0.067690 May 10 02:26:59.185929 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1942/3900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:59 2022] GET /compute/v2.1/servers/2372a766-c25a-4207-af11-0ba767798ec1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:26:59.197512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45b0fe27-ac40-439d-a084-f7089823851f tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] Calling method '.version_select at 0x7f3d36614820>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:59.232113 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45b0fe27-ac40-439d-a084-f7089823851f tempest-ServersTestFqdnHostnames-1620975462 tempest-ServersTestFqdnHostnames-1620975462-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385217391" status: 202 len: 0 microversion: 2.1 time: 0.042452 May 10 02:26:59.234813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1943/3901] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385217391 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:26:59.246828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-76b88aba-0047-4aa9-bc6c-52da0a856f22 req-3b9e97b7-fa75-486e-b900-692a55eae9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2372a766-c25a-4207-af11-0ba767798ec1", "name": "network-vif-deleted", "tag": "128a123f-e71f-447a-92de-3141860e2c28"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:59.268813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-76b88aba-0047-4aa9-bc6c-52da0a856f22 req-3b9e97b7-fa75-486e-b900-692a55eae9de service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.274750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-76b88aba-0047-4aa9-bc6c-52da0a856f22 req-3b9e97b7-fa75-486e-b900-692a55eae9de service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.289257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:59.303392 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8597ebf0-99c3-4974-a998-2909c1aca4c7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.312090 May 10 02:26:59.307641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1959/3902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:58 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:59.326950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:26:59.327853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:59.334063 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-76b88aba-0047-4aa9-bc6c-52da0a856f22 req-3b9e97b7-fa75-486e-b900-692a55eae9de service nova] Creating event network-vif-deleted:128a123f-e71f-447a-92de-3141860e2c28 for instance 2372a766-c25a-4207-af11-0ba767798ec1 on n-h1-841089-2 May 10 02:26:59.353129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.353602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.355134 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-76b88aba-0047-4aa9-bc6c-52da0a856f22 req-3b9e97b7-fa75-486e-b900-692a55eae9de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105775 May 10 02:26:59.359318 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1944/3903] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:26:59.365449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.366263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.402334 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'resume' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 14 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: {"resume": {}} May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: exception: Cannot 'resume' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'resume': {}}} May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state active. Cannot resume while the instance is in this state. May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:26:59.404871 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:26:59.410214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:26:59.410214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:26:59.410214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:26:59.410214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:26:59.410214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:26:59.417154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'resume' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:26:59.418254 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f57838a5-9c55-4504-a842-45f239570460 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 144 microversion: 2.1 time: 0.097371 May 10 02:26:59.419364 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1960/3904] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:26:59 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 144 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:26:59.433289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:59.434387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:59.443008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.443716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.444676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.445307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.679553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:59.690316 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2481fa3-3c41-4bac-97a7-825f9d3e87d9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.266033 May 10 02:26:59.690923 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1945/3905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:59 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:26:59.711345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:26:59.712148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:26:59.720626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.721096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.721904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:26:59.726667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:26:59.984047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:26:59.993812 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-116cbe4a-b271-4237-bb91-07a8c304f9b6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.286333 May 10 02:27:00.009387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1961/3906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:26:59 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:00.148427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d38d157b-46ea-431c-9ff4-6d35e3553d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d38d157b-46ea-431c-9ff4-6d35e3553d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers HTTP/1.1 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 160 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "544152f2-1965-429f-8d0a-33756737e75a"}]}} May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute name. Value: . '' is too short May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'server': {'name': '', 'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f', 'flavorRef': '452', 'networks': [{'uuid': '544152f2-1965-429f-8d0a-33756737e75a'}]}}} May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi '' May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:27:00.151658 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 10 02:27:00.157321 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:00.160210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d38d157b-46ea-431c-9ff4-6d35e3553d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:00.161062 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d38d157b-46ea-431c-9ff4-6d35e3553d40 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018417 May 10 02:27:00.161931 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1946/3907] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:27:00 2022] POST /compute/v2.1/servers => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:27:00.171246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:00.173279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:00.183340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:00.183782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:00.184584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:00.185036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:00.538811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:00.573951 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e552bbf3-b329-4f6b-9267-f10b4385e5eb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.407798 May 10 02:27:00.596894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:00.597335 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1962/3908] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:00 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:00.597857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:00.613686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:00.617412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:00.618453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:00.619307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:00.862336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:00.870200 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c56e211-95a4-4d0e-b009-8ea28f2e0ac3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.277194 May 10 02:27:00.883921 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1947/3909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:00 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:00.890780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea2543c1-f3a1-465c-a5e2-8c04102676b2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:00.892904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea2543c1-f3a1-465c-a5e2-8c04102676b2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 7ad420f0-168c-46a6-9add-faeb32d40263] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:00.905297 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ea2543c1-f3a1-465c-a5e2-8c04102676b2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 7ad420f0-168c-46a6-9add-faeb32d40263 could not be found. May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea2543c1-f3a1-465c-a5e2-8c04102676b2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/7ad420f0-168c-46a6-9add-faeb32d40263/action HTTP/1.1 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 14 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: {"shelve": {}} May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 7ad420f0-168c-46a6-9add-faeb32d40263 could not be found. May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '7ad420f0-168c-46a6-9add-faeb32d40263', 'body': {'shelve': {}}} May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad420f0-168c-46a6-9add-faeb32d40263 could not be found. May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad420f0-168c-46a6-9add-faeb32d40263 could not be found. May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:00.915629 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:00.920641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:00.920641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:00.920641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad420f0-168c-46a6-9add-faeb32d40263 could not be found. May 10 02:27:00.920641 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:00.924480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea2543c1-f3a1-465c-a5e2-8c04102676b2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 7ad420f0-168c-46a6-9add-faeb32d40263 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:00.926059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea2543c1-f3a1-465c-a5e2-8c04102676b2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/7ad420f0-168c-46a6-9add-faeb32d40263/action" status: 404 len: 111 microversion: 2.1 time: 0.040148 May 10 02:27:00.926901 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1963/3910] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:00 2022] POST /compute/v2.1/servers/7ad420f0-168c-46a6-9add-faeb32d40263/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:27:00.937190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:00.938000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:00.950410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:00.950410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:00.951276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:00.951738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.129751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:01.137927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb4ab9ed-e2d7-40a5-a614-c5c115d33175 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.206665 May 10 02:27:01.155260 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1948/3911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:00 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:01.163357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:01.166103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:01.174163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.175152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.176202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.176867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.380910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:01.397350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a973d2f-83a5-408a-8c7c-f88a77f2024b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.239878 May 10 02:27:01.397962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1964/3912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:01 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:01.414902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:01.415894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:01.422993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.423881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.425251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.426061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.451009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lazy-loading 'flavor' on Instance uuid 2e4512ed-540a-4c7f-884c-22e2f619a635 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:27:01.740611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e941fb1-6957-4f3c-9866-e55eeaec9998 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 202 len: 0 microversion: 2.1 time: 0.329458 May 10 02:27:01.741681 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1949/3913] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:01 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:27:01.750940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:01.752432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:01.760392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.762329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.763198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.764586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.772241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:01.772970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:01.781528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.782013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.782855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:01.783405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:01.994051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:02.002092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db85ce1c-98ac-4456-8d47-f3a094ccfdf2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.256432 May 10 02:27:02.003902 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1965/3914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:01 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:02.020195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:02.052686 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4fc328eb-3e27-4652-975d-d005f58e7181 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.286254 May 10 02:27:02.054292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1950/3915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:01 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:03.020488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:03.021041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:03.028491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.028944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.030532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.030982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.073400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:03.074728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:03.084972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.085788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.087058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.087805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.198978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:03.209041 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f602ff28-48ae-4367-ac40-98100449789f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.193343 May 10 02:27:03.210008 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1966/3916] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:03 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:03.330491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:03.338903 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb2dbdba-9d25-4f9d-ac39-cca9f6cce968 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.271462 May 10 02:27:03.340870 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1951/3917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:03 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:03.359183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2038310934"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:03.361411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:03.371479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.372461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.374529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.375527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.722086 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b433eed8-ed3d-47f1-91d5-74ef1d27c9ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.369942 May 10 02:27:03.726165 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1967/3918] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:03 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 10 02:27:03.734494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:03.734494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:03.739463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.740318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.741377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:03.743061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:03.957811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:03.966205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2425399-4cbc-4a28-a0d5-9670ba5bf43a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.238084 May 10 02:27:03.971226 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1952/3919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:03 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:04.227616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:04.228427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:04.235977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.236566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.237428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.237939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.328678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:04.329744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:04.343335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.344617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.345829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.346656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.470979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'services' on Instance uuid 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:27:04.516030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:04.527514 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-116a0d0b-8ffe-4cda-b933-8668c0095a31 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.305176 May 10 02:27:04.538058 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1968/3920] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:04 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:04.568657 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c2beef1a-9c06-4c10-afae-8fb1b2973ab3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments/043b05c4-a3ba-4e44-b366-f587c732d4fd" status: 202 len: 0 microversion: 2.1 time: 0.245203 May 10 02:27:04.569644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1953/3921] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:27:04 2022] DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments/043b05c4-a3ba-4e44-b366-f587c732d4fd => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:27:04.577748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:04.579203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:04.585318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.585874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.586743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.587450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.620978 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5567f2e-890d-4e60-9b45-09339f3e3f7b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047295 May 10 02:27:04.622188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1969/3922] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:04 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:04.985159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:04.986038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:04.992552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.993093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:04.994388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:04.994997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:05.143405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:05.152765 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72106dc7-dc35-4d82-b244-6fd2ad21efba tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.172712 May 10 02:27:05.162252 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1954/3923] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:04 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:05.547514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:05.555954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:05.567002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:05.567527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:05.568337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:05.568915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:05.633186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:05.635367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:05.650310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:05.656576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:05.657415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:05.657867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:05.692549 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-744652c1-469c-4030-a841-fd111d86fea3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063303 May 10 02:27:05.693526 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1955/3924] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:05 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:05.765967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:05.773587 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e90dc0b8-2c2f-4932-84d5-af20e4275efb tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.231112 May 10 02:27:05.774161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1970/3925] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:05 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:06.170622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:06.171215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:06.177529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.184284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.184284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.184284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.386866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:06.396216 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-585e0974-9329-47d8-95c6-1fe7de650013 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1686 microversion: 2.1 time: 0.230162 May 10 02:27:06.397032 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1956/3926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:06 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1686 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:06.536648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5ec1f44a-4a37-4a5b-a99f-b22b35352e3e req-b649e7cf-9dda-4251-9247-509b4e3d3554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-unplugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:06.546601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5ec1f44a-4a37-4a5b-a99f-b22b35352e3e req-b649e7cf-9dda-4251-9247-509b4e3d3554 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.547374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5ec1f44a-4a37-4a5b-a99f-b22b35352e3e req-b649e7cf-9dda-4251-9247-509b4e3d3554 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.561453 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5ec1f44a-4a37-4a5b-a99f-b22b35352e3e req-b649e7cf-9dda-4251-9247-509b4e3d3554 service nova] Creating event network-vif-unplugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:27:06.571279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5ec1f44a-4a37-4a5b-a99f-b22b35352e3e req-b649e7cf-9dda-4251-9247-509b4e3d3554 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038419 May 10 02:27:06.572539 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1971/3927] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:06.705311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:06.706906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:06.715963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.717325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.719262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.719954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.757046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f4c0897-27c5-4d50-94c8-3046630146ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056327 May 10 02:27:06.758310 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1957/3928] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:06 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:06.793499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:06.796316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:06.804239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.804710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.805502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:06.806073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:06.964255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:06.973672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-758a8003-d5a9-412d-a67b-6fbd108980f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.185013 May 10 02:27:06.975603 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1972/3929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:06 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:07.416780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:07.417424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:07.430709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:07.431210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:07.435880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:07.436108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:07.702237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:07.730500 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db4fee1d-542a-4b09-bc17-04425b69df36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1686 microversion: 2.1 time: 0.317588 May 10 02:27:07.731401 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1958/3930] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:07 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1686 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:07.769685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:07.770668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:07.782777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:07.784079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:07.787161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:07.787874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:07.825678 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ba976c2-ba59-46e1-8017-b95c9785bb05 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060596 May 10 02:27:07.827259 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1973/3931] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:07 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:07.994197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:07.995285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:08.022313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:08.023208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:08.024899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:08.025655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:08.490733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:08.498480 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db7bfd8a-c20d-42bb-bead-ae54069df0e2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.510105 May 10 02:27:08.511923 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1959/3932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:07 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:08.748906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:08.749835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:08.761058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:08.762421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:08.766914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:08.769512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:08.839615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:08.840698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:08.851795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:08.852263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:08.853059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:08.853561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:08.955357 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0e2c97c-aa41-4b93-a98e-b4afa4468558 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119800 May 10 02:27:08.955960 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1960/3933] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:08 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:09.226270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:09.242558 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a738ec5-d969-4d52-98f4-4ae060752424 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.497650 May 10 02:27:09.246812 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1974/3934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:08 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:09.528996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:09.530405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:09.553344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:09.557396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:09.558280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:09.558720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:09.793999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:09.806291 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33cb95c2-6449-4a10-906d-baa764f3f96d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.281329 May 10 02:27:09.813262 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1961/3935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:09 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:09.974224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:09.981686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:10.006206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.009652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.010703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.016420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.102667 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a089e4e6-13a2-4166-9c39-dfa0d2d3b10c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137831 May 10 02:27:10.103959 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1975/3936] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:09 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:10.270014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:10.270638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:10.291843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.293588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.296672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.297591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.668264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:10.697742 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1bcedb69-c74c-4621-b2b9-989fa1bef57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.431584 May 10 02:27:10.709832 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1962/3937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:10 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:10.833336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:10.835649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:10.850378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8afea116-519f-470b-b38d-c606f4099428 req-3809a3cb-f447-4ba5-819e-04a05282be84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-plugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:10.878051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8afea116-519f-470b-b38d-c606f4099428 req-3809a3cb-f447-4ba5-819e-04a05282be84 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.879599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8afea116-519f-470b-b38d-c606f4099428 req-3809a3cb-f447-4ba5-819e-04a05282be84 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.880230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.881241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.882106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:10.882555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:10.941185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8afea116-519f-470b-b38d-c606f4099428 req-3809a3cb-f447-4ba5-819e-04a05282be84 service nova] Creating event network-vif-plugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:27:10.959785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8afea116-519f-470b-b38d-c606f4099428 req-3809a3cb-f447-4ba5-819e-04a05282be84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105038 May 10 02:27:10.961099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1963/3938] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:11.115967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:11.117941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:11.129155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:11.129643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:11.130414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:11.130857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:11.193515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-694ef55c-be41-4b1c-a1af-1be4dcbb6691 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083174 May 10 02:27:11.194023 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1964/3939] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:11 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:11.291494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:11.303941 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07705fd3-a010-42c6-a648-1222ecce41b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.479356 May 10 02:27:11.320801 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1976/3940] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:10 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:11.715705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:11.716331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:11.737574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:11.738037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:11.738841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:11.739315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:12.016918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:12.025866 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d611191f-c945-4e5c-aca7-39d38cec6e0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.313995 May 10 02:27:12.039439 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1965/3941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:11 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:12.208487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:12.211576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:12.220501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:12.222724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:12.224230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:12.246310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:12.323126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:12.323759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:12.325167 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b75bc167-7b9e-473e-8cd6-c0ee95c8b9f3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121576 May 10 02:27:12.326209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1977/3942] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:12 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:12.338599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:12.339056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:12.339871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:12.340332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:12.738001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:12.753309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-449f2c80-5123-46de-a9f3-cf8dcc2adbc4 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1533 microversion: 2.1 time: 0.433154 May 10 02:27:12.769671 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1966/3943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:12 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1533 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:13.049067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:13.050668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:13.060654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:13.062165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:13.063731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:13.064421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:13.337795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:13.339631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:13.349681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:13.355904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:13.357115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:13.358517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:13.440878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:13.449192 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea5abad9-2b1e-44cf-b0cf-383c6d9cc663 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.405281 May 10 02:27:13.454717 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1978/3944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:13 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:13.464157 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afa4b456-2d43-4db5-8377-d4c2f25fddb9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131091 May 10 02:27:13.465403 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1967/3945] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:13 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:13.773620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:13.774910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:13.790665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:13.794392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:13.801469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:13.803451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:14.229297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05059f88-25dc-4333-b304-e82f43ee6c9b"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:14.236394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:14.261582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:14.267821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:14.274689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:14.276564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:14.971394 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4cf379fd-b493-461f-9107-c9f1759f5767 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "POST /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748338 May 10 02:27:14.973818 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1968/3946] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:27:14 2022] POST /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:14.988245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:14.989456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:15.015208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:15.015721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:15.016567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:15.017023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:15.388529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:15.397712 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b9a3487-1021-4a10-8ea8-983c4216ccfd tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1533 microversion: 2.1 time: 1.627960 May 10 02:27:15.425506 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1979/3947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1533 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:15.454319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:15.455339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:15.501060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:15.505199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:15.514359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:15.515466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:15.671732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:15.680187 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7f7c8f2-9f8d-4abd-9ea5-d63eb2009a99 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.250584 May 10 02:27:15.688106 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d124c10-4089-41c7-9b3d-e8ead95e8d9b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.712888 May 10 02:27:15.689896 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1980/3948] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:15 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:15.708260 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1969/3949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:14 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:16.156113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3cd2d1aa-9f3a-404a-b025-9dc2122c87d9 req-f3858833-c42f-478a-8dd3-e67e1691e597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4512ed-540a-4c7f-884c-22e2f619a635", "name": "network-vif-plugged", "status": "completed", "tag": "67f6d200-7310-4466-bd94-c656886c7d53"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:16.194795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3cd2d1aa-9f3a-404a-b025-9dc2122c87d9 req-f3858833-c42f-478a-8dd3-e67e1691e597 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.196415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3cd2d1aa-9f3a-404a-b025-9dc2122c87d9 req-f3858833-c42f-478a-8dd3-e67e1691e597 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:16.252860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3cd2d1aa-9f3a-404a-b025-9dc2122c87d9 req-f3858833-c42f-478a-8dd3-e67e1691e597 service nova] Creating event network-vif-plugged:67f6d200-7310-4466-bd94-c656886c7d53 for instance 2e4512ed-540a-4c7f-884c-22e2f619a635 on n-h1-841089-2 May 10 02:27:16.271100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3cd2d1aa-9f3a-404a-b025-9dc2122c87d9 req-f3858833-c42f-478a-8dd3-e67e1691e597 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122236 May 10 02:27:16.273264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1981/3950] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:16.414941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:16.415657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:16.426094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.426845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:16.432480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.433335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:16.700515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:16.702289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:16.717518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.730164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:16.731140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.733670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:16.883336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-115b9c57-1244-4983-b20f-95aefb180325 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188887 May 10 02:27:16.887863 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1982/3951] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:16 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:16.896665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:16.897801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:16.906730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.908115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:16.910042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:16.910744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:17.268487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:17.281255 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72d08512-074e-4103-9aa3-fddf7b6a6a7b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.870354 May 10 02:27:17.282182 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1970/3952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:16 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:17.748070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:17.761571 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee8c2784-e8d5-40c0-ae05-ddda9e2423f8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.870556 May 10 02:27:17.769670 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1983/3953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:16 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:17.896066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:17.897345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:17.917431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:17.918180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:17.919237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:17.920670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:18.014370 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-860b3111-04ec-4768-b64c-91f555a84fcd tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121948 May 10 02:27:18.015358 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1971/3954] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:17 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:18.300427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:18.301527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:18.313657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:18.316961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:18.319104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:18.320020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:18.734459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:18.750742 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-366f21c5-eb91-491b-8450-657142ada3f5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.448691 May 10 02:27:18.760233 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1984/3955] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:18 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:18.787293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:18.787952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:18.803242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:18.803693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:18.811208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:18.816596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:19.026848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:19.028157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:19.047201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:19.053533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:19.054561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:19.055181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:19.149902 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bd8da72d-6d78-4067-a7d2-f5d8be52a2b7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127722 May 10 02:27:19.157669 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1985/3956] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:19 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:19.298625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:19.307494 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2eff8c14-6294-4fa9-b4ba-af582384ccd9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.525236 May 10 02:27:19.308100 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1972/3957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:18 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:19.772314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:19.774071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:19.788211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:19.789419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:19.791777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:19.792916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:20.165520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:20.167638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:20.195768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:20.198028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:20.201533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:20.203652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:20.219455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:20.235448 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05bf512b-894d-4b08-97d0-af7049d1f8f2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.469991 May 10 02:27:20.236692 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1986/3958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:19 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:20.302462 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-55342204-4ecb-4a6f-871b-a101520c84b4 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140804 May 10 02:27:20.307388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1973/3959] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:20 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:20.332845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:20.333642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:20.349430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:20.353114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:20.354304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:20.358031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:20.718599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:20.728063 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9a107e6-733f-4674-ac8f-296d73920a00 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.402947 May 10 02:27:20.743914 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1987/3960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:20 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:21.255438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:21.258276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:21.278320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:21.281098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:21.289551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:21.290191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:21.315479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:21.316470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:21.335762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:21.336239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:21.337055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:21.347586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:21.505673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fafd0587-c9f4-4b93-ae80-a6309635e103 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194678 May 10 02:27:21.510956 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1988/3961] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:21 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:21.756859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:21.757387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:21.770245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:21.770718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:21.779844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:21.780358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:21.801227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:21.812420 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33136151-ef7b-4768-8771-16137c27d09d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.560871 May 10 02:27:21.813714 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1974/3962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:21 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:21.985978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:21.994718 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29d2decd-6f56-4dc0-8552-cc083e41c67d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.242265 May 10 02:27:22.011358 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1989/3963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:21 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:22.518866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:22.520080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:22.544884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:22.545644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:22.549753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:22.550509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:22.681367 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61c0a3f3-d0a4-4c94-a3f9-cbe32f94fb5d tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166677 May 10 02:27:22.683925 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1975/3964] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:22 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:22.831745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:22.832495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:22.847870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:22.848718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:22.854822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:22.857858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:23.014824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:23.015707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:23.034059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:23.035013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:23.036037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:23.036648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:23.727498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:23.736010 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d547c926-6c98-4a99-80f8-6a918f6e6d2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.726902 May 10 02:27:23.736599 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1976/3965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:23 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:23.745815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:23.748208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:23.753840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09492c13-6373-4fc3-8246-ef09b6bac558 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.927414 May 10 02:27:23.757370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:23.758496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1990/3966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:22 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:23.786754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:23.787269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:23.788050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:23.788489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:23.910364 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0756bddd-411f-468e-b7c1-95647e1eecf9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172411 May 10 02:27:23.917926 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1977/3967] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:23 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:24.758943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:24.759848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:24.776607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:24.777235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:24.816134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:24.816612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:24.817951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:24.818617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:24.819101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:24.820106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:24.820785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:24.824512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:25.534812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:25.546856 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a472937d-c405-408c-9660-67b9b81f0dcd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.794127 May 10 02:27:25.549642 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1991/3968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:24 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:25.565562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:25.567856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:25.581683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:25.589376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:25.590258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:25.590722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:25.681176 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5033085d-5572-42a0-bf0e-06160647978f tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129264 May 10 02:27:25.683908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1992/3969] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:25 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:27:25.702510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:25.707959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:25.724575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:25.725353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:25.726352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:25.726968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:25.762790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:25.771253 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-06f2db3f-25cf-4b2f-9c3c-d7ca522950fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 1.000388 May 10 02:27:25.781825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1978/3970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:24 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:25.835381 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e50ad4a-04c4-4414-ae1c-f73e9618c8ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.142885 May 10 02:27:25.837049 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1993/3971] 10.222.0.52 () {60 vars in 1342 bytes} [Tue May 10 02:27:25 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:25.897473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:25.898557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:25.950683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:25.951170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:25.964022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:25.969988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.065170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Cannot 'reboot' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.066991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:26.068528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action HTTP/1.1 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 28 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: {"reboot": {"type": "HARD"}} May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'reboot' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '271a109c-84b1-40fc-a0e3-0dbe5ac14af9', 'body': {'reboot': {'type': 'HARD'}}} May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:27:26.074278 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.078780 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.088838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 409 to user: Cannot 'reboot' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:26.090119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e208ba95-3b59-4900-aec9-a0382624e3cb tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action" status: 409 len: 145 microversion: 2.1 time: 0.200958 May 10 02:27:26.091813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1979/3972] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:25 2022] POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action => generated 145 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:27:26.094362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.094846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.100456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.100970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.106252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:26.109220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:26.116271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.116731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.117526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.120534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.161342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Cannot 'rebuild' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action HTTP/1.1 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 65 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'rebuild' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '271a109c-84b1-40fc-a0e3-0dbe5ac14af9', 'body': {'rebuild': {'imageRef': '193324a5-9e6a-4320-a184-bbef949b550f'}}} May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 in vm_state rescued. Cannot rebuild while the instance is in this state. May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:27:26.163569 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued May 10 02:27:26.169257 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:26.173125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 409 to user: Cannot 'rebuild' instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 while it is in vm_state rescued {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:26.174296 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e67465d-4996-4532-a293-4e1365a4ce38 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action" status: 409 len: 146 microversion: 2.1 time: 0.077357 May 10 02:27:26.179196 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1980/3973] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:26 2022] POST /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9/action => generated 146 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:27:26.186118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:26.186935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:26.205575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:27:26.210920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.218695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.221329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.223600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.318485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:27:26.440521 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8ab6cfa5-9e91-485c-b51b-2c306bce219b tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 204 len: 0 microversion: 2.20 time: 0.382243 May 10 02:27:26.443508 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1994/3974] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:27:26 2022] DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:27:26.463097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:26.466010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:26.493614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.494600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.495701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.498473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.575256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a017bd99-46f2-471c-bb1c-bf045b891192 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 204 len: 0 microversion: 2.1 time: 0.394415 May 10 02:27:26.581903 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1981/3975] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:27:26 2022] DELETE /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:27:26.599743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:26.601435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:26.652539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.662186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:26.663051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:26.663833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:27.027305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:27.038767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:27.051513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:27.053001 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7eb5cd9-af02-47a5-befe-4d91bcc819d1 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 0.603275 May 10 02:27:27.054210 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1995/3976] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:27:26 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:27:27.072478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:27.084877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:27.114714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:27.115585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:27.118061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:27.123501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:27.132133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:27.146276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ee6c68c-fc5c-4c9c-8e98-cb390d6acd75 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.562720 May 10 02:27:27.152163 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1982/3977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:26 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:27.168073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:27.172466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:27.199623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:27.201040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:27.204105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:27.204862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:27.940362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:27.965359 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bdd4619b-6198-431d-8b39-04824850eb1a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1687 microversion: 2.1 time: 0.900426 May 10 02:27:27.971254 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1996/3978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:27 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1687 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:28.072872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:28.074181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:28.096523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:28.097271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:28.100040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:28.101040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:28.240839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:28.252618 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-698d89c7-a8c0-4087-b766-6cd3bcaf2497 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 1.096118 May 10 02:27:28.255139 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1983/3979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:27 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:28.274143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:28.278490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:28.298448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:28.298913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:28.299746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:28.300192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:29.140305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:29.162859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:29.169259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:29.170671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:29.177694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8cd8a1b-0b68-42e0-9c5f-2cf68b91d2b6 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1724 microversion: 2.20 time: 1.105794 May 10 02:27:29.180851 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1997/3980] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:27:28 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1724 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:27:29.185724 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4108d7eb-17eb-48fb-a631-9aca33856014 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 0.929476 May 10 02:27:29.186323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1984/3981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:28 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:29.196790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:29.197811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:29.215764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:29.216754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:29.217753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:29.218365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:29.271409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:29.272069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:29.286108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:29.287674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:29.298373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:29.299090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:29.941231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:29.956342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36272f1b-b68a-4a6c-a901-802b26d3c500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.690048 May 10 02:27:29.971725 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1985/3982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:29 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:30.196834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:30.197712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:30.220888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:30.221486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:30.222343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:30.222831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:30.243736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:30.252100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eedff5b4-6231-4860-9873-3d9c069d3c4a tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1687 microversion: 2.1 time: 1.069397 May 10 02:27:30.252695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1998/3983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:29 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1687 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:30.272264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:30.272892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:30.316998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:30.317469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:30.318286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:30.318739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:31.242705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:31.252077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:31.268521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b4983326cda4029b72134cf8f2ee832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049d7523d65a466e9129bdd3842b3002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:31.270111 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed5d59d6-dced-4df4-b528-3f7c23014dcf tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 200 len: 1657 microversion: 2.20 time: 1.077760 May 10 02:27:31.270892 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1986/3984] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:27:30 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 1657 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:27:31.784031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ff2f43b4-4d3e-4c09-9357-7415c7c35d17 req-133a58e7-faa5-4d24-b3a6-a64c9410593f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3639a402-14be-4960-ab60-76c8ea5c120a", "name": "network-vif-deleted", "tag": "1a8c043f-59e1-448b-84f1-a4099e303169"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:31.800559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff2f43b4-4d3e-4c09-9357-7415c7c35d17 req-133a58e7-faa5-4d24-b3a6-a64c9410593f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:31.801278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff2f43b4-4d3e-4c09-9357-7415c7c35d17 req-133a58e7-faa5-4d24-b3a6-a64c9410593f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:31.814370 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ff2f43b4-4d3e-4c09-9357-7415c7c35d17 req-133a58e7-faa5-4d24-b3a6-a64c9410593f service nova] Creating event network-vif-deleted:1a8c043f-59e1-448b-84f1-a4099e303169 for instance 3639a402-14be-4960-ab60-76c8ea5c120a on n-h1-841089-2 May 10 02:27:31.826995 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ff2f43b4-4d3e-4c09-9357-7415c7c35d17 req-133a58e7-faa5-4d24-b3a6-a64c9410593f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.542891 May 10 02:27:31.827859 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1987/3985] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:31.847800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:31.848763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:31.875883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:31.878441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:31.886695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:31.887620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:32.307137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:32.315083 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c92940c-d5fd-45d2-ab57-12a812942fe5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1681 microversion: 2.1 time: 2.061289 May 10 02:27:32.321628 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 1999/3986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:30 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1681 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:32.336471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:32.337542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:32.357372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:32.393565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:32.394435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:32.394874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:32.481006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3fb87eb2-8425-4b30-9c11-b41fe3ea4988 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/ips" status: 200 len: 146 microversion: 2.1 time: 0.155888 May 10 02:27:32.506571 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2000/3987] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:27:32 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/ips => generated 146 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:32.515658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:32.516293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:32.544527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:32.548086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:32.548944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:32.557897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:33.040094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:33.054448 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77e94cda-5d7b-4ac1-a507-51e58845d2b5 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 1.223577 May 10 02:27:33.056306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1988/3988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:31 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:33.069894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:33.074394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:33.088833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:33.091493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:33.095220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:33.096111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:33.141357 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] HTTP exception thrown: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Request method failure captured: May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a HTTP/1.1 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecvTi2sbgr_6737NAyRrPO7-vLIWbdc0OkcQIF4bDZs4McQ8aydFZPs9LLLyxZcFO3N3jqddzoRs_S19bUR0uQZBiaM_omc_6-Owm5ONOQ4f1gwW7FEP8SDeNmZWAacYQr5wktrkz9XhXBXxXXQEnbRKt0R2KeQNAp-F_VTVQhTEnks May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.20 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_049d7523d65a466e9129bdd3842b3002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1b4983326cda4029b72134cf8f2ee832 May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3639a402-14be-4960-ab60-76c8ea5c120a'} May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:33.145655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:33.151895 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:27:33.155547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Returning 404 to user: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:33.160849 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5a6896f-c892-4d77-a868-63c783f147ce tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 404 len: 111 microversion: 2.20 time: 0.100548 May 10 02:27:33.161617 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1989/3989] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:27:33 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:27:33.176833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f4544c8c-8476-40d8-9799-ee21548d36e8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '.version_select at 0x7f3d35e29f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:33.230134 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f4544c8c-8476-40d8-9799-ee21548d36e8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017331091" status: 204 len: 0 microversion: 2.20 time: 0.063875 May 10 02:27:33.230725 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1990/3990] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:27:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017331091 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:27:33.334520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:33.335274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:33.356235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:33.356393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:33.365208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:33.367535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:33.598677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:33.614125 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1ccdbaa-7879-40e0-9a9c-b041896b46ed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1687 microversion: 2.1 time: 1.106224 May 10 02:27:33.616928 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2001/3991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:32 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1687 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:34.074280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:34.075149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:34.103394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:34.104927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:34.105959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:34.107729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:34.631389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:34.648155 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7ae04a9-2772-401c-9963-46a3bcf590c0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 1.319248 May 10 02:27:34.653993 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1991/3992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:33 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:34.674041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:34.676354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:34.701514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:34.703829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:34.710444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:34.711225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:35.623238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:35.632453 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5b5992b3-b346-4c1b-8d5d-96c1f5d6b1c3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 1.562388 May 10 02:27:35.650180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:35.662117 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2002/3993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:34 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:35.663490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4575273e-2971-4ecf-b9a4-9a798cc59b28 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1620 microversion: 2.1 time: 1.003088 May 10 02:27:35.669909 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1992/3994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:34 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1620 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:35.679274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-418c0c87-6476-422d-83ad-0fc57cefc528 req-4dc2e717-7f67-4cf2-8964-85549ddc3d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-unplugged", "status": "completed", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:35.680564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:35.681316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:35.696531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:35.696991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:35.698001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:35.702829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:35.705536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-418c0c87-6476-422d-83ad-0fc57cefc528 req-4dc2e717-7f67-4cf2-8964-85549ddc3d37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:35.706116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-418c0c87-6476-422d-83ad-0fc57cefc528 req-4dc2e717-7f67-4cf2-8964-85549ddc3d37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:35.749590 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-418c0c87-6476-422d-83ad-0fc57cefc528 req-4dc2e717-7f67-4cf2-8964-85549ddc3d37 service nova] Creating event network-vif-unplugged:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:27:35.767577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-418c0c87-6476-422d-83ad-0fc57cefc528 req-4dc2e717-7f67-4cf2-8964-85549ddc3d37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096076 May 10 02:27:35.780040 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1993/3995] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:36.678465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:36.679366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:36.707512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:36.708108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:36.708978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:36.709437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:37.058935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:37.079208 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a4e468e-b594-4aa4-bd77-3f560a9452af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 1.411554 May 10 02:27:37.079817 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2003/3996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:35 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:37.102715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:37.103399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:37.177827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:37.178464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:37.179185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:37.179647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:37.544409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:37.555100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ca2ed55-ab7e-4263-a29d-9fab7ccad165 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.880812 May 10 02:27:37.559020 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1994/3997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:36 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:37.620651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:37.649917 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5fcd9632-9a71-4285-bcc7-a3f4e002cfed tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1620 microversion: 2.1 time: 0.556993 May 10 02:27:37.652683 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2004/3998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:37 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1620 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:38.118761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c641ccef-7791-413a-be8f-dafa09cc0d22"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:38.124812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fe005db6-dc47-42ac-af14-baa69a879e0f req-dbcec37c-7a19-45d2-a871-23b5331ab223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747ed73f-82a0-4f2b-b1c8-1ddbf6020e83", "name": "network-vif-deleted", "tag": "e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:38.129715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:38.156647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.161528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fe005db6-dc47-42ac-af14-baa69a879e0f req-dbcec37c-7a19-45d2-a871-23b5331ab223 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.162277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:38.163908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.172815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fe005db6-dc47-42ac-af14-baa69a879e0f req-dbcec37c-7a19-45d2-a871-23b5331ab223 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:38.173901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:38.232403 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fe005db6-dc47-42ac-af14-baa69a879e0f req-dbcec37c-7a19-45d2-a871-23b5331ab223 service nova] Creating event network-vif-deleted:e09c5e3f-3ec8-4d0a-9e7f-f1d80c5220bf for instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 on n-h2-841089-2 May 10 02:27:38.244229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fe005db6-dc47-42ac-af14-baa69a879e0f req-dbcec37c-7a19-45d2-a871-23b5331ab223 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137388 May 10 02:27:38.247865 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1995/3999] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:38.579036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:38.580162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:38.633483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.634148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:38.635240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.635852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:38.885254 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a8d79bc-6bc9-4d69-92c6-f2eaf6b92da3 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774961 May 10 02:27:38.886306 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2005/4000] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:27:38 2022] POST /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:38.906773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:38.915938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:38.936606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.938057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:38.939019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:38.941505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:39.064038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:39.066057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:39.067922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'fault' on Instance uuid 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:27:39.392951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:39.413031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67f8839e-ce2c-47b3-a2c1-0f64b5fced4c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.833610 May 10 02:27:39.415219 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1996/4001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:38 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:39.655083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:39.665799 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-68f47cd3-e152-4a40-864b-d8c8aa6027a5 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 200 len: 1336 microversion: 2.1 time: 0.776291 May 10 02:27:39.667972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2006/4002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:38 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 1336 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:39.705803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:39.706848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:39.721424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:39.721894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:39.722710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:39.723219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:40.315914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:40.342022 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d1c7ffcb-d6c0-435b-ab7f-1bb7e6524703 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.627839 May 10 02:27:40.345328 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1997/4003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:39 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:40.360366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:40.361222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:40.374678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:40.376280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:40.382851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:40.384146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:40.430429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:40.431663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:40.442575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:40.443543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:40.452718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:40.453512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:41.111361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:41.119734 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c764c3fc-0b36-44f8-a533-a5ce4f89aac9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.764768 May 10 02:27:41.139107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2007/4004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:40 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:41.144517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:41.151269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:41.169082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:41.169852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:41.170840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:41.171585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:41.211445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:41.219298 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0dbe8eb1-cee4-43eb-acec-87186fe23d74 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 0.793238 May 10 02:27:41.224558 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 could not be found. May 10 02:27:41.233478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1998/4005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:40 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:41.238609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 HTTP/1.1 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 could not be found. May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '747ed73f-82a0-4f2b-b1c8-1ddbf6020e83'} May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 could not be found. May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 could not be found. May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:41.240788 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 could not be found. May 10 02:27:41.245334 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:41.247904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 404 to user: Instance 747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:41.250904 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0dafbbd3-89b0-4820-bdf1-f43fd5ff2ff0 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83" status: 404 len: 111 microversion: 2.1 time: 0.110228 May 10 02:27:41.253008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:41.265087 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2008/4006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:41 2022] GET /compute/v2.1/servers/747ed73f-82a0-4f2b-b1c8-1ddbf6020e83 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:27:41.271147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d741897f-1e62-4d40-bf68-c5954ec2e785 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '.version_select at 0x7f3d371e01f0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:41.294903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:41.302788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:41.312262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:41.312734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:41.352400 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d741897f-1e62-4d40-bf68-c5954ec2e785 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818906510" status: 202 len: 0 microversion: 2.1 time: 0.085906 May 10 02:27:41.358652 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2009/4007] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1818906510 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:27:41.756635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:41.765885 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94e10c74-6c54-4e66-b5bb-64f78f85c14a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.530989 May 10 02:27:41.777294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 1999/4008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:41 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:41.783810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:41.785469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:41.792843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:41.794386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:41.798736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:41.799939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:42.048032 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3d037ac-7cb4-48d1-af4a-6090ea4159ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.257582 May 10 02:27:42.058114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:42.059135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:42.070847 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2010/4009] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:41 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:27:42.077315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:42.080244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:42.082755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:42.084952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:42.249652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:42.251128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:42.261153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:42.267998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:42.269298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:42.270023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:43.456816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:43.466952 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4fc88c2c-eeb2-41fe-b29a-60aec3080ceb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1670 microversion: 2.1 time: 1.412015 May 10 02:27:43.468092 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2000/4010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:42 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1670 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:43.625754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:43.640287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce55f24d-e21d-4fb7-8466-97642d5efa41 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1528 microversion: 2.1 time: 1.395414 May 10 02:27:43.642265 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2011/4011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:42 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1528 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:44.487719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:44.489055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:44.501808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:44.502637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:44.503716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:44.504416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:44.663468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:44.664733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:44.679345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:44.680096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:44.684468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:44.685457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:45.046116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:45.055379 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-30d9e75f-b5f9-4ac8-8204-e01625f51ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1670 microversion: 2.1 time: 0.571486 May 10 02:27:45.058017 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2001/4012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:44 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1670 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:45.180192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:45.190492 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58d3d0fe-1993-462c-85ce-288260f784f9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1510 microversion: 2.1 time: 0.535154 May 10 02:27:45.201085 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2012/4013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:44 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:46.075578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:46.076912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:46.099860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.100688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.101789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.102523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.208975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:46.213086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:46.222590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.223567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.224671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.225353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.273383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:46.283826 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7292f718-7f51-4374-b200-fc924695c98d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.212010 May 10 02:27:46.300815 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2002/4014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:46.313965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:46.315554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:46.330955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.331812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.332850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.333504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.419119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-93a1dcc8-8258-4051-922c-18287243e541 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 200 len: 322 microversion: 2.1 time: 0.116449 May 10 02:27:46.424231 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2003/4015] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:46 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 322 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:27:46.430300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:46.435161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:46.445235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:46.445464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.446107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.446978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.447577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.455367 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f573979-e673-496b-905e-3d61d11a65a7 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1510 microversion: 2.1 time: 0.251458 May 10 02:27:46.459565 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2013/4016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:46 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:46.606179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:46.614852 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08e250ef-1d7c-4067-864e-2799b3e82360 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.188998 May 10 02:27:46.618172 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2004/4017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:46.645200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:46.645909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:46.652258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.653583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.654534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.655248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.834154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:46.843047 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b9a30718-ef1d-4a8e-b7a2-9621d6b9dc19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.210442 May 10 02:27:46.853739 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2014/4018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:46.859024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:46.859693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:46.865859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.866320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:46.867135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:46.867582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:47.074818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:47.084212 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a802d6d7-dbc0-4fd3-b764-91e0f9ca102a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.228576 May 10 02:27:47.085483 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2005/4019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:47.105662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:47.105847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:47.113201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:47.113723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:47.114654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:47.115335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:47.313853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:47.323050 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06427f4b-7113-47e7-89db-a47b55a6cba1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.225507 May 10 02:27:47.323944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2015/4020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:47 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:47.450740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-39673007", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "5a552ca0-79f9-47dd-adf9-5195fd4ca6cd"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:47.472335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:47.473242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:47.482490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:47.501425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:47.502633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:47.503615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:47.551188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] validate_networks() for [('5a552ca0-79f9-47dd-adf9-5195fd4ca6cd', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:27:47.976583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:47.988433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-93c18ba4-5a5c-439b-a6d8-5257bd300f5d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1453 microversion: 2.1 time: 0.516908 May 10 02:27:47.989257 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2016/4021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:47 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1453 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:48.003260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:48.004039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:48.023532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.024306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.025305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.025929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.057198 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] HTTP exception thrown: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Request method failure captured: May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a HTTP/1.1 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvTi2sbgr_6737NAyRrPO7-vLIWbdc0OkcQIF4bDZs4McQ8aydFZPs9LLLyxZcFO3N3jqddzoRs_S19bUR0uQZBiaM_omc_6-Owm5ONOQ4f1gwW7FEP8SDeNmZWAacYQr5wktrkz9XhXBXxXXQEnbRKt0R2KeQNAp-F_VTVQhTEnks May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.20 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_049d7523d65a466e9129bdd3842b3002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1b4983326cda4029b72134cf8f2ee832 May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '3639a402-14be-4960-ab60-76c8ea5c120a'} May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:27:48.059701 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.064210 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.065928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Returning 404 to user: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:48.066931 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8812958d-2667-4066-b78c-feb98e80c661 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 404 len: 111 microversion: 2.20 time: 0.076543 May 10 02:27:48.067637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2017/4022] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:27:47 2022] DELETE /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:27:48.074537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8569aa6c-3235-43dd-aed3-ff68073e18ea req-32273781-e91f-4243-9782-f6664e4575c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4512ed-540a-4c7f-884c-22e2f619a635", "name": "network-vif-unplugged", "status": "completed", "tag": "67f6d200-7310-4466-bd94-c656886c7d53"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:48.084109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8569aa6c-3235-43dd-aed3-ff68073e18ea req-32273781-e91f-4243-9782-f6664e4575c0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.085050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8569aa6c-3235-43dd-aed3-ff68073e18ea req-32273781-e91f-4243-9782-f6664e4575c0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.099049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.server_external_events [req-8569aa6c-3235-43dd-aed3-ff68073e18ea req-32273781-e91f-4243-9782-f6664e4575c0 service nova] Unable to find a host for instance 2e4512ed-540a-4c7f-884c-22e2f619a635. Dropping event network-vif-unplugged {{(pid=118716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 02:27:48.100161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8569aa6c-3235-43dd-aed3-ff68073e18ea req-32273781-e91f-4243-9782-f6664e4575c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031517 May 10 02:27:48.101119 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2018/4023] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 02:27:48.107243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:48.107980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:48.114143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.116284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.117482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.118041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.384758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:48.393940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5492d63-a71b-4c72-a455-ef4d0b89ada9 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1453 microversion: 2.1 time: 0.291743 May 10 02:27:48.399707 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2019/4024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:48 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1453 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:48.414306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:48.416442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 3639a402-14be-4960-ab60-76c8ea5c120a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:48.427307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.429813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.431304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.431766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.463871 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] HTTP exception thrown: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Request method failure captured: May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a HTTP/1.1 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvTi2sbgr_6737NAyRrPO7-vLIWbdc0OkcQIF4bDZs4McQ8aydFZPs9LLLyxZcFO3N3jqddzoRs_S19bUR0uQZBiaM_omc_6-Owm5ONOQ4f1gwW7FEP8SDeNmZWAacYQr5wktrkz9XhXBXxXXQEnbRKt0R2KeQNAp-F_VTVQhTEnks May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.20 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_049d7523d65a466e9129bdd3842b3002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1b4983326cda4029b72134cf8f2ee832 May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '3639a402-14be-4960-ab60-76c8ea5c120a'} May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.465663 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.469776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Returning 404 to user: Instance 3639a402-14be-4960-ab60-76c8ea5c120a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:48.472939 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-73ed49fa-3c7d-4e39-9138-96b69128f649 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a" status: 404 len: 111 microversion: 2.20 time: 0.068891 May 10 02:27:48.477515 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2020/4025] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:27:48 2022] GET /compute/v2.1/servers/3639a402-14be-4960-ab60-76c8ea5c120a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:27:48.495919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:48.496475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:48.504475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.504948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.505757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.506198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.541633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lazy-loading 'flavor' on Instance uuid 2e4512ed-540a-4c7f-884c-22e2f619a635 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:27:48.562366 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'shelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state shelved_offloaded May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 14 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: {"shelve": {}} May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: exception: Cannot 'shelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state shelved_offloaded May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'shelve': {}}} May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 10 02:27:48.564480 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state shelved_offloaded May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state shelved_offloaded May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'shelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state shelved_offloaded {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:27:48.568725 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-84b06df0-4dbe-4a8e-bfc3-fd8d3e69608d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 155 microversion: 2.1 time: 0.074574 May 10 02:27:48.572139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2021/4026] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:48 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:27:48.578026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:48.578768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:48.585702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.586316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.587290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.588348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.620755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:27:48.621258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:27:48.622003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:27:48.622694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:27:48.623512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:27:48.649983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.651810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.654060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.659700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.714392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:27:48.730297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for user 2534074779504b4ca699312fdd4664cd and project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:27:48.759130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:27:48.761681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:27:48.796551 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-08b229c6-0fb4-43ad-a242-249d815d2972 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 202 len: 0 microversion: 2.1 time: 0.223125 May 10 02:27:48.797781 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2022/4027] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:27:48 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:27:48.805907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:48.806498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:48.816857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.817248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.818050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:48.820840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:48.864432 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b09f0a03-b93c-4f0a-864b-9b254311007d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418135 May 10 02:27:48.865795 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2006/4028] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:27:48.876893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89fd3969-a3ac-4fac-aa88-7babde71120f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:48.878053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89fd3969-a3ac-4fac-aa88-7babde71120f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:49.117294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89fd3969-a3ac-4fac-aa88-7babde71120f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:49.126892 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89fd3969-a3ac-4fac-aa88-7babde71120f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1213 microversion: 2.1 time: 0.254261 May 10 02:27:49.129064 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2007/4029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:48 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1213 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:49.264062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:49.272269 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-daa62b15-654f-4a2d-87e6-b84cf696aa7a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1461 microversion: 2.1 time: 0.470102 May 10 02:27:49.272825 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2023/4030] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:48 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1461 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:50.145603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:50.146237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:50.164739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:50.165459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:50.166282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:50.167605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:50.292184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:50.292812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:50.305774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:50.306236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:50.307025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:50.307497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:50.322831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:50.330826 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bcbbe028-bc49-4305-b436-c4df4e05e4d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1265 microversion: 2.1 time: 0.190121 May 10 02:27:50.331451 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2008/4031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:50 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:50.597686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:50.609828 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c629c4e4-990e-4c84-9fb5-a36b8eeef965 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.322021 May 10 02:27:50.610972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2024/4032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:50 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:51.350202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:51.350889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:51.372468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:51.373594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:51.382019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:51.382505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:51.565507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:51.579378 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-937e94f3-061a-4250-af7a-677e3d630fe4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1271 microversion: 2.1 time: 0.234221 May 10 02:27:51.581979 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2009/4033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:51 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:51.634968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:51.642968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:51.658206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:51.660555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:51.661874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:51.663561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:52.095827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:52.104941 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53cdb09b-c4bf-4445-9204-950392eed28d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.474443 May 10 02:27:52.122724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2025/4034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:51 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:52.603208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:52.605184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:52.642641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:52.644151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:52.646692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:52.648379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:53.072540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:53.088479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c85698cd-03ae-4f54-b957-faf6684a425e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.491896 May 10 02:27:53.089087 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2010/4035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:52 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:53.127829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:53.129298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:53.152447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:53.152929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:53.157625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:53.158069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:53.530840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:53.566668 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3428049-dac5-494c-9517-2e7081f88bb6 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.443678 May 10 02:27:53.574770 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2026/4036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:53 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:54.109303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:54.110206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:54.196118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.196696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.205423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.206477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.358363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2d1a0cb8-c365-42ea-a7b6-d9f68cc7e8aa req-76267484-e0ca-40a5-8228-295315bd1f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee42f628-6ffd-48e4-8cac-ebe17161f31d", "tag": "f4b048a1-f46a-44d7-80de-6e1250579657"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:54.376596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2d1a0cb8-c365-42ea-a7b6-d9f68cc7e8aa req-76267484-e0ca-40a5-8228-295315bd1f27 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.377043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2d1a0cb8-c365-42ea-a7b6-d9f68cc7e8aa req-76267484-e0ca-40a5-8228-295315bd1f27 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.448866 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2d1a0cb8-c365-42ea-a7b6-d9f68cc7e8aa req-76267484-e0ca-40a5-8228-295315bd1f27 service nova] Creating event network-changed:f4b048a1-f46a-44d7-80de-6e1250579657 for instance ee42f628-6ffd-48e4-8cac-ebe17161f31d on n-h1-841089-2 May 10 02:27:54.471152 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2d1a0cb8-c365-42ea-a7b6-d9f68cc7e8aa req-76267484-e0ca-40a5-8228-295315bd1f27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116359 May 10 02:27:54.471787 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2027/4037] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:54.573681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:54.574736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:54.594781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.600744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.603271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.605216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.656243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:54.665732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18b7a8e9-fc55-4f52-977e-541822918b66 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.564172 May 10 02:27:54.677734 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2011/4038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:54 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:54.701841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:54.704779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:54.726966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fedd87b1-0c47-4d2d-8c4b-b303db70f31c tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157572 May 10 02:27:54.727470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.728163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.729186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.729980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.735703 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2028/4039] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:27:54 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:27:54.746710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:54.749439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:54.763415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.766473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:54.768275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:54.770246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:55.098095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lazy-loading 'services' on Instance uuid 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:27:55.369850 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-844280f9-f3ca-4e99-9a1a-c9a9197600f8 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments/05059f88-25dc-4333-b304-e82f43ee6c9b" status: 202 len: 0 microversion: 2.1 time: 0.632711 May 10 02:27:55.371307 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2029/4040] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:27:54 2022] DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments/05059f88-25dc-4333-b304-e82f43ee6c9b => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:27:55.693564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:55.694573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:55.711975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:55.718338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:55.719446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:55.720071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:56.151588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:56.173030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a691db1-6106-47eb-98ba-425c672df42e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 1.490669 May 10 02:27:56.175517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2012/4041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:54 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:56.207913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:56.215912 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b019ffd-3e1c-4aaf-8120-cb9eb957d578 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.526549 May 10 02:27:56.227087 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2030/4042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:55 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:57.192303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:57.192916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:57.212048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:57.212484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:57.213298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:57.227744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:57.235127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:57.236406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:57.253881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:57.254539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:57.261433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:57.262074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:57.811798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:57.821148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ceaa5f92-4774-4022-833f-246dfb6f5178 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.632644 May 10 02:27:57.832699 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2013/4043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:57 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:57.890911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:57.904334 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-225eddcd-3822-45de-9545-bb06513ec944 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.670500 May 10 02:27:57.907734 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2031/4044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:57 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:58.863559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:58.865304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:58.890563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:58.891028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:58.891858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:58.892296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:58.926674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:27:58.927558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:27:58.947870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:58.948990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:58.957628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:58.962263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:59.420548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:59.436915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-175f6690-bb2e-4020-98d0-2676ff4545b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.600166 May 10 02:27:59.441987 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2014/4045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:58 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:27:59.499276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:27:59.520214 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c2e51fb1-0db9-4692-8a8d-a8a8c863f187 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.600905 May 10 02:27:59.524431 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2032/4046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:27:58 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:27:59.814605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e0121692-e55e-4141-9d3b-91e73f594806 req-e8d5fc6b-daa9-4b04-93c2-db8acf423521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee42f628-6ffd-48e4-8cac-ebe17161f31d", "name": "network-vif-plugged", "status": "completed", "tag": "f4b048a1-f46a-44d7-80de-6e1250579657"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:27:59.837437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e0121692-e55e-4141-9d3b-91e73f594806 req-e8d5fc6b-daa9-4b04-93c2-db8acf423521 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:27:59.839112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e0121692-e55e-4141-9d3b-91e73f594806 req-e8d5fc6b-daa9-4b04-93c2-db8acf423521 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:27:59.864089 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e0121692-e55e-4141-9d3b-91e73f594806 req-e8d5fc6b-daa9-4b04-93c2-db8acf423521 service nova] Creating event network-vif-plugged:f4b048a1-f46a-44d7-80de-6e1250579657 for instance ee42f628-6ffd-48e4-8cac-ebe17161f31d on n-h1-841089-2 May 10 02:27:59.912155 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e0121692-e55e-4141-9d3b-91e73f594806 req-e8d5fc6b-daa9-4b04-93c2-db8acf423521 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104125 May 10 02:27:59.913386 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2015/4047] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:00.459453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:00.460739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:00.472835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:00.474970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:00.476735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:00.478930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:00.549784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:00.555766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:00.568467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:00.570223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:00.571338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:00.572036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:00.876958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:00.888896 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24ed2dc3-49c8-4a2d-a105-09a5e8ce9c5f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.432055 May 10 02:28:00.890950 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2033/4048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:00 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:00.932746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:00.951801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c5c9f2e4-7ef4-4dc8-9ed5-1a0fbaec0146 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.418357 May 10 02:28:00.952696 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2016/4049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:00 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:01.925656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:01.925656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:01.925656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:01.925656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:01.925656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:01.925656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:01.972745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:01.972745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:01.990948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:01.990948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:01.990948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:01.990948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:02.490387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:02.498702 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4cce52a7-390f-453d-a0e7-6dbff8217efe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.588529 May 10 02:28:02.509231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2034/4050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:01 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:02.519195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:02.529795 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2412dae3-10dc-47c8-b9f0-791b15e1e49d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.564750 May 10 02:28:02.531461 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2017/4051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:01 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:03.525477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:03.526894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:03.544503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:03.548646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:03.549273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:03.556347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:03.557619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:03.564699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:03.569881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:03.570347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:03.571214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:03.571632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:03.977572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:03.985885 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1e7629f3-deb6-4c3d-86e3-e065c58b0f27 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.464788 May 10 02:28:04.003341 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2035/4052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:03 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:04.094563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:04.111224 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-391707f6-9b37-4c94-a3d0-0ee592dcfdc4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1313 microversion: 2.1 time: 0.558189 May 10 02:28:04.111224 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2018/4053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:03 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:05.010257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:05.010977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:05.027392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.027893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.028696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.030683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.121123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:05.123540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:05.137867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.143948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.152623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.154074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.250669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:05.259792 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d59e27b0-99fb-4712-8455-eeb52a426060 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.253800 May 10 02:28:05.261354 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2036/4054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:05 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:05.382869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:05.391354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef9a66af-ee56-455c-b31a-694de286aaf3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1500 microversion: 2.1 time: 0.274125 May 10 02:28:05.407736 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2019/4055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:05 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1500 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:05.412689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04c970f9-a5fe-4187-81ed-b77138d057d0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:05.443607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04c970f9-a5fe-4187-81ed-b77138d057d0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.448642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04c970f9-a5fe-4187-81ed-b77138d057d0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.517432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-04c970f9-a5fe-4187-81ed-b77138d057d0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Going to try to stop instance {{(pid=118716) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:28:05.568494 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-04c970f9-a5fe-4187-81ed-b77138d057d0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d/action" status: 202 len: 0 microversion: 2.1 time: 0.159749 May 10 02:28:05.572169 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2037/4056] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:05 2022] POST /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:28:05.580957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:05.581964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:05.588955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.589804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.591508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:05.592216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:05.789480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:05.799001 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-295a0c47-568c-4ed6-b2e4-cff8a18c4143 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.224627 May 10 02:28:05.815319 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2020/4057] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:05 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:06.282351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:06.283917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:06.313717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:06.315299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:06.316166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:06.316558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:06.556111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:06.573783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9cc4ace3-ed99-46bc-8c42-fecee8304f6c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.295882 May 10 02:28:06.575053 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2038/4058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:06 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:06.823340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:06.824747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:06.833147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:06.833871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:06.835299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:06.835959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:07.038708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:07.051550 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08ff6452-d4c8-4237-9507-b1ecd3510cb2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.233649 May 10 02:28:07.052354 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2021/4059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:06 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:07.592654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:07.593293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:07.607745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:07.614693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:07.615938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:07.616389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:07.802404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:07.821353 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-92ab7541-fcf2-45ff-9446-feeea7829e0a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.233703 May 10 02:28:07.831609 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2039/4060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:07 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:08.069225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:08.071780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:08.079674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:08.080786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:08.081796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:08.082455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:08.312468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:08.341428 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d462c6a-5465-4148-95c0-d099f5b044b8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.276597 May 10 02:28:08.342981 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2022/4061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:08 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:08.841579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:08.842158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:08.852200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:08.852967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:08.853766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:08.854211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:09.118828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:09.127870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-586c00d0-8fef-431b-8424-71db22c85887 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.292391 May 10 02:28:09.128781 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2040/4062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:08 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:09.360823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:09.362116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:09.375131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:09.377403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:09.378388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:09.380151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:09.623950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:09.635399 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bad8a37e-ea86-468b-91fb-888b6a1a41eb tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.279610 May 10 02:28:09.647151 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2023/4063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:09 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:09.875111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b3a099d3-cc05-4e84-8743-55b754f2579e req-5c1e20f5-71ec-4f12-9fb9-9dac7083f571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4512ed-540a-4c7f-884c-22e2f619a635", "name": "network-vif-plugged", "status": "completed", "tag": "67f6d200-7310-4466-bd94-c656886c7d53"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:09.905821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b3a099d3-cc05-4e84-8743-55b754f2579e req-5c1e20f5-71ec-4f12-9fb9-9dac7083f571 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:09.905821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b3a099d3-cc05-4e84-8743-55b754f2579e req-5c1e20f5-71ec-4f12-9fb9-9dac7083f571 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:09.950036 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b3a099d3-cc05-4e84-8743-55b754f2579e req-5c1e20f5-71ec-4f12-9fb9-9dac7083f571 service nova] Creating event network-vif-plugged:67f6d200-7310-4466-bd94-c656886c7d53 for instance 2e4512ed-540a-4c7f-884c-22e2f619a635 on n-h1-841089-2 May 10 02:28:09.958350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b3a099d3-cc05-4e84-8743-55b754f2579e req-5c1e20f5-71ec-4f12-9fb9-9dac7083f571 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087026 May 10 02:28:09.958977 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2041/4064] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:10.147147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:10.147874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:10.158855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:10.159347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:10.160410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:10.167731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:10.413747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:10.424122 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ce97892d-1449-44e3-b9b2-8fdd873f6413 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.282140 May 10 02:28:10.425230 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2024/4065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:10 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:10.653137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:10.654117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:10.660942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:10.661449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:10.662246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:10.662698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:10.817008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:10.826011 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32372064-e1f1-46e9-8a7a-27a50305b4f9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.177844 May 10 02:28:10.836264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2042/4066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:10 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:11.441123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:11.441735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:11.454298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:11.454979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:11.455946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:11.456561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:11.620072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:11.635770 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-32da0c46-f4da-44c1-9ef6-af386fcc0899 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1519 microversion: 2.1 time: 0.198194 May 10 02:28:11.636993 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2025/4067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:11 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:11.843561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:11.844198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:11.866693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:11.867206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:11.868077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:11.868472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:12.048623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:12.059436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6164cfd-a6de-43cf-89e7-b64c8c7f9f6c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.219620 May 10 02:28:12.071156 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2043/4068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:11 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:12.653948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:12.655197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:12.662409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:12.663195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:12.664142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:12.664589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:12.802909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:12.812338 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5df613b6-0f47-4858-822c-fe16362dba3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.163033 May 10 02:28:12.812938 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2026/4069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:12 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:12.828637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:12.829515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:12.836005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:12.836567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:12.837448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:12.838005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:12.976676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:12.985177 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51df9f38-64f7-4217-8c5e-e9bd59ed58fe tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.160616 May 10 02:28:12.985877 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2044/4070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:12 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:13.008127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:13.008762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.015766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.016230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.017022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.017474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.077798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:13.078565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.085213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.086262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.087410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.088034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.202916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:13.211590 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e8f60a5-ec8f-46d2-b610-acd501dff349 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.209533 May 10 02:28:13.212279 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2027/4071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:13.231705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb6b471a-1e0c-4781-a4a7-b091e70cea2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:13.237602 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-bb6b471a-1e0c-4781-a4a7-b091e70cea2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 8449e0da-c35a-43b0-82d1-319c1a5a9600 has no mapping to a cell. May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb6b471a-1e0c-4781-a4a7-b091e70cea2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/8449e0da-c35a-43b0-82d1-319c1a5a9600/action HTTP/1.1 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: {"os-stop": {}} May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 8449e0da-c35a-43b0-82d1-319c1a5a9600 has no mapping to a cell. May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8449e0da-c35a-43b0-82d1-319c1a5a9600', 'body': {'os-stop': {}}} May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8449e0da-c35a-43b0-82d1-319c1a5a9600 has no mapping to a cell. May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:13.243982 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8449e0da-c35a-43b0-82d1-319c1a5a9600 has no mapping to a cell. May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8449e0da-c35a-43b0-82d1-319c1a5a9600 has no mapping to a cell. May 10 02:28:13.249356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.251879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb6b471a-1e0c-4781-a4a7-b091e70cea2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 8449e0da-c35a-43b0-82d1-319c1a5a9600 has no mapping to a cell. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:13.252616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:13.253647 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb6b471a-1e0c-4781-a4a7-b091e70cea2d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/8449e0da-c35a-43b0-82d1-319c1a5a9600/action" status: 404 len: 117 microversion: 2.1 time: 0.027840 May 10 02:28:13.254771 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2028/4072] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:13 2022] POST /compute/v2.1/servers/8449e0da-c35a-43b0-82d1-319c1a5a9600/action => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:28:13.263601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:13.264215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.264353 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fff9efb7-7b62-48dd-949b-1fae85c8af9d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.191440 May 10 02:28:13.264871 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2045/4073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:13 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:13.273867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.273867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.273867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.273867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.410798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:13.419904 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec560232-5bf6-4775-883e-75c5d34e0e36 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.161061 May 10 02:28:13.421128 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2029/4074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:13.437345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:13.437972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.447054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.447474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.448276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.448725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.599886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:13.609940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c73654a6-82da-4b0c-b648-ca5f0a7be5f3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.176454 May 10 02:28:13.611108 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2046/4075] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:13.627503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc61976c-767d-491b-bf4d-f0a6f5e006c2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:13.628310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bc61976c-767d-491b-bf4d-f0a6f5e006c2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: a372972c-6d28-4cbd-8bf5-6da65eaa99a5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.636926 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-bc61976c-767d-491b-bf4d-f0a6f5e006c2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance a372972c-6d28-4cbd-8bf5-6da65eaa99a5 could not be found. May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc61976c-767d-491b-bf4d-f0a6f5e006c2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/a372972c-6d28-4cbd-8bf5-6da65eaa99a5/action HTTP/1.1 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: {"suspend": {}} May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance a372972c-6d28-4cbd-8bf5-6da65eaa99a5 could not be found. May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'a372972c-6d28-4cbd-8bf5-6da65eaa99a5', 'body': {'suspend': {}}} May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a372972c-6d28-4cbd-8bf5-6da65eaa99a5 could not be found. May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a372972c-6d28-4cbd-8bf5-6da65eaa99a5 could not be found. May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:13.639333 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:13.644966 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:13.644966 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:13.644966 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a372972c-6d28-4cbd-8bf5-6da65eaa99a5 could not be found. May 10 02:28:13.644966 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:13.647698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc61976c-767d-491b-bf4d-f0a6f5e006c2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance a372972c-6d28-4cbd-8bf5-6da65eaa99a5 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:13.648719 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bc61976c-767d-491b-bf4d-f0a6f5e006c2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/a372972c-6d28-4cbd-8bf5-6da65eaa99a5/action" status: 404 len: 111 microversion: 2.1 time: 0.026324 May 10 02:28:13.649304 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2030/4076] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:13 2022] POST /compute/v2.1/servers/a372972c-6d28-4cbd-8bf5-6da65eaa99a5/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:13.658334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:13.659041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.665857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.666416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.667349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.667867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.806007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:13.821403 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4034cdac-96b4-4959-bfc8-92f559330ba2 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.167069 May 10 02:28:13.822166 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2047/4077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:13.839559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:13.840752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:13.849082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.849489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.850265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:13.850713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:13.993327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:14.001016 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c9174d6-e2b0-4237-9cd9-26a7aeb0736d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.165301 May 10 02:28:14.001739 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2031/4078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:13 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:14.017530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:14.018083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:14.026803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:14.027312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:14.028667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:14.029116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:14.052082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lazy-loading 'flavor' on Instance uuid 2e4512ed-540a-4c7f-884c-22e2f619a635 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:28:14.127268 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c999fe74-7e3e-4948-a85f-08ec337ffb71 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 202 len: 0 microversion: 2.1 time: 0.113040 May 10 02:28:14.131000 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2048/4079] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:14 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:28:14.147387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:14.148067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:14.157734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:14.158204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:14.159017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:14.159500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:14.282353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:14.283295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:14.290411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:14.290411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:14.291534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:14.292112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:14.316105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:14.328746 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37b1bffa-8a9f-429b-9ec9-8aeac6ec349b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1514 microversion: 2.1 time: 0.192094 May 10 02:28:14.329540 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2032/4080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:14 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:14.436953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:14.444860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18a95019-89f0-4b46-96cd-42e7faf1ad38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.167233 May 10 02:28:14.445784 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2049/4081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:14 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:15.345480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:15.346760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:15.353714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.354167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.354922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.355390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.464059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:15.465591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:15.475934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.476400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.477413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.477996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.494111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:15.502362 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cefda024-2a7e-4685-bbcd-ec01ea38161b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1497 microversion: 2.1 time: 0.160806 May 10 02:28:15.510289 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2033/4082] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:15 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:15.521363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:15.522267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:15.529617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.530667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.531926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.532595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.568527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lazy-loading 'flavor' on Instance uuid 2e4512ed-540a-4c7f-884c-22e2f619a635 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:28:15.581698 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'suspend' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state suspended May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: {"suspend": {}} May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'suspend' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state suspended May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'suspend': {}}} May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state suspended. Cannot suspend while the instance is in this state. May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 10 02:28:15.583674 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state suspended May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state suspended May 10 02:28:15.587829 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:15.590227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'suspend' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state suspended {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:15.591358 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75a2f91c-5550-4c63-bea4-a592ae239034 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 148 microversion: 2.1 time: 0.074773 May 10 02:28:15.592153 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2034/4083] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:15 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 148 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:28:15.601943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:15.602595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:15.608999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.609563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.610605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.611184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.661490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:15.671516 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94d337c4-f936-41dd-9af9-d55513421a73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.213123 May 10 02:28:15.682605 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2050/4084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:15 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:15.687426 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b3ba0df-8fa4-4584-9785-239407566d30 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 202 len: 0 microversion: 2.1 time: 0.089053 May 10 02:28:15.691747 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2035/4085] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:15 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:28:15.706369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:15.707215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:15.714492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.715190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.716101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:15.716658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:15.971760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:15.985161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72515f10-4c65-45f8-a111-c5448393eb7d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1503 microversion: 2.1 time: 0.286275 May 10 02:28:15.991446 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2051/4086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:15 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:16.355899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:16.357026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:16.371833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.372675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.373679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.375199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:16.375667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:16.380641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.385722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.385722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.386351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.386821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.417551 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] HTTP exception thrown: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Request method failure captured: May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 HTTP/1.1 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvTi2sbgr_6737NAyRrPO7-vLIWbdc0OkcQIF4bDZs4McQ8aydFZPs9LLLyxZcFO3N3jqddzoRs_S19bUR0uQZBiaM_omc_6-Owm5ONOQ4f1gwW7FEP8SDeNmZWAacYQr5wktrkz9XhXBXxXXQEnbRKt0R2KeQNAp-F_VTVQhTEnks May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.20 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_049d7523d65a466e9129bdd3842b3002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1b4983326cda4029b72134cf8f2ee832 May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '62292e53-bc84-4672-ad76-e3f6f50ffd67'} May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:16.419366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.424411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Returning 404 to user: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:16.425341 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0458a5a3-8f9c-4e50-8cca-5636478ffdf8 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 404 len: 111 microversion: 2.20 time: 0.054816 May 10 02:28:16.426040 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2052/4087] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:28:16 2022] DELETE /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 02:28:16.439086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:16.441058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] [instance: 62292e53-bc84-4672-ad76-e3f6f50ffd67] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:16.443665 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5cff8343-9922-4648-883b-93ff57318640 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093079 May 10 02:28:16.445081 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2036/4088] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:28:16 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:28:16.450442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.451122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.452503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.453123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.468121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] HTTP exception thrown: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Request method failure captured: May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 HTTP/1.1 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecvTi2sbgr_6737NAyRrPO7-vLIWbdc0OkcQIF4bDZs4McQ8aydFZPs9LLLyxZcFO3N3jqddzoRs_S19bUR0uQZBiaM_omc_6-Owm5ONOQ4f1gwW7FEP8SDeNmZWAacYQr5wktrkz9XhXBXxXXQEnbRKt0R2KeQNAp-F_VTVQhTEnks May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.20 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_049d7523d65a466e9129bdd3842b3002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/049d7523d65a466e9129bdd3842b3002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 049d7523d65a466e9129bdd3842b3002 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895921475 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1b4983326cda4029b72134cf8f2ee832 May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895921475-project May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '62292e53-bc84-4672-ad76-e3f6f50ffd67'} May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.471061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. May 10 02:28:16.476348 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:16.478087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] Returning 404 to user: Instance 62292e53-bc84-4672-ad76-e3f6f50ffd67 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:16.479874 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b8e447c-6f0c-41fa-986c-8734d4086fa5 tempest-AttachVolumeShelveTestJSON-895921475 tempest-AttachVolumeShelveTestJSON-895921475-project] 10.222.0.52 "GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67" status: 404 len: 111 microversion: 2.20 time: 0.049556 May 10 02:28:16.480968 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2053/4089] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:28:16 2022] GET /compute/v2.1/servers/62292e53-bc84-4672-ad76-e3f6f50ffd67 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:28:16.690052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:16.690676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:16.701069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.701774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.702841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.703480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.725106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:16.726415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:16.753705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.756315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.757342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:16.765282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:16.859416 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35bdd7b4-7f8b-4a5d-9a6b-7c7c52112499 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138476 May 10 02:28:16.861090 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2054/4090] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:28:16 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:28:17.002833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:17.006371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:17.019861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:17.020600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:17.021416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:17.021871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:17.093288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:17.108340 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7bccaf9f-be8a-426f-b03b-342986db6501 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.414908 May 10 02:28:17.109041 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2037/4091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:16 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:17.124789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:17.128302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:17.143796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:17.146266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:17.148252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:17.150599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:17.224069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:28:17.357708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:17.369315 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17d28203-ccec-4ac4-b402-7cd7bfc1e507 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1503 microversion: 2.1 time: 0.369594 May 10 02:28:17.370686 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2055/4092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:16 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1503 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:17.393983 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2089d48b-f210-4052-b61c-c2eb61fbf1d4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 204 len: 0 microversion: 2.1 time: 0.283434 May 10 02:28:17.396346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2038/4093] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:28:17 2022] DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:28:17.408980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:17.409931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:17.420687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:17.422876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:17.425260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:17.427021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:17.733452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:17.745453 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c197a02-3a89-4b5c-863e-676dcc27fc67 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1680 microversion: 2.1 time: 0.341152 May 10 02:28:17.752951 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2056/4094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:17 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1680 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:18.126120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:18.127548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:18.141597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.142373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.143420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.144068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.413354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:18.414184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:18.426070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.426839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.427938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.428624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.613460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:18.630599 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1960b596-b05c-4846-8f63-907b215633ff tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.509103 May 10 02:28:18.634209 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2039/4095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:18 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:18.770327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:18.770956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:18.782443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.783359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.784330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.784948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.887630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:18.916800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-74e26729-edc3-4818-a8ff-b421ec02b463 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.491865 May 10 02:28:18.917494 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2057/4096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:18 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:18.935669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:18.936306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:18.950445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.950934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:18.951791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:18.952251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:19.302031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:19.316253 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-839bb89d-0a03-45f3-9873-7ac6281164b4 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1680 microversion: 2.1 time: 0.549741 May 10 02:28:19.317062 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2040/4097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:18 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1680 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:19.564922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:19.577300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0658289-b7f8-4485-bcc5-0c56da111a8e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.645762 May 10 02:28:19.578715 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2058/4098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:18 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:19.595132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ffb9a46-4d4a-455d-83f7-9980cc4acc0f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:19.595703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5ffb9a46-4d4a-455d-83f7-9980cc4acc0f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4232e79a-dd53-4791-b300-7e6f74b101a8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:19.602581 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-5ffb9a46-4d4a-455d-83f7-9980cc4acc0f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4232e79a-dd53-4791-b300-7e6f74b101a8 could not be found. May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ffb9a46-4d4a-455d-83f7-9980cc4acc0f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/4232e79a-dd53-4791-b300-7e6f74b101a8/action HTTP/1.1 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: {"unpause": {}} May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4232e79a-dd53-4791-b300-7e6f74b101a8 could not be found. May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4232e79a-dd53-4791-b300-7e6f74b101a8', 'body': {'unpause': {}}} May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4232e79a-dd53-4791-b300-7e6f74b101a8 could not be found. May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4232e79a-dd53-4791-b300-7e6f74b101a8 could not be found. May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:19.604291 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4232e79a-dd53-4791-b300-7e6f74b101a8 could not be found. May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ffb9a46-4d4a-455d-83f7-9980cc4acc0f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4232e79a-dd53-4791-b300-7e6f74b101a8 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5ffb9a46-4d4a-455d-83f7-9980cc4acc0f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/4232e79a-dd53-4791-b300-7e6f74b101a8/action" status: 404 len: 111 microversion: 2.1 time: 0.015073 May 10 02:28:19.608635 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2041/4099] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:19 2022] POST /compute/v2.1/servers/4232e79a-dd53-4791-b300-7e6f74b101a8/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:19.615042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:19.615714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:19.632305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:19.634280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:19.635334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:19.648915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:19.650148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:19.654819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:19.667248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:19.668521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:19.671848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:19.672618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:20.676595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:20.693575 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0945db86-3f4b-46b3-a669-918ee25240d3 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.082584 May 10 02:28:20.700438 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2059/4100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:19 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:20.729275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:20.733615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:20.764825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:20.765287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:20.766087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:20.766533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:20.797272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:20.816406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5600044e-ef8d-4694-a2c6-5d07924204ce tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 1.172086 May 10 02:28:20.827550 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2042/4101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:19 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:20.834340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:20.837070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:20.853257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:20.853991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:20.854957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:20.856240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:21.574199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:21.585098 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46b15d0e-ac56-4dfb-9bcb-8c7622274514 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.754149 May 10 02:28:21.585726 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2043/4102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:20 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:21.601847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:21.621998 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c47f671-b241-40cb-903b-97e2db872356 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1680 microversion: 2.1 time: 0.917938 May 10 02:28:21.643997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2060/4103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:20 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1680 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:21.645498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:21.646045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:21.657164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:21.657620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:21.662177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:21.662643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:21.718239 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'unpause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: {"unpause": {}} May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'unpause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'unpause': {}}} May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state active. Cannot unpause while the instance is in this state. May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:21.719138 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'unpause' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:21.724159 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e35649d-11a4-4885-ada2-ee5a0927f13f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 145 microversion: 2.1 time: 0.107521 May 10 02:28:21.734447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:21.735129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:21.738235 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2044/4104] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:21 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 145 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:28:21.744244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:21.744893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:21.750559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:21.751032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:21.834233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:21.835653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:21.846394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:21.847167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:21.848927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:21.851303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:22.283379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:22.295940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb7dbba4-6113-4b30-9f37-7271ad7d481c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.565783 May 10 02:28:22.297244 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2061/4105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:21 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:22.305801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:22.306541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:22.318238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:22.318925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:22.320589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:22.321246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:22.358019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:28:22.461818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:22.471057 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a1fd2a9-63ed-46f6-bf5e-4904118a1de7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.640922 May 10 02:28:22.482733 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2045/4106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:21 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:22.489061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:22.490037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:22.498895 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-546c466e-6a63-4ae6-9cc6-63db0f88615b tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "DELETE /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 204 len: 0 microversion: 2.1 time: 0.199948 May 10 02:28:22.499934 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2062/4107] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:28:22 2022] DELETE /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:28:22.505704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:22.506710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:22.507767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:22.508373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:22.514090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:22.515134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:22.524868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:22.524868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:22.525661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:22.526425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:23.411430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:23.426300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88767fae-c272-43b0-aa10-fd59c9eef0cc tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1506 microversion: 2.1 time: 0.917077 May 10 02:28:23.428299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2063/4108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:22 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1506 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:23.441286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:23.442095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:23.479868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:23.480880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:23.482152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:23.482747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:23.528956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:23.547698 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4fa7409-1ab6-49ed-83f7-f4f817d3e3ce tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 1.062135 May 10 02:28:23.560000 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2046/4109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:22 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:23.568958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:23.570895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:23.578465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:23.579217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:23.580817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:23.581505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:23.649571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:23.661557 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-40d31390-631f-4789-9729-526bc52c8595 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1612 microversion: 2.1 time: 0.232324 May 10 02:28:23.665605 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2064/4110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:23 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1612 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:23.678831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95c1b99d-5072-4e5f-a028-8908e6579e92 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:23.679746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-95c1b99d-5072-4e5f-a028-8908e6579e92 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:23.692427 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-95c1b99d-5072-4e5f-a028-8908e6579e92 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07 could not be found. May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95c1b99d-5072-4e5f-a028-8908e6579e92 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07/action HTTP/1.1 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 18 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: {"unshelve": null} May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07 could not be found. May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07', 'body': {'unshelve': None}} May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07 could not be found. May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07 could not be found. May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:23.698971 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:23.704738 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:23.704738 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:23.704738 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:23.704738 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07 could not be found. May 10 02:28:23.704738 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:23.708562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95c1b99d-5072-4e5f-a028-8908e6579e92 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:23.710897 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-95c1b99d-5072-4e5f-a028-8908e6579e92 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07/action" status: 404 len: 111 microversion: 2.1 time: 0.042603 May 10 02:28:23.713047 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2065/4111] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:23 2022] POST /compute/v2.1/servers/4ddb470b-5ac7-40cb-82ea-a3cfff3f0a07/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:23.725190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:23.727828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:23.744409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:23.746672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:23.749285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:23.750853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:24.267349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:24.278062 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce4f5ed0-86c7-438f-9833-2c1a08511369 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.561076 May 10 02:28:24.279571 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2066/4112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:23 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:24.309407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:24.310240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:24.318616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:24.321545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:24.322553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:24.324758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:24.392372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:24.406842 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8cd788c5-e5c4-4d64-913f-ef648de58306 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.842488 May 10 02:28:24.414924 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2047/4113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:23 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:24.445925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:24.446443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:24.457317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:24.457790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:24.458590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:24.459035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.091619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:25.104439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1edb4e6a-f0f7-41fa-9e69-60c45e2562b8 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.800266 May 10 02:28:25.117196 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2067/4114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:24 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:25.140612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-bf76ab77-abb6-451e-af6b-c25fe7522c09 req-cc5c8d10-46e7-4655-ac47-476b08c3bc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e", "name": "network-vif-deleted", "tag": "90b7d1ae-a4ce-465b-a887-a66acd33f032"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:25.171157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bf76ab77-abb6-451e-af6b-c25fe7522c09 req-cc5c8d10-46e7-4655-ac47-476b08c3bc14 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.171850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bf76ab77-abb6-451e-af6b-c25fe7522c09 req-cc5c8d10-46e7-4655-ac47-476b08c3bc14 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.217552 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-bf76ab77-abb6-451e-af6b-c25fe7522c09 req-cc5c8d10-46e7-4655-ac47-476b08c3bc14 service nova] Creating event network-vif-deleted:90b7d1ae-a4ce-465b-a887-a66acd33f032 for instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e on n-h2-841089-2 May 10 02:28:25.234351 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-bf76ab77-abb6-451e-af6b-c25fe7522c09 req-cc5c8d10-46e7-4655-ac47-476b08c3bc14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115743 May 10 02:28:25.235466 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2068/4115] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:25.240875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:25.245882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:25.248087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:25.255154 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53bd6e43-f5dc-4541-8061-535951bb0f33 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1506 microversion: 2.1 time: 0.814119 May 10 02:28:25.256030 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2048/4116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:24 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:25.266267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.270517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.271411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:25.272334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:25.272556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.277132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.306251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.306705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.307541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.311290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.348858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.359701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.360752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lazy-loading 'fault' on Instance uuid 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:28:25.373874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Cannot 'unshelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action HTTP/1.1 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 18 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: {"unshelve": null} May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: exception: Cannot 'unshelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'unshelve': None}} May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 in vm_state active. Cannot unshelve while the instance is in this state. May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:25.387166 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active May 10 02:28:25.393126 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:25.396240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 409 to user: Cannot 'unshelve' instance 2e4512ed-540a-4c7f-884c-22e2f619a635 while it is in vm_state active {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:25.397311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-476ce8dc-9a49-4d67-ba09-b17899808043 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action" status: 409 len: 146 microversion: 2.1 time: 0.140168 May 10 02:28:25.399383 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2049/4117] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:25 2022] POST /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635/action => generated 146 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:28:25.408054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:25.408926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:25.428347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.429138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.433915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.434773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.490043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf50d046513b4e77b582feaf5dc353e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2c55288ab4495c99a636b525230e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:25.497944 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c968688d-f3de-4b3e-91bf-9d890816a312 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 200 len: 1329 microversion: 2.1 time: 0.261203 May 10 02:28:25.501491 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2069/4118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:25 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 1329 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:25.517108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:25.519553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:25.533803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.536364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:25.538528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:25.541208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.216384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:26.235323 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-034bba40-fd85-4e87-838c-05a06378689f tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.829100 May 10 02:28:26.262350 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2050/4119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:25 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:26.284236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:26.284745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:26.285562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:26.296676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.297653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.298280 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43f2a2cf-8ce5-4498-b428-5ae9affda617 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.794911 May 10 02:28:26.299284 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2070/4120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:25 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:26.307899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.308756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.312569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:26.314419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:26.344001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.346898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.351720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.352642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.418774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.419676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.420372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'fault' on Instance uuid 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:28:26.520518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:26.544692 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a9cde9c9-9342-4489-a543-bccfa4f05f56 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 200 len: 1311 microversion: 2.1 time: 0.238582 May 10 02:28:26.545350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2071/4121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:26 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:26.568709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:26.573714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:26.591745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.597010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.597902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.598356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.605671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:26.619922 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c371395f-1ca1-4863-84b9-0bdb45f247c0 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.356167 May 10 02:28:26.621322 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2051/4122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:26 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:26.630551 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] HTTP exception thrown: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Request method failure captured: May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e HTTP/1.1 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz7AGV-CKGIEZ5h4nZFhtYVX3HBMB1QpvvJVaXOMvF0jEFuX924w5RncPtfGCRFsqpttrH_y9TRpnJWwTTZoz4fYvH40AiNzBmerN4v-KF5O7NSEKt_gIwFL_1fOQwDTNDA7fmf86srnZMWlzYVD7AqlhqRj6uBPvV0lpO5PEAOWlM May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7e2c55288ab4495c99a636b525230e31 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e2c55288ab4495c99a636b525230e31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7e2c55288ab4495c99a636b525230e31 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachSCSIVolumeTestJSON-2075974068-project May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: bf50d046513b4e77b582feaf5dc353e4 May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2075974068-project May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e'} May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:26.632402 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Returning 404 to user: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:26.637428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86a7ea0a-c5c3-4216-8977-823aa6b5fe4b tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 404 len: 111 microversion: 2.1 time: 0.077698 May 10 02:28:26.646851 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2072/4123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:26 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:26.652956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d97fbb6-7645-4b1e-9625-040a726e8181 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1288815291_updated"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:26.654252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d97fbb6-7645-4b1e-9625-040a726e8181 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 5b9c2dbc-bc56-4a08-9e70-965771188cf0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:26.655735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5bacb4c5-4177-47ed-a425-07a7526345ca tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '.version_select at 0x7f3d367e63a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:26.666505 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2d97fbb6-7645-4b1e-9625-040a726e8181 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 5b9c2dbc-bc56-4a08-9e70-965771188cf0 could not be found. May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d97fbb6-7645-4b1e-9625-040a726e8181 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: request: PUT /compute/v2.1/servers/5b9c2dbc-bc56-4a08-9e70-965771188cf0 HTTP/1.1 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 81 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1288815291_updated"}} May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5b9c2dbc-bc56-4a08-9e70-965771188cf0 could not be found. May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5b9c2dbc-bc56-4a08-9e70-965771188cf0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1288815291_updated'}}} May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9c2dbc-bc56-4a08-9e70-965771188cf0 could not be found. May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 10 02:28:26.669461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9c2dbc-bc56-4a08-9e70-965771188cf0 could not be found. May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9c2dbc-bc56-4a08-9e70-965771188cf0 could not be found. May 10 02:28:26.676911 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:26.680935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d97fbb6-7645-4b1e-9625-040a726e8181 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 5b9c2dbc-bc56-4a08-9e70-965771188cf0 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:26.682159 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d97fbb6-7645-4b1e-9625-040a726e8181 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "PUT /compute/v2.1/servers/5b9c2dbc-bc56-4a08-9e70-965771188cf0" status: 404 len: 111 microversion: 2.1 time: 0.042769 May 10 02:28:26.691195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2052/4124] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:28:26 2022] PUT /compute/v2.1/servers/5b9c2dbc-bc56-4a08-9e70-965771188cf0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:26.691431 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5bacb4c5-4177-47ed-a425-07a7526345ca tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-98902076" status: 202 len: 0 microversion: 2.1 time: 0.039696 May 10 02:28:26.695618 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2073/4125] 10.222.0.52 () {58 vars in 1214 bytes} [Tue May 10 02:28:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-98902076 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:28:26.727973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:26.729462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:26.746042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.747815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:26.773048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:26.778710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.108744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:27.138171 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d11bc713-8b07-4b09-a978-cab72ae4cf84 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.445277 May 10 02:28:27.138955 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2053/4126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:26 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:27.157754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:27.158570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:27.170296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.173512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.174700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.181420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.264160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-cdc96612-354b-4c0c-97bb-d21206f519c3 req-5b8a5832-0954-445b-9343-f53cc6a77f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271a109c-84b1-40fc-a0e3-0dbe5ac14af9", "name": "network-vif-deleted", "tag": "15150371-b677-48f5-a5c7-d99cb60f1037"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:27.279660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cdc96612-354b-4c0c-97bb-d21206f519c3 req-5b8a5832-0954-445b-9343-f53cc6a77f3b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.280617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cdc96612-354b-4c0c-97bb-d21206f519c3 req-5b8a5832-0954-445b-9343-f53cc6a77f3b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.300714 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-cdc96612-354b-4c0c-97bb-d21206f519c3 req-5b8a5832-0954-445b-9343-f53cc6a77f3b service nova] Creating event network-vif-deleted:15150371-b677-48f5-a5c7-d99cb60f1037 for instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 on n-h1-841089-2 May 10 02:28:27.311442 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-cdc96612-354b-4c0c-97bb-d21206f519c3 req-5b8a5832-0954-445b-9343-f53cc6a77f3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052318 May 10 02:28:27.312487 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2054/4127] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:28:27.321899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:27.322866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:27.355588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.356070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.361294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.361597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.735289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:27.745017 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e22eb83b-f7dd-468f-b268-b0776f2f2285 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.430842 May 10 02:28:27.756312 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2055/4128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:27 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:27.762704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:27.763785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 271a109c-84b1-40fc-a0e3-0dbe5ac14af9] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:27.771224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.772092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.773495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.774480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.782255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:27.791901 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 could not be found. May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 HTTP/1.1 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 could not be found. May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '271a109c-84b1-40fc-a0e3-0dbe5ac14af9'} May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 could not be found. May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 could not be found. May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:27.793945 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 could not be found. May 10 02:28:27.799306 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:27.800793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 404 to user: Instance 271a109c-84b1-40fc-a0e3-0dbe5ac14af9 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:27.801518 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35f3a0fb-484f-469e-b640-e99124279a1e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.645873 May 10 02:28:27.802074 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ad839c8-ee53-4aaf-a0e8-4496782be5c7 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9" status: 404 len: 111 microversion: 2.1 time: 0.044030 May 10 02:28:27.802673 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2056/4129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:27 2022] GET /compute/v2.1/servers/271a109c-84b1-40fc-a0e3-0dbe5ac14af9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:27.805674 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2074/4130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:27 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:27.820773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:27.821392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:27.826120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82b61c56-7b87-4390-8620-97314719a05b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:27.828368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.828909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.829928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82b61c56-7b87-4390-8620-97314719a05b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: request: PUT /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 HTTP/1.1 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 280 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.830154 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 10 02:28:27.833823 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:27.836329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.836425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82b61c56-7b87-4390-8620-97314719a05b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:27.836425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82b61c56-7b87-4390-8620-97314719a05b tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "PUT /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 400 len: 619 microversion: 2.1 time: 0.011299 May 10 02:28:27.836425 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2075/4131] 10.222.0.52 () {60 vars in 1256 bytes} [Tue May 10 02:28:27 2022] PUT /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:28:27.855511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:27.856259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:27.863350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.866828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.867920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:27.868554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:27.881831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:28:28.010058 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4485b558-82a6-429a-a261-21f29c5af807 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 204 len: 0 microversion: 2.1 time: 0.191831 May 10 02:28:28.021229 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2057/4132] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:28:27 2022] DELETE /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:28:28.037191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:28.038184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:28.048200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.049412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.052238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.053077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.196208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:28.207710 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24d14d82-36be-4048-9f63-7f89b9684108 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.367434 May 10 02:28:28.211571 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2076/4133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:27 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:28.229328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:28.230214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:28.241180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.245746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:28.247419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.254572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.255514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.256294 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-11200708-029a-44df-8296-e5eebe4a591c tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.230435 May 10 02:28:28.257053 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2058/4134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:28 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:28.466347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:28.479568 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad1ceae0-3f5e-4d96-ad3c-f8350fc5e63c tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.250501 May 10 02:28:28.479568 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2077/4135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:28 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:28.492269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4c5605f-4a2f-49d4-b6ef-061abf7fbf3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4c5605f-4a2f-49d4-b6ef-061abf7fbf3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: request: PUT /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 HTTP/1.1 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 24 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: {"server": {"name": ""}} May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute name. Value: . '' is too short May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635', 'body': {'server': {'name': ''}}} May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['server']: May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi '' May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:28:28.495724 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:28.502483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4c5605f-4a2f-49d4-b6ef-061abf7fbf3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:28.504139 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4c5605f-4a2f-49d4-b6ef-061abf7fbf3a tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "PUT /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 400 len: 108 microversion: 2.1 time: 0.015152 May 10 02:28:28.506511 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2059/4136] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:28:28 2022] PUT /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:28:28.514939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:28.517364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:28.533317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.533796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.538788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.541139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.668280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:28.669224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:28.685257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.685777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.686858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.690067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.748312 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1d11f5e-4ce4-4dc9-b5fc-aec7f1b62397 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084347 May 10 02:28:28.753922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2060/4137] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:28:28 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:28.763030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:28.769584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:28.770102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:28.772488 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46ca4caf-e45e-4aa2-9658-c41d604d2d03 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1506 microversion: 2.1 time: 0.262451 May 10 02:28:28.773264 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2078/4138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:28 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:28.776102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.776565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.777371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.779440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:28.780468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:28.781093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.787802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.789157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.804492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:28.805236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:28.844727 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-01a027d5-c257-4921-854a-d074a7791f8f tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/c641ccef-7791-413a-be8f-dafa09cc0d22" status: 200 len: 194 microversion: 2.1 time: 0.089668 May 10 02:28:28.845659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2061/4139] 10.222.0.52 () {58 vars in 1412 bytes} [Tue May 10 02:28:28 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/c641ccef-7791-413a-be8f-dafa09cc0d22 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:29.107287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:29.125256 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42e6e37d-8b69-4d6b-87b7-7fb5d0c4b4f0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.343145 May 10 02:28:29.126494 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2079/4140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:28 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:29.278040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:29.278932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:29.286020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:29.293581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:29.295790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:29.296414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:29.604288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:29.612341 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b19cf63e-8202-42e6-882a-cbaa0c7b9965 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.339162 May 10 02:28:29.626183 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2062/4141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:29 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:30.142792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:30.143918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:30.155373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:30.157292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:30.164651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:30.165406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:30.388345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:30.399020 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce67f726-4071-4ba2-a431-971384acdc25 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1510 microversion: 2.1 time: 0.260454 May 10 02:28:30.409936 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2080/4142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:30 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:30.647144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:30.648924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:30.660429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:30.661752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:30.663122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:30.663850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:30.997058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:31.007943 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-577d34c0-ce40-4a3e-bd61-43f8d60ae7d3 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1520 microversion: 2.1 time: 0.373896 May 10 02:28:31.008906 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2063/4143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:30 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:31.417096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:31.417800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:31.436752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:31.437246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:31.438207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:31.456390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:31.941588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-13fa2d0c-1184-4acc-9789-f95bd80adab4 req-c8ccba5e-555e-4b6e-876e-3fddd08baa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d467dd-f2fb-4d80-b26a-16fe06043cec", "name": "network-vif-deleted", "tag": "69ddc964-8950-48c3-a491-0650f386909b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:31.956650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-13fa2d0c-1184-4acc-9789-f95bd80adab4 req-c8ccba5e-555e-4b6e-876e-3fddd08baa86 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:31.957252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-13fa2d0c-1184-4acc-9789-f95bd80adab4 req-c8ccba5e-555e-4b6e-876e-3fddd08baa86 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.026347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-13fa2d0c-1184-4acc-9789-f95bd80adab4 req-c8ccba5e-555e-4b6e-876e-3fddd08baa86 service nova] Creating event network-vif-deleted:69ddc964-8950-48c3-a491-0650f386909b for instance 69d467dd-f2fb-4d80-b26a-16fe06043cec on n-h2-841089-2 May 10 02:28:32.044923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-13fa2d0c-1184-4acc-9789-f95bd80adab4 req-c8ccba5e-555e-4b6e-876e-3fddd08baa86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107197 May 10 02:28:32.048267 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2064/4144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:28:32.055195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:32.066194 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-606a3691-7c75-42c1-b2f1-076d241ef8ae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1487 microversion: 2.1 time: 0.653656 May 10 02:28:32.066352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:32.069170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:32.083923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2081/4145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:31 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1487 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:32.087844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.088474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.089429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.090196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.107846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:32.108923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:32.134909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.135679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.138998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.141781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.245461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.246482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.250616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lazy-loading 'fault' on Instance uuid 69d467dd-f2fb-4d80-b26a-16fe06043cec {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:28:32.361425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2a71a6cd7c48bcb26383b5cece8a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea90205bb50b414890bf521c1182bcd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:32.370141 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-446b772b-9811-4aaa-af6e-1c20f58dec70 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 200 len: 1312 microversion: 2.1 time: 0.319140 May 10 02:28:32.374232 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2065/4146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:32 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:32.440723 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c57a35e1-bf38-4cd1-ad95-3e1e59b020d3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 200 len: 189 microversion: 2.1 time: 0.355114 May 10 02:28:32.450622 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2082/4147] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:28:32 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 189 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:32.452233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:32.452864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:32.485619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.486458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.494866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.495355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.706445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5ddb3b1-f2d4-4aa3-bb71-aa94468c4358"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:32.708271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:32.717463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.718202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.719889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.721300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.867515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:32.882827 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f31b039c-240b-4ee7-b121-fbeba284fbc1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.430922 May 10 02:28:32.884734 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2066/4148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:32 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:32.922300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:32.924180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:32.959291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.960712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:32.963146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:32.964773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:33.271549 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a124b042-88e7-44ae-8b28-5517bbea82f2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "POST /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569927 May 10 02:28:33.291979 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2083/4149] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:28:32 2022] POST /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:33.365477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:33.383004 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-372ca041-11f0-497c-8585-bcf49abee118 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.476764 May 10 02:28:33.387230 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2067/4150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:32 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:33.406902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:33.408108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:33.413884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:33.414617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] [instance: 69d467dd-f2fb-4d80-b26a-16fe06043cec] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:33.419197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:33.421962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:33.423492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:33.424114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:33.427667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:33.444593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:33.445584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:33.446057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:33.489820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] HTTP exception thrown: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec could not be found. May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Request method failure captured: May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec HTTP/1.1 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecxALUr1tbGzbaAijrCyXPjnV4CVZ31Vms8t9z80HcjTpqaMKRueQ3t7DL3wFthI0yvc3pNzIBYp7_keBUNdN0Xh9WDfaqEN_tI5YYLXZpUBxEhPbRTR_40HiuMPzJGac5cwZrAAy1CqJDMwfeMrNdfM8CjaipG6Ks7b4yz2Xa3cu84 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea90205bb50b414890bf521c1182bcd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea90205bb50b414890bf521c1182bcd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ea90205bb50b414890bf521c1182bcd5 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1770413670 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0a2a71a6cd7c48bcb26383b5cece8a00 May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1770413670-project May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec could not be found. May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '69d467dd-f2fb-4d80-b26a-16fe06043cec'} May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec could not be found. May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec could not be found. May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:33.491560 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec could not be found. May 10 02:28:33.496901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:28:33.502951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] Returning 404 to user: Instance 69d467dd-f2fb-4d80-b26a-16fe06043cec could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:33.505367 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d82fa29a-33e8-4d22-b0c1-cd38e11279a9 tempest-ServerRescueNegativeTestJSON-1770413670 tempest-ServerRescueNegativeTestJSON-1770413670-project] 10.222.0.52 "GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec" status: 404 len: 111 microversion: 2.1 time: 0.108065 May 10 02:28:33.512364 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2084/4151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:33 2022] GET /compute/v2.1/servers/69d467dd-f2fb-4d80-b26a-16fe06043cec => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:33.725853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:33.742530 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9be12b54-8a66-4668-832f-1d3b1a7ef05e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.340405 May 10 02:28:33.744727 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2068/4152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:33 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:33.761448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:33.762893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:33.771126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:33.771859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:33.772827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:33.773473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:34.113562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:34.132922 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc412f3c-b0d0-40ac-88bb-edbcc8587c98 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.371832 May 10 02:28:34.152550 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2085/4153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:33 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:34.401948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-134318974", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "5a552ca0-79f9-47dd-adf9-5195fd4ca6cd"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:34.521307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] validate_networks() for [('5a552ca0-79f9-47dd-adf9-5195fd4ca6cd', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:28:35.784919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:28:35.785921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:28:35.786347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:28:35.786882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:28:35.787466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:28:35.803499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:35.807328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:35.809116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:35.810784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:35.854209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:28:35.865534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for user 2534074779504b4ca699312fdd4664cd and project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:28:35.914080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:28:35.923397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:28:36.052277 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a95b858-c266-4dc9-9cd5-50729e0f5431 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654809 May 10 02:28:36.062209 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2069/4154] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:28:36.064032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-03129de9-83af-44a1-8d65-cad9d6ac86ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:36.064652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-03129de9-83af-44a1-8d65-cad9d6ac86ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:36.356747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-03129de9-83af-44a1-8d65-cad9d6ac86ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:36.364721 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-03129de9-83af-44a1-8d65-cad9d6ac86ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1214 microversion: 2.1 time: 0.304945 May 10 02:28:36.375134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2086/4155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:36 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:37.391328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:37.394862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:37.430856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:37.439292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:37.440393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:37.464924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:37.762996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:37.798167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d0f2088-41ed-4049-b261-a37dbeeac149 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1210 microversion: 2.1 time: 0.417670 May 10 02:28:37.802557 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2070/4156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:37 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1210 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:38.498847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6b6374a-4aa7-4d8f-adb3-3f635a15cd28 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Action: 'create', calling method: .version_select at 0x7f3d36765160>, body: {"keypair": {"name": "tempest-keypair-621481917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsGlb7/cix/Mzs46NrVeKFLWXEH4/AnHQW3l7uUcBbj87Cws9JT4aT8CmPfpVdfBfZgX0an5OqrJk2718t4fzOy5/ksCcotljNSV01dzNXFfkCHNH7qBopoUCV6A2I0YQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:38.561439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d6b6374a-4aa7-4d8f-adb3-3f635a15cd28 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Getting quotas for project 2ca02e648ae54ea0b81cec26d8d88dbd. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:28:38.570135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d6b6374a-4aa7-4d8f-adb3-3f635a15cd28 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Getting quotas for user 46d1961d957b4971abe3829138adc2c2 and project 2ca02e648ae54ea0b81cec26d8d88dbd. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:28:38.655860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6b6374a-4aa7-4d8f-adb3-3f635a15cd28 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.161659 May 10 02:28:38.658532 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2087/4157] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:28:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:28:38.819995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:38.820614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:38.833033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:38.840372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:38.841473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:38.842087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:39.395147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:39.403366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-14529096-f37f-48b5-bf98-11c467510e05 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1272 microversion: 2.1 time: 0.587409 May 10 02:28:39.411323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2071/4158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:38 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1272 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:40.427269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:40.428426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:40.456900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:40.457703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:40.459764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:40.466955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:40.910449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:40.927682 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e1aadb0-9218-443d-9e07-e70a049ad2e7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1272 microversion: 2.1 time: 0.503304 May 10 02:28:40.942553 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2088/4159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:40 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1272 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:41.950909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:41.951560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:41.975324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:41.975877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:41.976696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:41.977200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:43.852218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:43.854524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1251324173", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e764faff-35e7-432c-9ffe-8f8c07f9d9f1"}, {"port": "1cd6542c-ca6a-46b6-9410-e82cc46c88fa", "tag": "port-1"}, {"port": "1ee72d75-fe01-47ef-8899-964336a78f6b", "tag": "port-2"}, {"uuid": "b33852c6-3ade-4302-af1f-31ed05ce4a99", "tag": "net-1"}, {"uuid": "b33852c6-3ade-4302-af1f-31ed05ce4a99"}, {"uuid": "b24e99f0-d057-43ab-b4ed-75bd335e30a4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b24e99f0-d057-43ab-b4ed-75bd335e30a4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "761a6958-f029-46d6-9d6c-0a5df173fee6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8c85024c-4ed9-4b65-a3c8-ae282dfe92da", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "99b0da23-8d01-4ac3-8dba-4e4ce82a11f6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1893061655"}], "key_name": "tempest-keypair-621481917", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:43.864134 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-135bb0b3-85cc-43d9-9e33-6ec4428d038b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 1.915554 May 10 02:28:43.870896 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2072/4160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:41 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:44.828868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] validate_networks() for [('e764faff-35e7-432c-9ffe-8f8c07f9d9f1', None, None, None, None, None), (None, None, '1cd6542c-ca6a-46b6-9410-e82cc46c88fa', None, None, None), (None, None, '1ee72d75-fe01-47ef-8899-964336a78f6b', None, None, None), ('b33852c6-3ade-4302-af1f-31ed05ce4a99', None, None, None, None, None), ('b33852c6-3ade-4302-af1f-31ed05ce4a99', None, None, None, None, None), ('b24e99f0-d057-43ab-b4ed-75bd335e30a4', '10.2.2.100', None, None, None, None), ('b24e99f0-d057-43ab-b4ed-75bd335e30a4', '10.2.2.200', None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:28:44.887163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:44.887773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:44.905488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:44.905946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:44.906754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:44.907229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:45.954463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:45.967031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77ee6c0c-6389-42e1-85da-68b75cec7c36 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 1.083730 May 10 02:28:45.973387 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2073/4161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:44 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:45.989952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:45.991650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:46.013210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:46.014788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:46.015648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:46.019710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:46.063800 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] HTTP exception thrown: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Request method failure captured: May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e HTTP/1.1 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz7AGV-CKGIEZ5h4nZFhtYVX3HBMB1QpvvJVaXOMvF0jEFuX924w5RncPtfGCRFsqpttrH_y9TRpnJWwTTZoz4fYvH40AiNzBmerN4v-KF5O7NSEKt_gIwFL_1fOQwDTNDA7fmf86srnZMWlzYVD7AqlhqRj6uBPvV0lpO5PEAOWlM May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7e2c55288ab4495c99a636b525230e31 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e2c55288ab4495c99a636b525230e31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7e2c55288ab4495c99a636b525230e31 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachSCSIVolumeTestJSON-2075974068-project May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: bf50d046513b4e77b582feaf5dc353e4 May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2075974068-project May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e'} May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:46.065647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.070926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Returning 404 to user: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:46.072318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de22ab3b-57db-4ad1-8f98-80ff79ddf070 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 404 len: 111 microversion: 2.1 time: 0.092711 May 10 02:28:46.073792 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2074/4162] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:28:45 2022] DELETE /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:46.092720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:46.097808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] [instance: 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:46.122599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:46.124811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:46.125791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:46.129809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:46.179103 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] HTTP exception thrown: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Request method failure captured: May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e HTTP/1.1 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz7AGV-CKGIEZ5h4nZFhtYVX3HBMB1QpvvJVaXOMvF0jEFuX924w5RncPtfGCRFsqpttrH_y9TRpnJWwTTZoz4fYvH40AiNzBmerN4v-KF5O7NSEKt_gIwFL_1fOQwDTNDA7fmf86srnZMWlzYVD7AqlhqRj6uBPvV0lpO5PEAOWlM May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7e2c55288ab4495c99a636b525230e31 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e2c55288ab4495c99a636b525230e31", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e2c55288ab4495c99a636b525230e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7e2c55288ab4495c99a636b525230e31 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2075974068 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachSCSIVolumeTestJSON-2075974068-project May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: bf50d046513b4e77b582feaf5dc353e4 May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2075974068-project May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e'} May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:46.182461 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. May 10 02:28:46.188261 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:46.191796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] Returning 404 to user: Instance 53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:46.195309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72654843-0b3a-44e0-a4a1-50756c56b972 tempest-AttachSCSIVolumeTestJSON-2075974068 tempest-AttachSCSIVolumeTestJSON-2075974068-project] 10.222.0.52 "GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e" status: 404 len: 111 microversion: 2.1 time: 0.116783 May 10 02:28:46.198719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2075/4163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:46 2022] GET /compute/v2.1/servers/53dc83d9-fe8e-4ff9-b99a-d19dbb7ba56e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:46.778421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-39afd9f4-e30a-46bf-a4e0-5af06a22f02c req-60858751-a2a0-4369-8533-a4cfe42314f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7505a4ef-6342-42ac-96fb-f4c07b37ce2d", "tag": "8ef57eb4-6dfa-41dc-8f06-b1df793bfaf5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:46.806995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-39afd9f4-e30a-46bf-a4e0-5af06a22f02c req-60858751-a2a0-4369-8533-a4cfe42314f4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:46.808822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-39afd9f4-e30a-46bf-a4e0-5af06a22f02c req-60858751-a2a0-4369-8533-a4cfe42314f4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:46.847674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-39afd9f4-e30a-46bf-a4e0-5af06a22f02c req-60858751-a2a0-4369-8533-a4cfe42314f4 service nova] Creating event network-changed:8ef57eb4-6dfa-41dc-8f06-b1df793bfaf5 for instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d on n-h2-841089-2 May 10 02:28:46.856208 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-39afd9f4-e30a-46bf-a4e0-5af06a22f02c req-60858751-a2a0-4369-8533-a4cfe42314f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083934 May 10 02:28:46.857433 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2076/4164] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:46.990199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:46.990905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:47.006950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:47.012599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:47.018100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:47.020687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.569792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:49.579424 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c317f2d-4248-46ee-a464-2e758f60bd73 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 2.593473 May 10 02:28:49.591901 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2077/4165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:46 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:28:49.599599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:49.616787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:49.644161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:49.651919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.654049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:49.662869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.704578 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 HTTP/1.1 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4d28bffe-ca57-4e7a-b709-155c20b52121'} May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:49.727576 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.732635 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.739472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:49.741220 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e0a551a-18ed-4ffb-9950-a64bfc6aa6e1 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 404 len: 111 microversion: 2.1 time: 0.147734 May 10 02:28:49.748554 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2078/4166] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:28:49 2022] DELETE /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:49.753732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:49.755950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 4d28bffe-ca57-4e7a-b709-155c20b52121] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:49.775052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:49.779504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.780805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:49.781500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.813207 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 HTTP/1.1 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4d28bffe-ca57-4e7a-b709-155c20b52121'} May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:49.816699 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. May 10 02:28:49.821137 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:49.827961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 4d28bffe-ca57-4e7a-b709-155c20b52121 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:49.829994 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cdd08aba-1f5b-4bca-992a-c8bd3f4f9973 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121" status: 404 len: 111 microversion: 2.1 time: 0.080144 May 10 02:28:49.831865 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2079/4167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:49 2022] GET /compute/v2.1/servers/4d28bffe-ca57-4e7a-b709-155c20b52121 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:49.860025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:49.861613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:49.883605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:49.887917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.888985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:49.890577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:49.989781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:28:50.184032 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acb97283-a7d1-4edc-86b9-317485f6f5db tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 204 len: 0 microversion: 2.1 time: 0.345495 May 10 02:28:50.185028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2080/4168] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:28:49 2022] DELETE /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:28:50.199804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:50.201043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:50.219403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:50.220122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:50.221110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:50.221813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:50.657409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:50.667009 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f6d89af-97bc-4e94-b6b3-6b8748d8620d tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.477372 May 10 02:28:50.670813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2081/4169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:50 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:50.678711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:50.684580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:50.701244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:50.701711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:50.702507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:50.702952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:51.351716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:51.361349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f0305b57-5d7e-4e00-9767-1213e0b320dc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 0.686351 May 10 02:28:51.365659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2082/4170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:50 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:51.687975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:51.688626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:51.705456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:51.707493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:51.710747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:51.712157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:52.456335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:52.468863 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5056fb98-249a-4d60-a77c-27f7edc3e500 tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.785393 May 10 02:28:52.484029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2083/4171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:51 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:52.499675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:52.500328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:52.506637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:52.507112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:52.507912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:52.508358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:53.726564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:53.735682 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24f2297f-52cc-4ddd-bc7a-eef0dacfc9e4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 1.250536 May 10 02:28:53.740482 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2084/4172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:52 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:53.754725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:53.762571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:53.781091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:53.781907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:53.784722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:53.785641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:54.565812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebf77f83f4d4ca689a3c2384ebc6b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547c652992a84f43bb35fbf17dbb9244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:54.578392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4f513fd6-73f0-4a3b-ad7d-cb1d232b828e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 200 len: 1512 microversion: 2.1 time: 0.835542 May 10 02:28:54.579659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2085/4173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:53 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:54.962541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-658034934", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "5c5ec74c-167d-4ec3-99ee-8d6e2d51fb2a"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:55.092503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] validate_networks() for [('5c5ec74c-167d-4ec3-99ee-8d6e2d51fb2a', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:28:55.550435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:28:55.550943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:28:55.551234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:28:55.551656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:28:55.552078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:28:55.577819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:55.579489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:55.581545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:55.582937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:55.649126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Getting quotas for project 2ca02e648ae54ea0b81cec26d8d88dbd. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:28:55.654889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Getting quotas for user 46d1961d957b4971abe3829138adc2c2 and project 2ca02e648ae54ea0b81cec26d8d88dbd. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:28:55.935545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:28:55.938872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='761a6958-f029-46d6-9d6c-0a5df173fee6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8c85024c-4ed9-4b65-a3c8-ae282dfe92da',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99b0da23-8d01-4ac3-8dba-4e4ce82a11f6',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:28:56.149131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:28:56.149617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:28:56.150032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:28:56.150453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:28:56.159453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:28:56.215746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.217938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.223188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.225737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.293505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Getting quotas for project cde04b0feef94f88b1c823e79297c670. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:28:56.303895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Getting quotas for user 00e7252710bb4b37b9f86c754ef19f81 and project cde04b0feef94f88b1c823e79297c670. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:28:56.356062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:28:56.361907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:28:56.485637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b89a5643-08e9-46c1-9b1d-c0471c3598cc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.904345 May 10 02:28:56.489704 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2086/4174] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:28:56.503672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:56.505050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:56.517553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.520172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.521324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.522056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.611103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9be3a81c-14f1-42e6-afe3-2f1fdd6b4de5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.760671 May 10 02:28:56.612113 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2089/4175] 10.222.0.52 () {62 vars in 1188 bytes} [Tue May 10 02:28:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 12762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 02:28:56.623633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-bb7ee5ad-da18-4d5c-ae16-1b4380d58a3b req-ce5e16ea-2714-4f6e-8341-43cc7948df7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4512ed-540a-4c7f-884c-22e2f619a635", "name": "network-vif-deleted", "tag": "67f6d200-7310-4466-bd94-c656886c7d53"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:56.653413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bb7ee5ad-da18-4d5c-ae16-1b4380d58a3b req-ce5e16ea-2714-4f6e-8341-43cc7948df7f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.653884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bb7ee5ad-da18-4d5c-ae16-1b4380d58a3b req-ce5e16ea-2714-4f6e-8341-43cc7948df7f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.709222 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-bb7ee5ad-da18-4d5c-ae16-1b4380d58a3b req-ce5e16ea-2714-4f6e-8341-43cc7948df7f service nova] Creating event network-vif-deleted:67f6d200-7310-4466-bd94-c656886c7d53 for instance 2e4512ed-540a-4c7f-884c-22e2f619a635 on n-h1-841089-2 May 10 02:28:56.731903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-bb7ee5ad-da18-4d5c-ae16-1b4380d58a3b req-ce5e16ea-2714-4f6e-8341-43cc7948df7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107271 May 10 02:28:56.732765 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2090/4176] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:56.740161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-bdce6fed-e5f4-42c1-b8da-34a7610e2f7e req-cbe72bb0-f354-4eb0-99c5-cca7c0f64f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7505a4ef-6342-42ac-96fb-f4c07b37ce2d", "name": "network-vif-plugged", "status": "completed", "tag": "8ef57eb4-6dfa-41dc-8f06-b1df793bfaf5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:28:56.771302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bdce6fed-e5f4-42c1-b8da-34a7610e2f7e req-cbe72bb0-f354-4eb0-99c5-cca7c0f64f39 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.771772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bdce6fed-e5f4-42c1-b8da-34a7610e2f7e req-cbe72bb0-f354-4eb0-99c5-cca7c0f64f39 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.773178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:56.782969 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b17fccdb-9420-43dd-be21-83e6fee361cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 0.290867 May 10 02:28:56.783622 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2087/4177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:56 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:56.797423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:56.798598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] [instance: 2e4512ed-540a-4c7f-884c-22e2f619a635] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:56.807153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.813118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.814068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:56.814883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:56.823474 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-bdce6fed-e5f4-42c1-b8da-34a7610e2f7e req-cbe72bb0-f354-4eb0-99c5-cca7c0f64f39 service nova] Creating event network-vif-plugged:8ef57eb4-6dfa-41dc-8f06-b1df793bfaf5 for instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d on n-h2-841089-2 May 10 02:28:56.837015 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-bdce6fed-e5f4-42c1-b8da-34a7610e2f7e req-cbe72bb0-f354-4eb0-99c5-cca7c0f64f39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102766 May 10 02:28:56.837632 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2091/4178] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:28:56.852056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3de181da-1621-4fe9-a16f-c43a1adee339 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:56.852764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3de181da-1621-4fe9-a16f-c43a1adee339 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:56.856953 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] HTTP exception thrown: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 could not be found. May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Request method failure captured: May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 HTTP/1.1 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecz8S_yqkNwO_oVz-q5HyVQcgmZlL2Mo7ZQt_iPcsUYYbu7MTGAM-rplvxpBu-FRkhM_RgCVB6XGjc3q_1c1o6cDMxL6F2bvaXwhcgmdjTD1jYNYJTeqXlYL525dJDkVx6gI3sIPf5wALEeKXq-778mNdDTgxaGKD8NnrCs3ni6jwYE May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_547c652992a84f43bb35fbf17dbb9244", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/547c652992a84f43bb35fbf17dbb9244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 547c652992a84f43bb35fbf17dbb9244 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-404051888 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 4ebf77f83f4d4ca689a3c2384ebc6b82 May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-404051888-project May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 could not be found. May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '2e4512ed-540a-4c7f-884c-22e2f619a635'} May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 could not be found. May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 could not be found. May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:28:56.862488 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 could not be found. May 10 02:28:56.867887 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:28:56.871840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] Returning 404 to user: Instance 2e4512ed-540a-4c7f-884c-22e2f619a635 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:28:56.876162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb08d931-86bc-4095-90e5-dc632ec2ee7e tempest-ServersNegativeTestJSON-404051888 tempest-ServersNegativeTestJSON-404051888-project] 10.222.0.52 "GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635" status: 404 len: 111 microversion: 2.1 time: 0.091219 May 10 02:28:56.876751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2088/4179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:56 2022] GET /compute/v2.1/servers/2e4512ed-540a-4c7f-884c-22e2f619a635 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:28:56.914773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-480e7b96-ea1f-44b5-9ff8-dbef96cc7b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:56.915421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-480e7b96-ea1f-44b5-9ff8-dbef96cc7b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:57.138194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-480e7b96-ea1f-44b5-9ff8-dbef96cc7b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:57.147871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-480e7b96-ea1f-44b5-9ff8-dbef96cc7b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:57.157647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-480e7b96-ea1f-44b5-9ff8-dbef96cc7b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:57.159249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-480e7b96-ea1f-44b5-9ff8-dbef96cc7b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1285 microversion: 2.32 time: 0.280760 May 10 02:28:57.173098 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2089/4180] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:28:56 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1285 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:28:57.180373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3de181da-1621-4fe9-a16f-c43a1adee339 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:57.199190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3de181da-1621-4fe9-a16f-c43a1adee339 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:57.211303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3de181da-1621-4fe9-a16f-c43a1adee339 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:57.219242 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3de181da-1621-4fe9-a16f-c43a1adee339 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1261 microversion: 2.26 time: 0.371275 May 10 02:28:57.222059 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2092/4181] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:28:56 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1261 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:28:57.800980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:57.801597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:57.818888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:57.829232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:57.830188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:57.830649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:58.182369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-20e1b5cb-6bf1-4e72-aef1-56ac67206388 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:58.183049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-20e1b5cb-6bf1-4e72-aef1-56ac67206388 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:58.325826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.341481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0bc7e52f-984f-4f63-bcf3-b131d6a022c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1314 microversion: 2.1 time: 0.544214 May 10 02:28:58.345509 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2090/4182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:57 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:28:58.360235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:58.362230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:58.372079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:58.372654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:58.373722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:58.374596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:58.391791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20e1b5cb-6bf1-4e72-aef1-56ac67206388 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.418950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20e1b5cb-6bf1-4e72-aef1-56ac67206388 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.426748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20e1b5cb-6bf1-4e72-aef1-56ac67206388 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.431737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-20e1b5cb-6bf1-4e72-aef1-56ac67206388 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1285 microversion: 2.32 time: 0.254820 May 10 02:28:58.449293 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2093/4183] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:28:58 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:28:58.833871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.846336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.848129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:28:58.849548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c1174f84-7f6f-4522-bd9b-56511831e171 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1313 microversion: 2.26 time: 0.502681 May 10 02:28:58.861618 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2091/4184] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:28:58 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:28:59.365831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:59.367556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:59.379406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:59.380495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:59.383250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:59.384080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:59.454180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:28:59.455575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:28:59.465020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:59.465449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:28:59.466729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:28:59.467209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:00.000247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.009432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.015839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.019273 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42b416cb-a95b-4f06-812b-5573fdaedca3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1593 microversion: 2.32 time: 0.571839 May 10 02:29:00.026908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2092/4185] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:28:59 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1593 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:00.045297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:00.046313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:00.058383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:00.060734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:00.061872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:00.064802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:00.333256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.358753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.370938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.372450 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04c9a625-057a-4309-9037-4eabcb1ba5fb tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1319 microversion: 2.26 time: 0.344249 May 10 02:29:00.373049 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2093/4186] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:00 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:00.458033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:00.472300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-669aea28-c631-45e2-a7e8-6a791ee4e16d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1501 microversion: 2.1 time: 1.113263 May 10 02:29:00.473695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2094/4187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:28:59 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1501 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:00.490587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:00.492094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:00.512687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:00.517436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:00.518465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:00.518931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:00.629079 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e92150e0-b4a0-4bea-8e1d-28eb582d1124 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.142777 May 10 02:29:00.630522 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2094/4188] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:00 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:01.045960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:01.047413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:01.058209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:01.058683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:01.062191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:01.062948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:01.392556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:01.393285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:01.405887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:01.406253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:01.408852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:01.410095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:01.416774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:01.424252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:01.426299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:01.427904 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b48e41c0-4884-4c63-8803-616f17709877 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1593 microversion: 2.32 time: 0.386162 May 10 02:29:01.447682 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2095/4189] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:01 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1593 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:01.640658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:01.642752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:01.649677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:01.650394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:01.652038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:01.653186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:01.714834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.077227 May 10 02:29:01.715699 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2096/4190] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:01 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:01.814112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:01.815414 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f8d5129-46f9-48fc-b3a5-086d82e99f2e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001781 May 10 02:29:01.815757 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2097/4191] 10.222.0.52 () {56 vars in 885 bytes} [Tue May 10 02:29:01 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) May 10 02:29:02.007711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:02.028005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:02.035473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:02.036946 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f02d2eb4-f208-4f24-b96d-e5c16ea27e6d tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 0.649328 May 10 02:29:02.038570 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2095/4192] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:01 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:02.453249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:02.466519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:02.499675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:02.507450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:02.509676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:02.510320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:02.725993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:02.726942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:02.751672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:02.752348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:02.753321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:02.754114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:02.837824 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a63de372-38e1-4688-b98c-c69b47c66793 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.115539 May 10 02:29:02.839633 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2096/4193] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:02 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:29:03.058109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:03.058897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:03.079458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:03.086181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:03.087202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:03.087777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:03.231468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:03.240872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:03.245814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:03.256562 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d39ab49e-b12c-446b-9105-f8681e21872c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1661 microversion: 2.32 time: 0.813052 May 10 02:29:03.267191 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2098/4194] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:02 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1661 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:03.767276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:03.785971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:03.787547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:03.797278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e476a44a-db34-4fb5-b9d0-1d1d4ad082d7 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 0.744625 May 10 02:29:03.816643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2097/4195] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:03 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:03.860634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:03.861794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:03.885141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:03.888499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:03.889584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:03.891902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.036520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12609620-df8c-4523-ad63-cf924e7708d9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.189587 May 10 02:29:04.040310 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2099/4196] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:03 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:04.281123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:04.282450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:04.296376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.304549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.307434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.308081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.383878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-12f88c83-ddbc-4b97-a078-e9c17e64c20e req-fa830ed9-8408-4580-8d61-fa39c301fbec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01de0db2-fc9a-4d2b-b25a-335a5a61157c", "tag": "1e57f8c2-88b0-438d-9099-d0669901d6ae"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:04.410010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-12f88c83-ddbc-4b97-a078-e9c17e64c20e req-fa830ed9-8408-4580-8d61-fa39c301fbec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.410918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-12f88c83-ddbc-4b97-a078-e9c17e64c20e req-fa830ed9-8408-4580-8d61-fa39c301fbec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.464756 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-12f88c83-ddbc-4b97-a078-e9c17e64c20e req-fa830ed9-8408-4580-8d61-fa39c301fbec service nova] Creating event network-changed:1e57f8c2-88b0-438d-9099-d0669901d6ae for instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c on n-h1-841089-2 May 10 02:29:04.472414 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-12f88c83-ddbc-4b97-a078-e9c17e64c20e req-fa830ed9-8408-4580-8d61-fa39c301fbec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099212 May 10 02:29:04.483403 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2100/4197] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:29:04.502890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:04.504460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:04.511696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.512305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.513239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.514011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.591080 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6ca86ff-145b-460c-afa7-468cdf78d60a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.092552 May 10 02:29:04.596621 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2101/4198] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:29:04 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:29:04.742514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:04.743182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:04.759096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.777301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.780334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.781549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.839779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f71e81d6-be18-464d-8875-16d9402d7e4a tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/c641ccef-7791-413a-be8f-dafa09cc0d22" status: 200 len: 194 microversion: 2.1 time: 0.101393 May 10 02:29:04.851578 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2102/4199] 10.222.0.52 () {58 vars in 1412 bytes} [Tue May 10 02:29:04 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/c641ccef-7791-413a-be8f-dafa09cc0d22 => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:04.857649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:04.863970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:04.879722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.880541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.881716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:04.882558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:04.953510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:04.963675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:04.976445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:04.978091 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62f05866-a56b-4740-935f-69e25ebffd92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1708 microversion: 2.32 time: 0.701433 May 10 02:29:04.979953 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2098/4200] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:04 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1708 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:04.995715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:04.996686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:05.003324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:05.004133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:05.005442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:05.006157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:05.240883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lazy-loading 'services' on Instance uuid 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:05.389715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1ee59dc-2fcc-4141-8d76-c92e987981cb tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/c641ccef-7791-413a-be8f-dafa09cc0d22" status: 202 len: 0 microversion: 2.1 time: 0.406473 May 10 02:29:05.405076 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2099/4201] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:29:04 2022] DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/c641ccef-7791-413a-be8f-dafa09cc0d22 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:05.453349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:05.457844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:05.476387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:05.477792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:05.480396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:05.482185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:05.503729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:05.516362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:05.518216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:05.528324 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e3edc40d-5357-4503-ab2c-a918a594e150 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 0.675298 May 10 02:29:05.545075 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2103/4202] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:04 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:05.571133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8af5ba0e-d01c-4a2c-9c75-6004c1d87d82 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.162718 May 10 02:29:05.575931 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2100/4203] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:05 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:06.004456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:06.005566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:06.020938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:06.029289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:06.032679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:06.034377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:06.555004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:06.558767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:06.569316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:06.570104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:06.571826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:06.572490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:07.115056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:07.133160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:07.140616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:07.144973 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7199e5b-6e80-47fd-8edb-344ee9564a1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1755 microversion: 2.32 time: 1.148384 May 10 02:29:07.147118 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2104/4204] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:05 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1755 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:07.160801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:07.162021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:07.197319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:07.199759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:07.202470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:07.203958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:07.277757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:07.292670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:07.294197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:07.295406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 0.745663 May 10 02:29:07.298660 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.148583 May 10 02:29:07.299142 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2101/4205] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:06 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:07.300486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:07.301004 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2105/4206] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:07 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:07.302422 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002147 May 10 02:29:07.303691 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2102/4207] 10.222.0.52 () {56 vars in 885 bytes} [Tue May 10 02:29:07 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 10 02:29:07.311600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:07.313587 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002684 May 10 02:29:07.314096 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2106/4208] 10.222.0.52 () {54 vars in 1034 bytes} [Tue May 10 02:29:07 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) May 10 02:29:07.321394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:07.322428 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-94fb93a4-6674-496d-aa6b-83a45483508f tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 10 02:29:07.329971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2103/4209] 10.222.0.52 () {54 vars in 1040 bytes} [Tue May 10 02:29:07 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:07.332254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:07.333810 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-438299e2-7ea8-4214-a429-22ab0a14a7bf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002063 May 10 02:29:07.344127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2107/4210] 10.222.0.52 () {56 vars in 885 bytes} [Tue May 10 02:29:07 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 10 02:29:08.165925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:08.166547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:08.180139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:08.180604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:08.181870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:08.182318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:08.314564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:08.316336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:08.332613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:08.333074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:08.333881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:08.334330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:09.158690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:09.177712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:09.183369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:09.188874 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7907753c-eeac-4730-af4a-0c41fffe198b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 0.878800 May 10 02:29:09.192159 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2108/4211] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:08 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:09.208074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:09.212377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:09.237861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:09.256409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:09.257317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:09.259210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:09.262114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:09.263576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:09.270382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:09.279491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54306219-2d9f-4d9f-b902-0ba3d7717345 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1802 microversion: 2.32 time: 1.112799 May 10 02:29:09.283306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2104/4212] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:08 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1802 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:09.352991 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39f91900-f4d5-4eab-8021-12772bf3d3af tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 14 microversion: 2.1 time: 0.158280 May 10 02:29:09.354198 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2109/4213] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:09 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:10.212285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:10.213242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:10.230056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:10.243842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:10.245450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:10.252003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:10.300697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:10.302522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:10.325626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:10.326368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:10.328760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:10.333673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.270935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:11.298505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:11.301683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:11.306962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:11.310483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c63da59-6890-4930-8ea2-099c5c1cb3b6 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 1.104517 May 10 02:29:11.312725 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2105/4214] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:10 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:11.329673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:11.336342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:11.337679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:11.345627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:11.347259 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18c4367c-d1f4-4a56-8650-1356fce3ba8d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1849 microversion: 2.32 time: 1.051086 May 10 02:29:11.351694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:11.354087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.361593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:11.362147 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2110/4215] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:10 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1849 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:11.362635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.373252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9c2c9ce5-7c94-4d59-9bd0-97f772979a2f req-6b4c55fd-33e5-419d-a11c-4437d117465a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01de0db2-fc9a-4d2b-b25a-335a5a61157c", "name": "network-vif-plugged", "status": "completed", "tag": "1e57f8c2-88b0-438d-9099-d0669901d6ae"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:11.399322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9c2c9ce5-7c94-4d59-9bd0-97f772979a2f req-6b4c55fd-33e5-419d-a11c-4437d117465a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:11.402795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9c2c9ce5-7c94-4d59-9bd0-97f772979a2f req-6b4c55fd-33e5-419d-a11c-4437d117465a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.452853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9c2c9ce5-7c94-4d59-9bd0-97f772979a2f req-6b4c55fd-33e5-419d-a11c-4437d117465a service nova] Creating event network-vif-plugged:1e57f8c2-88b0-438d-9099-d0669901d6ae for instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c on n-h1-841089-2 May 10 02:29:11.457819 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef788bf9-5162-48ae-9612-be884da22e79 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action" status: 200 len: 8205 microversion: 2.1 time: 0.143430 May 10 02:29:11.459046 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2106/4216] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:11 2022] POST /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d/action => generated 8205 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:11.469217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ee887059-5628-4227-a922-bda7a7baba73 req-d660fb2a-0503-40a3-ac21-e7febd72daaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "56d91969-4b69-4350-be46-fc0367169266"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:11.474254 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9c2c9ce5-7c94-4d59-9bd0-97f772979a2f req-6b4c55fd-33e5-419d-a11c-4437d117465a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107459 May 10 02:29:11.476644 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2111/4217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:11.500515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:11.501423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:11.518369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ee887059-5628-4227-a922-bda7a7baba73 req-d660fb2a-0503-40a3-ac21-e7febd72daaf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:11.519172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ee887059-5628-4227-a922-bda7a7baba73 req-d660fb2a-0503-40a3-ac21-e7febd72daaf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.528482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:11.528951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.529745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:11.530193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:11.535915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ee887059-5628-4227-a922-bda7a7baba73 req-d660fb2a-0503-40a3-ac21-e7febd72daaf service nova] Creating event network-changed:56d91969-4b69-4350-be46-fc0367169266 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:11.543475 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ee887059-5628-4227-a922-bda7a7baba73 req-d660fb2a-0503-40a3-ac21-e7febd72daaf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082522 May 10 02:29:11.544994 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2107/4218] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:12.176657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:12.185938 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7dbf3ab7-c6ea-4438-9545-bb69e10365a8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.708089 May 10 02:29:12.191865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2112/4219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:11 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:12.215288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:12.217915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:12.235061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:12.235607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:12.239782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:12.240386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:12.330756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:12.332160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:12.340629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:12.341729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:12.343434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:12.344174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.121175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.137625 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7fe9c64-12b5-4333-8b87-a772cc1a9188 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.927171 May 10 02:29:13.141854 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2108/4220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:12 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:13.150760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:13.154124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:13.163511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:13.164241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.165380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:13.166148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.247098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.259846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.266825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.269478 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5a6d5ca1-ef26-40e3-b06d-9daf233ec950 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1361 microversion: 2.26 time: 0.943279 May 10 02:29:13.272596 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2113/4221] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:12 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1361 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:13.283399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:13.284874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:13.300609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:13.301190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.301980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:13.308176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.864547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.875444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2475deab-88bc-47f9-98be-ff1a68c618c2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.599348 May 10 02:29:13.876680 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2114/4222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:13 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:13.887032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.892593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:13.893697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:13.903398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.905097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:13.906532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:13.907326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.911183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:13.911695 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e8e4a64-acf9-4e07-8e57-add0d0220063 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1870 microversion: 2.32 time: 0.768441 May 10 02:29:13.912171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:13.912620 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2109/4223] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:13 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1870 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:14.134461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1799f375-cc01-4b11-9def-9a84dc8ab25a req-909bbc8e-562b-48c0-89ed-a6c5433e9bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "1cd6542c-ca6a-46b6-9410-e82cc46c88fa"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:14.164836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1799f375-cc01-4b11-9def-9a84dc8ab25a req-909bbc8e-562b-48c0-89ed-a6c5433e9bab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.165451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1799f375-cc01-4b11-9def-9a84dc8ab25a req-909bbc8e-562b-48c0-89ed-a6c5433e9bab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:14.209533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:14.216234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1799f375-cc01-4b11-9def-9a84dc8ab25a req-909bbc8e-562b-48c0-89ed-a6c5433e9bab service nova] Creating event network-changed:1cd6542c-ca6a-46b6-9410-e82cc46c88fa for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:14.220823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-92afc9ad-9f4a-4ccc-8f55-7bc00747289d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.332315 May 10 02:29:14.222958 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2115/4224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:13 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:14.228042 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1799f375-cc01-4b11-9def-9a84dc8ab25a req-909bbc8e-562b-48c0-89ed-a6c5433e9bab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100385 May 10 02:29:14.229662 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2110/4225] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:29:14.239340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:14.240181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:14.256224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.258066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:14.263488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.264316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:14.291228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:14.292959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:14.309199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.311825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:14.313998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.316669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:14.366526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Locking {{(pid=118716) lock /opt/stack/nova/nova/compute/api.py:4700}} May 10 02:29:14.483648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-da1a8270-b466-4ee8-a4ee-2963b467b442 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.248429 May 10 02:29:14.488699 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2116/4226] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:14 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:14.496422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:14.498969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:14.507552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.508995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:14.510126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:14.510909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.149558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.157296 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a400482-887d-4e44-acb3-1fb8ac82711b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.666925 May 10 02:29:15.159514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2117/4227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:14 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:15.173065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.175975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:15.191005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.191704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.192638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.195428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.205007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.216543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.218918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.220500 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe6d75ba-7a01-49d9-bbb8-0aedb7a3f83b tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1545 microversion: 2.26 time: 0.934641 May 10 02:29:15.234195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2111/4228] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:14 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1545 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:15.237507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:15.245459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.246175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.302242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] HTTP exception thrown: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f is locked May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Request method failure captured: May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action HTTP/1.1 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 15 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec0O8XQo4FrGmeG_HpzjeS7gR5W57_tJMJMscRCJn0ajWbtzsiH9KDhIrWIP7kOelJGFNd4_f0pSrS2XvvUxq_2Y6GcOQyt6GJ7RbyRbeKU9XvpYgKRw9aPmuBasDNcFlmSr-5zY2eXsQR3iRPvU4ildoOxDoKuj7ymJiMvLCQsZdu4 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_338dfffcacb94a729ac6d34dcafb5c4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-155324918 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-155324918-project May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2534074779504b4ca699312fdd4664cd May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-155324918-project May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: {"os-stop": {}} May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f is locked May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fb527ff7-e5fa-4225-8f67-285b9796b48f', 'body': {'os-stop': {}}} May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f is locked May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f is locked May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f is locked May 10 02:29:15.304700 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:15.314000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Returning 409 to user: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f is locked {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:29:15.315720 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-16f5780c-484a-4909-b32a-5872f56f2eae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 409 len: 107 microversion: 2.1 time: 0.084204 May 10 02:29:15.316898 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2112/4229] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:15 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 107 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:29:15.328202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d451e6f70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.339855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.340841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.341882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:15.349500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.350384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.351526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.352252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.388532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.389519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.437115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.437831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.498800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:15.522521 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34ce19d3-2f97-4432-b461-7d32ebdc319e tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-547818925" status: 201 len: 0 microversion: 2.26 time: 0.204240 May 10 02:29:15.523529 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2113/4230] 10.222.0.52 () {62 vars in 1376 bytes} [Tue May 10 02:29:15 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-547818925 => generated 0 bytes in 206 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 10 02:29:15.531428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:15.536988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:15.550710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.551563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.552571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.553223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.582379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.596358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.598200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:15.603616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8fdc7005-7999-4da1-aa5e-f44107ed6787 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.439172 May 10 02:29:15.615822 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2118/4231] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:15 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:15.621907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cf52472c-357d-4279-b6fd-b5541d260861 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d374a3ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.640915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Unlocking {{(pid=118717) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 10 02:29:15.643420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf52472c-357d-4279-b6fd-b5541d260861 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.649940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf52472c-357d-4279-b6fd-b5541d260861 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.699510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cf52472c-357d-4279-b6fd-b5541d260861 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-547818925" status: 204 len: 0 microversion: 2.26 time: 0.079030 May 10 02:29:15.703436 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2119/4232] 10.222.0.52 () {60 vars in 1357 bytes} [Tue May 10 02:29:15 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-547818925 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:15.720844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d367a8f70>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.743804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.746746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.747512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:15.747837 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e8a12296-5ca1-4822-8edb-d85c56e27151 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.222272 May 10 02:29:15.749373 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2114/4233] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:15 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:15.762120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.762482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4afdd00a-0190-4c17-83a1-6c643f7473c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:15.763038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.766395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.767717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.775398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4afdd00a-0190-4c17-83a1-6c643f7473c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.776716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4afdd00a-0190-4c17-83a1-6c643f7473c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.803977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.804704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.827855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:15.838456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4afdd00a-0190-4c17-83a1-6c643f7473c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:29:15.846443 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4753e7d0-6c1e-454a-bee4-eb2715a9af15 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 204 len: 0 microversion: 2.26 time: 0.137919 May 10 02:29:15.847700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2120/4234] 10.222.0.52 () {60 vars in 1294 bytes} [Tue May 10 02:29:15 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:15.861055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-297a1669-260a-4b6e-b301-6b2f5c3ef9ba tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d367a8d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.878805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-297a1669-260a-4b6e-b301-6b2f5c3ef9ba tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.880193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-297a1669-260a-4b6e-b301-6b2f5c3ef9ba tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.908765 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-297a1669-260a-4b6e-b301-6b2f5c3ef9ba tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 200 len: 12 microversion: 2.26 time: 0.051768 May 10 02:29:15.911220 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2121/4235] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:29:15 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:15.928448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d374a3700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.950430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4afdd00a-0190-4c17-83a1-6c643f7473c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.196760 May 10 02:29:15.953149 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2115/4236] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:15 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:15.953710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.954363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.969681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:15.984714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:15.987955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:15.991255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.992238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:15.994916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:15.996807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.005213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.009543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.011504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.015041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.065530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.066336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.087975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.092148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.129651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:16.150165 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3d3ce90a-361f-4d15-9f86-581fba1d2636 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-1986232664" status: 201 len: 0 microversion: 2.26 time: 0.234639 May 10 02:29:16.153266 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2122/4237] 10.222.0.52 () {62 vars in 1379 bytes} [Tue May 10 02:29:15 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-1986232664 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 10 02:29:16.162868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55f666d6-f8e8-4743-a2ae-4a2d53230738 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d3621ed30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.189981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55f666d6-f8e8-4743-a2ae-4a2d53230738 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.190786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55f666d6-f8e8-4743-a2ae-4a2d53230738 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.203611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55f666d6-f8e8-4743-a2ae-4a2d53230738 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 200 len: 36 microversion: 2.26 time: 0.045754 May 10 02:29:16.204578 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2123/4238] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:29:16 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 36 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:16.220152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d36746310>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.229943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.230646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.231345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:16.238337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.239024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.240218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.240833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.272634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.273610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.302577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:16.317988 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e2c3b41-5947-4f1f-9074-1edee11afe55 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.349340 May 10 02:29:16.318595 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2116/4239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:15 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:16.321676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:16.340688 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e9bc65e-8211-4f4d-ac0b-139335777ebf tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-1986232664" status: 204 len: 0 microversion: 2.26 time: 0.125125 May 10 02:29:16.341773 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2124/4240] 10.222.0.52 () {60 vars in 1363 bytes} [Tue May 10 02:29:16 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-1986232664 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:16.352456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0032e4b8-0905-4eeb-b2fd-6de118388aa1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35d2b9d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.365358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0032e4b8-0905-4eeb-b2fd-6de118388aa1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.366229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0032e4b8-0905-4eeb-b2fd-6de118388aa1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.388063 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0032e4b8-0905-4eeb-b2fd-6de118388aa1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 200 len: 12 microversion: 2.26 time: 0.041872 May 10 02:29:16.388798 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2117/4241] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:29:16 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:16.399233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d367463a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.408282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.408856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.409588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:16.416461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.417831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.418715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.419266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.450377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.450989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.464318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:16.482153 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8e0d97b9-7f92-411f-9f29-fb94f9adf68a tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 204 len: 0 microversion: 2.26 time: 0.087349 May 10 02:29:16.483240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2125/4242] 10.222.0.52 () {60 vars in 1294 bytes} [Tue May 10 02:29:16 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:16.493087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35dd7430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.502928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.503737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.504606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:16.511695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.512616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.513625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.514302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.547241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.547792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.558761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.559343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.590797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:16.611517 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-655f8639-6bba-45af-8383-b392f7ab3f65 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-577131653" status: 201 len: 0 microversion: 2.26 time: 0.123083 May 10 02:29:16.612548 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2118/4243] 10.222.0.52 () {62 vars in 1376 bytes} [Tue May 10 02:29:16 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-577131653 => generated 0 bytes in 125 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 10 02:29:16.633935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35d2b310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.646837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.647620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:16.651736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.652571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.653359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:16.659493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.660184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.660703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.661591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.662206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.663271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.665486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.666035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.688727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.689415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.703109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.703834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.728941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:16.770914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e7718ff-9449-4f0b-ab54-6ed67673945c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-1690015903" status: 201 len: 0 microversion: 2.26 time: 0.142319 May 10 02:29:16.773691 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2119/4244] 10.222.0.52 () {62 vars in 1379 bytes} [Tue May 10 02:29:16 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-1690015903 => generated 0 bytes in 146 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 10 02:29:16.787355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35dd75e0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:16.797174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.797633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.798279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:16.804385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.804832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.805614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.806058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.850835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.851324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:16.886498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:16.937731 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0002ff0c-5715-471f-bf2b-52932beb33a3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 204 len: 0 microversion: 2.26 time: 0.157203 May 10 02:29:16.939909 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2120/4245] 10.222.0.52 () {60 vars in 1294 bytes} [Tue May 10 02:29:16 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:16.964851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bdb17144-8466-41f9-aeb5-40f3e5b194af req-2cb5d3c3-b33c-4e46-b218-bae11bfbc71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "1ee72d75-fe01-47ef-8899-964336a78f6b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:16.985912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bdb17144-8466-41f9-aeb5-40f3e5b194af req-2cb5d3c3-b33c-4e46-b218-bae11bfbc71b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:16.986368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bdb17144-8466-41f9-aeb5-40f3e5b194af req-2cb5d3c3-b33c-4e46-b218-bae11bfbc71b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.032515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bdb17144-8466-41f9-aeb5-40f3e5b194af req-2cb5d3c3-b33c-4e46-b218-bae11bfbc71b service nova] Creating event network-changed:1ee72d75-fe01-47ef-8899-964336a78f6b for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:17.049889 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bdb17144-8466-41f9-aeb5-40f3e5b194af req-2cb5d3c3-b33c-4e46-b218-bae11bfbc71b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105948 May 10 02:29:17.051144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2121/4246] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:17.063982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-935249fc-f668-4f68-bc00-6df2b5497d0c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35d2b670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.087829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-935249fc-f668-4f68-bc00-6df2b5497d0c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.088294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-935249fc-f668-4f68-bc00-6df2b5497d0c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.089984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:17.106343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:17.108714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:17.110493 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2b5d039e-c65a-42e4-8ab4-cf9e14c1f136 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.488916 May 10 02:29:17.112286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2126/4247] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:16 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:17.118756 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-935249fc-f668-4f68-bc00-6df2b5497d0c tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 200 len: 12 microversion: 2.26 time: 0.066161 May 10 02:29:17.119580 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2122/4248] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:29:17 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:17.133991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d367a8a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.149899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.150837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.153430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:17.175575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.176094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.180145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.180727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.243053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.245515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.271621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:17.290641 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ebdb6d68-8e06-4da5-ba8c-6a3890aaa2f1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 204 len: 0 microversion: 2.26 time: 0.162612 May 10 02:29:17.296907 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2127/4249] 10.222.0.52 () {60 vars in 1294 bytes} [Tue May 10 02:29:17 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:17.301091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35e77430>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.315130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.317538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.318748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:17.336041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.337066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:17.347174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.347659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.350441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.351102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.353278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.354666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.356395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.357137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.388117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.388577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.398244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.398780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.429476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:17.468151 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47024417-9b29-41e0-85ea-478f8af67884 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-192271432" status: 201 len: 0 microversion: 2.26 time: 0.170631 May 10 02:29:17.472459 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2123/4250] 10.222.0.52 () {62 vars in 1376 bytes} [Tue May 10 02:29:17 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-192271432 => generated 0 bytes in 172 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 10 02:29:17.478488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35deaaf0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.488730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.489190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.489676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:17.496306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.496763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.497542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.497984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.530241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.531109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.541507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.542928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.574336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:17.598803 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-734017ea-6def-4066-9b2d-e0b33c629025 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-174412847" status: 201 len: 0 microversion: 2.26 time: 0.124951 May 10 02:29:17.605936 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2124/4251] 10.222.0.52 () {62 vars in 1376 bytes} [Tue May 10 02:29:17 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags/tempest-tag-174412847 => generated 0 bytes in 133 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 10 02:29:17.613781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Action: 'update_all', calling method: .version_select at 0x7f3d35dd7820>, body: {"tags": ["tempest-tag-454025805", "tempest-tag-1161440228"]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:17.624434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.625279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.627225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:17.643238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.643939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.645109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.645931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.685290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.686029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.712076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:17.717316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:17.725165 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8fca00d-3656-490e-9f89-683786fa3fd7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.393851 May 10 02:29:17.725770 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2128/4252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:17 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:17.738751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb89a6b0-b25a-45bb-95fe-60b628cf98f2 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 200 len: 61 microversion: 2.26 time: 0.129701 May 10 02:29:17.745247 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2125/4253] 10.222.0.52 () {62 vars in 1311 bytes} [Tue May 10 02:29:17 2022] PUT /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 61 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:17.749341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a35ac31-0bdd-4de1-8776-a8c4ca1a2b97 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d374a3670>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.757206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a35ac31-0bdd-4de1-8776-a8c4ca1a2b97 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.757670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a35ac31-0bdd-4de1-8776-a8c4ca1a2b97 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.799844 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9a35ac31-0bdd-4de1-8776-a8c4ca1a2b97 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 200 len: 61 microversion: 2.26 time: 0.054348 May 10 02:29:17.821843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '.version_select at 0x7f3d35d2b310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.839033 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2129/4254] 10.222.0.52 () {60 vars in 1291 bytes} [Tue May 10 02:29:17 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 61 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:17.848123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.848749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.849871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:17.860565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.862858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.864498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.866340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.913059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:17.915094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:17.959028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lazy-loading 'flavor' on Instance uuid 01de0db2-fc9a-4d2b-b25a-335a5a61157c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:17.987695 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e219321-5fde-4b2b-af46-31d3cec85be3 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags" status: 204 len: 0 microversion: 2.26 time: 0.170717 May 10 02:29:17.988445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2126/4255] 10.222.0.52 () {60 vars in 1294 bytes} [Tue May 10 02:29:17 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:17.997781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:17.998374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:18.011931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:18.013347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:18.014743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:18.016107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:18.062585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:29:18.137507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:18.138898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:18.150595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:18.155095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:18.155917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:18.156367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:18.242380 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3dc1a99b-c7f3-4c0a-aed1-4e0c67b367c8 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 204 len: 0 microversion: 2.26 time: 0.247845 May 10 02:29:18.246730 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2130/4256] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:29:17 2022] DELETE /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:29:18.257048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:18.257793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:18.269168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:18.269628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:18.270435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:18.270883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:18.941352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:18.953715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:18.959053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:18.960404 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a490f6a8-d6ed-45e7-be92-de49bc5b50fc tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1551 microversion: 2.26 time: 0.712103 May 10 02:29:18.974262 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2131/4257] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:18 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1551 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:18.987785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:18.988685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:19.001876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:19.002339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:19.003805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:19.004257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:19.106955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:19.122541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:19.124091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:19.125306 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b67aade5-4989-4d9d-93dc-b36f8ca48dc3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.998684 May 10 02:29:19.143726 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2127/4258] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:18 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:19.289018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-76e24bec-abf9-4290-8f48-709065bfdde3 req-b836d651-6121-48a5-9d0f-ddebd7be51aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:19.313146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-76e24bec-abf9-4290-8f48-709065bfdde3 req-b836d651-6121-48a5-9d0f-ddebd7be51aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:19.315168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-76e24bec-abf9-4290-8f48-709065bfdde3 req-b836d651-6121-48a5-9d0f-ddebd7be51aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:19.329196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-76e24bec-abf9-4290-8f48-709065bfdde3 req-b836d651-6121-48a5-9d0f-ddebd7be51aa service nova] Creating event network-changed:2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:19.336089 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-76e24bec-abf9-4290-8f48-709065bfdde3 req-b836d651-6121-48a5-9d0f-ddebd7be51aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052708 May 10 02:29:19.337815 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2128/4259] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:29:19.447417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:19.457471 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58d395ae-d922-4c02-a120-486b8dabce09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.481680 May 10 02:29:19.473917 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2132/4260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:18 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:19.980681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:19.981847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:20.002284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:20.007056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:20.011365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:20.015882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:20.144343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:20.145244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:20.155885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:20.156961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:20.159850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:20.160856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:20.516422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.536200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.549284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.553891 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-378d0e47-bf54-4aa9-bc72-3c77d6781875 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1551 microversion: 2.26 time: 0.575320 May 10 02:29:20.554825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2129/4261] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:19 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1551 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:20.569452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:20.570527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:20.578730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:20.579262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:20.580085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:20.584432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:20.665716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.681889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.685387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.699246 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3929f8fd-b724-46ac-8d3d-499adbc9a4ab tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.553610 May 10 02:29:20.700380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2133/4262] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:20 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:20.901716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:20.919711 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aa83a0e6-29d5-4c3f-81c9-012e2a662a65 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.353846 May 10 02:29:20.920565 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2130/4263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:20 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:21.572633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:21.573443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:21.586392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.591418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:21.592355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.594314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:21.654565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d4b8cbdc-204d-4460-ab33-d50d5cb06b11 req-155765dc-22ab-4f92-93c4-a58aee720e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01de0db2-fc9a-4d2b-b25a-335a5a61157c", "name": "network-vif-deleted", "tag": "1e57f8c2-88b0-438d-9099-d0669901d6ae"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:21.681473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d4b8cbdc-204d-4460-ab33-d50d5cb06b11 req-155765dc-22ab-4f92-93c4-a58aee720e20 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.684943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d4b8cbdc-204d-4460-ab33-d50d5cb06b11 req-155765dc-22ab-4f92-93c4-a58aee720e20 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:21.724993 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d4b8cbdc-204d-4460-ab33-d50d5cb06b11 req-155765dc-22ab-4f92-93c4-a58aee720e20 service nova] Creating event network-vif-deleted:1e57f8c2-88b0-438d-9099-d0669901d6ae for instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c on n-h1-841089-2 May 10 02:29:21.753778 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d4b8cbdc-204d-4460-ab33-d50d5cb06b11 req-155765dc-22ab-4f92-93c4-a58aee720e20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105399 May 10 02:29:21.754563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2131/4264] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 10 02:29:21.776865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:21.777648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:21.807008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.815448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:21.821452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.822438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:21.860043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:21.872901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:21.878136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00e7252710bb4b37b9f86c754ef19f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde04b0feef94f88b1c823e79297c670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:21.881887 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7621b51e-2300-4c1a-a870-d679a4341dd1 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 200 len: 1509 microversion: 2.26 time: 0.313178 May 10 02:29:21.886821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2134/4265] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:21 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:21.936847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:21.937628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:21.959894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.964192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:21.965381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:21.969003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:22.391609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:22.399561 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c51468f-5923-4f87-a9db-b2d544f1dde9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.466568 May 10 02:29:22.400068 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2135/4266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:21 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:22.404115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:22.417588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:22.422664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:22.428583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eee11f45-aa5c-4bd2-a702-e0dd949ae746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.666345 May 10 02:29:22.429197 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2132/4267] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:21 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:22.904600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:22.905224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] [instance: 01de0db2-fc9a-4d2b-b25a-335a5a61157c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:22.912945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:22.913707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:22.914676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:22.915332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:22.931419 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] HTTP exception thrown: Instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c could not be found. May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Request method failure captured: May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c HTTP/1.1 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec3l6GnDE8X2zzu1hL2xq7pLoQDl7HMhSKl41FbvbhPgvZjRClx6uUab--PqnlbLPB0y63cj1qQF_jGSJwc7uXaRA4jisNRs8xgF_Y2H6I07I9PMkq4cW58A-auQwUwD21IRJTHvb21HjLwMxuNbOB1AYf0WKIcyi9WHgtWzt4_w380 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.26 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: cde04b0feef94f88b1c823e79297c670 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerTagsTestJSON-1277177855 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cde04b0feef94f88b1c823e79297c670", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cde04b0feef94f88b1c823e79297c670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cde04b0feef94f88b1c823e79297c670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cde04b0feef94f88b1c823e79297c670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerTagsTestJSON-1277177855 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: cde04b0feef94f88b1c823e79297c670 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerTagsTestJSON-1277177855 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerTagsTestJSON-1277177855-project May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 00e7252710bb4b37b9f86c754ef19f81 May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerTagsTestJSON-1277177855-project May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c could not be found. May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '01de0db2-fc9a-4d2b-b25a-335a5a61157c'} May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c could not be found. May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c could not be found. May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:22.933939 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c could not be found. May 10 02:29:22.939457 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:29:22.940756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] Returning 404 to user: Instance 01de0db2-fc9a-4d2b-b25a-335a5a61157c could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:29:22.941800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc72d830-adb8-428c-834f-836c3ab39239 tempest-ServerTagsTestJSON-1277177855 tempest-ServerTagsTestJSON-1277177855-project] 10.222.0.52 "GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c" status: 404 len: 111 microversion: 2.26 time: 0.041161 May 10 02:29:22.942559 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2136/4268] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:22 2022] GET /compute/v2.1/servers/01de0db2-fc9a-4d2b-b25a-335a5a61157c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:29:23.418501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:23.419308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:23.446746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:23.447125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:23.447303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:23.448137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:23.449850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:23.450319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:23.461162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:23.461921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:23.463016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:23.463717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:24.212067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:24.224373 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02933275-7fcf-4da9-9c3d-384e4f581de3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.811445 May 10 02:29:24.226248 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2133/4269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:23 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:24.231163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4d58f0ac-705a-44b0-924f-1ca1a30444ec req-b85cb902-5470-424f-9f07-a0db9b1c8b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "2f01f1dc-4f00-4813-8bb2-213d0724b05b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:24.251943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4d58f0ac-705a-44b0-924f-1ca1a30444ec req-b85cb902-5470-424f-9f07-a0db9b1c8b47 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:24.253696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:24.254812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4d58f0ac-705a-44b0-924f-1ca1a30444ec req-b85cb902-5470-424f-9f07-a0db9b1c8b47 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:24.270975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:24.280659 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4d58f0ac-705a-44b0-924f-1ca1a30444ec req-b85cb902-5470-424f-9f07-a0db9b1c8b47 service nova] Creating event network-changed:2f01f1dc-4f00-4813-8bb2-213d0724b05b for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:24.284985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:24.286528 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e2a9750-a232-4b17-9303-d33adb884676 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.843322 May 10 02:29:24.287300 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2137/4270] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:23 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:24.290922 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4d58f0ac-705a-44b0-924f-1ca1a30444ec req-b85cb902-5470-424f-9f07-a0db9b1c8b47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063250 May 10 02:29:24.306635 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2134/4271] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:25.243045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:25.245160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:25.259383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:25.260054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:25.265521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:25.266010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:25.306297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:25.307623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:25.320806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:25.321276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:25.322089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:25.322542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:26.074562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:26.099055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:26.114047 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5094ea2-0b06-4976-9166-31f58994c054 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.861536 May 10 02:29:26.117219 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2138/4272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:25 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:26.125406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:26.127059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:26.128316 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a886d901-eb98-4931-ab97-9649fd9c73b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.826354 May 10 02:29:26.128889 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2135/4273] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:25 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:26.635377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f8543cc7-8ab8-4943-8570-6ff1853ea788 req-a0f77ed8-12a9-4e24-88f4-a6516d5173ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "142271ce-0d6a-47b7-88f4-74833f70d123"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:26.659587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f8543cc7-8ab8-4943-8570-6ff1853ea788 req-a0f77ed8-12a9-4e24-88f4-a6516d5173ce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:26.666095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f8543cc7-8ab8-4943-8570-6ff1853ea788 req-a0f77ed8-12a9-4e24-88f4-a6516d5173ce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:26.723903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f8543cc7-8ab8-4943-8570-6ff1853ea788 req-a0f77ed8-12a9-4e24-88f4-a6516d5173ce service nova] Creating event network-changed:142271ce-0d6a-47b7-88f4-74833f70d123 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:26.742736 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f8543cc7-8ab8-4943-8570-6ff1853ea788 req-a0f77ed8-12a9-4e24-88f4-a6516d5173ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110950 May 10 02:29:26.743428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2139/4274] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:27.134117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:27.134923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:27.148861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:27.149583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:27.166459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:27.166707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:27.167727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:27.169324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:27.169600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:27.170592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:27.170821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:27.177940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:27.824128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:27.833691 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53e389ca-0867-4fd8-a4cc-fc747d4bd8f4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1655 microversion: 2.1 time: 0.705346 May 10 02:29:27.836978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2136/4275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:27 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1655 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:27.896941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:27.936932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:27.943692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:27.953499 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5055830f-21cd-423e-b624-f907a0f02ea2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.808486 May 10 02:29:27.959944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2140/4276] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:27 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:27.981512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b5b08ab-63e4-45f1-953a-b18d97c2bd30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:28.016149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b5b08ab-63e4-45f1-953a-b18d97c2bd30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.019216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b5b08ab-63e4-45f1-953a-b18d97c2bd30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.066914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b5b08ab-63e4-45f1-953a-b18d97c2bd30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Going to try to start instance {{(pid=118716) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 02:29:28.096791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-361435381", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": "none"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:28.231018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b5b08ab-63e4-45f1-953a-b18d97c2bd30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.264368 May 10 02:29:28.232311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2141/4277] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:27 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:28.242772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:28.245088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:28.261727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.262779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.264027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.264712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.331637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:29:28.332380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:29:28.332984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:29:28.333976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:29:28.334508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:29:28.357163 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e4227c2-649b-4956-bf01-d5d66683e8d5 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/f5ddb3b1-f2d4-4aa3-bb71-aa94468c4358" status: 200 len: 194 microversion: 2.1 time: 0.123160 May 10 02:29:28.370507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2142/4278] 10.222.0.52 () {58 vars in 1412 bytes} [Tue May 10 02:29:28 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/f5ddb3b1-f2d4-4aa3-bb71-aa94468c4358 => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:28.375097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.375097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.379044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.380255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:28.381268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.383868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:28.398482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.403522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.406543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.407101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.446713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Getting quotas for project b376ac8e1b1c488da461a1f7137cabaa. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:29:28.462364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Getting quotas for user f16bcad42a154386b55d709a23506d91 and project b376ac8e1b1c488da461a1f7137cabaa. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:29:28.502866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:29:28.505194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:29:28.602317 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f19a34b8-dddc-4b4e-8e1e-344aa1cd60c3 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.760137 May 10 02:29:28.609176 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2137/4279] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:29:28.619975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:28.623032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:28.642248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.642953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:28.644594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:28.645221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:29.240133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:29.266300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7519b200-7827-48ea-a819-dc9e8ab1d519 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1664 microversion: 2.1 time: 0.894647 May 10 02:29:29.279177 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2143/4280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:28 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1664 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:29.306991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bbfa078c-5d27-4096-89a8-a46a44fef3c5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:29.307657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bbfa078c-5d27-4096-89a8-a46a44fef3c5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:29.480422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lazy-loading 'services' on Instance uuid 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:29.704701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bbfa078c-5d27-4096-89a8-a46a44fef3c5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:29.727521 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3214ad9-dba8-4e4a-bbad-5b38aac4ab1e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/f5ddb3b1-f2d4-4aa3-bb71-aa94468c4358" status: 202 len: 0 microversion: 2.1 time: 1.114229 May 10 02:29:29.730905 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2138/4281] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:29:28 2022] DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments/f5ddb3b1-f2d4-4aa3-bb71-aa94468c4358 => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:29.732560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bbfa078c-5d27-4096-89a8-a46a44fef3c5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:29.740285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bbfa078c-5d27-4096-89a8-a46a44fef3c5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:29.747605 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bbfa078c-5d27-4096-89a8-a46a44fef3c5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2" status: 200 len: 1277 microversion: 2.47 time: 0.463468 May 10 02:29:29.773943 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2144/4282] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:29 2022] GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 => generated 1277 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:29.776644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-66fa62fd-607d-4251-b400-8db627d21664 req-7bf25dc4-ed30-4d35-a9d5-13401f432f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "923ee96f-7965-470c-b993-497366970f03"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:29.793178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:29.796017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:29.818587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-66fa62fd-607d-4251-b400-8db627d21664 req-7bf25dc4-ed30-4d35-a9d5-13401f432f84 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:29.819058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-66fa62fd-607d-4251-b400-8db627d21664 req-7bf25dc4-ed30-4d35-a9d5-13401f432f84 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:29.832208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:29.832782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:29.835871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:29.837099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:29.893050 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-66fa62fd-607d-4251-b400-8db627d21664 req-7bf25dc4-ed30-4d35-a9d5-13401f432f84 service nova] Creating event network-changed:923ee96f-7965-470c-b993-497366970f03 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:29:29.917103 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-66fa62fd-607d-4251-b400-8db627d21664 req-7bf25dc4-ed30-4d35-a9d5-13401f432f84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181976 May 10 02:29:29.921216 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2139/4283] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:30.078795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1659589310", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": "none"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:30.188810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:29:30.189579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:29:30.190465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:29:30.191689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:29:30.192120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:29:30.213199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:30.214176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:30.215002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:30.221027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:30.266958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Getting quotas for project b376ac8e1b1c488da461a1f7137cabaa. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:29:30.280295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Getting quotas for user f16bcad42a154386b55d709a23506d91 and project b376ac8e1b1c488da461a1f7137cabaa. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:29:30.319804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:29:30.322659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:29:30.435357 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44315ee7-4f0b-4ae9-af36-f60635d5567b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.365052 May 10 02:29:30.436259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2140/4284] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:29:30.445934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:30.446564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:30.476596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:30.481662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:30.482528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:30.483276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:30.859565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:30.875505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:30.878243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:30.880815 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1da984d1-6bb1-4eed-8fa0-039fb9971f2c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.103896 May 10 02:29:30.895350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2145/4285] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:29 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:30.903489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b45ea9c8-7d8e-4cd9-bb4d-11d0c1e67549 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:30.906290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b45ea9c8-7d8e-4cd9-bb4d-11d0c1e67549 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:30.962903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b45ea9c8-7d8e-4cd9-bb4d-11d0c1e67549 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "PUT /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 992 microversion: 2.47 time: 0.065953 May 10 02:29:30.976726 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2146/4286] 10.222.0.52 () {62 vars in 1296 bytes} [Tue May 10 02:29:30 2022] PUT /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 992 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:29:30.983162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c92ebf9-2714-4fa7-a521-f8fbc9979a5e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:30.984035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c92ebf9-2714-4fa7-a521-f8fbc9979a5e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:31.196095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:31.216994 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90e47120-bbd5-4e2d-83db-d8eecaf62982 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1664 microversion: 2.1 time: 0.777276 May 10 02:29:31.218206 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2141/4287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:30 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1664 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:31.239563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c92ebf9-2714-4fa7-a521-f8fbc9979a5e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:31.247327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c92ebf9-2714-4fa7-a521-f8fbc9979a5e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:31.248868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c92ebf9-2714-4fa7-a521-f8fbc9979a5e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:31.255544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c92ebf9-2714-4fa7-a521-f8fbc9979a5e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1278 microversion: 2.47 time: 0.275471 May 10 02:29:31.256844 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2147/4288] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:30 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:31.901445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:31.902088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:31.916691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:31.917861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:31.926873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:31.930877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:32.237487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:32.238350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:32.253945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:32.254752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:32.259357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:32.259875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:32.564364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.573273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.575048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.576476 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-66a9a0ea-cdab-40bf-8757-a3a595e9d655 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.679899 May 10 02:29:32.577530 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2142/4289] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:31 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:32.582710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:32.583539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:32.599316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:32.600066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:32.601250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:32.601856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:32.670020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.680010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea28b90f-1a21-4a34-b19c-30a78c7b8758 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1664 microversion: 2.1 time: 0.446240 May 10 02:29:32.681373 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2148/4290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:32 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1664 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:32.743564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.799742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.816224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:32.817838 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cd667681-46c8-4d5b-af79-2749ebd5f75d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1338 microversion: 2.47 time: 0.239137 May 10 02:29:32.820049 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2143/4291] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:32 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1338 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:33.598786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:33.600229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:33.659795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:33.660939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:33.667359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:33.668758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:33.701748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:33.703113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:33.730638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:33.731144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:33.736139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:33.738264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:34.830124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:34.834109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:34.846223 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6f825fd-c6b2-46d8-bfb3-d2a5683f7e81 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 1.148658 May 10 02:29:34.848211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2144/4292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:33 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:34.855313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:34.855914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:34.856595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:34.857694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:34.860314 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c888f6a-5f61-4ab1-a783-456c9110f62b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.265998 May 10 02:29:34.866155 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2149/4293] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:33 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:34.879824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:34.882543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:34.882898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:34.885177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:34.888237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:34.891359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:34.913910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:34.917283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:34.918205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:34.919227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:35.053150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:35.085013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:35.090243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:35.094375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c0fe6a0-e934-4d94-ac8b-cbb153f58b03 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1336 microversion: 2.47 time: 0.243523 May 10 02:29:35.095349 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2145/4294] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:34 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:35.261614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:35.285187 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d94451b8-4363-4434-a77e-8c5c6611d765 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.417182 May 10 02:29:35.286747 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2150/4295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:34 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:35.315726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:35.316679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:35.325312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:35.326142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:35.327376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:35.328082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:35.427898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Unlocking {{(pid=118716) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 10 02:29:35.479864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b607f0b9-f21a-49c9-9d3c-bd4f24181f33 tempest-FloatingIPDetailsNegativeTestJSON-169485025 tempest-FloatingIPDetailsNegativeTestJSON-169485025-project] Calling method '.version_select at 0x7f3d35e970d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:35.581753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7aa4b790-5fae-4379-8313-67c35bffdd5c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.270603 May 10 02:29:35.587930 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2151/4296] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:35 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:35.599885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:35.601625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:35.616089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:35.620736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:35.624671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:35.625123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:35.713751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG neutronclient.v2_0.client [None req-b607f0b9-f21a-49c9-9d3c-bd4f24181f33 tempest-FloatingIPDetailsNegativeTestJSON-169485025 tempest-FloatingIPDetailsNegativeTestJSON-169485025-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b485b359-8f8f-4c43-ad50-74b73063215e could not be found", "detail": ""}} {{(pid=118717) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 10 02:29:35.715180 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b607f0b9-f21a-49c9-9d3c-bd4f24181f33 tempest-FloatingIPDetailsNegativeTestJSON-169485025 tempest-FloatingIPDetailsNegativeTestJSON-169485025-project] HTTP exception thrown: Floating IP not found for ID b485b359-8f8f-4c43-ad50-74b73063215e May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b607f0b9-f21a-49c9-9d3c-bd4f24181f33 tempest-FloatingIPDetailsNegativeTestJSON-169485025 tempest-FloatingIPDetailsNegativeTestJSON-169485025-project] Request method failure captured: May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-floating-ips/b485b359-8f8f-4c43-ad50-74b73063215e HTTP/1.1 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec4OGYOxsHAXK6w44PgO7IWFEfjIs9BV4hkkm1rZiYHIgMGCvX9gciNfPwUpy976DFlGdErtpf4U5vdGy_RyhgnJqGgsBMWdFIOSAn2TvTyIHBjyCv9lx3OCDKy3w7w5CO8CwYHRQqOWWFMOznvgQSRC-oq6xoTp8FckNvsmHAOjhfQ May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 70b3b6f7c7f04030ab7adbb3f192d31d May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-169485025 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_70b3b6f7c7f04030ab7adbb3f192d31d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/70b3b6f7c7f04030ab7adbb3f192d31d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/70b3b6f7c7f04030ab7adbb3f192d31d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/70b3b6f7c7f04030ab7adbb3f192d31d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-169485025 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 70b3b6f7c7f04030ab7adbb3f192d31d May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-169485025 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-169485025-project May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: ba89f6672c4c4b4dad08113a46db9c71 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-169485025-project May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: exception: Floating IP not found for ID b485b359-8f8f-4c43-ad50-74b73063215e May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'b485b359-8f8f-4c43-ad50-74b73063215e'} May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b485b359-8f8f-4c43-ad50-74b73063215e could not be found May 10 02:29:35.718086 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5202e99-a6c1-4079-b03a-00794237ced2'] May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b485b359-8f8f-4c43-ad50-74b73063215e. May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b485b359-8f8f-4c43-ad50-74b73063215e May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b485b359-8f8f-4c43-ad50-74b73063215e May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b607f0b9-f21a-49c9-9d3c-bd4f24181f33 tempest-FloatingIPDetailsNegativeTestJSON-169485025 tempest-FloatingIPDetailsNegativeTestJSON-169485025-project] Returning 404 to user: Floating IP not found for ID b485b359-8f8f-4c43-ad50-74b73063215e {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b607f0b9-f21a-49c9-9d3c-bd4f24181f33 tempest-FloatingIPDetailsNegativeTestJSON-169485025 tempest-FloatingIPDetailsNegativeTestJSON-169485025-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/b485b359-8f8f-4c43-ad50-74b73063215e" status: 404 len: 111 microversion: 2.1 time: 0.623319 May 10 02:29:35.722878 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2146/4297] 10.222.0.52 () {58 vars in 1259 bytes} [Tue May 10 02:29:35 2022] GET /compute/v2.1/os-floating-ips/b485b359-8f8f-4c43-ad50-74b73063215e => generated 111 bytes in 625 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:29:35.896385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:35.897752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:35.931206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:35.934243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:35.937399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:35.939741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:36.852941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:36.863470 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99a307ee-a48f-435b-a719-942d51b03ddc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 1.273263 May 10 02:29:36.864056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2152/4298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:35 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:36.878794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:36.892727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:36.902852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:36.909617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:36.915032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:36.918652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:37.228536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:37.238217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:37.249993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:37.251268 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88707b77-97a3-4218-8df1-48912966fb6c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1357 microversion: 2.47 time: 0.379256 May 10 02:29:37.268076 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2153/4299] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:36 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1357 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:37.275162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:37.276428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:37.305433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:37.305893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:37.306713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:37.307187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:37.403338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:37.432893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:37.437606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:37.462204 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89df779b-9566-4689-82c3-5b550faff3a9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.569596 May 10 02:29:37.482712 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2147/4300] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:35 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:37.523406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:37.530861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:37.568467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:37.569300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:37.570717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:37.571541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:37.906078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:29:37.909871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:29:37.913809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:29:37.917487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:29:37.919464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:29:38.172938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:38.185744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:38.186893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:38.190599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:38.192071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:38.320184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-725fe931-4907-4b11-b4a5-27c2c46c6614 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "POST /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5/action" status: 202 len: 1079 microversion: 2.47 time: 0.828455 May 10 02:29:38.321071 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2148/4301] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:29:37 2022] POST /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5/action => generated 1079 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 10 02:29:38.336863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:38.337802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:38.349594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:38.350063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:38.352746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:38.353026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:38.590016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:38.600813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:38.604742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:38.606585 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4eb032c8-debc-4dc5-8f55-45f924048c5a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.274268 May 10 02:29:38.607852 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2149/4302] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:38 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:38.613611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:38.615056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:38.623910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:38.624666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:38.625656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:38.626452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.058465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.066488 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dfcf01b7-d1c8-42e2-9d3b-0b6b1c554236 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 1.799117 May 10 02:29:39.078467 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2154/4303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:37 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:39.096113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:39.097848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:39.106279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:39.107029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.109272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:39.110036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.540915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.561333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.563477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.565665 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac3104e1-bb64-4f97-9415-907297c9c64c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.956441 May 10 02:29:39.580635 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2150/4304] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:38 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:39.625306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:39.625955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:39.632959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:39.633687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.644686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:39.645472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.774398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.798947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.802628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.805564 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-820ea609-51cb-43e5-ae95-fec227579238 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.183096 May 10 02:29:39.809100 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2151/4305] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:39 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:39.809393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:39.824060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f3f20c5-8f34-41b0-beda-4dd3ba9b34b3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.731943 May 10 02:29:39.825087 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2155/4306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:39 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:39.851151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:39.851608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:39.871459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:39.871934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.872760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:39.873208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:39.996386 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7c434313-1337-4106-ab75-a6e75f4f7e90 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.158941 May 10 02:29:39.997621 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2152/4307] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:39 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:29:40.007333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:40.008059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:40.021853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:40.022316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:40.027729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:40.029529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:40.586036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:40.587058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:40.597012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:40.597440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:40.601952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:40.602832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:40.960158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:40.972869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8c637745-b8ca-4ff8-a7ed-38eb12de4ac3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1673 microversion: 2.1 time: 0.970569 May 10 02:29:40.973930 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2156/4308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:40 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1673 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:40.979427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:40.980299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:40.986580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:40.987180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:40.988346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:40.989466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:41.159135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:41.171849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:41.175091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:41.176704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f732bd2-657c-4d74-a360-d028d6fc8739 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.201563 May 10 02:29:41.189395 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2157/4309] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:40 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:41.244921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:41.255056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:41.256883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:41.258436 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5a64066-eebd-4adf-9447-d792b6ad0737 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.676548 May 10 02:29:41.258829 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2153/4310] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:40 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:41.993372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:41.994628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:42.004341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.004941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.005914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.007054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.203606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:42.207130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:42.224073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.224913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.225961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.226635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.469460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.484791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.489254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.493509 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b543c3b5-0045-454e-92f2-fda92fd247a5 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.300235 May 10 02:29:42.507091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2154/4311] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:42 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:42.507091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:42.507091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:42.527434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.528070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.530033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.533169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.814196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.825826 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43a811e3-6292-4020-93b3-71324336d6ef tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1653 microversion: 2.1 time: 0.839451 May 10 02:29:42.839665 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2158/4312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:41 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1653 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:42.851894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:42.852815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:42.871875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.872301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.873103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:42.875957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:42.959975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.973160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.975110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:42.982226 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8818a36a-1beb-45a8-b288-45432fcb81e4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.478521 May 10 02:29:42.983457 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2155/4313] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:42 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:43.032749 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d36593a-cd40-4b87-89a8-b60f61fc0392 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.189494 May 10 02:29:43.038633 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2159/4314] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:29:42 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:43.044283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:43.045105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:43.058028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:43.059809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:43.061443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:43.063604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:43.519460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:43.520469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:43.542512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:43.543315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:43.544384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:43.547012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:43.555199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:43.567585 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2a322c1-f9d8-4c3c-be5b-b81ec1f6781b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1660 microversion: 2.1 time: 0.527741 May 10 02:29:43.569486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2156/4315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:43 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1660 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:43.668121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:43.683413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:43.684937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:43.686337 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59c0677d-0e74-450a-b3aa-a61a3e4fe068 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.174234 May 10 02:29:43.686917 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2160/4316] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:43 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:44.004048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:44.005085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:44.012781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:44.013239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:44.014291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:44.014735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:44.586992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:44.589360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:44.607866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:44.608934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:44.612510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:44.615049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:44.956346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:44.973073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:44.975042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:44.976477 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f25c6cc2-632a-4bbf-8b6c-93430f16a0af tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.979201 May 10 02:29:44.977542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2157/4317] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:43 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:44.991639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:44.992569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:45.006290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.008594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.010153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.013824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.084550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:45.093649 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1e20679-2c38-4a7d-958d-c54b5b77ec69 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.511766 May 10 02:29:45.095678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2161/4318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:44 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:45.120116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:45.120797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:45.133052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.133518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.134321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.148557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.196768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:45.206712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:45.217192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:45.219220 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0abc610d-9e94-4e7d-aa23-c340b1ad5929 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.240253 May 10 02:29:45.220046 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2158/4319] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:44 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:45.418541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:45.429090 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4bb3cbc-758c-45fa-ba9f-114a5a08ac30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.320794 May 10 02:29:45.430537 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2162/4320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:45 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:45.448035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:45.448667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:45.462461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.462960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.463979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.464431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.859439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:45.867565 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-380ba06a-5b92-460e-a109-692c9aa415b6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.423846 May 10 02:29:45.868152 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2159/4321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:45 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:45.885253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:45.886586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:45.898986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.899770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.902616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:45.903362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:45.996928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:45.998258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:46.009837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:46.010537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:46.011613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:46.016293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:46.409766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.428036 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9a5f9fbd-5aba-4fde-a7e3-e1a7af7c5776 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.547879 May 10 02:29:46.429721 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2163/4322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:45 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:46.449474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:46.450586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:46.461529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.485148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.493445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:46.495958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:46.498562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.499337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:46.501490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:46.506013 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6099a0ba-c3c3-4b38-815c-8c4ad92ca0d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.513705 May 10 02:29:46.520173 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2160/4323] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:45 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:46.526123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:46.527103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:46.534479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:46.535322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:46.536657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:46.537321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:46.732611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.744752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.746275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.761147 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53643578-9dcf-47e5-a75c-1191876a9972 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.316071 May 10 02:29:46.771685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2164/4324] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:46 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:46.981220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:46.990930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4da2863-62b3-415d-bbb9-85935ff1e92d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.469287 May 10 02:29:46.991564 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2161/4325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:47.007371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:47.010385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:47.021127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:47.031496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:47.032614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:47.033871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:47.302924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.313453 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5f27c42-dea4-4153-913a-6417e2e13240 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.310554 May 10 02:29:47.318257 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2165/4326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:47 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:47.531453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:47.533966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:47.554701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:47.559679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:47.560975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:47.562148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:47.789938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:47.791926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:47.801323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:47.809998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:47.813046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:47.816930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:47.837051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.849861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.851800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.853982 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1aa4e7e5-c724-4163-892c-0e084b71b6b2 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.331522 May 10 02:29:47.867493 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2162/4327] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:47 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:47.936084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.945031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.950818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:47.955013 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-236de8b8-3167-4172-afcb-b2a8f5b0532a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.171157 May 10 02:29:47.959262 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2166/4328] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:47 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:48.878303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:48.879775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:48.893199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:48.893354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:48.894114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:48.896470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:48.983143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:48.983799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:49.002484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:49.010389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:49.017351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:49.021611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:49.208079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:49.220486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:49.222341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:49.225534 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbcddefa-b32a-4be2-9f6a-bef9ff3cd5a7 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.251859 May 10 02:29:49.230015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2167/4329] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:48 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:49.255707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:49.266468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:49.269148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:49.270572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef4a9a06-81d7-4175-9205-7c9c0b824376 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.396454 May 10 02:29:49.271706 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2163/4330] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:48 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:49.781563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-415324692", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:49.854610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:29:50.219288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:29:50.219935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:29:50.220221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:29:50.220642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:29:50.221067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:29:50.250049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.250588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.251591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.252154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.258492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:50.259289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:50.273576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.274940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.276479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.278454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.280101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Getting quotas for project ed15443f450f40dd9c0e79a399472ad7. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:29:50.286863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Getting quotas for user 97d94877c34a425a9994f00097d7f929 and project ed15443f450f40dd9c0e79a399472ad7. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:29:50.303303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:29:50.306039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:29:50.368571 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c366bb11-1245-4e11-a836-75ff0627ce8a tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.136878 May 10 02:29:50.369585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2168/4331] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:29:50.376340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:50.380099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:50.396796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.397483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.398594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.401625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.430599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.441255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.443338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.444964 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6c130fc-ed7c-4c5d-a463-1478e3a91849 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.191208 May 10 02:29:50.447692 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2164/4332] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:50 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:50.452750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:50.453624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:50.460719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.461309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.462192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.463339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.474060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7fa3212f-ffcd-4483-8b8b-adcd6b93df89 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093889 May 10 02:29:50.474060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2169/4333] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:29:50 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:29:50.474060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa447d8f-a343-453c-a154-80dfe68e6e8b tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:50.474060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa447d8f-a343-453c-a154-80dfe68e6e8b tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:50.574978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa447d8f-a343-453c-a154-80dfe68e6e8b tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.584650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa447d8f-a343-453c-a154-80dfe68e6e8b tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1215 microversion: 2.1 time: 0.116325 May 10 02:29:50.594895 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2170/4334] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:50 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:50.700971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:50.701910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:50.716364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.728238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.732502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:50.737038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:50.757212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.769196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.772587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:50.775975 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45818f68-da39-4ede-a2a2-83c1c70099b3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.327033 May 10 02:29:50.776896 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2165/4335] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:50 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:50.826232 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-64d98e04-b362-4b0f-abe6-90522cef7c4c tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128861 May 10 02:29:50.826586 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2171/4336] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:29:50 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:29:51.359469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:51.362639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:51.396368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.399995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.402016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.402643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.469105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:51.470217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:51.490433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.491353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.492428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.496669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.509935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:29:51.705149 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5fbb5ec9-b7ac-4ba1-b5a2-2edd6f5a4ab1 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 204 len: 0 microversion: 2.1 time: 0.355058 May 10 02:29:51.706439 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2166/4337] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:29:51 2022] DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:29:51.714510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:51.715581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:51.724290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.724763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.725618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.726069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.746021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:51.760224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:51.764080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:51.767006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bb5dd89b-dd97-4a66-8577-09977feecd3f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.305866 May 10 02:29:51.778986 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2172/4338] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:51 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:51.784474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:51.785334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:51.792653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.795037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:51.800026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:51.800769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:52.154087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.163006 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42a86313-d471-49a2-8a96-cae4aa7c4852 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1267 microversion: 2.1 time: 0.454913 May 10 02:29:52.173768 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2167/4339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:51 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1267 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:52.184993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:52.185962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:52.194651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:52.195408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:52.200279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:52.200943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:52.225005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.234432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0547c741-3a2f-4e39-aed9-fec096830421 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1673 microversion: 2.1 time: 0.452571 May 10 02:29:52.235953 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2173/4340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:51 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1673 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:52.645894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.674656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.681971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.683257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fdabfb96-40b9-4cad-8ab6-96243ba2b825 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.508134 May 10 02:29:52.683837 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2168/4341] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:52 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:52.786916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:52.787693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:52.804821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:52.808191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:52.810887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:52.813782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:52.945470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.958601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.961651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:52.967004 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-22c24345-139b-4f00-a502-47294eead9f0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.184240 May 10 02:29:52.968117 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2174/4342] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:52 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:53.180440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:53.182472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:53.193801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:53.194564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:53.195589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:53.197107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:53.277675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:53.279169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:53.315437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:53.319605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:53.320654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:53.321221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:53.347512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:53.372155 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb337ab5-3001-42c0-9cc2-0c3295871937 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1267 microversion: 2.1 time: 0.194828 May 10 02:29:53.376132 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2169/4343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:53 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:53.701849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:53.703013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:53.741853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:53.742687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:53.745211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:53.748334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:53.766200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:53.779113 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b9e79ff3-3c15-4b66-80d5-35148aaf0c88 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1673 microversion: 2.1 time: 0.526271 May 10 02:29:53.780677 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2175/4344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:53 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1673 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:53.986366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:53.987790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:53.999171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:54.002585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:54.003665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:54.004337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:54.262429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.273362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.284751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.288215 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06f16f9d-b95f-4f9a-8cb2-538fdecbf5f1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.305834 May 10 02:29:54.289282 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2176/4345] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:53 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:54.393797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:54.394611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:54.405216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:54.406110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:54.407184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.409869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:54.411384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:54.432296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.436867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.443208 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a9af45eb-1d39-4b6a-84d0-97ef99bab8ef tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.740195 May 10 02:29:54.445663 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2170/4346] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:53 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:54.536458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:54.554410 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8e0c4d1-a358-43eb-bba4-a4dd2083d2d7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1273 microversion: 2.1 time: 0.165228 May 10 02:29:54.569998 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2177/4347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:54 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:54.797256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:54.797820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:54.808701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:54.809408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:54.811052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:54.811744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.307825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:55.308483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:55.321444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:55.325493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.327804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:55.328957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.416991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:55.428793 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f991d71d-3fca-43cc-9c38-98203684bafc tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1673 microversion: 2.1 time: 0.635454 May 10 02:29:55.429408 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2171/4348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:54 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1673 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:55.464302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:55.464935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:55.473594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:55.477763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.478885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:55.479367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.488488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:55.502564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:55.504198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:55.505418 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-779703cb-7ea9-4614-86a0-16f40a3d6567 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.201675 May 10 02:29:55.513476 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2178/4349] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:55 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:29:55.574362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:55.574977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:55.592619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:55.593363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.594335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:55.594962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:55.818409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:55.834789 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-330729a9-f262-4f85-bfc5-9bd8e29633c0 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1273 microversion: 2.1 time: 0.257701 May 10 02:29:55.839921 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2179/4350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:55 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:29:56.039740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.049385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.050901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.058697 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3292523b-678a-42f5-8ca4-c0d9bedb4ab5 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.599283 May 10 02:29:56.063129 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2172/4351] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:55 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:56.446924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:56.448200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:56.468290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:56.469025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:56.471492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:56.479375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:56.524577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:56.525568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:56.534726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:56.536532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:56.542529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:56.545205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:56.809528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.823838 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ff82349-0e3b-4d1c-a6eb-5f933cd3521e tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1606 microversion: 2.1 time: 0.381751 May 10 02:29:56.824462 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2180/4352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:56 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1606 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:56.832350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.846386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:56.847019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:56.866671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.889831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:56.891147 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-554ece04-ed56-471c-bebd-e0fb9022140d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.370720 May 10 02:29:56.891758 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2173/4353] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:56 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:56.902347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:56.902347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:56.902347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:56.903716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.081910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:57.083446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:57.090498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.096383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.097493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.098145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.120893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:57.134533 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f39bd520-7201-4844-85c7-5f770e566b5e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1273 microversion: 2.1 time: 0.292548 May 10 02:29:57.137047 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2181/4354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:56 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:57.575125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:57.593779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:57.597917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:57.602900 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b7b4b3fd-d069-440a-a31e-be40d26a277e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.524071 May 10 02:29:57.605867 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2174/4355] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:57 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:57.670687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-cfcccaee-50c8-4201-8df6-68bf59e32ea6 req-b43273b8-b77b-4a89-9398-982a624ec171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6675fb3c-50fc-4c49-bd0f-e9f6f68f4467", "name": "network-vif-deleted", "tag": "1575eff5-abd5-44f8-9e9b-2d8c882e85a6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:29:57.696491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cfcccaee-50c8-4201-8df6-68bf59e32ea6 req-b43273b8-b77b-4a89-9398-982a624ec171 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.699697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cfcccaee-50c8-4201-8df6-68bf59e32ea6 req-b43273b8-b77b-4a89-9398-982a624ec171 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.724780 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-cfcccaee-50c8-4201-8df6-68bf59e32ea6 req-b43273b8-b77b-4a89-9398-982a624ec171 service nova] Creating event network-vif-deleted:1575eff5-abd5-44f8-9e9b-2d8c882e85a6 for instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 on n-h1-841089-2 May 10 02:29:57.757149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-cfcccaee-50c8-4201-8df6-68bf59e32ea6 req-b43273b8-b77b-4a89-9398-982a624ec171 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086602 May 10 02:29:57.758044 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2182/4356] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:29:57.845924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:57.845924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:57.886292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.886764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.890414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.890880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.910258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:57.911477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:57.929045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.932882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:57.937085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:57.937562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:58.046704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:58.048442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:58.054897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lazy-loading 'fault' on Instance uuid 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:29:58.196551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:58.208795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:58.210314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:58.211578 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-642df1d2-8711-4478-8668-24a4ed61bf25 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.305640 May 10 02:29:58.227111 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2183/4357] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:57 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:58.236497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0edd300fe34f92a9e265863d12718a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300f71d3f6b34fa1a787c5e0f10788db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:58.258737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:58.258943 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-decb8dd3-8757-429a-a496-a99acd49aea2 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 200 len: 1327 microversion: 2.1 time: 0.419066 May 10 02:29:58.268710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2175/4358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:57 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:58.268929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:58.276693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:58.278068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:58.278911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:58.279388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:58.624382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:58.625530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:58.638735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:58.651477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:58.653028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:58.654727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:59.304367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.313008 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-513777be-abee-4948-9012-c9b0a4dd68b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 1.084713 May 10 02:29:59.319804 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2184/4359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:58 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:29:59.329548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:59.331465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:59.345355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.362105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:59.372475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.373537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:59.375666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.376796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:59.381134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:59.382751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aed9e288-9e61-4dc3-a0d4-8fc3b70c72e7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.762906 May 10 02:29:59.389127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2176/4360] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:58 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:29:59.395687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:59.408691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:29:59.438514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:59.439268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:59.444318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:29:59.445089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:29:59.485243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] HTTP exception thrown: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Request method failure captured: May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 HTTP/1.1 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecw3w7Rk_2R3GrdT9k-QjXe1FcXkw9hIoh_9SUBgwsudEOtJnPaJUlBCPhzmkyH4hFfhm9Im568VLrGl1rHKMJ80kQ62e-NwSL9c9Bkj5OlSy1BgBajndTTXog5FZ-OkMGxoaL_s3AUsr3Z1Ss2ms2D__7aTOlRl_eb3XZKZeuRHdbE May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_300f71d3f6b34fa1a787c5e0f10788db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeTestJSON-1516735498 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1d0edd300fe34f92a9e265863d12718a May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6675fb3c-50fc-4c49-bd0f-e9f6f68f4467'} May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:29:59.498029 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:29:59.502871 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:29:59.510782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Returning 404 to user: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:29:59.511969 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a604f727-13fc-434f-a5d3-816e0fb57bba tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 404 len: 111 microversion: 2.1 time: 0.121615 May 10 02:29:59.514302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2177/4361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:29:59 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:29:59.527246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e51a13c-787b-4cc2-ae09-cd375fc7b887 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '.version_select at 0x7f3d35dea670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:29:59.565953 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e51a13c-787b-4cc2-ae09-cd375fc7b887 tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123760646" status: 202 len: 0 microversion: 2.1 time: 0.042991 May 10 02:29:59.566923 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2178/4362] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123760646 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:29:59.584435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.595387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.608640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:29:59.610295 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e3c104d7-62d7-4077-800f-dd705156627a tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.289206 May 10 02:29:59.611128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2185/4363] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:29:59 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:00.333163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:00.334176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:00.345255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:00.348857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:00.351533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:00.353104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:00.411879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:00.413272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:00.437013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:00.440411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:00.441308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:00.441773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:01.163322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.180434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.187949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.208096 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-47814f01-21c7-4e61-bc48-71d02d78c32e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.802013 May 10 02:30:01.208704 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2186/4364] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:00 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:01.218990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:01.231681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:01.263352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:01.266714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:01.279803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:01.283149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:01.463679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.479123 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64859987-fb80-4db9-ad67-dec4e0237441 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 1.147500 May 10 02:30:01.480084 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2179/4365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:00 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:01.582993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.599332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.601264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:01.608089 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8e1b044a-c2a4-4f6e-ae7d-5d30e04ef13c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.396806 May 10 02:30:01.620997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2187/4366] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:01 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:02.226240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:02.227321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:02.241200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:02.244762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:02.247061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:02.247969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:02.497503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:02.498337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:02.521147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:02.531668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:02.532752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:02.533480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:02.935769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:02.953073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:02.955380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:02.956906 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c3b31184-8e47-47a4-a294-b8adaaed2548 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.734913 May 10 02:30:02.978285 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2180/4367] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:02 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:02.996531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:02.999013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:03.017849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:03.018317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:03.019183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:03.019641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:03.065456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:03.092000 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e6160a6-71f4-47d3-937e-2568ea01c36e tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.599406 May 10 02:30:03.093103 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2188/4368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:02 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:03.203933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:03.213526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:03.215047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:03.220671 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6aa0497d-0d48-49ca-8c6d-dca76f0727a0 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.240381 May 10 02:30:03.224188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2181/4369] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:02 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:03.375667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-101a35ea-42c8-477f-baca-77d149aa4438 req-a9d85156-f4d1-4350-8762-c656efcdbbea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545625b9-077e-40f0-94da-4a06f63211d4", "tag": "dd4ce761-1d0d-4719-a816-226368fbea00"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:03.390452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-101a35ea-42c8-477f-baca-77d149aa4438 req-a9d85156-f4d1-4350-8762-c656efcdbbea service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:03.390452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-101a35ea-42c8-477f-baca-77d149aa4438 req-a9d85156-f4d1-4350-8762-c656efcdbbea service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:03.421059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-101a35ea-42c8-477f-baca-77d149aa4438 req-a9d85156-f4d1-4350-8762-c656efcdbbea service nova] Creating event network-changed:dd4ce761-1d0d-4719-a816-226368fbea00 for instance 545625b9-077e-40f0-94da-4a06f63211d4 on n-h1-841089-2 May 10 02:30:03.428040 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-101a35ea-42c8-477f-baca-77d149aa4438 req-a9d85156-f4d1-4350-8762-c656efcdbbea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058006 May 10 02:30:03.432616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2189/4370] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:30:03.980297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:03.981754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:03.995794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:03.996650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:03.997697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:04.004734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:04.110908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:04.111730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:04.127814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:04.135030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:04.136041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:04.136505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:04.971678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:04.986299 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6834c43d-d295-46e4-a035-d9b698af57d8 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.879030 May 10 02:30:04.988551 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2190/4371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:04 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:05.001748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:05.008928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:05.026001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:05.026587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:05.027550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:05.028093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:05.415782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:05.424278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:05.441150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:05.443113 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7d1644d2-0287-4d16-b7d4-6d831eb37219 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.452549 May 10 02:30:05.444416 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2191/4372] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:04 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:05.533980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:05.550989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:05.552652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:05.556489 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-58a24d26-73ca-4848-b6ea-c275d0dd9d85 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.580590 May 10 02:30:05.560729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2182/4373] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:03 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:06.005001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:06.005883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:06.016844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:06.017609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:06.018626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:06.019935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:06.462917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:06.464708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:06.479034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:06.479734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:06.480715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:06.483627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:06.564689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:06.573936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c2135fd-d07a-4c96-b9c9-fc01b3cdaa82 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.572781 May 10 02:30:06.579529 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2192/4374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:05 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:06.591836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:06.592717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:06.600401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:06.609079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:06.622692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:06.639922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:06.641905 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfdebf10-f571-4554-b8b4-a83a495d6863 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.182914 May 10 02:30:06.642694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:06.645587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:06.646220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:06.646652 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2183/4375] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:06 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:30:07.141127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:07.156471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:07.157936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:07.159397 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4823f9b-a27b-4353-bf2f-f353a7f73b98 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.578180 May 10 02:30:07.183681 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2193/4376] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:06 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:07.594552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:07.595734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:07.614075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:07.614720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:07.615310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:07.620709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:07.674049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:07.674049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:07.695589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:07.696086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:07.697447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:07.697896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:07.963140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.007319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.008878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.010120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd7bc985-a9bf-40c0-91e0-189b3f655cf1 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.350501 May 10 02:30:08.040155 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2194/4377] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:07 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:08.114413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.122771 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3ba1f1d-29bc-47a2-9bc1-db140a471066 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.531851 May 10 02:30:08.130028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2184/4378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:07 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:08.180701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:08.181372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:08.205977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:08.206458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:08.207335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:08.207790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:08.712080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.722901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.730127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:08.731636 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dd57737e-90a1-4eca-a3f4-cb1dbf542a5b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.555040 May 10 02:30:08.745211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2195/4379] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:08 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:09.030045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:09.031263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:09.045258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:09.046021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:09.047059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:09.049031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:09.139742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:09.140244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:09.147868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:09.148324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:09.155312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:09.155874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:09.242962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:09.260266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:09.265178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:09.269957 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8783d57d-79a6-4fd5-b6d0-534ed3041ee2 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.242579 May 10 02:30:09.272134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2185/4380] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:09 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:09.511857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:09.520423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aeeee612-06b4-41a2-9057-1aa443164286 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.384882 May 10 02:30:09.526498 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2196/4381] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:09 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:09.751546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:09.752538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:09.775727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:09.780764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:09.781893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:09.783761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:10.082752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.107922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.110675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.112460 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a8132d09-1968-4728-ade0-a306667290f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.365108 May 10 02:30:10.117637 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2186/4382] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:09 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:10.290788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:10.291850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:10.305715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:10.306997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:10.308090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:10.319812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:10.465663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.491523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.494606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.497325 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-762d3400-8aa7-4d9f-b15c-555ad7fb2288 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1366 microversion: 2.47 time: 0.210851 May 10 02:30:10.501094 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2197/4383] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:10 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:10.546304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:10.546945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:10.563410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:10.564969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:10.567554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:10.572653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:10.779509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:10.791459 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9006c6b4-c8fc-4f4d-b1e7-564d414cb2b3 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.251327 May 10 02:30:10.793056 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2187/4384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:10 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:10.973432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-22196396-9769-4a4d-99e1-2b6f518b3752 req-5e43279a-86d0-4a37-ab3b-9a1a4bc7f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545625b9-077e-40f0-94da-4a06f63211d4", "name": "network-vif-plugged", "status": "completed", "tag": "dd4ce761-1d0d-4719-a816-226368fbea00"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:10.987038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-22196396-9769-4a4d-99e1-2b6f518b3752 req-5e43279a-86d0-4a37-ab3b-9a1a4bc7f67c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:10.991962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-22196396-9769-4a4d-99e1-2b6f518b3752 req-5e43279a-86d0-4a37-ab3b-9a1a4bc7f67c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:11.020134 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-22196396-9769-4a4d-99e1-2b6f518b3752 req-5e43279a-86d0-4a37-ab3b-9a1a4bc7f67c service nova] Creating event network-vif-plugged:dd4ce761-1d0d-4719-a816-226368fbea00 for instance 545625b9-077e-40f0-94da-4a06f63211d4 on n-h1-841089-2 May 10 02:30:11.026736 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-22196396-9769-4a4d-99e1-2b6f518b3752 req-5e43279a-86d0-4a37-ab3b-9a1a4bc7f67c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056990 May 10 02:30:11.030597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2198/4385] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:30:11.133264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:11.134711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:11.152574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:11.153376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:11.154478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:11.155223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:11.517928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:11.518820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:11.537576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:11.545874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:11.546898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:11.547485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:12.022491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.031420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.044190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.046185 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5a0005aa-4f42-41e5-8ac4-0caeb3301cbf tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1372 microversion: 2.47 time: 0.533602 May 10 02:30:12.051379 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2199/4386] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:11 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1372 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:30:12.056391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:12.061802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:12.080987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:12.081755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:12.082757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:12.083433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:12.102997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.117378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.121943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.123249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56a0e02e-f353-4892-9011-0217734db100 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.994399 May 10 02:30:12.128586 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2188/4387] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:11 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:12.880083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:12.900828 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad5d57ea-e1e4-4a10-880a-40ea6b13b9b7 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1315 microversion: 2.1 time: 0.846818 May 10 02:30:12.915805 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2200/4388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:12 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:13.069348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:13.072262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:13.085510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:13.085977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:13.086787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:13.093170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:13.146989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:13.149226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:13.184954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:13.188007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:13.195791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:13.196584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:13.464307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:13.551843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:13.577004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:13.593165 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68ac5e2f-cf50-4052-9eb6-afab62f0338f tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1372 microversion: 2.47 time: 0.522770 May 10 02:30:13.611292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2189/4389] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:13 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1372 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:13.862937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:13.919815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:13.975458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:13.982170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:13.982170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:13.985512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:13.986926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:14.096438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:14.098151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:14.111666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2785ae4d-2330-4c47-88a4-9b9d8243058a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.961494 May 10 02:30:14.112560 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2201/4390] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:13 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:14.127101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:14.133016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:14.157321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:14.158335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:14.159324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:14.175425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:14.394003 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72b69ef0-8cc6-47ca-8a8f-c498615ea6ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.565577 May 10 02:30:14.395920 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2190/4391] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:30:13 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:30:14.412456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:14.423916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:14.432130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:14.432880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:14.434008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:14.444191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:15.733797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:15.745300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:15.749693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c46f6c52-55de-4fd9-be48-48f5e89dea18 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1670 microversion: 2.1 time: 1.341934 May 10 02:30:15.755028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2191/4392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:14 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1670 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:15.761103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d30bcdd-0941-4006-9b3f-0553918e0009 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1465 microversion: 2.1 time: 1.642126 May 10 02:30:15.762020 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2202/4393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:14 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1465 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:15.764624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:15.767023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:15.769921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:15.770818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:15.781228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:15.781662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:15.783188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:15.784338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:15.784585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:15.785087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:15.786421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:15.787537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.238403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.262093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.276251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.278148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-859ebde0-435e-4b98-8398-28dd20400a4c tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1357 microversion: 2.47 time: 0.521163 May 10 02:30:16.297716 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2192/4394] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:15 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1357 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:16.301992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:16.301992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:16.315485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:16.316849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.317664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:16.318115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.357305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.377762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.385190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.392115 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2b4da62b-fa11-4b3a-b4d5-365e29c3c0c0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.628077 May 10 02:30:16.394573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2203/4395] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:15 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:16.419253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:16.426188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:30:16.435200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:16.436152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Searching by: {'deleted': False, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 02:30:16.459752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:16.465439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.466413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:16.466860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.717633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf4aa451-8fd8-4f9c-9d51-cf98a1395d30 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "DELETE /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 204 len: 0 microversion: 2.1 time: 0.428035 May 10 02:30:16.725042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2193/4396] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:30:16 2022] DELETE /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:30:16.746674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:16.749096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:16.771705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:16.774473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.779772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:16.780724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:16.867745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 02:30:17.044309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:17.053944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.055568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:17.086069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:17.089963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:17.216565 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09985c0f-1eea-4939-bdaf-02e9177768b9 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.815270 May 10 02:30:17.232366 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2204/4397] 10.222.0.52 () {60 vars in 1186 bytes} [Tue May 10 02:30:16 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:17.245020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:17.245657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:17.252966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.253437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:17.254613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.255082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:17.468508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:17.481935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41d9778c-18c2-496f-9430-ed63d2288245 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1471 microversion: 2.1 time: 0.748452 May 10 02:30:17.493408 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2194/4398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:16 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1471 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:17.504226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:17.508564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:17.520860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.524754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:17.527167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.527667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:17.615540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:30:17.866171 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12b532ea-6812-4ecf-a11c-79d421d244bb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 204 len: 0 microversion: 2.47 time: 0.371164 May 10 02:30:17.867001 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2195/4399] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:30:17 2022] DELETE /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:30:17.905613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:17.906640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:17.925009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.925923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:17.930347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:17.932078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:18.904657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:18.913628 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c4c033d-cfd0-483e-8e47-2e4fde0bfaf6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1670 microversion: 2.1 time: 1.680265 May 10 02:30:18.916685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2205/4400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:17 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1670 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:18.926979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:18.930387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:18.947200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:18.947922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:18.951765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:18.952655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:18.978636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.003162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.005305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.006690 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e54dfdfc-b9c4-4aa4-a365-8865d14136d0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.137370 May 10 02:30:19.007428 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2196/4401] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:17 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:19.017131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:19.024520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:19.039756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:19.041036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:19.042102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:19.042784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:19.313141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.314572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d94877c34a425a9994f00097d7f929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed15443f450f40dd9c0e79a399472ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.323211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.324889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:19.327799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53687793-7502-4c0a-b221-6386f28828e1 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 200 len: 1429 microversion: 2.1 time: 0.319192 May 10 02:30:19.342734 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c133a111-5f75-49f4-bc5e-c10f47324ecb tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1363 microversion: 2.47 time: 0.424169 May 10 02:30:19.345476 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2206/4402] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:18 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:19.348087 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2197/4403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:19 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 1429 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:19.548730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f44c1726-70ca-43e1-aab4-d1061e6634cf req-c58cd65d-34e9-4ca1-98d8-20b0d1cfcd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545625b9-077e-40f0-94da-4a06f63211d4", "name": "network-vif-deleted", "tag": "dd4ce761-1d0d-4719-a816-226368fbea00"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:19.600258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f44c1726-70ca-43e1-aab4-d1061e6634cf req-c58cd65d-34e9-4ca1-98d8-20b0d1cfcd65 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:19.601000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f44c1726-70ca-43e1-aab4-d1061e6634cf req-c58cd65d-34e9-4ca1-98d8-20b0d1cfcd65 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:19.635380 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f44c1726-70ca-43e1-aab4-d1061e6634cf req-c58cd65d-34e9-4ca1-98d8-20b0d1cfcd65 service nova] Creating event network-vif-deleted:dd4ce761-1d0d-4719-a816-226368fbea00 for instance 545625b9-077e-40f0-94da-4a06f63211d4 on n-h1-841089-2 May 10 02:30:19.650742 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f44c1726-70ca-43e1-aab4-d1061e6634cf req-c58cd65d-34e9-4ca1-98d8-20b0d1cfcd65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105020 May 10 02:30:19.653387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2207/4404] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:30:19.934251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:19.934899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:19.943951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:19.948130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:19.949561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:19.950033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:20.029158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:20.030721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:20.045326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:20.046137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:20.047209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:20.047923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:20.833872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:20.846521 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f09d1296-9173-40f9-8955-35236b48f563 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.916862 May 10 02:30:20.857743 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2198/4405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:19 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:20.862098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:20.864981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:20.882886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:20.883642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:20.888629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:20.889647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:20.907964 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 HTTP/1.1 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '545625b9-077e-40f0-94da-4a06f63211d4'} May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:20.917712 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:20.923522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:20.926310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:20.927482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-541feb68-fd58-43c8-898e-5c4971ae4d05 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 404 len: 111 microversion: 2.1 time: 0.070584 May 10 02:30:20.933545 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2199/4406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:20 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:20.947889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:20.970227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:20.976187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:20.979408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:20.979670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:20.984340 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f9933518-79a2-4694-9cd6-154553cb3bd4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.962104 May 10 02:30:21.000219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.000816 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2208/4407] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:20 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:21.006812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.007958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.008265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-408831757", "metadata": {"image_type": "test"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:21.009437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.010871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:21.024107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.027255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.029441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.033641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.102144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4/action HTTP/1.1 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 111 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-408831757", "metadata": {"image_type": "test"}}} May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '545625b9-077e-40f0-94da-4a06f63211d4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-408831757', 'metadata': {'image_type': 'test'}}}} May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:30:21.104535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa0ad503-6595-40cd-8221-68818e90e821 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "POST /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4/action" status: 404 len: 111 microversion: 2.1 time: 0.103954 May 10 02:30:21.116042 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2209/4408] 10.222.0.52 () {60 vars in 1278 bytes} [Tue May 10 02:30:21 2022] POST /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4/action => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:21.117249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-de545ce3-98df-4f4f-9381-06161834e641 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1451232229", "metadata": {"image_type": "test"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:21.119360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-de545ce3-98df-4f4f-9381-06161834e641 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Failed to fetch instance by id tempest-invalid-1704939740 {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:30:21.119360 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-de545ce3-98df-4f4f-9381-06161834e641 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance tempest-invalid-1704939740 could not be found. May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-de545ce3-98df-4f4f-9381-06161834e641 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/tempest-invalid-1704939740/action HTTP/1.1 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 112 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1451232229", "metadata": {"image_type": "test"}}} May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance tempest-invalid-1704939740 could not be found. May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'tempest-invalid-1704939740', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1451232229', 'metadata': {'image_type': 'test'}}}} May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1704939740 could not be found. May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:21.120633 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1704939740 could not be found. May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1704939740 could not be found. May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-de545ce3-98df-4f4f-9381-06161834e641 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance tempest-invalid-1704939740 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-de545ce3-98df-4f4f-9381-06161834e641 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "POST /compute/v2.1/servers/tempest-invalid-1704939740/action" status: 404 len: 101 microversion: 2.1 time: 0.009050 May 10 02:30:21.133919 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2210/4409] 10.222.0.52 () {60 vars in 1248 bytes} [Tue May 10 02:30:21 2022] POST /compute/v2.1/servers/tempest-invalid-1704939740/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:21.136323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d29cdb85-65c1-451c-a261-c0aecfdf4425 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1335110570"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:21.137300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d29cdb85-65c1-451c-a261-c0aecfdf4425 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:30:21.137818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d29cdb85-65c1-451c-a261-c0aecfdf4425 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d29cdb85-65c1-451c-a261-c0aecfdf4425 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 57 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: {"createImage": {"name": "tempest-test-snap-1335110570"}} May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1335110570'}}} May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.139403 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.144084 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.145603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d29cdb85-65c1-451c-a261-c0aecfdf4425 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:21.147158 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d29cdb85-65c1-451c-a261-c0aecfdf4425 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.014427 May 10 02:30:21.148301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2211/4410] 10.222.0.52 () {60 vars in 1274 bytes} [Tue May 10 02:30:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:21.159604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d652560-3302-4411-83f8-57d2e5c2271f tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1604144916"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:21.159837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.160231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.160960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lazy-loading 'fault' on Instance uuid bac75877-84a8-4755-9620-ae4774b736f5 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:30:21.162104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0d652560-3302-4411-83f8-57d2e5c2271f tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:30:21.163936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0d652560-3302-4411-83f8-57d2e5c2271f tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d652560-3302-4411-83f8-57d2e5c2271f tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 57 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: {"createImage": {"name": "tempest-test-snap-1604144916"}} May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1604144916'}}} May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.166373 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 10 02:30:21.170965 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.178002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d652560-3302-4411-83f8-57d2e5c2271f tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:21.179258 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d652560-3302-4411-83f8-57d2e5c2271f tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.024150 May 10 02:30:21.180398 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2212/4411] 10.222.0.52 () {60 vars in 1280 bytes} [Tue May 10 02:30:21 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:21.190874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:21.192753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:21.216490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.217216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.218292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.225532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.251894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 HTTP/1.1 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '545625b9-077e-40f0-94da-4a06f63211d4'} May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:21.257703 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.262292 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.269096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:21.270372 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b55919f-2ccb-4046-948e-26c56c934871 tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "DELETE /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 404 len: 111 microversion: 2.1 time: 0.084740 May 10 02:30:21.272028 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2213/4412] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:30:21 2022] DELETE /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:21.294052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:21.294693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] [instance: 545625b9-077e-40f0-94da-4a06f63211d4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:21.314769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.315280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.316106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:21.316537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:21.353818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:21.354415 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] HTTP exception thrown: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Request method failure captured: May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 HTTP/1.1 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4cyw4ANXTUPjPGlEsAJpNIGQDEaijOqnvw2IQ57xQnKzyBzt5CISaufC9CVS1EGKGGqDrRul-HKDIi3XXEHzJ9jemSfR5mfrJFPRemb5NeAgJ7eHRYkWHe1ZVQlneFGcOQ94HqHeWzZc2lRD_g7q5RPEbsm9nJVkIbZ0tL6rcpLiU May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed15443f450f40dd9c0e79a399472ad7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed15443f450f40dd9c0e79a399472ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ed15443f450f40dd9c0e79a399472ad7 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-466418216 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 97d94877c34a425a9994f00097d7f929 May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ImagesNegativeTestJSON-466418216-project May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '545625b9-077e-40f0-94da-4a06f63211d4'} May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:21.356281 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. May 10 02:30:21.361130 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:21.365795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] Returning 404 to user: Instance 545625b9-077e-40f0-94da-4a06f63211d4 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:21.365976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:21.370009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44213df1-54ea-4307-956f-2929559ad2cf tempest-ImagesNegativeTestJSON-466418216 tempest-ImagesNegativeTestJSON-466418216-project] 10.222.0.52 "GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4" status: 404 len: 111 microversion: 2.1 time: 0.085328 May 10 02:30:21.381955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:21.393598 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2214/4413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:21 2022] GET /compute/v2.1/servers/545625b9-077e-40f0-94da-4a06f63211d4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:21.402205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-05e202e9-8f59-443a-9cd9-28153f9e6d88 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 200 len: 1368 microversion: 2.47 time: 0.463877 May 10 02:30:21.409614 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2200/4414] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:20 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 1368 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:22.005996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:22.007080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:22.039683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.042479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.044488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.048242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.431954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:22.434881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: bac75877-84a8-4755-9620-ae4774b736f5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:22.448000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.455041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.456566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.457132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.565527 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] HTTP exception thrown: Instance bac75877-84a8-4755-9620-ae4774b736f5 could not be found. May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Request method failure captured: May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 HTTP/1.1 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec4HdC9O8n-4GOc2JXr2KQoXgOcjA11rbI2GSqUtSOSdh_ULqVKhmfhNe3YgHChBh_XK7LpkGHMr-Qao028wHoJOk--fdEG3GqtnoNjbOnTU6zGJirFPcQljX03oL-MSlcb6EJGolGEZW_h57oI4vKsvda_zG7QZpiTOUpj0vo90F64 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.47 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: b376ac8e1b1c488da461a1f7137cabaa May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerShowV247Test-836149435 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b376ac8e1b1c488da461a1f7137cabaa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b376ac8e1b1c488da461a1f7137cabaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b376ac8e1b1c488da461a1f7137cabaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b376ac8e1b1c488da461a1f7137cabaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerShowV247Test-836149435 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: b376ac8e1b1c488da461a1f7137cabaa May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerShowV247Test-836149435 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerShowV247Test-836149435-project May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f16bcad42a154386b55d709a23506d91 May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerShowV247Test-836149435-project May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance bac75877-84a8-4755-9620-ae4774b736f5 could not be found. May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'bac75877-84a8-4755-9620-ae4774b736f5'} May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac75877-84a8-4755-9620-ae4774b736f5 could not be found. May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac75877-84a8-4755-9620-ae4774b736f5 could not be found. May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:22.575819 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac75877-84a8-4755-9620-ae4774b736f5 could not be found. May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:22.581622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Returning 404 to user: Instance bac75877-84a8-4755-9620-ae4774b736f5 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:22.584376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3927055f-ab8c-4f03-bc7e-c361ad747dbe tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5" status: 404 len: 111 microversion: 2.47 time: 0.149296 May 10 02:30:22.589380 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2201/4415] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:22 2022] GET /compute/v2.1/servers/bac75877-84a8-4755-9620-ae4774b736f5 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:30:22.606040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:22.620090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:22.623305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:22.625879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:22.630248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:22.639729 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-856c9743-696e-4a03-a6d2-d13c88a7aafc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.639561 May 10 02:30:22.640691 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2215/4416] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:21 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:22.649823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.653839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.654968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.659192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.728808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:30:22.910374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00eb86a1-9ac4-4080-b0c3-570e64c1ea2d tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2" status: 204 len: 0 microversion: 2.47 time: 0.316504 May 10 02:30:22.926194 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2202/4417] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:30:22 2022] DELETE /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:30:22.939629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:22.940379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:22.960544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.961017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:22.962374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:22.962837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:23.298973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:23.315952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:23.317494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:23.318841 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a998cd5c-0322-4c7d-bb66-a84e191b1226 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2" status: 200 len: 1362 microversion: 2.47 time: 0.391425 May 10 02:30:23.340594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2216/4418] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:22 2022] GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:23.662616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:23.663911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:23.682418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:23.683098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:23.684070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:23.684688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:24.286405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:24.296415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:24.297952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:24.299220 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-695fed3a-53ac-4b87-95e8-ad0d99006c66 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.641427 May 10 02:30:24.299804 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2203/4419] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:23 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:24.341281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:24.341925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:24.363248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:24.367103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:24.370326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:24.372011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:24.589046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:24.605533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:24.608881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:24.613667 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d9854f6-9846-4a09-b5de-34ede89c1e9e tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2" status: 200 len: 1362 microversion: 2.47 time: 0.277791 May 10 02:30:24.617298 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2217/4420] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:24 2022] GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:24.722372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-664b5137-7f1c-48e2-9817-469979b8b7fc tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d35e51d30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi9Wjh3Yuu2EZyeTcCYcotutBu7S4ul66ptRek4nE9r4WQQEryuk/z7JT3zBLxrZpTtxiEpS5TOTjmBq0qCI4HiNOt8fuWNWvv1oj0ehl2Zz7bJxo03SO6e2KTLde3pg=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:24.727997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-664b5137-7f1c-48e2-9817-469979b8b7fc tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-664b5137-7f1c-48e2-9817-469979b8b7fc tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 257 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi9Wjh3Yuu2EZyeTcCYcotutBu7S4ul66ptRek4nE9r4WQQEryuk/z7JT3zBLxrZpTtxiEpS5TOTjmBq0qCI4HiNOt8fuWNWvv1oj0ehl2Zz7bJxo03SO6e2KTLde3pg=="}} May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi9Wjh3Yuu2EZyeTcCYcotutBu7S4ul66ptRek4nE9r4WQQEryuk/z7JT3zBLxrZpTtxiEpS5TOTjmBq0qCI4HiNOt8fuWNWvv1oj0ehl2Zz7bJxo03SO6e2KTLde3pg=='}}} May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6643, in import_key_pair May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in _validate_new_key_pair May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:24.739171 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 10 02:30:24.744856 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:24.749428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-664b5137-7f1c-48e2-9817-469979b8b7fc tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:24.750518 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-664b5137-7f1c-48e2-9817-469979b8b7fc tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.293816 May 10 02:30:24.751789 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2204/4421] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:30:24 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:30:24.762412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d360e9af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1465130421", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:24.803399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:24.809390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for user b8fce19f87a64f4ca3c5d33a00784f8f and project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:24.860358 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 2167 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1465130421", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:24.876859 n-d-841089-2 devstack@n-api.service[118716]: exception: Keypair data is invalid: failed to generate fingerprint May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1465130421', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6660, in import_key_pair May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6733, in _generate_fingerprint May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:24.879660 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 10 02:30:24.882488 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:24.887844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:24.889665 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ef2251e8-d4c6-4ea2-974b-afc39fd3a331 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.133033 May 10 02:30:24.891389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2218/4422] 10.222.0.52 () {60 vars in 1159 bytes} [Tue May 10 02:30:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:30:24.904629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75fc87e7-0889-4e92-a180-2c415b6a2c93 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d35e98b80>, body: {"keypair": {"name": "tempest-keypair-73551557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK71WhRmbwee14hPhlxmcbp22fxhYQEGUdM4jYlu2seLY/N+I8faV6FDjdPshBl+qcwlTNuF615s0SL59PeeDOfDhem12oziy+XXBl9UumBQippc6y4EXPcXDKhsrL9kxA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:24.935264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-75fc87e7-0889-4e92-a180-2c415b6a2c93 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:24.943594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-75fc87e7-0889-4e92-a180-2c415b6a2c93 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for user b8fce19f87a64f4ca3c5d33a00784f8f and project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:25.019581 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75fc87e7-0889-4e92-a180-2c415b6a2c93 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.119496 May 10 02:30:25.020999 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2205/4423] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:30:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:30:25.034667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d361f1940>, body: {"keypair": {"name": "tempest-keypair-73551557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSorUdRAtKopqhxgJdEEWrDmZc9izupvLfPCp5OFdgH6anQjSH3OBR83qVp70q+jKa8FeOiyySFDrW0qjmiIKcl+qiLgYjNPYBmes9qtnQoaEgYPmky51yKdVCFM7Ep/Q=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:25.060808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:25.066912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for user b8fce19f87a64f4ca3c5d33a00784f8f and project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:25.103392 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] HTTP exception thrown: Key pair 'tempest-keypair-73551557' already exists. May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 271 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: {"keypair": {"name": "tempest-keypair-73551557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSorUdRAtKopqhxgJdEEWrDmZc9izupvLfPCp5OFdgH6anQjSH3OBR83qVp70q+jKa8FeOiyySFDrW0qjmiIKcl+qiLgYjNPYBmes9qtnQoaEgYPmky51yKdVCFM7Ep/Q=="}} May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: exception: Key pair 'tempest-keypair-73551557' already exists. May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-73551557', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSorUdRAtKopqhxgJdEEWrDmZc9izupvLfPCp5OFdgH6anQjSH3OBR83qVp70q+jKa8FeOiyySFDrW0qjmiIKcl+qiLgYjNPYBmes9qtnQoaEgYPmky51yKdVCFM7Ep/Q=='}}} May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = self._query(query) May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi conn.query(q) May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result.read() May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b8fce19f87a64f4ca3c5d33a00784f8f-tempest-keypair-73551557' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 10 02:30:25.244822 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi session.flush() May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._flush(objects) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi compat.raise_( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi flush_context.execute() May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi rec.execute(self) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = self._query(query) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi conn.query(q) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result.read() May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 10 02:30:25.249186 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b8fce19f87a64f4ca3c5d33a00784f8f-tempest-keypair-73551557' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 10, 2, 30, 25, 94945), 'updated_at': None, 'name': 'tempest-keypair-73551557', 'user_id': 'b8fce19f87a64f4ca3c5d33a00784f8f', 'fingerprint': '0f:2a:28:ae:dd:8b:85:db:6b:72:6f:fe:13:10:fe:43', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSorUdRAtKopqhxgJdEEWrDmZc9izupvLfPCp5OFdgH6anQjSH3OBR83qVp70q+jKa8FeOiyySFDrW0qjmiIKcl+qiLgYjNPYBmes9qtnQoaEgYPmky51yKdVCFM7Ep/Q==', 'type': 'ssh'}] May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6663, in import_key_pair May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi keypair.create() May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._create() May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-73551557' already exists. May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 10 02:30:25.254489 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-73551557' already exists. May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-73551557' already exists. May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 409 to user: Key pair 'tempest-keypair-73551557' already exists. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c85e0da-a4d1-498a-90fc-762a078e5167 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.224459 May 10 02:30:25.262549 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2219/4424] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:30:25 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 02:30:25.268702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c28fb5c-1eaf-4fc2-b1e2-b3223761f49f tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Calling method '.version_select at 0x7f3d366d8dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:25.295507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c28fb5c-1eaf-4fc2-b1e2-b3223761f49f tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73551557" status: 202 len: 0 microversion: 2.1 time: 0.030519 May 10 02:30:25.302917 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2206/4425] 10.222.0.52 () {58 vars in 1214 bytes} [Tue May 10 02:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73551557 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:30:25.308445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e10cdc3b-9113-4caf-ad4e-a719043c8401 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d35f31f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7DIPWQqwiRC9wMzlKqtQPXh6san/53ExkcgPooWrJgGJexZF3cofW2XFdEJVUgFc31IWNAE7RpFdXMKMoXljYBlK7LlppsaWB+AMkg0f7CXMR3rSj9ripKffna4/O9iw=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e10cdc3b-9113-4caf-ad4e-a719043c8401 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 247 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7DIPWQqwiRC9wMzlKqtQPXh6san/53ExkcgPooWrJgGJexZF3cofW2XFdEJVUgFc31IWNAE7RpFdXMKMoXljYBlK7LlppsaWB+AMkg0f7CXMR3rSj9ripKffna4/O9iw=="}} May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute name. Value: . '' is too short May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7DIPWQqwiRC9wMzlKqtQPXh6san/53ExkcgPooWrJgGJexZF3cofW2XFdEJVUgFc31IWNAE7RpFdXMKMoXljYBlK7LlppsaWB+AMkg0f7CXMR3rSj9ripKffna4/O9iw=='}}} May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '' May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:30:25.311091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e10cdc3b-9113-4caf-ad4e-a719043c8401 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e10cdc3b-9113-4caf-ad4e-a719043c8401 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008092 May 10 02:30:25.321412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2220/4426] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:30:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:30:25.331291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d35f31b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1766757195", "public_key": " "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:25.348154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:25.348552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:25.364664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:25.365137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:25.365949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:25.366413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:25.367620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:25.384119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for user b8fce19f87a64f4ca3c5d33a00784f8f and project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:25.453439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 95 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1766757195", "public_key": " "}} May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: exception: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1766757195', 'public_key': ' '}}} May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6660, in import_key_pair May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6733, in _generate_fingerprint May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.461129 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89cb1f55-2796-4c2a-a2b1-255412531f0a tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.141014 May 10 02:30:25.470366 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2221/4427] 10.222.0.52 () {60 vars in 1157 bytes} [Tue May 10 02:30:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:30:25.485421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da41dc97-a08f-412d-9515-229f70f346c2 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d360fa820>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5Wpsfch8M3VTOTxGBpzxPO58ZDg3wMjw6hywOP5ANpLOhIyJ2lzmXIUXuIYE6g5D60lUlOybYr8yFjy/nHkHDu78oz25k54RNWz+Eo0SgdR2du2nO61Dk9KIQivo/twQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da41dc97-a08f-412d-9515-229f70f346c2 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 507 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5Wpsfch8M3VTOTxGBpzxPO58ZDg3wMjw6hywOP5ANpLOhIyJ2lzmXIUXuIYE6g5D60lUlOybYr8yFjy/nHkHDu78oz25k54RNWz+Eo0SgdR2du2nO61Dk9KIQivo/twQ=="}} May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5Wpsfch8M3VTOTxGBpzxPO58ZDg3wMjw6hywOP5ANpLOhIyJ2lzmXIUXuIYE6g5D60lUlOybYr8yFjy/nHkHDu78oz25k54RNWz+Eo0SgdR2du2nO61Dk9KIQivo/twQ=='}}} May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 10 02:30:25.488061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da41dc97-a08f-412d-9515-229f70f346c2 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-da41dc97-a08f-412d-9515-229f70f346c2 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009288 May 10 02:30:25.491973 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2222/4428] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:30:25 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:30:25.503462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Action: 'create', calling method: .version_select at 0x7f3d360fadc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1384074449", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:25.520612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:25.527563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Getting quotas for user b8fce19f87a64f4ca3c5d33a00784f8f and project e8a95f9437304077aa44177db864fab3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:25.550930 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 118 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1384074449", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: exception: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1384074449', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6660, in import_key_pair May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6733, in _generate_fingerprint May 10 02:30:25.555353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-83718e01-cf12-4e0f-b45c-205c65bdfa13 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.061462 May 10 02:30:25.563600 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2223/4429] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:30:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 10 02:30:25.574038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a4fc67d-775f-4d6a-954d-fd3ec5eab477 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Calling method '.version_select at 0x7f3d35f31af0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:25.610170 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9a4fc67d-775f-4d6a-954d-fd3ec5eab477 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-556386378 not found for user b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a4fc67d-775f-4d6a-954d-fd3ec5eab477 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Request method failure captured: May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-556386378 HTTP/1.1 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5A-DlMjTOnojoGoCeUC7hewuurXBnQQOiHPBChsE7qL3E-6KVlT_E6e4FLmzL-JpodNT1xpMoNVRP711-3alB7_5xyqq0KMYzyOkINn9pHLw5TI_AJlXEBmXZt85Me8mS6RZrUaKch3v0N1D0zvbNyK-2eicEA2rKeDDiA6V6flHs May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e8a95f9437304077aa44177db864fab3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e8a95f9437304077aa44177db864fab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e8a95f9437304077aa44177db864fab3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e8a95f9437304077aa44177db864fab3 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1777090010 May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1777090010-project May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: exception: Keypair tempest-keypair-non-existent-556386378 not found for user b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'tempest-keypair-non-existent-556386378'} May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.force_reraise() May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise self.value May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6747, in delete_key_pair May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6768, in get_key_pair May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-556386378 not found for user b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.616078 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-556386378 not found for user b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-556386378 not found for user b8fce19f87a64f4ca3c5d33a00784f8f May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a4fc67d-775f-4d6a-954d-fd3ec5eab477 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] Returning 404 to user: Keypair tempest-keypair-non-existent-556386378 not found for user b8fce19f87a64f4ca3c5d33a00784f8f {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9a4fc67d-775f-4d6a-954d-fd3ec5eab477 tempest-KeyPairsNegativeTestJSON-1777090010 tempest-KeyPairsNegativeTestJSON-1777090010-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-556386378" status: 404 len: 144 microversion: 2.1 time: 0.051520 May 10 02:30:25.624755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2224/4430] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 02:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-556386378 => generated 144 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:25.636684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:25.637307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:25.652072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:25.652538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:25.656933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:25.660006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:25.749946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:25.751442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:25.753629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lazy-loading 'fault' on Instance uuid 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:30:25.824768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:25.863501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:25.865500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:25.867114 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-366fe6cf-9291-4502-8428-be1441eb0d03 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.552820 May 10 02:30:25.868811 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2207/4431] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:25 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:25.917911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:25.936286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:25.947730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f16bcad42a154386b55d709a23506d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b376ac8e1b1c488da461a1f7137cabaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:25.950436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eadb9134-9ad3-4601-bf0a-a36b3a2b9e98 tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2" status: 200 len: 1367 microversion: 2.47 time: 0.320318 May 10 02:30:25.966181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2225/4432] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:25 2022] GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:30:26.887598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:26.888764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:26.899967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:26.903874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:26.904911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:26.907079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:26.971557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:26.986231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] [instance: 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:26.993643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:27.004555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:27.010664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:27.011382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:27.063040 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] HTTP exception thrown: Instance 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 could not be found. May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Request method failure captured: May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 HTTP/1.1 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec4HdC9O8n-4GOc2JXr2KQoXgOcjA11rbI2GSqUtSOSdh_ULqVKhmfhNe3YgHChBh_XK7LpkGHMr-Qao028wHoJOk--fdEG3GqtnoNjbOnTU6zGJirFPcQljX03oL-MSlcb6EJGolGEZW_h57oI4vKsvda_zG7QZpiTOUpj0vo90F64 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.47 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: b376ac8e1b1c488da461a1f7137cabaa May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerShowV247Test-836149435 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b376ac8e1b1c488da461a1f7137cabaa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b376ac8e1b1c488da461a1f7137cabaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b376ac8e1b1c488da461a1f7137cabaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b376ac8e1b1c488da461a1f7137cabaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerShowV247Test-836149435 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: b376ac8e1b1c488da461a1f7137cabaa May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerShowV247Test-836149435 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerShowV247Test-836149435-project May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: f16bcad42a154386b55d709a23506d91 May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerShowV247Test-836149435-project May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 could not be found. May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2'} May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 could not be found. May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 could not be found. May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:27.067014 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 could not be found. May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] Returning 404 to user: Instance 2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:27.079952 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c219d7d4-f5cf-4506-90b7-0ff47ccf036b tempest-ServerShowV247Test-836149435 tempest-ServerShowV247Test-836149435-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2" status: 404 len: 111 microversion: 2.47 time: 0.109655 May 10 02:30:27.086231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2226/4433] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:26 2022] GET /compute/v2.1/servers/2ae4f7c1-5a00-4109-86ef-14a1c81ba3f2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:30:28.016145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:28.036755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:28.038698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:28.043979 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ec5aef6-a4ae-4168-a9d0-17e9661b71d4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.161041 May 10 02:30:28.049693 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2208/4434] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:26 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:29.065823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:29.067055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:29.083482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:29.086274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:29.090463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:29.092269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:29.777342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-387416407", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": "none"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:29.904759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:30:29.905425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:30:29.906211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:30:29.907138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:30:29.914171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:30:29.939471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:29.941289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:29.950490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:29.951360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:29.971298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:29.991619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:29.995474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Getting quotas for project 1627caccd0424135912294ed1fdbcfd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:29.999831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:30.001319 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2ff6219-4a84-4eec-ae1e-6311658f1f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 0.941128 May 10 02:30:30.008323 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2227/4435] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:29 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:30.012812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Getting quotas for user a5e436b9d8c04d29bb579c7f7c09644d and project 1627caccd0424135912294ed1fdbcfd5. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:30.040513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:30:30.046836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:30:30.137606 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7f8233d1-7c62-458a-8e81-d947913b7cbc tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.747027 May 10 02:30:30.138922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2209/4436] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:30:30.149295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71a081fd-af2a-42b5-b1db-f067b558a0d0 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:30.150974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71a081fd-af2a-42b5-b1db-f067b558a0d0 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:30.300258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71a081fd-af2a-42b5-b1db-f067b558a0d0 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:30.315166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71a081fd-af2a-42b5-b1db-f067b558a0d0 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:30.317001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71a081fd-af2a-42b5-b1db-f067b558a0d0 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:30.318375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71a081fd-af2a-42b5-b1db-f067b558a0d0 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1280 microversion: 2.47 time: 0.172970 May 10 02:30:30.330691 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2228/4437] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:30 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:31.030013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:31.030758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:31.068027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:31.074506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:31.075578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:31.076215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:31.340762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:31.342200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:31.369880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:31.371188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:31.372376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:31.373061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:31.929564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:31.947266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:31.955232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:31.957481 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f2412f3-61b5-4ed4-9323-abf45889e9ba tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1284 microversion: 2.47 time: 0.623936 May 10 02:30:31.958890 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2229/4438] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:31 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1284 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:32.440342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:32.454150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:32.456860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:32.465321 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c49c3efe-7426-48a4-9f54-1f650f9338da tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.441247 May 10 02:30:32.466580 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2210/4439] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:31 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:32.609531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5fb5c74-001d-41ad-8a9d-2f28a1d4522e tempest-ExtensionsTest-1164308116 tempest-ExtensionsTest-1164308116-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:32.616520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c5fb5c74-001d-41ad-8a9d-2f28a1d4522e tempest-ExtensionsTest-1164308116 tempest-ExtensionsTest-1164308116-project] 10.222.0.52 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.265054 May 10 02:30:32.621221 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2230/4440] 10.222.0.52 () {58 vars in 1169 bytes} [Tue May 10 02:30:32 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:30:32.631677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b47dbec-6de3-44ae-a466-770a5fd31568 tempest-ExtensionsTest-1164308116 tempest-ExtensionsTest-1164308116-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:32.634217 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b47dbec-6de3-44ae-a466-770a5fd31568 tempest-ExtensionsTest-1164308116 tempest-ExtensionsTest-1164308116-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006351 May 10 02:30:32.666163 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2211/4441] 10.222.0.52 () {58 vars in 1133 bytes} [Tue May 10 02:30:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:30:32.979051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:32.979988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:32.992154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:32.994801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:32.997021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:32.999717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:33.167736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:33.184409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:33.190735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:33.200950 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3a26b87-acc1-4a3a-a0b6-8b6ca6f9e47f tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1338 microversion: 2.47 time: 0.223781 May 10 02:30:33.203720 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2231/4442] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:32 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1338 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:33.485108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:33.485893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:33.495867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:33.506418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:33.507558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:33.508622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:34.224659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:34.225401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:34.254866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:34.258928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:34.266118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:34.269981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:34.434204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:34.473403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:34.478901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:34.485828 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1cdde927-63be-45a5-a2e5-fe176db2593c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1891 microversion: 2.32 time: 1.001913 May 10 02:30:34.517006 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2212/4443] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:33 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1891 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:34.606590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:34.620068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:34.628016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:34.629244 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e250d1a2-2e3e-4b6a-baa0-6b9cb2b3db48 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1338 microversion: 2.47 time: 0.412066 May 10 02:30:34.632296 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2232/4444] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:34 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1338 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:30:34.885704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:34.886835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:34.947271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:34.952697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:34.954833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:34.956413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:35.020736 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] HTTP exception thrown: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Request method failure captured: May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 HTTP/1.1 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecw3w7Rk_2R3GrdT9k-QjXe1FcXkw9hIoh_9SUBgwsudEOtJnPaJUlBCPhzmkyH4hFfhm9Im568VLrGl1rHKMJ80kQ62e-NwSL9c9Bkj5OlSy1BgBajndTTXog5FZ-OkMGxoaL_s3AUsr3Z1Ss2ms2D__7aTOlRl_eb3XZKZeuRHdbE May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_300f71d3f6b34fa1a787c5e0f10788db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1d0edd300fe34f92a9e265863d12718a May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6675fb3c-50fc-4c49-bd0f-e9f6f68f4467'} May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:35.028356 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.032983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:35.050855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Returning 404 to user: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:35.056082 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d0b7736-a7cd-4d13-ba1b-58d0ac000d3d tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 404 len: 111 microversion: 2.1 time: 0.194604 May 10 02:30:35.073904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:35.074213 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2213/4445] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:30:34 2022] DELETE /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:35.074545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:35.091155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:35.118352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:35.119358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:35.119826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:35.219874 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] HTTP exception thrown: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Request method failure captured: May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 HTTP/1.1 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecw3w7Rk_2R3GrdT9k-QjXe1FcXkw9hIoh_9SUBgwsudEOtJnPaJUlBCPhzmkyH4hFfhm9Im568VLrGl1rHKMJ80kQ62e-NwSL9c9Bkj5OlSy1BgBajndTTXog5FZ-OkMGxoaL_s3AUsr3Z1Ss2ms2D__7aTOlRl_eb3XZKZeuRHdbE May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_300f71d3f6b34fa1a787c5e0f10788db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1d0edd300fe34f92a9e265863d12718a May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6675fb3c-50fc-4c49-bd0f-e9f6f68f4467'} May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:35.223925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. May 10 02:30:35.229685 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:35.234161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Returning 404 to user: Instance 6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:35.239288 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c5faedd3-11c7-42db-88ce-8fd561e813ac tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467" status: 404 len: 111 microversion: 2.1 time: 0.170629 May 10 02:30:35.247301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2233/4446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:35 2022] GET /compute/v2.1/servers/6675fb3c-50fc-4c49-bd0f-e9f6f68f4467 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:35.531015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:35.532416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:35.566005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:35.569612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:35.575216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:35.576670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:35.650946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:35.654506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:35.665737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:35.668634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:35.669712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:35.670342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:36.010346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:36.024008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:36.041263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:36.044493 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-089df035-ce8d-4f20-b1cb-68ba578f6aea tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1359 microversion: 2.47 time: 0.398594 May 10 02:30:36.053145 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2234/4447] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:35 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:30:36.076510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-156791704"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:36.077712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:36.108493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:36.108971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:36.112046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:36.115268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:36.829141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:36.847736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:36.855235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:36.860512 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a2fde37-6c65-4dd7-9489-96befc1de836 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 1.332677 May 10 02:30:36.873599 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2214/4448] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:35 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:37.061713 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3ae05f4-82d8-48fa-b964-7ff62d1dcda7 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "POST /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0/action" status: 202 len: 52 microversion: 2.47 time: 0.995694 May 10 02:30:37.067856 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2235/4449] 10.222.0.52 () {62 vars in 1318 bytes} [Tue May 10 02:30:36 2022] POST /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0/action => generated 52 bytes in 1003 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 10 02:30:37.078588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:37.080548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:37.096254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:37.106669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:37.109609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:37.112032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:37.174767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:30:37.376107 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-318cf816-0ac7-4912-a723-d976e0f2f768 tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 204 len: 0 microversion: 2.47 time: 0.301908 May 10 02:30:37.384278 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2215/4450] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:30:37 2022] DELETE /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:30:37.390868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:37.391844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:37.403520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:37.404237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:37.405210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:37.407700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:37.727851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:37.746919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:37.748866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:37.755869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98aeb9c3-e540-4d0d-bfe8-8d5d518bb30a tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1365 microversion: 2.47 time: 0.368527 May 10 02:30:37.768427 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2236/4451] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:37 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:37.888095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:37.889494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:37.896759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:37.903463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:37.906486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:37.912957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:38.380398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:38.408632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:38.412319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:38.413810 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-be20f6d3-0948-49ee-a702-bb573319b79c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.536898 May 10 02:30:38.419985 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2216/4452] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:37 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:38.775572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:38.776809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:38.792771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:38.794313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:38.795350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:38.800897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:38.984628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:39.002894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:39.020602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:39.021869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f99e5039-ce22-43b1-a6f9-80dac8921fed tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1365 microversion: 2.47 time: 0.250589 May 10 02:30:39.022444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2237/4453] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:38 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:39.440912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:39.441694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:39.467881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:39.477662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:39.488747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:39.494414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:40.047144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:40.048344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:40.065549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:40.066024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:40.066839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:40.067323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:40.444973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:40.458971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:40.464381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:40.466176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5e436b9d8c04d29bb579c7f7c09644d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1627caccd0424135912294ed1fdbcfd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:40.473711 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a58605e-0e1d-4f99-8d78-b20323a8cd4b tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 200 len: 1365 microversion: 2.47 time: 0.429820 May 10 02:30:40.474397 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2238/4454] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:40 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:40.490359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:40.495152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:40.502803 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fbab1301-751b-4e5d-96be-fd7416cac97b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 1.063890 May 10 02:30:40.506479 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2217/4455] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:39 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:41.526449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:41.527905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] [instance: 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:41.532821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:41.533573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:41.560579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:41.568055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:41.569724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:41.569954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:41.572061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:41.572522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:41.577756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:41.582291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:41.642669 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] HTTP exception thrown: Instance 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 could not be found. May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Request method failure captured: May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 HTTP/1.1 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5FaYrwbs7KLGcAXYbFgBJXhyYGX3w69rWlKVkNkpnGU573jjD4M0qjBbs4DnDAshYchu-caqnCTHgf_bnQybW82rrrTR6-lXE2e_GKmq5EVEE6fZBs1gfEH3A2ghhArN6K-hOKVxeqyqWlseVrM5365F26j7q5ayODWtJs8azq7sk May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.47 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 1627caccd0424135912294ed1fdbcfd5 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAaction247Test-1310537577 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1627caccd0424135912294ed1fdbcfd5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1627caccd0424135912294ed1fdbcfd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1627caccd0424135912294ed1fdbcfd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1627caccd0424135912294ed1fdbcfd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAaction247Test-1310537577 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 1627caccd0424135912294ed1fdbcfd5 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAaction247Test-1310537577 May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAaction247Test-1310537577-project May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: a5e436b9d8c04d29bb579c7f7c09644d May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAaction247Test-1310537577-project May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 could not be found. May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0'} May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 could not be found. May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 could not be found. May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:41.644332 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 could not be found. May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] Returning 404 to user: Instance 1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f323dec-c209-4c03-909a-2b9778ffa20c tempest-ServersAaction247Test-1310537577 tempest-ServersAaction247Test-1310537577-project] 10.222.0.52 "GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0" status: 404 len: 111 microversion: 2.47 time: 0.150116 May 10 02:30:41.650465 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2239/4456] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:41 2022] GET /compute/v2.1/servers/1c5d4fdd-5a16-4857-aa7d-8e52c6e678e0 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:30:42.609267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:42.619015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:42.627729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:42.628983 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b69b383d-c0ab-49c1-8e6b-dd3139c75ab3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 1.104652 May 10 02:30:42.629568 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2218/4457] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:41 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:43.647751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:43.648470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:43.665296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:43.665815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:43.666862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:43.669346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:44.700410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:44.714372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:44.717720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:44.722704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e7b0385-c3da-4eb3-88cd-6940ab986b52 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 1.077164 May 10 02:30:44.736061 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2240/4458] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:43 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:45.745608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:45.746439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:45.766195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:45.769782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:45.770807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:45.776943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:46.247850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:46.269321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:46.271734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:46.273400 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-495cf44b-f7dd-4457-b777-c9ceab3ad3c4 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.534267 May 10 02:30:46.274890 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2219/4459] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:45 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:46.667250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:46.667721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:46.686719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:46.687211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:46.688010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:46.688529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:46.708159 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] HTTP exception thrown: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Request method failure captured: May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f HTTP/1.1 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiecw3w7Rk_2R3GrdT9k-QjXe1FcXkw9hIoh_9SUBgwsudEOtJnPaJUlBCPhzmkyH4hFfhm9Im568VLrGl1rHKMJ80kQ62e-NwSL9c9Bkj5OlSy1BgBajndTTXog5FZ-OkMGxoaL_s3AUsr3Z1Ss2ms2D__7aTOlRl_eb3XZKZeuRHdbE May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_300f71d3f6b34fa1a787c5e0f10788db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1d0edd300fe34f92a9e265863d12718a May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f'} May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:46.709747 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:30:46.715051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Returning 404 to user: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:46.723313 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ad1a464-e568-41fa-a87e-80847335bb9b tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 404 len: 111 microversion: 2.1 time: 0.048795 May 10 02:30:46.723948 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2241/4460] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:30:46 2022] DELETE /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:30:46.732746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:46.733826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] [instance: eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:46.741448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:46.744931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:46.746341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:46.749072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:46.782195 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] HTTP exception thrown: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Request method failure captured: May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f HTTP/1.1 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiecw3w7Rk_2R3GrdT9k-QjXe1FcXkw9hIoh_9SUBgwsudEOtJnPaJUlBCPhzmkyH4hFfhm9Im568VLrGl1rHKMJ80kQ62e-NwSL9c9Bkj5OlSy1BgBajndTTXog5FZ-OkMGxoaL_s3AUsr3Z1Ss2ms2D__7aTOlRl_eb3XZKZeuRHdbE May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_300f71d3f6b34fa1a787c5e0f10788db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/300f71d3f6b34fa1a787c5e0f10788db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 300f71d3f6b34fa1a787c5e0f10788db May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1516735498 May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1d0edd300fe34f92a9e265863d12718a May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeTestJSON-1516735498-project May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f'} May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:30:46.783991 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] Returning 404 to user: Instance eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b75e00fd-f720-481a-8bbc-f0c492d27faf tempest-AttachVolumeTestJSON-1516735498 tempest-AttachVolumeTestJSON-1516735498-project] 10.222.0.52 "GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f" status: 404 len: 111 microversion: 2.1 time: 0.062052 May 10 02:30:46.835627 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2220/4461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:46 2022] GET /compute/v2.1/servers/eb6fe63b-42cb-48d4-b64f-4bb9fd20be1f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:30:47.297325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:47.298117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:47.319534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:47.320105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:47.321654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:47.322245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:47.556804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-36287110", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "ebc54d08-fc65-44f0-bfe2-60d6f1cc3bae"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:47.635770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] validate_networks() for [('ebc54d08-fc65-44f0-bfe2-60d6f1cc3bae', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:30:47.745341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:47.755257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:47.761102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:47.762320 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbb9ffa2-bbfb-4748-a009-8e3a3a3559f1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.469105 May 10 02:30:47.780887 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2221/4462] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:47 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:48.101076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:30:48.102396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:30:48.102879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:30:48.103364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:30:48.103763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:30:48.121692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:48.122310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:48.123675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:48.125666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:48.155957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Getting quotas for project 6d4ea53be9904fe5bad20c770784f55d. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:48.164162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Getting quotas for user 0efdd8f24dca4b7fbb59e73b75a7dbb0 and project 6d4ea53be9904fe5bad20c770784f55d. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:48.182783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:30:48.186201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:30:48.262566 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea92c078-1ea5-4a89-8734-0fa9ed153a13 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974296 May 10 02:30:48.264167 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2242/4463] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:30:48.274062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a55ccaf0-ceb6-41b5-a10d-c4dfbfce0c85 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:48.274695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a55ccaf0-ceb6-41b5-a10d-c4dfbfce0c85 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:48.399435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a55ccaf0-ceb6-41b5-a10d-c4dfbfce0c85 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:48.416036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a55ccaf0-ceb6-41b5-a10d-c4dfbfce0c85 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1223 microversion: 2.1 time: 0.145827 May 10 02:30:48.418958 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2222/4464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:48 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:48.782768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:48.783753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:48.800464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:48.802501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:48.805956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:48.806630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:49.197998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:49.221308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:49.232790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:49.240515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21d36f3e-e769-4ed9-91a0-ab54b145cbcf tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.462724 May 10 02:30:49.244971 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2243/4465] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:48 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:49.436022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:49.437486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:49.446083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:49.446994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:49.448031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:49.448808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:49.528997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:49.537577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f51ce418-7105-4ef6-ae31-d761c0387164 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1219 microversion: 2.1 time: 0.105439 May 10 02:30:49.538167 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2223/4466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:49 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:50.271871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:50.278814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:50.289990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:50.290694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:50.292061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:50.292698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:50.556410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:50.557058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:50.568189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:50.568651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:50.569456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:50.569908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:50.792494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:50.825646 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fab0b9e0-5982-4aaa-97e3-2f8838a707de tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1281 microversion: 2.1 time: 0.264446 May 10 02:30:50.826928 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2224/4467] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:50 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1281 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:50.878709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:50.901542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:50.905151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:50.906361 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acb1355a-fbe4-4fbd-90dd-c2e34e0940e6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.646744 May 10 02:30:50.921102 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2244/4468] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:50 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:51.843195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:51.843833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:51.856902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:51.857595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:51.858555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:51.860307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:51.931369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:51.932545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:51.958114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:51.958694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:51.959640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:51.960201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:52.411231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:52.430643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:52.439518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:52.441050 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b10240bb-8a39-4993-b40c-0691fa3f80c9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.518940 May 10 02:30:52.442066 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2245/4469] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:51 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:30:52.502285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:52.522735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2175d37-7e51-43fb-a740-4cc564f388e9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.683335 May 10 02:30:52.524969 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2225/4470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:51 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:53.460952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:53.461585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:53.488149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:53.488149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:53.488149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:53.490445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:53.499725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:53.501144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:53.508656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:53.510091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:53.511488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:53.512169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:54.629653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:54.647315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00b7cc73-7cc2-49d1-94b0-318b77696960 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 1.147978 May 10 02:30:54.663826 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2226/4471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:53 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:54.670995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:54.671878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:54.680995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:54.681682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:54.682647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:54.683276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:54.796181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:54.816489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:54.818966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:54.820840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5465be7-689d-4b28-a45e-b076c5c198b0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 1.363322 May 10 02:30:54.821701 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2246/4472] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:53 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:54.849198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-da1816ba-f6cc-4e23-b34b-113e9e6d36eb req-6d63556d-087c-4112-858e-648031ec2735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d615793d-a40a-4f4a-8f6f-1648b8eb24ed", "tag": "bccd55ac-0d75-407a-87f0-5ad5e0891f59"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:54.871370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-da1816ba-f6cc-4e23-b34b-113e9e6d36eb req-6d63556d-087c-4112-858e-648031ec2735 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:54.872148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-da1816ba-f6cc-4e23-b34b-113e9e6d36eb req-6d63556d-087c-4112-858e-648031ec2735 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:54.911426 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-da1816ba-f6cc-4e23-b34b-113e9e6d36eb req-6d63556d-087c-4112-858e-648031ec2735 service nova] Creating event network-changed:bccd55ac-0d75-407a-87f0-5ad5e0891f59 for instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed on n-h2-841089-2 May 10 02:30:54.918084 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-da1816ba-f6cc-4e23-b34b-113e9e6d36eb req-6d63556d-087c-4112-858e-648031ec2735 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077242 May 10 02:30:54.920219 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2247/4473] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:30:54.930591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:54.932456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:54.953322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:54.959747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:54.965950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:54.966644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:55.211516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:55.219095 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c8741db-2ef7-45d8-a5d7-6826a1054cde tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.552241 May 10 02:30:55.223987 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2227/4474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:54 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:55.542845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:55.561996 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-184d5117-680d-4128-ae36-6d68b1e506a0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.634485 May 10 02:30:55.562964 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2248/4475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:54 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:55.581080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:55.581959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:55.602667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:55.603174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:55.611319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:55.611319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:55.840933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:55.841483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:55.854282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:55.854890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:55.856316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:55.858001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:56.194900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:56.202549 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-93709754-23ec-43b6-8cdc-79efb4ce17f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.627656 May 10 02:30:56.215609 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2228/4476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:55 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:56.225113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:56.225831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:56.233304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:56.234016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:56.235334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:56.235963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:56.246755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:56.260134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:56.264382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:56.266210 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88a6a307-1e02-4383-978a-408f24782214 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.429990 May 10 02:30:56.269269 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2249/4477] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:55 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:56.291424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:56.293430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:56.316034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:56.316530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:56.317413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:56.318022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:56.517682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:56.526412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42473a55-f9ba-46de-9b85-6cedcb265b38 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.305741 May 10 02:30:56.531972 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2229/4478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:56 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:56.573429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:56.588362 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7043813e-1a02-45e3-a1a4-4750bbe9b32d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.317966 May 10 02:30:56.588976 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2250/4479] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:56 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:56.736646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-405819752", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "5a552ca0-79f9-47dd-adf9-5195fd4ca6cd"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:30:56.854833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] validate_networks() for [('5a552ca0-79f9-47dd-adf9-5195fd4ca6cd', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:30:57.294894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:57.296857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:57.306113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:57.307103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:57.309418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:57.311222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:57.922546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:57.932265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:57.940485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:57.941887 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9555e0c9-6eda-4b57-8d76-217c69b181ca tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.657711 May 10 02:30:57.944378 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2251/4480] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:57 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:57.950447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:57.951912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:57.968095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:57.970932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:57.971940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:57.974981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:58.087646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:30:58.089889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:30:58.090640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:30:58.091466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:30:58.092042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:30:58.125704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:58.126323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:58.127312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:58.127886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:58.153339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:30:58.165085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for user 2534074779504b4ca699312fdd4664cd and project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:30:58.203609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:30:58.207225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:30:58.296018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:58.308161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6269305c-2ed6-4a9e-9754-1d40750215ac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.362204 May 10 02:30:58.310969 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2252/4481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:57 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:58.323302 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adae3d83-70ac-476c-926e-d8e0b7e8f303 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591858 May 10 02:30:58.328036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2230/4482] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:30:58.338201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9b7adccb-b4a8-4874-b2b3-37fc0a1cf362 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:58.339171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9b7adccb-b4a8-4874-b2b3-37fc0a1cf362 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:58.587172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9b7adccb-b4a8-4874-b2b3-37fc0a1cf362 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:58.598357 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9b7adccb-b4a8-4874-b2b3-37fc0a1cf362 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1214 microversion: 2.1 time: 0.264910 May 10 02:30:58.613948 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2253/4483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:58 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1214 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:30:58.963605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:58.965609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:58.986997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:58.987517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:58.988323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:58.988776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:59.326494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:59.327238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:59.341390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:59.354650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:59.356620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:59.357094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:59.357896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:59.362991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:59.364462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:59.373270 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f13b695a-4183-4ce9-aaff-fb8f88057aa0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.415111 May 10 02:30:59.385766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2231/4484] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:30:58 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:30:59.628265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:30:59.628949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:30:59.655650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:59.660404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:59.661161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:30:59.661615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:30:59.951961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:59.954505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:30:59.971010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5ba3b5d-4101-4876-8246-e437d6faec09 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.648769 May 10 02:30:59.975934 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2254/4485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:59 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:30:59.991607 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f330bfc0-6f9f-4f13-8dff-df8233df88e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1266 microversion: 2.1 time: 0.367680 May 10 02:30:59.995882 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2232/4486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:30:59 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:00.256085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3bcc6792-55ac-447c-baa3-40675717236e req-9ad56901-b7c0-44ab-b302-19ecc31d26eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "56d91969-4b69-4350-be46-fc0367169266"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:00.293251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3bcc6792-55ac-447c-baa3-40675717236e req-9ad56901-b7c0-44ab-b302-19ecc31d26eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:00.294128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3bcc6792-55ac-447c-baa3-40675717236e req-9ad56901-b7c0-44ab-b302-19ecc31d26eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:00.337530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3bcc6792-55ac-447c-baa3-40675717236e req-9ad56901-b7c0-44ab-b302-19ecc31d26eb service nova] Creating event network-vif-plugged:56d91969-4b69-4350-be46-fc0367169266 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:00.353054 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3bcc6792-55ac-447c-baa3-40675717236e req-9ad56901-b7c0-44ab-b302-19ecc31d26eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101839 May 10 02:31:00.354019 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2255/4487] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:00.396078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:00.396961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:00.415815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:00.419143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:00.421901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:00.423155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:00.772140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:00.790533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:00.796399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:00.799935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf815308-ca1c-4ff9-87ce-53e48bef94df tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.408840 May 10 02:31:00.800875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2233/4488] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:00 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:31:00.995650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:00.996542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:01.012307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:01.012933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:01.026613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:01.027092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:01.034485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:01.034945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:01.037043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:01.039681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:01.041169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:01.041624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:01.262759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:01.274404 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a037e97-a78a-4570-96e4-528b292d87c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1272 microversion: 2.1 time: 0.265239 May 10 02:31:01.276426 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2234/4489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:01 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:01.386309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:01.400724 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-945f76e8-680d-4f3e-8b6b-a34d91117dac tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.411529 May 10 02:31:01.407272 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2256/4490] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:00 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:01.822113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:01.823122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:01.851475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:01.852199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:01.855014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:01.856166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:02.293619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:02.295116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:02.308836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:02.311586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:02.312720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:02.315018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:02.613573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:02.636376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:02.639970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:02.644246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40d165f8-def3-4619-9516-8e9540996024 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.826641 May 10 02:31:02.646800 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2235/4491] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:01 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:31:02.662606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:02.663719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:02.681906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:02.682586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:02.684059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:02.684711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:02.780427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:02.794515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2921f86-abaf-44e2-807e-cd40460ec87b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.505193 May 10 02:31:02.800532 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2257/4492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:02 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:02.800532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-434423d3-c00d-47d0-a290-bc9f874b34e6 req-9bea8167-6417-4976-8674-553fe66edc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "1cd6542c-ca6a-46b6-9410-e82cc46c88fa"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:02.809257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-434423d3-c00d-47d0-a290-bc9f874b34e6 req-9bea8167-6417-4976-8674-553fe66edc53 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:02.810439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-434423d3-c00d-47d0-a290-bc9f874b34e6 req-9bea8167-6417-4976-8674-553fe66edc53 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:02.825235 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-434423d3-c00d-47d0-a290-bc9f874b34e6 req-9bea8167-6417-4976-8674-553fe66edc53 service nova] Creating event network-vif-plugged:1cd6542c-ca6a-46b6-9410-e82cc46c88fa for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:02.841234 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-434423d3-c00d-47d0-a290-bc9f874b34e6 req-9bea8167-6417-4976-8674-553fe66edc53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044407 May 10 02:31:02.845703 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2258/4493] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:03.056564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:03.068534 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f55d0fb7-dad3-430d-bcfd-baac1c35dbe3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.420137 May 10 02:31:03.069153 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2236/4494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:02 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:03.669287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:03.670018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:03.684568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:03.684568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:03.685623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:03.686809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:03.812112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:03.813364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:03.828136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:03.828761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:03.830324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:03.831932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:04.355505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:04.364787 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abf20967-b161-4a74-9193-61b217a3777e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.557009 May 10 02:31:04.370402 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2237/4495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:03 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:04.374864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:04.392164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:04.394157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:04.403326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:04.404984 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e946b41-94c1-48c4-86b6-ff40a80b748c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.743080 May 10 02:31:04.405959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:04.410059 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2259/4496] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:03 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:31:04.424904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:04.425729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:04.426769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:04.427483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:04.768508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:04.781299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a737aa3e-b55c-4935-9bd6-1964e84a7887 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.400102 May 10 02:31:04.783669 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2238/4497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:04 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:04.925436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-507e3a7d-7f07-49c3-a59e-c2036274130d req-f64e038b-0701-40d0-9bb8-7beb20e6e934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9378d419-fde3-4ec0-aa2e-8171f8f5d7fd", "tag": "05ae6dae-74e9-425d-bfb0-e3206dc0c7d9"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:04.943546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-507e3a7d-7f07-49c3-a59e-c2036274130d req-f64e038b-0701-40d0-9bb8-7beb20e6e934 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:04.946568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-507e3a7d-7f07-49c3-a59e-c2036274130d req-f64e038b-0701-40d0-9bb8-7beb20e6e934 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:04.973204 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-507e3a7d-7f07-49c3-a59e-c2036274130d req-f64e038b-0701-40d0-9bb8-7beb20e6e934 service nova] Creating event network-changed:05ae6dae-74e9-425d-bfb0-e3206dc0c7d9 for instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd on n-h1-841089-2 May 10 02:31:04.985897 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-507e3a7d-7f07-49c3-a59e-c2036274130d req-f64e038b-0701-40d0-9bb8-7beb20e6e934 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063066 May 10 02:31:04.986781 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2260/4498] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:05.292792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f"}, {"server_uuid": "d615793d-a40a-4f4a-8f6f-1648b8eb24ed", "name": "network-vif-plugged", "status": "completed", "tag": "bccd55ac-0d75-407a-87f0-5ad5e0891f59"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "142271ce-0d6a-47b7-88f4-74833f70d123"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:05.310145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:05.313143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:05.339697 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] Creating event network-vif-plugged:2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:05.346874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] Creating event network-vif-plugged:bccd55ac-0d75-407a-87f0-5ad5e0891f59 for instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed on n-h2-841089-2 May 10 02:31:05.347643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] Creating event network-vif-plugged:142271ce-0d6a-47b7-88f4-74833f70d123 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:05.368400 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9f75b566-9a27-4c0e-bc69-471b3ff46a5b req-9bad6c6d-0056-4b1a-bbac-db2db8ad442d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.079741 May 10 02:31:05.370109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2239/4499] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:05.389732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:05.391319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:05.400138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:05.404345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:05.408698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:05.409425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:05.433657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:05.434498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:05.457346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:05.459499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:05.463624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:05.465046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:06.611443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:06.616206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:06.654287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fe1a58ba-1cc8-42a2-8da9-33a6272a5d91 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 1.269104 May 10 02:31:06.657620 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2261/4500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:05 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:06.660454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:06.665260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:06.669420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:06.669928 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af87e0e3-09a2-40bb-bf1e-7c65be9f434c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 1.240932 May 10 02:31:06.670740 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2240/4501] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:05 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:31:06.671613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:06.679975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:06.681265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:06.683145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:06.683790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:07.007211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:07.017572 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-85dc83e3-8eca-4c91-9deb-f75912607da3 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1323 microversion: 2.1 time: 0.358547 May 10 02:31:07.019319 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2262/4502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:06 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:07.469443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "1ee72d75-fe01-47ef-8899-964336a78f6b"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "923ee96f-7965-470c-b993-497366970f03"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-plugged", "status": "completed", "tag": "2f01f1dc-4f00-4813-8bb2-213d0724b05b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:07.493994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:07.493994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:07.533025 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] Creating event network-vif-plugged:1ee72d75-fe01-47ef-8899-964336a78f6b for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:07.533735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] Creating event network-vif-plugged:923ee96f-7965-470c-b993-497366970f03 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:07.542142 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] Creating event network-vif-plugged:2f01f1dc-4f00-4813-8bb2-213d0724b05b for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:07.552586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0cf96f0e-7946-42e7-8ed4-020e469f6bbd req-b567043d-7b22-44b2-8030-e5c2a69ef531 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.086872 May 10 02:31:07.555651 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2241/4503] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:07.672169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:07.679926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:07.691634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:07.692363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:07.704587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:07.705622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:07.706646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:07.706772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:07.707545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:07.708118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:07.712240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:07.712707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.185568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:08.209443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:08.220078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:08.226538 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-39d02900-6467-4cce-95bb-54db22e3ff48 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.540297 May 10 02:31:08.230758 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2242/4504] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:07 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:31:08.243762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:08.244330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:08.245226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:08.253356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90cbbb4f-af7c-450a-97a3-e632ed19a7e1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.584990 May 10 02:31:08.256762 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2263/4505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:07 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:08.264770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:08.265860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.268481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:08.269556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.673178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:08.681644 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ce9b433-d438-4b86-bc0d-a22bf567b9a9 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1520 microversion: 2.1 time: 0.448448 May 10 02:31:08.696334 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2243/4506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:08 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:08.713982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:08.715085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:08.722787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:08.723547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.724503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:08.725104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.753189 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] HTTP exception thrown: Instance is not a member of specified network May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Request method failure captured: May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed/ips/invalid HTTP/1.1 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec5XeE3Ux3CzQ6m4-oZv-ZmCHPBstbBF_IcnYiccgd1AldZ3c8FoVXHDSUXboU5bgQLLRfquAw8XpkOGDK0-z1P-go_uORVEf6UBq5xTtcftaCAimc_qXhAiwBin5cwWqkENPCWfdv5Tpfe9dIn3QU9U7la7oV9GGZc-32HkRUYegLo May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 6d4ea53be9904fe5bad20c770784f55d May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d4ea53be9904fe5bad20c770784f55d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "tempest-type-1992767138", "name": "tempest-service-1442154820", "endpoints": []}, {"type": "tempest-type-1415523976", "name": "tempest-service-436244458", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 6d4ea53be9904fe5bad20c770784f55d May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerAddressesNegativeTestJSON-163447190-project May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0efdd8f24dca4b7fbb59e73b75a7dbb0 May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-163447190-project May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance is not a member of specified network May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'server_id': 'd615793d-a40a-4f4a-8f6f-1648b8eb24ed', 'id': 'invalid'} May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 10 02:31:08.758867 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:31:08.764021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Returning 404 to user: Instance is not a member of specified network {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:31:08.765091 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c50da62c-e9b1-4d1c-8daa-afe0e796927a tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.055831 May 10 02:31:08.766296 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2264/4507] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 02:31:08 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed/ips/invalid => generated 91 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:31:08.782178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fa48b17-efef-4e87-9b84-e7f27378b296 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:08.782887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9fa48b17-efef-4e87-9b84-e7f27378b296 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Failed to fetch instance by id 999 {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2926}} May 10 02:31:08.783264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9fa48b17-efef-4e87-9b84-e7f27378b296 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] HTTP exception thrown: Instance 999 could not be found. May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fa48b17-efef-4e87-9b84-e7f27378b296 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Request method failure captured: May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec5XeE3Ux3CzQ6m4-oZv-ZmCHPBstbBF_IcnYiccgd1AldZ3c8FoVXHDSUXboU5bgQLLRfquAw8XpkOGDK0-z1P-go_uORVEf6UBq5xTtcftaCAimc_qXhAiwBin5cwWqkENPCWfdv5Tpfe9dIn3QU9U7la7oV9GGZc-32HkRUYegLo May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 6d4ea53be9904fe5bad20c770784f55d May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d4ea53be9904fe5bad20c770784f55d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "tempest-type-1992767138", "name": "tempest-service-1442154820", "endpoints": []}, {"type": "tempest-type-1415523976", "name": "tempest-service-436244458", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 6d4ea53be9904fe5bad20c770784f55d May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerAddressesNegativeTestJSON-163447190-project May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0efdd8f24dca4b7fbb59e73b75a7dbb0 May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-163447190-project May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 999 could not be found. May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '999'} May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:31:08.784955 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 10 02:31:08.789338 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:08.789338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fa48b17-efef-4e87-9b84-e7f27378b296 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Returning 404 to user: Instance 999 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:31:08.789338 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9fa48b17-efef-4e87-9b84-e7f27378b296 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012946 May 10 02:31:08.789338 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2244/4508] 10.222.0.52 () {58 vars in 1148 bytes} [Tue May 10 02:31:08 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:31:08.810365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:08.810964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:08.821435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:08.822103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.823163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:08.824331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:08.879814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:31:09.028857 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac11b836-3cc3-4ab4-9394-9813f6e99ecf tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 204 len: 0 microversion: 2.1 time: 0.233787 May 10 02:31:09.029944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2265/4509] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:31:08 2022] DELETE /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:31:09.044466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:09.046416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:09.082461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:09.086100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:09.086885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:09.087361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:09.263446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:09.266320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:09.276242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:09.276992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:09.278510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:09.279209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:09.355310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:09.363391 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5cf7f92b-9b78-4aff-bc83-9ffdf1db2709 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1526 microversion: 2.1 time: 0.329449 May 10 02:31:09.376127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2245/4510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:09 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1526 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:09.387523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:09.388345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:09.412097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:09.412935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:09.414512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:09.417205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:09.951594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:09.966508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:09.978417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:09.980967 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98fc2865-c008-456d-8704-7509df42e5d7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1879 microversion: 2.32 time: 0.734523 May 10 02:31:09.992783 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2266/4511] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:09 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1879 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:31:10.043396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:10.052698 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d11787a6-1b7a-4079-8e4c-6f736493d2e5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.675053 May 10 02:31:10.053784 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2246/4512] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:09 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:10.388375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:10.391651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:10.408946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:10.409364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:10.411979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:10.414421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:10.771505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:10.785071 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4dfc7bd3-21bb-467e-990a-bab57c19e715 tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1526 microversion: 2.1 time: 0.406826 May 10 02:31:10.787283 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2267/4513] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:10 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1526 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:11.004306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:11.004948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:11.015777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:11.016394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:11.017404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:11.017959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:11.072523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:11.074450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:11.091705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:11.093314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:11.097205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:11.097844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:11.873030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:11.884873 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea360dfd-5a32-4a24-9d04-0b0b0734a413 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.818925 May 10 02:31:11.885849 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2268/4514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:11 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:11.910959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:11.914682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:11.931164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:11.934017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:11.936430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:11.940242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:11.975558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:11.992714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:11.994233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:11.995707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7b7e9beb-bf40-48fb-bac2-cac6c67a4b06 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2833 microversion: 2.32 time: 0.995786 May 10 02:31:11.996282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2247/4515] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:10 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2833 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:31:12.025181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:12.026265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:12.046731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:12.047491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:12.049315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:12.052726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:12.345488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-48f52c04-2bef-43be-8790-e6cea777deda tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.332786 May 10 02:31:12.353744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2248/4516] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:31:12 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0/os-interface => generated 1831 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:31:12.696276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:12.716394 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-45223114-36a8-472c-b894-dfea0f663a4d tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1526 microversion: 2.1 time: 0.815168 May 10 02:31:12.730764 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2269/4517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:11 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1526 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:12.901803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:12.902655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:12.905283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-39c33c5a-35d5-4f18-97f9-b5fa4796964c req-6a7ce717-0714-45f3-94fb-99d867bedb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9378d419-fde3-4ec0-aa2e-8171f8f5d7fd", "name": "network-vif-plugged", "status": "completed", "tag": "05ae6dae-74e9-425d-bfb0-e3206dc0c7d9"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:12.913216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:12.914231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:12.915032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:12.915507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:12.919184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-39c33c5a-35d5-4f18-97f9-b5fa4796964c req-6a7ce717-0714-45f3-94fb-99d867bedb5d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:12.919927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-39c33c5a-35d5-4f18-97f9-b5fa4796964c req-6a7ce717-0714-45f3-94fb-99d867bedb5d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:12.940980 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-39c33c5a-35d5-4f18-97f9-b5fa4796964c req-6a7ce717-0714-45f3-94fb-99d867bedb5d service nova] Creating event network-vif-plugged:05ae6dae-74e9-425d-bfb0-e3206dc0c7d9 for instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd on n-h1-841089-2 May 10 02:31:12.948586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-39c33c5a-35d5-4f18-97f9-b5fa4796964c req-6a7ce717-0714-45f3-94fb-99d867bedb5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051099 May 10 02:31:12.949802 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2249/4518] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:13.211271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1f65b30b-90e8-48e3-8a80-4acbc9375d7d req-93997fa6-4c34-4f54-825b-d5dad1c62244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615793d-a40a-4f4a-8f6f-1648b8eb24ed", "name": "network-vif-deleted", "tag": "bccd55ac-0d75-407a-87f0-5ad5e0891f59"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:13.235347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1f65b30b-90e8-48e3-8a80-4acbc9375d7d req-93997fa6-4c34-4f54-825b-d5dad1c62244 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:13.236575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1f65b30b-90e8-48e3-8a80-4acbc9375d7d req-93997fa6-4c34-4f54-825b-d5dad1c62244 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:13.269573 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1f65b30b-90e8-48e3-8a80-4acbc9375d7d req-93997fa6-4c34-4f54-825b-d5dad1c62244 service nova] Creating event network-vif-deleted:bccd55ac-0d75-407a-87f0-5ad5e0891f59 for instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed on n-h2-841089-2 May 10 02:31:13.285267 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1f65b30b-90e8-48e3-8a80-4acbc9375d7d req-93997fa6-4c34-4f54-825b-d5dad1c62244 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078730 May 10 02:31:13.290190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2250/4519] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:31:13.396485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:13.412349 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21589682-ad2b-423c-8aba-989b3dcbff6d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.514672 May 10 02:31:13.415205 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2270/4520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:12 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:13.741557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:13.742587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:13.758241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:13.758972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:13.759802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:13.763118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:13.853055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:13.854167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:13.855608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lazy-loading 'fault' on Instance uuid d615793d-a40a-4f4a-8f6f-1648b8eb24ed {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:31:14.000928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0efdd8f24dca4b7fbb59e73b75a7dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4ea53be9904fe5bad20c770784f55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:14.009650 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c34b916a-3863-4f08-b29a-76a84cd6ce2f tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 200 len: 1313 microversion: 2.1 time: 0.274065 May 10 02:31:14.012696 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2251/4521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:13 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:14.440840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:14.441518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:14.472529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:14.477132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:14.478148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:14.478612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:14.896202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:14.904424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d2c58f5-b041-47be-9545-4303b3ef71e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1314 microversion: 2.1 time: 0.473302 May 10 02:31:14.905013 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2271/4522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:14 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:15.030928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:15.032456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] [instance: d615793d-a40a-4f4a-8f6f-1648b8eb24ed] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:15.048305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:15.050394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:15.053181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:15.055396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:15.131717 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] HTTP exception thrown: Instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed could not be found. May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Request method failure captured: May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed HTTP/1.1 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec5XeE3Ux3CzQ6m4-oZv-ZmCHPBstbBF_IcnYiccgd1AldZ3c8FoVXHDSUXboU5bgQLLRfquAw8XpkOGDK0-z1P-go_uORVEf6UBq5xTtcftaCAimc_qXhAiwBin5cwWqkENPCWfdv5Tpfe9dIn3QU9U7la7oV9GGZc-32HkRUYegLo May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 6d4ea53be9904fe5bad20c770784f55d May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d4ea53be9904fe5bad20c770784f55d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "tempest-type-1992767138", "name": "tempest-service-1442154820", "endpoints": []}, {"type": "tempest-type-1415523976", "name": "tempest-service-436244458", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d4ea53be9904fe5bad20c770784f55d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 6d4ea53be9904fe5bad20c770784f55d May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-163447190 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerAddressesNegativeTestJSON-163447190-project May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0efdd8f24dca4b7fbb59e73b75a7dbb0 May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-163447190-project May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed could not be found. May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd615793d-a40a-4f4a-8f6f-1648b8eb24ed'} May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed could not be found. May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:31:15.133951 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed could not be found. May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed could not be found. May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:31:15.137665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] Returning 404 to user: Instance d615793d-a40a-4f4a-8f6f-1648b8eb24ed could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:31:15.140396 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44e1a006-98fb-4e91-9acd-0a8ffd1dfd0e tempest-ServerAddressesNegativeTestJSON-163447190 tempest-ServerAddressesNegativeTestJSON-163447190-project] 10.222.0.52 "GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed" status: 404 len: 111 microversion: 2.1 time: 0.109626 May 10 02:31:15.145259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2252/4523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:15 2022] GET /compute/v2.1/servers/d615793d-a40a-4f4a-8f6f-1648b8eb24ed => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:31:15.554172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fce007dc-3134-4a91-90ca-276f741613c4 req-13864775-e8a5-4c26-b2f7-cf8304ef8a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "tag": "56d91969-4b69-4350-be46-fc0367169266"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:15.565220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fce007dc-3134-4a91-90ca-276f741613c4 req-13864775-e8a5-4c26-b2f7-cf8304ef8a76 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:15.565679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fce007dc-3134-4a91-90ca-276f741613c4 req-13864775-e8a5-4c26-b2f7-cf8304ef8a76 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:15.608438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fce007dc-3134-4a91-90ca-276f741613c4 req-13864775-e8a5-4c26-b2f7-cf8304ef8a76 service nova] Creating event network-changed:56d91969-4b69-4350-be46-fc0367169266 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:31:15.627829 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fce007dc-3134-4a91-90ca-276f741613c4 req-13864775-e8a5-4c26-b2f7-cf8304ef8a76 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077213 May 10 02:31:15.628450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2272/4524] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:15.922470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:15.923141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:15.933099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:15.933679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:15.935452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:15.936920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:16.239877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:16.249038 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f40d065-06ab-472d-8ab1-5fa0e561d0f7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1501 microversion: 2.1 time: 0.330418 May 10 02:31:16.254133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2253/4525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:15 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:16.274163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:16.274796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:16.291533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:16.292403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:16.293466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:16.293918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:16.770371 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.network.security_group_api [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Removing security group 0264a02c-a326-4ade-ba20-9a7bc86f26f6 from port 05ae6dae-74e9-425d-bfb0-e3206dc0c7d9 May 10 02:31:18.458070 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-367c9e6c-b880-48d8-a0cb-c0e2db012976 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd/action" status: 202 len: 0 microversion: 2.1 time: 2.187600 May 10 02:31:18.459244 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2273/4526] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:31:16 2022] POST /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd/action => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:31:18.469265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:18.470412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:18.481810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8a16d142-ee83-4d1f-a74f-e3aa6339087c req-1eeada47-ed9f-47cb-ae4d-bb83db31cc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9378d419-fde3-4ec0-aa2e-8171f8f5d7fd", "tag": "05ae6dae-74e9-425d-bfb0-e3206dc0c7d9"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:18.488453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:18.489570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:18.491375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:18.499520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:18.504522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8a16d142-ee83-4d1f-a74f-e3aa6339087c req-1eeada47-ed9f-47cb-ae4d-bb83db31cc44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:18.507832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8a16d142-ee83-4d1f-a74f-e3aa6339087c req-1eeada47-ed9f-47cb-ae4d-bb83db31cc44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:18.542714 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8a16d142-ee83-4d1f-a74f-e3aa6339087c req-1eeada47-ed9f-47cb-ae4d-bb83db31cc44 service nova] Creating event network-changed:05ae6dae-74e9-425d-bfb0-e3206dc0c7d9 for instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd on n-h1-841089-2 May 10 02:31:18.557955 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8a16d142-ee83-4d1f-a74f-e3aa6339087c req-1eeada47-ed9f-47cb-ae4d-bb83db31cc44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082560 May 10 02:31:18.589562 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2274/4527] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:19.407837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:19.423571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4953af59-6af1-4644-a05d-f3f6984b7694 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1459 microversion: 2.1 time: 0.960348 May 10 02:31:19.424171 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2254/4528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:18 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1459 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:19.440841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:19.441659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:19.455434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:19.457979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:19.459144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:19.459941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:19.949121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:19.963623 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1909d101-fb8e-4af5-be24-da12b66c233f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.527233 May 10 02:31:19.972341 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2275/4529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:19 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:19.993275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:19.994386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:20.004572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:20.007812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:20.009722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:20.010183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:20.739012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:20.751785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e9590bb-c720-4f22-b291-0ad33e577dab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.763535 May 10 02:31:20.752391 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2255/4530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:19 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:20.769715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:20.770498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:20.782087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:20.782639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:20.783681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:20.784143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:21.226760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:21.237123 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6d6837b0-e7c1-4fc9-9611-c884ec088bf0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.471970 May 10 02:31:21.238527 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2276/4531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:20 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:21.258542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:21.261130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:21.277974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:21.278987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:21.280327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:21.281571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:21.742719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:21.757648 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-548dddff-a584-4466-9e65-4fcd4afe8d0e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.505636 May 10 02:31:21.768110 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2256/4532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:21 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:21.930071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1938976350", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "5a552ca0-79f9-47dd-adf9-5195fd4ca6cd"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:22.030029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] validate_networks() for [('5a552ca0-79f9-47dd-adf9-5195fd4ca6cd', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:31:22.923229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:31:22.923673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:31:22.924163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:31:22.924589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:31:22.925417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:31:22.956894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:22.957476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:22.958216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:22.960894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:23.013298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:31:23.030942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Getting quotas for user 2534074779504b4ca699312fdd4664cd and project 338dfffcacb94a729ac6d34dcafb5c4d. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:31:23.068578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:31:23.071583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:31:23.156595 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-519f86d8-0791-46f7-b13e-c20f958221e2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231383 May 10 02:31:23.157952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2277/4533] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:31:23.173664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8246996f-5649-412d-9a49-ae94ea087f22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:23.177040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8246996f-5649-412d-9a49-ae94ea087f22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:23.433916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8246996f-5649-412d-9a49-ae94ea087f22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:23.441622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8246996f-5649-412d-9a49-ae94ea087f22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1215 microversion: 2.1 time: 0.274918 May 10 02:31:23.449138 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2257/4534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:23 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:24.465372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:24.466010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:24.478125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:24.480529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:24.483337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:24.486575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:24.740784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:24.748286 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-548bf48b-2a86-4dd0-8391-fc90b82f46e8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1267 microversion: 2.1 time: 0.286743 May 10 02:31:24.748879 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2278/4535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:24 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:25.767998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:25.768680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:25.790443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:25.793084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:25.794080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:25.799437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:26.079415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:26.089177 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cab2e1d5-062c-4dc0-a1dc-29f26331f2c3 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1273 microversion: 2.1 time: 0.327290 May 10 02:31:26.094913 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2258/4536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:25 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:27.116374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:27.117848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:27.133039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:27.135722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:27.138889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:27.140451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:27.851601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:27.867804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-648724c0-70ce-4629-8fdf-16e3f19dfa30 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.756463 May 10 02:31:27.883345 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2279/4537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:27 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:28.894025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:28.895664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:28.913269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:28.914397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:28.915528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:28.918208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:29.957832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:29.977333 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbb246ba-43de-4859-823d-36a1995890d1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 1.090913 May 10 02:31:29.980391 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2259/4538] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:28 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:30.994377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:30.995552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:31.002812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:31.003300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:31.004088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:31.004529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:31.028044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d191c151-9e5b-49b4-ae6a-8809d0d19bda req-906b9198-d780-4466-b7d9-044ef48dc30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1315ef69-47fe-491a-9c19-c286dceee05c", "tag": "205958e4-937e-42ea-bf43-d296ae0cbeb2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:31.042782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d191c151-9e5b-49b4-ae6a-8809d0d19bda req-906b9198-d780-4466-b7d9-044ef48dc30f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:31.043284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d191c151-9e5b-49b4-ae6a-8809d0d19bda req-906b9198-d780-4466-b7d9-044ef48dc30f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:31.072983 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d191c151-9e5b-49b4-ae6a-8809d0d19bda req-906b9198-d780-4466-b7d9-044ef48dc30f service nova] Creating event network-changed:205958e4-937e-42ea-bf43-d296ae0cbeb2 for instance 1315ef69-47fe-491a-9c19-c286dceee05c on n-h2-841089-2 May 10 02:31:31.089503 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d191c151-9e5b-49b4-ae6a-8809d0d19bda req-906b9198-d780-4466-b7d9-044ef48dc30f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069377 May 10 02:31:31.099344 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2260/4539] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 10 02:31:32.038930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:32.052432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-340b9c4c-d244-4d96-af87-5a3860938ffa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 1.058642 May 10 02:31:32.055636 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2280/4540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:30 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:33.072240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:33.073549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:33.093489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:33.093973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:33.094816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:33.095299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:33.540950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:33.548734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80aa4199-d8cd-4283-9e48-0aab96d2788b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.480994 May 10 02:31:33.553235 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2261/4541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:33 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:34.565881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:34.566498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:34.581635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:34.589221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:34.590365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:34.591003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:35.087896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:35.113130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-235988fd-4bb9-4489-a6cd-d4ecd8075367 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.551062 May 10 02:31:35.120637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2281/4542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:34 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:36.139002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:36.141077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:36.158234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:36.164192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:36.165456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:36.166076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:36.464882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:36.473816 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e89ffb04-b150-4238-927f-92cb8c0eb040 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.340138 May 10 02:31:36.480169 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2262/4543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:36 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:36.979719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-342257ef-3e14-467b-b31b-c347989c0f9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: .version_select at 0x7f3d3630e040>, body: {"keypair": {"name": "tempest-keypair-1235960262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/1zt9zz8KyuQlgsINXYaJsWldJ4rlIkj85D5UZmoGxJT37+3ecXJ50tG0Mvn4eW10BHFsa6XHdfwDb85QJw34cy1sfNzXB/8C+MNU5CNxD13uI230UVaY3uqzNQJ5Fng=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:37.014011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-342257ef-3e14-467b-b31b-c347989c0f9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:31:37.025900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-342257ef-3e14-467b-b31b-c347989c0f9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:31:37.078161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-342257ef-3e14-467b-b31b-c347989c0f9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.538856 May 10 02:31:37.089693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2282/4544] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:31:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:37.500508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:37.501226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:37.523683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:37.525569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:37.528565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:37.529259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:38.344090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:38.353024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-66fc2aa1-3ae4-4a43-acc4-afa161e02192 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.858313 May 10 02:31:38.353631 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2263/4545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:37 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:39.371056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:39.371942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:39.381974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:39.382791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:39.383849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:39.384533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:39.911390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-357143796", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b17ef216-a989-4dab-a21d-9ac51c1b13b9"}], "security_groups": [{"name": "tempest-securitygroup--198486950"}], "key_name": "tempest-keypair-1235960262", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:40.005038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:40.029726 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f65e4d72-ab63-49a8-ac22-fc50fc24fa21 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.662009 May 10 02:31:40.033045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2283/4546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:39 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:40.101845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] validate_networks() for [('b17ef216-a989-4dab-a21d-9ac51c1b13b9', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:31:40.154660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c1b12d7f-e206-4af2-a5aa-1df91b0ec87a req-5bc035aa-25e8-4e01-b7f7-09922c5d1a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1315ef69-47fe-491a-9c19-c286dceee05c", "name": "network-vif-plugged", "status": "completed", "tag": "205958e4-937e-42ea-bf43-d296ae0cbeb2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:40.177585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c1b12d7f-e206-4af2-a5aa-1df91b0ec87a req-5bc035aa-25e8-4e01-b7f7-09922c5d1a61 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:40.179207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c1b12d7f-e206-4af2-a5aa-1df91b0ec87a req-5bc035aa-25e8-4e01-b7f7-09922c5d1a61 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:40.788625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c1b12d7f-e206-4af2-a5aa-1df91b0ec87a req-5bc035aa-25e8-4e01-b7f7-09922c5d1a61 service nova] Creating event network-vif-plugged:205958e4-937e-42ea-bf43-d296ae0cbeb2 for instance 1315ef69-47fe-491a-9c19-c286dceee05c on n-h2-841089-2 May 10 02:31:40.810219 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c1b12d7f-e206-4af2-a5aa-1df91b0ec87a req-5bc035aa-25e8-4e01-b7f7-09922c5d1a61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.668316 May 10 02:31:40.811433 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2284/4547] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:41.052699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:41.055450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:41.094521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:41.095006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:41.101658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:41.102134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:41.575841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:41.583752 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56acd033-6bb4-49e1-a70a-101a6d8cbe5a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.537503 May 10 02:31:41.584323 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2285/4548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:41 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:42.593165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:31:42.594434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:31:42.595468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:31:42.595952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:31:42.596385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:31:42.601426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:42.602918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:42.614360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:42.618333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:42.619949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:42.622733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:42.641921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:42.642809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:42.643906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:42.644359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:42.682848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:31:42.705089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:31:42.727451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:31:42.730294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:31:42.828935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e779a06c-5bc0-4705-98c2-14015962e9ea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.922599 May 10 02:31:42.837872 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2264/4549] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:31:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:31:42.848157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44e6c541-7880-46c4-b912-9cf728b8d290 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:42.851717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44e6c541-7880-46c4-b912-9cf728b8d290 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:43.034972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-44e6c541-7880-46c4-b912-9cf728b8d290 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:43.049979 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44e6c541-7880-46c4-b912-9cf728b8d290 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1241 microversion: 2.1 time: 0.210776 May 10 02:31:43.056379 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2265/4550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:42 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1241 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:43.135717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:43.144912 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e4729d9-db79-4766-8906-a2efcca8652f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1315 microversion: 2.1 time: 0.548105 May 10 02:31:43.147853 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2286/4551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:42 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:44.074187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:44.074953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:44.089014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.089480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.090282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.090733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.163528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:44.164730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:44.175448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.181149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.182200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.182812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.235406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:44.253734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2005e94-7633-44c6-b965-6b85ba2cc940 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1245 microversion: 2.1 time: 0.184754 May 10 02:31:44.254751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2266/4552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:44 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1245 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:44.398773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:44.410114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8367c73a-0edf-4c65-8279-1e8c887e223c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1502 microversion: 2.1 time: 0.249413 May 10 02:31:44.411316 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2287/4553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:44 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:44.435893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:44.436718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:44.448394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.450030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.451545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.453956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.573560 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6219c621-bb47-4961-ba1f-38825f45f5a4 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c/action" status: 202 len: 0 microversion: 2.1 time: 0.146414 May 10 02:31:44.575526 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2267/4554] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:31:44 2022] POST /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:31:44.587105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:44.587828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:44.603660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.604810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:44.606511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:44.608778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:45.190250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:45.207234 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ec4a1f9-a055-4942-92d5-c04bafd53d95 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1507 microversion: 2.1 time: 0.625315 May 10 02:31:45.208973 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2288/4555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:44 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1507 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:45.273770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:45.275100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:45.285543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:45.286901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:45.287975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:45.288942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:45.567943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:45.582865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b4d295ea-ed5c-4c34-bb3f-6922663d3834 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1311 microversion: 2.1 time: 0.313111 May 10 02:31:45.585110 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2268/4556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:45 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:46.228257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:46.229814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:46.244697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:46.249210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:46.250219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:46.250676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:46.601644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:46.602601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:46.610250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:46.610863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:46.611755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:46.612274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:46.873735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:46.882870 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bfe65bbe-3961-4554-82b5-0b77374570cf tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1299 microversion: 2.1 time: 0.285445 May 10 02:31:46.887302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2269/4557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:46 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1299 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:47.169331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:47.180270 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c6b79c9-422b-44ff-a325-1f55a79d778c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1487 microversion: 2.1 time: 0.957625 May 10 02:31:47.191678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2289/4558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:46 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1487 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:47.204261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:47.205087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:47.214338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:47.217062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:47.218288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:47.218944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:47.258253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lazy-loading 'flavor' on Instance uuid 1315ef69-47fe-491a-9c19-c286dceee05c {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:31:47.787234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2aa86af5-6ef7-433e-a239-b6c8f2adceb0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c/action" status: 202 len: 0 microversion: 2.1 time: 0.589560 May 10 02:31:47.792895 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2270/4559] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:31:47 2022] POST /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:31:47.799403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:47.800760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:47.811101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:47.812008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:47.813259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:47.813880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:47.902859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:47.904453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:47.917474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:47.917948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:47.918753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:47.930284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:48.278971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:48.287224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:48.291712 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5b61103-7e07-4795-b601-391dd826a59f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1493 microversion: 2.1 time: 0.496838 May 10 02:31:48.293884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2290/4560] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:47 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1493 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:48.298679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e52c19da-b9fa-4040-adb1-96b9ef606568 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 0.400107 May 10 02:31:48.308872 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2271/4561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:47 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:49.039197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-be2b88b0-dc61-4d90-a15c-2c070ac92d18 req-7b4fa2c9-9eac-4b8c-a745-044db76527eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868a9602-d66a-4a42-b74c-48bd9bc11aff", "tag": "d64460fa-37a0-4af1-a0e1-c55f47ad456f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:49.076538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-be2b88b0-dc61-4d90-a15c-2c070ac92d18 req-7b4fa2c9-9eac-4b8c-a745-044db76527eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:49.080821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-be2b88b0-dc61-4d90-a15c-2c070ac92d18 req-7b4fa2c9-9eac-4b8c-a745-044db76527eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:49.113568 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-be2b88b0-dc61-4d90-a15c-2c070ac92d18 req-7b4fa2c9-9eac-4b8c-a745-044db76527eb service nova] Creating event network-changed:d64460fa-37a0-4af1-a0e1-c55f47ad456f for instance 868a9602-d66a-4a42-b74c-48bd9bc11aff on n-h2-841089-2 May 10 02:31:49.119537 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-be2b88b0-dc61-4d90-a15c-2c070ac92d18 req-7b4fa2c9-9eac-4b8c-a745-044db76527eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094360 May 10 02:31:49.120371 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2291/4562] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:49.312189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:49.313437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:49.316064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:49.317056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:49.329829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:49.330922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:49.333134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:49.333393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:49.333867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:49.338162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:49.342947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:49.347780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:49.656484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:49.666698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa8caea6-86c9-4ec4-b52a-99c78926b081 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 0.354801 May 10 02:31:49.668088 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2292/4563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:49 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:50.043851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:50.071245 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-427f3ea4-c7ed-451d-9571-a8dec17deb92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1514 microversion: 2.1 time: 0.765859 May 10 02:31:50.078190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2272/4564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:49 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1514 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:50.684482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:50.685689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:50.692953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:50.693426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:50.694427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:50.695029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:50.972224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:50.987345 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6262f44-d062-460c-b13e-feb367daa2b6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 0.305909 May 10 02:31:50.989134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2293/4565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:50 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:51.097417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:51.098053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:51.107256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:51.107726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:51.108692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:51.109155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:51.502262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:51.524305 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a2712b27-1247-4e71-b8b4-f904bed7ca15 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.430712 May 10 02:31:51.525229 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2273/4566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:51 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:52.005240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:52.006166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:52.018273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:52.018754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:52.019614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:52.020065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:52.137402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-dcb4d8bb-b5dd-48e1-8c65-bc0b6eda6b3b req-1f831cf8-1e30-424c-bcbc-786ff99479ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1315ef69-47fe-491a-9c19-c286dceee05c", "name": "network-vif-plugged", "status": "completed", "tag": "205958e4-937e-42ea-bf43-d296ae0cbeb2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:52.157268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-dcb4d8bb-b5dd-48e1-8c65-bc0b6eda6b3b req-1f831cf8-1e30-424c-bcbc-786ff99479ed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:52.157747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-dcb4d8bb-b5dd-48e1-8c65-bc0b6eda6b3b req-1f831cf8-1e30-424c-bcbc-786ff99479ed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:52.187473 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-dcb4d8bb-b5dd-48e1-8c65-bc0b6eda6b3b req-1f831cf8-1e30-424c-bcbc-786ff99479ed service nova] Creating event network-vif-plugged:205958e4-937e-42ea-bf43-d296ae0cbeb2 for instance 1315ef69-47fe-491a-9c19-c286dceee05c on n-h2-841089-2 May 10 02:31:52.199974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-dcb4d8bb-b5dd-48e1-8c65-bc0b6eda6b3b req-1f831cf8-1e30-424c-bcbc-786ff99479ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437786 May 10 02:31:52.200507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2294/4567] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:52.543664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:52.544573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:52.563346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:52.564422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:52.565314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:52.565770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:52.935845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:52.943580 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ddf6de3e-95ad-4d71-bc7f-c6fcf128e393 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 0.942534 May 10 02:31:52.957254 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2274/4568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:51 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:53.127541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:53.140118 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed0a397a-b88b-4965-b6aa-e495bfb0225d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.597035 May 10 02:31:53.141257 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2295/4569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:52 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:53.961691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:53.962904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:53.979387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:53.984838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:53.989386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:53.992654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:54.161095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:54.162994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:54.182582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:54.184120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:54.187537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:54.190340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:55.923642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:55.940280 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d56685d-4de2-4c3b-8748-bc7f9c4eeb22 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 1.784256 May 10 02:31:55.941326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2296/4570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:54 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:56.011228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:56.029837 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-65a5771d-673e-488e-8667-3b7a0f56400e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 2.072832 May 10 02:31:56.032733 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2275/4571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:53 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:56.962748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:56.964683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:57.006791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:57.007303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:57.013825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:57.021987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:57.086072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:57.086766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:57.103920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:57.104873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:57.106034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:57.113162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:58.283773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:58.301956 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-85465564-f467-4f65-8aba-ba97ae42764f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 1.343295 May 10 02:31:58.303793 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2297/4572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:56 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:31:58.369711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:31:58.392949 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-25a90ba4-bf26-4ad7-876d-f9aec98488b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 1.311377 May 10 02:31:58.393553 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2276/4573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:57 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:31:58.793585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8cfbcf3e-60a1-44b0-8e54-8a198d936cf1 req-07ee7936-73f7-4274-8bde-99b5d8229f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868a9602-d66a-4a42-b74c-48bd9bc11aff", "name": "network-vif-plugged", "status": "completed", "tag": "d64460fa-37a0-4af1-a0e1-c55f47ad456f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:31:58.817659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8cfbcf3e-60a1-44b0-8e54-8a198d936cf1 req-07ee7936-73f7-4274-8bde-99b5d8229f1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:58.821874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8cfbcf3e-60a1-44b0-8e54-8a198d936cf1 req-07ee7936-73f7-4274-8bde-99b5d8229f1b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:58.917433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8cfbcf3e-60a1-44b0-8e54-8a198d936cf1 req-07ee7936-73f7-4274-8bde-99b5d8229f1b service nova] Creating event network-vif-plugged:d64460fa-37a0-4af1-a0e1-c55f47ad456f for instance 868a9602-d66a-4a42-b74c-48bd9bc11aff on n-h2-841089-2 May 10 02:31:58.948980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8cfbcf3e-60a1-44b0-8e54-8a198d936cf1 req-07ee7936-73f7-4274-8bde-99b5d8229f1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161359 May 10 02:31:58.952762 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2298/4574] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:31:58.979175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:58.979944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:59.011117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:59.014589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:59.018379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:59.024103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:59.323927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:31:59.325265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:31:59.342359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:59.344484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:31:59.349087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:31:59.350432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:00.280407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:00.309289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:00.313840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:00.321804 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f226ec08-3487-42b4-bc11-d141503f0613 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2951 microversion: 2.32 time: 1.346288 May 10 02:32:00.324211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2277/4575] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:31:58 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2951 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:32:00.329590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:00.330605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:00.342424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:00.343535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:00.344706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:00.345460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:00.514313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:00.530403 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89d4bea3-b1ff-4762-9237-d5dbdb767caa tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 1.211157 May 10 02:32:00.544607 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2299/4576] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:31:59 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:00.576415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:00.577131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:00.595299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:00.596125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:00.596644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:00.597100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:01.029038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:01.045562 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c9ec4ed-ce2e-4d91-84d9-1ba39c9f60b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1366 microversion: 2.1 time: 0.717109 May 10 02:32:01.047211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2278/4577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:00 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1366 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:01.083460 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2542edd0-be63-49c8-b5d7-e40ed20af3de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.534539 May 10 02:32:01.084181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2300/4578] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:32:00 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0/os-interface => generated 1831 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:32:01.555710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:01.559326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:01.569748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:01.570216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:01.571270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:01.571732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:02.070013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:02.070805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:02.085063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:02.085526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:02.094116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:02.094655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:03.239670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:03.255339 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-750c6015-f1ff-4266-8973-8928577baca5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1555 microversion: 2.1 time: 1.191060 May 10 02:32:03.259522 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2301/4579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:02 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1555 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:03.294065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:03.294423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:03.322578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:03.325400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:03.326874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:03.336466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:03.435495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:03.455942 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49f284aa-b7d8-4b6b-89ba-cd32f9ff1527 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 1.912205 May 10 02:32:03.456570 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2279/4580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:01 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:03.763856 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-787deb39-7710-4459-8faa-fe6169c21039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.489826 May 10 02:32:03.765227 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2302/4581] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:32:03 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-interface => generated 284 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:32:04.473591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:04.476614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:04.492723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:04.493428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:04.494400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:04.496157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:05.307472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:05.364292 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7b0627a3-dd57-4f7d-b6a9-46eff481acb9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.895676 May 10 02:32:05.377224 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2280/4582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:04 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:06.394910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:06.396171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:06.419827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:06.423731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:06.429125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:06.429599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:07.184857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:07.197079 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e272bb55-0025-41a4-8a5f-4f9a03ee0f09 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.811553 May 10 02:32:07.198689 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2303/4583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:06 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:08.215757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:08.216388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:08.231854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:08.232367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:08.237838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:08.239053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:08.432146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2589cb3b-a313-4893-9909-e50f7916bd00 req-780d1d6b-f7fc-4730-b83a-e40249a85846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "868a9602-d66a-4a42-b74c-48bd9bc11aff", "tag": "d64460fa-37a0-4af1-a0e1-c55f47ad456f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:08.448224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2589cb3b-a313-4893-9909-e50f7916bd00 req-780d1d6b-f7fc-4730-b83a-e40249a85846 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:08.456947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2589cb3b-a313-4893-9909-e50f7916bd00 req-780d1d6b-f7fc-4730-b83a-e40249a85846 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:08.479539 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2589cb3b-a313-4893-9909-e50f7916bd00 req-780d1d6b-f7fc-4730-b83a-e40249a85846 service nova] Creating event network-changed:d64460fa-37a0-4af1-a0e1-c55f47ad456f for instance 868a9602-d66a-4a42-b74c-48bd9bc11aff on n-h2-841089-2 May 10 02:32:08.494112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2589cb3b-a313-4893-9909-e50f7916bd00 req-780d1d6b-f7fc-4730-b83a-e40249a85846 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065934 May 10 02:32:08.495777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2304/4584] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:32:08.851037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:08.864890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-52e5d742-ba6e-4b8c-a4dc-c704abfdba4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.653753 May 10 02:32:08.877064 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2281/4585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:08 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:09.894686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:09.895600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:09.917276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:09.917911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:09.933125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:09.939702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:11.218875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:11.237772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37c59beb-da91-49bd-96dc-8ef7b515b3c9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 1.348176 May 10 02:32:11.244780 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2305/4586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:09 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:12.260976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:12.261508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:12.277036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:12.280385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:12.284160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:12.286205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:12.711177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:12.722398 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f17a149c-90ee-4873-886b-94f594381b19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.464984 May 10 02:32:12.723327 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2282/4587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:12 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:32:13.743409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:13.744896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:13.758264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:13.763296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:13.764551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:13.765368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:14.194519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:14.206732 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c969dba4-5a02-4641-b0e8-93521c1bea8f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.468982 May 10 02:32:14.208563 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2306/4588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:13 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:15.225867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:15.227263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:15.241792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:15.242243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:15.245873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:15.246356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:16.187300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:16.220796 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7c49e7fa-9e07-41d8-9cf6-089fab676008 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.984955 May 10 02:32:16.223876 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2283/4589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:15 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:17.240653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:17.241512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:17.262060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:17.262979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:17.264083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:17.266006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:17.724497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:17.747753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00239828-6d25-4b85-863d-9b07893ad2cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.510082 May 10 02:32:17.748452 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2307/4590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:17 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:18.770662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:18.772778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:18.781088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:18.782145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:18.783163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:18.787441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:19.051641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:19.064373 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82e3995d-ce51-4d2c-8b77-5c15d918cb9e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1506 microversion: 2.1 time: 0.302962 May 10 02:32:19.064992 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2284/4591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:18 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:20.088238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:20.089769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:20.103620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:20.104839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:20.106040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:20.106727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:20.456483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:20.468056 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65f0cea3-5c99-4eed-874a-2a1f13129717 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1506 microversion: 2.1 time: 0.390049 May 10 02:32:20.479620 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2308/4592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:20 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:21.485997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:21.486540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:21.497037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:21.503812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:21.504670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:21.505127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:21.818557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f3339be0-3813-45c4-b54e-7fef9708be80 req-f8308bc8-185b-47ca-bf06-53e6cd3f985e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1315ef69-47fe-491a-9c19-c286dceee05c", "name": "network-vif-unplugged", "status": "completed", "tag": "205958e4-937e-42ea-bf43-d296ae0cbeb2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:21.836808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f3339be0-3813-45c4-b54e-7fef9708be80 req-f8308bc8-185b-47ca-bf06-53e6cd3f985e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:21.851485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f3339be0-3813-45c4-b54e-7fef9708be80 req-f8308bc8-185b-47ca-bf06-53e6cd3f985e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:21.890257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.server_external_events [req-f3339be0-3813-45c4-b54e-7fef9708be80 req-f8308bc8-185b-47ca-bf06-53e6cd3f985e service nova] Unable to find a host for instance 1315ef69-47fe-491a-9c19-c286dceee05c. Dropping event network-vif-unplugged {{(pid=118716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 02:32:21.893368 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f3339be0-3813-45c4-b54e-7fef9708be80 req-f8308bc8-185b-47ca-bf06-53e6cd3f985e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078787 May 10 02:32:21.901240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2309/4593] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 10 02:32:22.305932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:22.314245 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36e02836-af77-4d11-a2f5-317fadf9d1c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 200 len: 1509 microversion: 2.1 time: 0.832319 May 10 02:32:22.321273 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2285/4594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:21 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 1509 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:22.340724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:22.345884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:22.353522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:22.362007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:22.363766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:22.364671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:22.551627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:22.568477 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2a047ac-510d-4707-b1d5-168dba1ad57c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.234356 May 10 02:32:22.569637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2310/4595] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:22 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:22.596242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:22.597401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:22.633972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:22.645547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:22.647834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:22.648946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:22.921670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:22.937240 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a92ba672-7e32-4c7a-abac-4a8c9c433aae tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.347564 May 10 02:32:22.938079 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2286/4596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:22 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:22.956919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:22.959058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:22.977556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:22.978024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:22.979739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:22.982654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:23.191777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:23.203167 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b8d4cf5a-a54d-46ba-b0d4-cfc78a1421b7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.252944 May 10 02:32:23.204566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2311/4597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:22 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:23.219392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:23.220788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:23.227849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:23.231625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:23.233597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:23.235225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:23.469081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:23.484070 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24307520-1e19-41a3-83b7-e45175021e19 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.267872 May 10 02:32:23.485886 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2287/4598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:23 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:23.501524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acb66965-5912-4dbe-ae31-3f71f5f64c92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:23.508566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb66965-5912-4dbe-ae31-3f71f5f64c92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:23.508998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb66965-5912-4dbe-ae31-3f71f5f64c92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:23.537459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acb66965-5912-4dbe-ae31-3f71f5f64c92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Going to try to stop instance {{(pid=118716) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:32:23.617646 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acb66965-5912-4dbe-ae31-3f71f5f64c92 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.119702 May 10 02:32:23.656245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:23.657522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:23.662945 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2312/4599] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:32:23 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:32:23.669072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:23.669809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:23.670850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:23.674273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:23.987579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:24.000823 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a2bc6d4-6ebd-48bb-a8c9-3e8d0c8d24ab tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.377998 May 10 02:32:24.003238 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2288/4600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:23 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:25.032041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:25.033915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:25.043097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:25.043850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:25.045982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:25.046624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:25.354683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:25.363644 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f24148d-33b9-4f7e-958f-e558f83017c1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.340040 May 10 02:32:25.368160 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2313/4601] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:25 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:32:26.386108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:26.388180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:26.397335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:26.397920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:26.398949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:26.399505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:26.714286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:26.725716 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa6e6246-ccc2-4e27-8957-58437a7d6544 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.345043 May 10 02:32:26.726609 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2289/4602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:26 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:32:27.744595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:27.745415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:27.760701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:27.766089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:27.767704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:27.769439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:28.400985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:28.409299 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f80c065-a5ae-4172-b3b1-ed215c1f44a6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.670285 May 10 02:32:28.421240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2314/4603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:27 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:29.428792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:29.429558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:29.439856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:29.442753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:29.445766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:29.446399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:29.723278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:29.734211 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37f87c8d-32e9-4c2e-8a34-b0bc6625bec8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.310107 May 10 02:32:29.737291 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2290/4604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:29 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:30.754208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:30.754837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:30.766087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:30.766997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:30.768631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:30.769248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:31.019604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:31.028524 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5854fa0f-ecc4-4f44-8c10-c5db153cb8a1 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.278296 May 10 02:32:31.029136 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2315/4605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:30 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:32.055104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:32.055104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:32.073959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:32.073959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:32.073959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:32.073959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:32.314823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:32.322890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d713799e-9790-4a1a-9fac-0eb78a539c29 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.280899 May 10 02:32:32.331112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2291/4606] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:32 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:33.340472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:33.341112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:33.350423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:33.350927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:33.351766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:33.352390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:33.800126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:33.809570 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7390ab62-dee3-4985-97ea-42ec784df5a2 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1678 microversion: 2.1 time: 0.472187 May 10 02:32:33.810306 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2316/4607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:33 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1678 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:34.826647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:34.827305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:34.837938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:34.838394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:34.839209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:34.839652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:35.222574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:35.235724 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4179a46-094e-45c0-9509-983368cc7c8e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1655 microversion: 2.1 time: 0.413308 May 10 02:32:35.237246 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2292/4608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:34 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1655 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:35.258989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e0cfc92-cc16-437d-add0-71c5305a6a28 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:35.267326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e0cfc92-cc16-437d-add0-71c5305a6a28 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:35.268020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e0cfc92-cc16-437d-add0-71c5305a6a28 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:35.295683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e0cfc92-cc16-437d-add0-71c5305a6a28 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Going to try to start instance {{(pid=118716) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 02:32:35.347760 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e0cfc92-cc16-437d-add0-71c5305a6a28 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.098688 May 10 02:32:35.351962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2317/4609] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:32:35 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:32:35.356991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:35.357628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:35.371257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:35.371745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:35.372537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:35.373002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:35.922634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:35.932663 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8967e925-4285-4006-85bc-7d16e8ac3170 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1664 microversion: 2.1 time: 0.579424 May 10 02:32:35.935973 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2293/4610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:35 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1664 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:36.953305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:36.954162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:36.967663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:36.970043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:36.973879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:36.974498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:37.194760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:37.205089 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0521330d-7685-4761-ba9b-5e0a9b5435c7 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1664 microversion: 2.1 time: 0.255765 May 10 02:32:37.206635 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2318/4611] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:36 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1664 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:38.222340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:38.223622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:38.232593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:38.232969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:38.233849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:38.245177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:38.633981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:38.656744 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-32a5cd2a-fcfe-4152-a357-e0e369603b4d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.432812 May 10 02:32:38.656744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2294/4612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:38 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:38.675234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:38.676313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:38.695377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:38.695762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:38.696941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:38.697408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:39.004096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:39.018924 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-68a37aa4-1f91-4bb2-80d1-e17c36c4a96d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.348459 May 10 02:32:39.019572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2319/4613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:38 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:39.042651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:39.056052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:39.064414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:39.065106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:39.066109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:39.066765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:39.426464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:39.445668 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab8b8498-9c68-40b1-b0a5-10bb1bed9b16 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.407283 May 10 02:32:39.447420 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2295/4614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:39 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:39.462615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:39.463544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:39.470479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:39.476786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:39.477794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:39.478403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:39.766431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:39.775652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa99929b-fb5f-47b2-80c8-2b473656641f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.317010 May 10 02:32:39.776366 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2320/4615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:39 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:39.795957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:39.796512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:39.804250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:39.804962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:39.806107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:39.807110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.128251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:40.129016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:40.139846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:40.142311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.143458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:40.144137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.172078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:40.174660 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51eb5c76-1e28-4355-a7cb-da6b08ba4405 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/ips" status: 200 len: 149 microversion: 2.1 time: 0.050681 May 10 02:32:40.189808 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c4955f92-486c-49ea-8edd-4c4719ca3882 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.400166 May 10 02:32:40.190657 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2321/4616] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:32:40 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/ips => generated 149 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:32:40.193305 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2296/4617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:39 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:40.206537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:40.207109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:40.213177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:40.213955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.214912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:40.215542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.242762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lazy-loading 'flavor' on Instance uuid fb527ff7-e5fa-4225-8f67-285b9796b48f {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:32:40.356893 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-947e4c2c-98ef-4c66-aa1a-5790fe94de2d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.153715 May 10 02:32:40.358139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2322/4618] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:32:40 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:32:40.380643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:40.383317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:40.426202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:40.428074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.429595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:40.430222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:40.881794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:40.898061 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9622ba68-0635-4d1f-9eb6-c8a69a1c7d4f tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1676 microversion: 2.1 time: 0.535244 May 10 02:32:40.898968 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2297/4619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:40 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1676 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:41.916729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:41.917574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:41.936954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:41.937643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:41.939326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:41.940980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:42.267965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:42.278309 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32a439aa-c885-4f15-8d0e-d8b9912bfeaf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1659 microversion: 2.1 time: 0.365992 May 10 02:32:42.279220 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2323/4620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:41 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1659 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:42.304391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:42.305694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:42.331434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:42.333501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:42.338618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:42.339210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:42.531100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92122823-f3bb-4cab-b6d4-31c244df51e9 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action" status: 202 len: 0 microversion: 2.1 time: 0.237846 May 10 02:32:42.533905 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2298/4621] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:32:42 2022] POST /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:32:42.543524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:42.544161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:42.550252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:42.550747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:42.551625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:42.552213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:43.084193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:43.097901 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-34528984-9471-4628-8394-8162c61e00e0 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1665 microversion: 2.1 time: 0.559136 May 10 02:32:43.099410 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2324/4622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:42 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1665 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:43.974906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:43.976799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:43.988867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:43.989364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:43.990160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:43.990600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:44.119135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:44.121117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:44.159046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:44.159893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:44.168016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:44.169234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:44.477763 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c9a1c03a-2855-45eb-837a-c5f69befd6fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507416 May 10 02:32:44.479018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2299/4623] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:32:43 2022] POST /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:32:44.751220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:44.762946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a66d8ecf-3b11-4a23-bf1c-a97619fdb136 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1665 microversion: 2.1 time: 0.650638 May 10 02:32:44.771112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2325/4624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:44 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1665 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:45.784515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:45.786347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:45.803471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:45.806243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:45.807822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:45.808944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:46.058405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:46.068600 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5be27346-5ae0-420a-862e-6eb329283566 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.290572 May 10 02:32:46.081025 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2300/4625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:45 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:46.086157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:46.087468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:46.094844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:46.095557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:46.096514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:46.097108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:46.407352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:46.425919 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54782ff4-8daf-44ad-ae4d-6ea04af328d8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1668 microversion: 2.1 time: 0.342223 May 10 02:32:46.449225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:46.449991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:46.452469 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2326/4626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:46 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1668 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:46.459223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:46.459891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:46.461105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:46.461860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:46.523786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:32:46.540935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Working on deleting snapshot 84d5e52b-075b-4141-a431-dd35490069b5 from shelved instance... May 10 02:32:47.921653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Doing local delete in cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) {{(pid=118717) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 10 02:32:47.922614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:47.923326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:47.923973 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 10 02:32:47.932669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] deallocate_for_instance() {{(pid=118717) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 10 02:32:49.761701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Updating instance_info_cache with network_info: [] {{(pid=118717) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 10 02:32:50.217346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5e297064-ea16-4ef9-ad08-8403a62c0506 req-e72cc896-fda8-47e8-b286-feb30991164a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1315ef69-47fe-491a-9c19-c286dceee05c", "name": "network-vif-deleted", "tag": "205958e4-937e-42ea-bf43-d296ae0cbeb2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:50.236291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5e297064-ea16-4ef9-ad08-8403a62c0506 req-e72cc896-fda8-47e8-b286-feb30991164a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.237080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5e297064-ea16-4ef9-ad08-8403a62c0506 req-e72cc896-fda8-47e8-b286-feb30991164a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:50.272911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.server_external_events [req-5e297064-ea16-4ef9-ad08-8403a62c0506 req-e72cc896-fda8-47e8-b286-feb30991164a service nova] Unable to find a host for instance 1315ef69-47fe-491a-9c19-c286dceee05c. Dropping event network-vif-deleted {{(pid=118716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 02:32:50.276462 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5e297064-ea16-4ef9-ad08-8403a62c0506 req-e72cc896-fda8-47e8-b286-feb30991164a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.464333 May 10 02:32:50.279438 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2327/4627] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 466 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 02:32:50.416173 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-997945cb-710c-4ada-8e3b-2d3fe6714daf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 204 len: 0 microversion: 2.1 time: 3.973838 May 10 02:32:50.417366 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2301/4628] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:32:46 2022] DELETE /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 0 bytes in 3976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:32:50.427452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:50.428356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 1315ef69-47fe-491a-9c19-c286dceee05c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:50.443577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.444341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:50.446854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.449161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:50.501058 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] HTTP exception thrown: Instance 1315ef69-47fe-491a-9c19-c286dceee05c could not be found. May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Request method failure captured: May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c HTTP/1.1 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec0O8XQo4FrGmeG_HpzjeS7gR5W57_tJMJMscRCJn0ajWbtzsiH9KDhIrWIP7kOelJGFNd4_f0pSrS2XvvUxq_2Y6GcOQyt6GJ7RbyRbeKU9XvpYgKRw9aPmuBasDNcFlmSr-5zY2eXsQR3iRPvU4ildoOxDoKuj7ymJiMvLCQsZdu4 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_338dfffcacb94a729ac6d34dcafb5c4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-155324918 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-155324918-project May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2534074779504b4ca699312fdd4664cd May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-155324918-project May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1315ef69-47fe-491a-9c19-c286dceee05c could not be found. May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1315ef69-47fe-491a-9c19-c286dceee05c'} May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1315ef69-47fe-491a-9c19-c286dceee05c could not be found. May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1315ef69-47fe-491a-9c19-c286dceee05c could not be found. May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:32:50.508672 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1315ef69-47fe-491a-9c19-c286dceee05c could not be found. May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Returning 404 to user: Instance 1315ef69-47fe-491a-9c19-c286dceee05c could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52cd2bd1-6335-4eb7-a50b-e6b60c34e84d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c" status: 404 len: 111 microversion: 2.1 time: 0.083793 May 10 02:32:50.517247 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2328/4629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:50 2022] GET /compute/v2.1/servers/1315ef69-47fe-491a-9c19-c286dceee05c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:32:50.526978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:50.527628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:50.537360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.537825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:50.538624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.539125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:50.615868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:32:50.790948 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8e64dd8-b218-4938-b5ff-f9e3da4ea209 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 204 len: 0 microversion: 2.1 time: 0.267475 May 10 02:32:50.791839 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2302/4630] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:32:50 2022] DELETE /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:32:50.802332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:50.803524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:50.818347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.818998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:50.823639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:50.824415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:51.141543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:51.156142 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-048ba56a-7254-409b-b96a-2118bd1498cc tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1465 microversion: 2.1 time: 0.359028 May 10 02:32:51.156993 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2329/4631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:50 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1465 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:52.174614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:52.175979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:52.191608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:52.192910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:52.193860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:52.194549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:52.413013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:52.427873 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a7580ccc-c505-44d2-ac91-30272cd41343 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1465 microversion: 2.1 time: 0.257475 May 10 02:32:52.428809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2303/4632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:52 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1465 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:53.444727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:53.445366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:53.463980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:53.465529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:53.466409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:53.466869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:53.701407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3aa69f14-b2dd-4bea-af7f-f34dcbee11cd req-b534f8ad-14b6-47fa-880c-984f8ffa3a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9378d419-fde3-4ec0-aa2e-8171f8f5d7fd", "name": "network-vif-deleted", "tag": "05ae6dae-74e9-425d-bfb0-e3206dc0c7d9"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:53.742242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3aa69f14-b2dd-4bea-af7f-f34dcbee11cd req-b534f8ad-14b6-47fa-880c-984f8ffa3a8b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:53.742737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3aa69f14-b2dd-4bea-af7f-f34dcbee11cd req-b534f8ad-14b6-47fa-880c-984f8ffa3a8b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:53.768854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3aa69f14-b2dd-4bea-af7f-f34dcbee11cd req-b534f8ad-14b6-47fa-880c-984f8ffa3a8b service nova] Creating event network-vif-deleted:05ae6dae-74e9-425d-bfb0-e3206dc0c7d9 for instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd on n-h1-841089-2 May 10 02:32:53.782832 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3aa69f14-b2dd-4bea-af7f-f34dcbee11cd req-b534f8ad-14b6-47fa-880c-984f8ffa3a8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235159 May 10 02:32:53.789074 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2304/4633] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:32:53.828643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:53.837177 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-77749191-536b-474c-936f-6b09ce61337d tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 200 len: 1465 microversion: 2.1 time: 0.396633 May 10 02:32:53.837759 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2330/4634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:53 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 1465 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:54.857253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:54.858624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:54.871863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:54.877186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:54.878326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:54.883790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:54.959865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] HTTP exception thrown: Instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd could not be found. May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Request method failure captured: May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd HTTP/1.1 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec0O8XQo4FrGmeG_HpzjeS7gR5W57_tJMJMscRCJn0ajWbtzsiH9KDhIrWIP7kOelJGFNd4_f0pSrS2XvvUxq_2Y6GcOQyt6GJ7RbyRbeKU9XvpYgKRw9aPmuBasDNcFlmSr-5zY2eXsQR3iRPvU4ildoOxDoKuj7ymJiMvLCQsZdu4 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_338dfffcacb94a729ac6d34dcafb5c4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-155324918 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-155324918-project May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2534074779504b4ca699312fdd4664cd May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-155324918-project May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd could not be found. May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '9378d419-fde3-4ec0-aa2e-8171f8f5d7fd'} May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd could not be found. May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd could not be found. May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:32:54.968302 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd could not be found. May 10 02:32:54.971797 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:54.979970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Returning 404 to user: Instance 9378d419-fde3-4ec0-aa2e-8171f8f5d7fd could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:32:54.981237 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59ba44e2-5ebb-4324-8e16-21c5588bc4ec tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd" status: 404 len: 111 microversion: 2.1 time: 0.130454 May 10 02:32:54.988335 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2305/4635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:54 2022] GET /compute/v2.1/servers/9378d419-fde3-4ec0-aa2e-8171f8f5d7fd => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:32:54.997120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:54.997975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:55.031682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:55.032621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:55.035166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:55.036714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:55.164016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:32:55.384220 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cad0947-8a5e-429e-890d-f92ae3bde189 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 204 len: 0 microversion: 2.1 time: 0.391332 May 10 02:32:55.384878 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2331/4636] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:32:54 2022] DELETE /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:32:55.393031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:55.393883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:55.402560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:55.403259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:55.404552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:55.405237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:56.136034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:56.145831 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08afbdfe-339f-45de-9ef3-70a38b84f182 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1507 microversion: 2.1 time: 0.756592 May 10 02:32:56.149126 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2306/4637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:55 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:57.167444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:57.168744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:57.177567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:57.177931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:57.179462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:57.180061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:57.514499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:57.527644 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee46d6fb-5805-4e31-98b7-4f61f1b44be8 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1507 microversion: 2.1 time: 0.366651 May 10 02:32:57.535374 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2332/4638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:57 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1507 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:32:58.478398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b4a35ffd-8cb6-4298-a0fa-eae1e2c250fa req-18849aae-7629-4081-ba6a-89550b5d6cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7505a4ef-6342-42ac-96fb-f4c07b37ce2d", "name": "network-vif-deleted", "tag": "8ef57eb4-6dfa-41dc-8f06-b1df793bfaf5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:32:58.502242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b4a35ffd-8cb6-4298-a0fa-eae1e2c250fa req-18849aae-7629-4081-ba6a-89550b5d6cca service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:58.503651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b4a35ffd-8cb6-4298-a0fa-eae1e2c250fa req-18849aae-7629-4081-ba6a-89550b5d6cca service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:58.547902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:58.548439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:58.550339 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b4a35ffd-8cb6-4298-a0fa-eae1e2c250fa req-18849aae-7629-4081-ba6a-89550b5d6cca service nova] Creating event network-vif-deleted:8ef57eb4-6dfa-41dc-8f06-b1df793bfaf5 for instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d on n-h2-841089-2 May 10 02:32:58.558732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:58.563943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:58.565216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:58.565833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:58.567418 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b4a35ffd-8cb6-4298-a0fa-eae1e2c250fa req-18849aae-7629-4081-ba6a-89550b5d6cca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093610 May 10 02:32:58.568727 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2307/4639] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:32:58.835414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:32:58.853007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62efb3ca-7cdb-47f6-acc6-83c957559297 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 200 len: 1299 microversion: 2.1 time: 0.308464 May 10 02:32:58.856188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2333/4640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:58 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 1299 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:32:59.875387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:59.876808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: 7505a4ef-6342-42ac-96fb-f4c07b37ce2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:59.889220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:59.899785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:59.900942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:59.901644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:59.925253 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] HTTP exception thrown: Instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d could not be found. May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Request method failure captured: May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d HTTP/1.1 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec0O8XQo4FrGmeG_HpzjeS7gR5W57_tJMJMscRCJn0ajWbtzsiH9KDhIrWIP7kOelJGFNd4_f0pSrS2XvvUxq_2Y6GcOQyt6GJ7RbyRbeKU9XvpYgKRw9aPmuBasDNcFlmSr-5zY2eXsQR3iRPvU4ildoOxDoKuj7ymJiMvLCQsZdu4 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_338dfffcacb94a729ac6d34dcafb5c4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-155324918 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-155324918-project May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2534074779504b4ca699312fdd4664cd May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-155324918-project May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d could not be found. May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '7505a4ef-6342-42ac-96fb-f4c07b37ce2d'} May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d could not be found. May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d could not be found. May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:32:59.927838 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d could not be found. May 10 02:32:59.931266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:32:59.934726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Returning 404 to user: Instance 7505a4ef-6342-42ac-96fb-f4c07b37ce2d could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:32:59.935842 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe4a508a-5306-48ec-a15c-f66ac1eda6a5 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d" status: 404 len: 111 microversion: 2.1 time: 0.065550 May 10 02:32:59.936969 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2308/4641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:32:59 2022] GET /compute/v2.1/servers/7505a4ef-6342-42ac-96fb-f4c07b37ce2d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:32:59.945729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:32:59.946261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:32:59.957019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:59.957557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:32:59.966113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:32:59.966776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:00.028042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:33:00.260832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-522a9bbf-4ee6-4fa8-a2c1-e69b5acf3e27 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 204 len: 0 microversion: 2.1 time: 0.318899 May 10 02:33:00.263025 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2334/4642] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:32:59 2022] DELETE /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:00.271190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:00.272161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:00.282355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:00.283190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:00.291453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:00.292260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:00.650075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:00.658421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-257f7a7b-062b-4d3e-9c13-60a442267815 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1493 microversion: 2.1 time: 0.391223 May 10 02:33:00.664912 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2309/4643] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:00 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1493 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:01.683653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:01.684449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:01.691625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:01.706815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:01.707968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:01.708424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:01.927338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:01.944932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-42a6ead5-527e-4a89-8438-d6ed712c9ba1 req-89122f75-a702-4956-9f7f-f0aa48082778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee42f628-6ffd-48e4-8cac-ebe17161f31d", "name": "network-vif-deleted", "tag": "f4b048a1-f46a-44d7-80de-6e1250579657"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:01.962243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42a6ead5-527e-4a89-8438-d6ed712c9ba1 req-89122f75-a702-4956-9f7f-f0aa48082778 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:01.963596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-42a6ead5-527e-4a89-8438-d6ed712c9ba1 req-89122f75-a702-4956-9f7f-f0aa48082778 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:01.969982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7d1b7ebd-d8ae-4fd3-b321-5c7e546c195e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 200 len: 1451 microversion: 2.1 time: 0.291094 May 10 02:33:01.970917 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2335/4644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:01 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 1451 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:01.998656 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-42a6ead5-527e-4a89-8438-d6ed712c9ba1 req-89122f75-a702-4956-9f7f-f0aa48082778 service nova] Creating event network-vif-deleted:f4b048a1-f46a-44d7-80de-6e1250579657 for instance ee42f628-6ffd-48e4-8cac-ebe17161f31d on n-h1-841089-2 May 10 02:33:02.009613 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-42a6ead5-527e-4a89-8438-d6ed712c9ba1 req-89122f75-a702-4956-9f7f-f0aa48082778 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070209 May 10 02:33:02.011473 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2310/4645] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:02.989292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:02.995027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: ee42f628-6ffd-48e4-8cac-ebe17161f31d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:03.020666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:03.021384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:03.022770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:03.023454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:03.044130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] HTTP exception thrown: Instance ee42f628-6ffd-48e4-8cac-ebe17161f31d could not be found. May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Request method failure captured: May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d HTTP/1.1 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec0O8XQo4FrGmeG_HpzjeS7gR5W57_tJMJMscRCJn0ajWbtzsiH9KDhIrWIP7kOelJGFNd4_f0pSrS2XvvUxq_2Y6GcOQyt6GJ7RbyRbeKU9XvpYgKRw9aPmuBasDNcFlmSr-5zY2eXsQR3iRPvU4ildoOxDoKuj7ymJiMvLCQsZdu4 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_338dfffcacb94a729ac6d34dcafb5c4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-155324918 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-155324918-project May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2534074779504b4ca699312fdd4664cd May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-155324918-project May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance ee42f628-6ffd-48e4-8cac-ebe17161f31d could not be found. May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'ee42f628-6ffd-48e4-8cac-ebe17161f31d'} May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee42f628-6ffd-48e4-8cac-ebe17161f31d could not be found. May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee42f628-6ffd-48e4-8cac-ebe17161f31d could not be found. May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:03.047707 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee42f628-6ffd-48e4-8cac-ebe17161f31d could not be found. May 10 02:33:03.052166 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:03.053326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Returning 404 to user: Instance ee42f628-6ffd-48e4-8cac-ebe17161f31d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:03.054358 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e415ff8-2786-4696-9d42-6f2e9c45747c tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d" status: 404 len: 111 microversion: 2.1 time: 0.069893 May 10 02:33:03.058369 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2336/4646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:02 2022] GET /compute/v2.1/servers/ee42f628-6ffd-48e4-8cac-ebe17161f31d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:33:03.065974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:03.067434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:03.089713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:03.090310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:03.091427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:03.092088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:03.120671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:33:03.249149 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-30201d75-ddb7-40d4-a4f3-e94b7eac481b tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 204 len: 0 microversion: 2.1 time: 0.186962 May 10 02:33:03.249981 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2311/4647] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:33:03 2022] DELETE /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:03.259601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:03.260234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:03.271094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:03.271923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:03.272870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:03.273496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:03.573721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:03.585026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fbc47bdb-6472-4195-8660-b728b033b3cd tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1674 microversion: 2.1 time: 0.330163 May 10 02:33:03.585943 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2337/4648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:03 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1674 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:04.602529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:04.603441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:04.614968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:04.615458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:04.616255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:04.620935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:05.384559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:05.393284 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b10b81b-8e4d-417c-9c5d-6ee9e99862cf tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1674 microversion: 2.1 time: 0.795158 May 10 02:33:05.396910 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2312/4649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:04 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1674 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:06.413558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:06.414187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:06.427056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:06.427779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:06.438868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:06.439366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:06.588325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:06.596300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-855cc14e-11f6-4668-b44d-9ce1c1001c70 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1606 microversion: 2.1 time: 0.186804 May 10 02:33:06.603701 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2338/4650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:06 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1606 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:07.119999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-200d38f6-3aa3-4abd-a3c4-8ce80cdcf6ac req-cae21b36-2d66-416f-81ac-5d8a1142a695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527ff7-e5fa-4225-8f67-285b9796b48f", "name": "network-vif-deleted", "tag": "be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:07.169860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-200d38f6-3aa3-4abd-a3c4-8ce80cdcf6ac req-cae21b36-2d66-416f-81ac-5d8a1142a695 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:07.170265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-200d38f6-3aa3-4abd-a3c4-8ce80cdcf6ac req-cae21b36-2d66-416f-81ac-5d8a1142a695 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:07.251345 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-200d38f6-3aa3-4abd-a3c4-8ce80cdcf6ac req-cae21b36-2d66-416f-81ac-5d8a1142a695 service nova] Creating event network-vif-deleted:be2e97fb-9685-4fdd-8baf-0c64ecbb6aa3 for instance fb527ff7-e5fa-4225-8f67-285b9796b48f on n-h2-841089-2 May 10 02:33:07.270203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-200d38f6-3aa3-4abd-a3c4-8ce80cdcf6ac req-cae21b36-2d66-416f-81ac-5d8a1142a695 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155954 May 10 02:33:07.277406 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2313/4651] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:07.621072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:07.621707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:07.655497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:07.656032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:07.656867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:07.658158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:07.747984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:07.750221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:07.752088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lazy-loading 'fault' on Instance uuid fb527ff7-e5fa-4225-8f67-285b9796b48f {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:33:07.861248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2534074779504b4ca699312fdd4664cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dfffcacb94a729ac6d34dcafb5c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:07.874837 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2c0a90c-edd1-4378-92ed-5c4fc777397e tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 200 len: 1326 microversion: 2.1 time: 0.263863 May 10 02:33:07.883214 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2339/4652] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:07 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 1326 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:08.298183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c89f026-ed7e-408c-89a4-b6e3f2b99780 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: .version_select at 0x7f3d378af940>, body: {"keypair": {"name": "tempest-keypair-428871594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQlPj2GdMHniWrYeWSjYNTY4MHDCIUprj5AEZtIRHEMJHqcfTYLvFzCNzonU9vtL0D9elNcksvN8yzKOnkJbmKatTmpC+BsFLN4xFGhS9nsto3lvq3jU76auwwUyPL/BA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:08.333382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-5c89f026-ed7e-408c-89a4-b6e3f2b99780 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:08.348786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-5c89f026-ed7e-408c-89a4-b6e3f2b99780 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:08.415418 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c89f026-ed7e-408c-89a4-b6e3f2b99780 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122693 May 10 02:33:08.422031 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2314/4653] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:33:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:33:08.899463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:08.900236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] [instance: fb527ff7-e5fa-4225-8f67-285b9796b48f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:08.914530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:08.915000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:08.918579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:08.919689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:08.952915 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] HTTP exception thrown: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f could not be found. May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Request method failure captured: May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f HTTP/1.1 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec0O8XQo4FrGmeG_HpzjeS7gR5W57_tJMJMscRCJn0ajWbtzsiH9KDhIrWIP7kOelJGFNd4_f0pSrS2XvvUxq_2Y6GcOQyt6GJ7RbyRbeKU9XvpYgKRw9aPmuBasDNcFlmSr-5zY2eXsQR3iRPvU4ildoOxDoKuj7ymJiMvLCQsZdu4 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_338dfffcacb94a729ac6d34dcafb5c4d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/338dfffcacb94a729ac6d34dcafb5c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-155324918 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 338dfffcacb94a729ac6d34dcafb5c4d May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-155324918 May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-155324918-project May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2534074779504b4ca699312fdd4664cd May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-155324918-project May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f could not be found. May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'fb527ff7-e5fa-4225-8f67-285b9796b48f'} May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f could not be found. May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f could not be found. May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:08.956117 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f could not be found. May 10 02:33:08.960734 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:08.963689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Returning 404 to user: Instance fb527ff7-e5fa-4225-8f67-285b9796b48f could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:08.966858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8e4a18ae-e37a-4dda-9696-74480a897fa6 tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f" status: 404 len: 111 microversion: 2.1 time: 0.077786 May 10 02:33:08.969185 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2340/4654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:08 2022] GET /compute/v2.1/servers/fb527ff7-e5fa-4225-8f67-285b9796b48f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:33:08.979306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a56c6a48-92fb-4ca1-9dcc-ab5c1d6cf08a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] Calling method '.version_select at 0x7f3d36dacdc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:09.017502 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a56c6a48-92fb-4ca1-9dcc-ab5c1d6cf08a tempest-ServerActionsTestJSON-155324918 tempest-ServerActionsTestJSON-155324918-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950939008" status: 202 len: 0 microversion: 2.1 time: 0.042049 May 10 02:33:09.021869 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2315/4655] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950939008 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:33:13.108344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1704057933", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b17ef216-a989-4dab-a21d-9ac51c1b13b9"}], "security_groups": [{"name": "tempest-securitygroup--97371723"}], "key_name": "tempest-keypair-428871594", "user_data": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:13.397471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] validate_networks() for [('b17ef216-a989-4dab-a21d-9ac51c1b13b9', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:33:14.710835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:33:14.711394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:33:14.712093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:33:14.712926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:33:14.713545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:33:14.731287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:14.731882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:14.735422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:14.737263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:14.824884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:14.843829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:14.881423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:33:14.883805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:33:14.991263 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6cc2d712-3c54-4352-9e8a-475b601cb0ee tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.887115 May 10 02:33:14.996587 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2341/4656] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:33:13 2022] POST /compute/v2.1/servers => generated 400 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:33:15.004783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-692b233c-941a-4864-a70d-ef62685155d5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:15.006618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-692b233c-941a-4864-a70d-ef62685155d5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:15.228169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-692b233c-941a-4864-a70d-ef62685155d5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:15.237422 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-692b233c-941a-4864-a70d-ef62685155d5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1241 microversion: 2.1 time: 0.239304 May 10 02:33:15.241851 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2316/4657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:14 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:16.258872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:16.260270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:16.273625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:16.276743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:16.278296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:16.278950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:16.530248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:16.545311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e4e4393-eea1-4293-b58c-f0ce2441ddb8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1237 microversion: 2.1 time: 0.291261 May 10 02:33:16.545921 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2342/4658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:16 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1237 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:17.562346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:17.562976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:17.574658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:17.575024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:17.575858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:17.576314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:17.777536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:17.787597 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6ccb2c9-1746-4a95-8108-3934ab09b959 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1299 microversion: 2.1 time: 0.229573 May 10 02:33:17.789519 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2317/4659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:17 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:18.807144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:18.808390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:18.883841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:18.884671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:18.889415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:18.898713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:19.044696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:19.059866 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-336ad0af-e5cf-44eb-ba9d-733c7a9ad89b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1299 microversion: 2.1 time: 0.258462 May 10 02:33:19.069689 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2343/4660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:18 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:20.078413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:20.079043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:20.086011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:20.086468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:20.095115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:20.095812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:20.227346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:20.235002 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff6f58d4-c410-4281-ba12-940360780dc3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1299 microversion: 2.1 time: 0.161407 May 10 02:33:20.239091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2318/4661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:20 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:21.255341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:21.261965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:21.284660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:21.293285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:21.294339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:21.294967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:22.105251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:22.112615 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc310c02-e7b1-4a03-9ddc-8f3a67280e7c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.861500 May 10 02:33:22.119850 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2344/4662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:21 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:23.136478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:23.137225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:23.148314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:23.159281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:23.161735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:23.162309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:23.656639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:23.665944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5174f7b2-c2b2-4f87-ac3c-fd0c2b32d2d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.533718 May 10 02:33:23.672207 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2319/4663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:23 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:24.021309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0b06cc8e-65f5-4ee9-8561-eeab0dc2233d req-82b33536-eecb-49c7-b19b-63dd223f444c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4aa7ac0-2fe6-4523-9195-33e40f831359", "tag": "31a08f81-9058-46ff-8d70-0ec2d0a64e1e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:24.042563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0b06cc8e-65f5-4ee9-8561-eeab0dc2233d req-82b33536-eecb-49c7-b19b-63dd223f444c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:24.044235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0b06cc8e-65f5-4ee9-8561-eeab0dc2233d req-82b33536-eecb-49c7-b19b-63dd223f444c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:24.079242 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0b06cc8e-65f5-4ee9-8561-eeab0dc2233d req-82b33536-eecb-49c7-b19b-63dd223f444c service nova] Creating event network-changed:31a08f81-9058-46ff-8d70-0ec2d0a64e1e for instance f4aa7ac0-2fe6-4523-9195-33e40f831359 on n-h1-841089-2 May 10 02:33:24.095262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0b06cc8e-65f5-4ee9-8561-eeab0dc2233d req-82b33536-eecb-49c7-b19b-63dd223f444c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078727 May 10 02:33:24.098291 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2345/4664] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:24.689373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:24.690002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:24.702795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:24.713473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:24.717716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:24.720540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:25.031527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:25.045307 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c9ea64ce-0eb1-43bf-a1ab-7e034c78994c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.360001 May 10 02:33:25.059766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2320/4665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:24 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:26.063189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:26.063890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:26.076429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:26.077234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:26.078261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:26.079045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:26.304578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c40c436-df0a-4f6f-ad4c-094fd11f6336 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Action: 'create', calling method: .version_select at 0x7f3d367e63a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-360537609", "policies": ["affinity"]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:26.321840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7c40c436-df0a-4f6f-ad4c-094fd11f6336 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:26.333522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7c40c436-df0a-4f6f-ad4c-094fd11f6336 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:26.353299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:26.364530 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7ba36de-8711-4e65-815f-ce9292d9cf72 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.305421 May 10 02:33:26.375890 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2321/4666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:26 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:26.426391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7c40c436-df0a-4f6f-ad4c-094fd11f6336 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:26.434490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-7c40c436-df0a-4f6f-ad4c-094fd11f6336 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:26.455916 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c40c436-df0a-4f6f-ad4c-094fd11f6336 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.411006 May 10 02:33:26.458699 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2346/4667] 10.222.0.52 () {60 vars in 1173 bytes} [Tue May 10 02:33:26 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:33:26.480243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ef9e753-bd32-4a67-854a-3c726cb5387e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Action: 'create', calling method: .version_select at 0x7f3d370da040>, body: {"server_group": {"name": "tempest-server-group-665432913", "policies": ["affinity"]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:26.524619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0ef9e753-bd32-4a67-854a-3c726cb5387e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:26.532003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0ef9e753-bd32-4a67-854a-3c726cb5387e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:26.660506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0ef9e753-bd32-4a67-854a-3c726cb5387e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:26.682096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0ef9e753-bd32-4a67-854a-3c726cb5387e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:26.713172 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ef9e753-bd32-4a67-854a-3c726cb5387e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.248708 May 10 02:33:26.715125 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2322/4668] 10.222.0.52 () {60 vars in 1172 bytes} [Tue May 10 02:33:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:26.725872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0624f00d-f34a-490b-933a-9f1e26ff3d4a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Action: 'create', calling method: .version_select at 0x7f3d36631c10>, body: {"server_group": {"name": "tempest-server-group-665432913", "policies": ["affinity"]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:26.753086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0624f00d-f34a-490b-933a-9f1e26ff3d4a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:26.766677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0624f00d-f34a-490b-933a-9f1e26ff3d4a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:26.853378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0624f00d-f34a-490b-933a-9f1e26ff3d4a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:26.868692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0624f00d-f34a-490b-933a-9f1e26ff3d4a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:26.895350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0624f00d-f34a-490b-933a-9f1e26ff3d4a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.173842 May 10 02:33:26.896533 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2347/4669] 10.222.0.52 () {60 vars in 1172 bytes} [Tue May 10 02:33:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:26.909566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9dfa7275-4884-4889-87d9-7b0c580c9b47 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:26.971925 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9dfa7275-4884-4889-87d9-7b0c580c9b47 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/e819d934-a417-4730-b174-6f81c282a53b" status: 204 len: 0 microversion: 2.1 time: 0.070174 May 10 02:33:26.975708 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2323/4670] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:26 2022] DELETE /compute/v2.1/os-server-groups/e819d934-a417-4730-b174-6f81c282a53b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:26.984025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a83bada-3949-4f5a-9c47-72401f893f53 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.000900 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a83bada-3949-4f5a-9c47-72401f893f53 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.021212 May 10 02:33:27.002893 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2348/4671] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:33:26 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:27.012575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d83a92f-b08f-41fe-8f2e-50d72162b324 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.043323 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d83a92f-b08f-41fe-8f2e-50d72162b324 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/753670ce-0ece-469a-aba5-de9816fb3eb8" status: 204 len: 0 microversion: 2.1 time: 0.035811 May 10 02:33:27.045225 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2324/4672] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:27 2022] DELETE /compute/v2.1/os-server-groups/753670ce-0ece-469a-aba5-de9816fb3eb8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:27.053553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-368c8115-104e-4df0-84ce-33db2559706d tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.063412 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-368c8115-104e-4df0-84ce-33db2559706d tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014219 May 10 02:33:27.070509 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2349/4673] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:33:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:27.076241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c996d047-f45d-4039-a62d-af15f90b18b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Action: 'create', calling method: .version_select at 0x7f3d36d9ad30>, body: {"server_group": {"name": "tempest-server-group-1058825568", "policies": ["affinity"]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:27.103385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c996d047-f45d-4039-a62d-af15f90b18b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:27.111346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c996d047-f45d-4039-a62d-af15f90b18b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:27.209975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c996d047-f45d-4039-a62d-af15f90b18b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:27.217405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c996d047-f45d-4039-a62d-af15f90b18b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:27.232906 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c996d047-f45d-4039-a62d-af15f90b18b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.161528 May 10 02:33:27.234126 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2325/4674] 10.222.0.52 () {60 vars in 1172 bytes} [Tue May 10 02:33:27 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:33:27.244651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6c24363-5a3f-4cd5-8cf8-eaa4813b39da tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.311923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f6c24363-5a3f-4cd5-8cf8-eaa4813b39da tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/1b031f58-cf9b-470a-b97f-3507cbad5664" status: 204 len: 0 microversion: 2.1 time: 0.071115 May 10 02:33:27.316000 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2350/4675] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:27 2022] DELETE /compute/v2.1/os-server-groups/1b031f58-cf9b-470a-b97f-3507cbad5664 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:27.321862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a05d4ae-c133-4a90-ba55-16bcfcf7d0d2 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.352926 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a05d4ae-c133-4a90-ba55-16bcfcf7d0d2 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032442 May 10 02:33:27.353943 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2326/4676] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:33:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:27.367265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-331b3271-decf-402f-a5a4-a95d11e48cd1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Action: 'create', calling method: .version_select at 0x7f3d362b7040>, body: {"server_group": {"name": "tempest-server-group-427933724", "policies": ["anti-affinity"]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:27.381792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.382430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:27.385259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-331b3271-decf-402f-a5a4-a95d11e48cd1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:27.391826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-331b3271-decf-402f-a5a4-a95d11e48cd1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:27.396406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:27.399754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:27.403722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:27.404352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:27.446271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-331b3271-decf-402f-a5a4-a95d11e48cd1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:27.452299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-331b3271-decf-402f-a5a4-a95d11e48cd1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_groups'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:27.467531 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-331b3271-decf-402f-a5a4-a95d11e48cd1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.106667 May 10 02:33:27.468705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2351/4677] 10.222.0.52 () {60 vars in 1172 bytes} [Tue May 10 02:33:27 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:27.479219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f4c6b7b-9e2f-4fbc-b9dc-363b21beedaf tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.529155 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f4c6b7b-9e2f-4fbc-b9dc-363b21beedaf tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b22960b7-c55e-4943-b604-e881bc2df8af" status: 204 len: 0 microversion: 2.1 time: 0.053908 May 10 02:33:27.532720 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2352/4678] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:27 2022] DELETE /compute/v2.1/os-server-groups/b22960b7-c55e-4943-b604-e881bc2df8af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:33:27.543540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3bc390b-e751-49f1-855f-cc296304c598 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:27.567388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3bc390b-e751-49f1-855f-cc296304c598 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029057 May 10 02:33:27.568505 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2353/4679] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:33:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:27.645920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-944115569", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "558845c8-95b2-4291-9d83-b21931430bf9"}]}, "os:scheduler_hints": {"group": "777e1aea-6af1-49f4-b056-8f6b107cc378"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:27.756355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:27.763678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] validate_networks() for [('558845c8-95b2-4291-9d83-b21931430bf9', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:33:27.771691 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-01986313-c2c4-46cb-ab9e-e5d744cd8684 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.394174 May 10 02:33:27.772293 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2327/4680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:27 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:33:28.789913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:28.791315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:28.807352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:28.808145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:28.809381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:28.810023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:28.833187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:33:28.834628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:33:28.835755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:33:28.836561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:33:28.837178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:33:28.869527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:28.869993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:28.870806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:28.871881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:28.905920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:28.914587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:28.947527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:33:28.951762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:33:29.059451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:29.068033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:29.138885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:29.153284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Getting quotas for user 21521f4e4c3741a0adcd157025df7e78 and project 15e6ddbe45704a4180d392633b7db925. Resources: {'server_group_members'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:29.190020 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-691a9c73-0e1e-492c-8f5f-448c274ef4f6 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549083 May 10 02:33:29.191952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2354/4681] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:33:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:33:29.208678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7813d1e5-0622-4a58-b0c3-af140560d629 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:29.209451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7813d1e5-0622-4a58-b0c3-af140560d629 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:29.661074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7813d1e5-0622-4a58-b0c3-af140560d629 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:29.674319 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7813d1e5-0622-4a58-b0c3-af140560d629 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1212 microversion: 2.1 time: 0.475470 May 10 02:33:29.675789 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2355/4682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:29 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1212 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:29.814702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:29.828399 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-109324e4-747e-4e4a-b411-5637dd8bcf71 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 1.042515 May 10 02:33:29.841993 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2328/4683] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:28 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:33:30.694155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:30.695955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:30.709943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:30.711145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:30.730261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:30.733262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:30.847479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:30.848382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:30.861835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:30.863304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:30.865604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:30.867417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:30.913382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:30.922702 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b93c398c-1786-44d7-9109-bf2af8941aca tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1264 microversion: 2.1 time: 0.234374 May 10 02:33:30.923334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2356/4684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:30 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:31.356961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ae9c1818-c919-41bc-90d2-ad201f4d8a35 req-f7e00513-7e7c-4bea-b820-3b69c132210e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4aa7ac0-2fe6-4523-9195-33e40f831359", "name": "network-vif-plugged", "status": "completed", "tag": "31a08f81-9058-46ff-8d70-0ec2d0a64e1e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:31.372198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ae9c1818-c919-41bc-90d2-ad201f4d8a35 req-f7e00513-7e7c-4bea-b820-3b69c132210e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:31.372677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ae9c1818-c919-41bc-90d2-ad201f4d8a35 req-f7e00513-7e7c-4bea-b820-3b69c132210e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:31.414099 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ae9c1818-c919-41bc-90d2-ad201f4d8a35 req-f7e00513-7e7c-4bea-b820-3b69c132210e service nova] Creating event network-vif-plugged:31a08f81-9058-46ff-8d70-0ec2d0a64e1e for instance f4aa7ac0-2fe6-4523-9195-33e40f831359 on n-h1-841089-2 May 10 02:33:31.420574 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ae9c1818-c919-41bc-90d2-ad201f4d8a35 req-f7e00513-7e7c-4bea-b820-3b69c132210e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067166 May 10 02:33:31.421717 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2357/4685] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:33:31.598130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:31.606449 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d311b83-48a3-4c2b-bacb-ac8ab3a64004 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.764838 May 10 02:33:31.620400 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2329/4686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:30 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:31.945270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:31.946108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:31.971767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:31.973072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:31.974601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:31.975620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:32.169230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:32.183206 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7bca4bc5-95f3-4b42-acb7-59d0b072b232 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1270 microversion: 2.1 time: 0.247078 May 10 02:33:32.207031 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2358/4687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:31 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:32.641757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:32.642426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:32.653493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:32.658462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:32.659683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:32.663476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:33.124935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:33.133222 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e139a51-457a-4a52-aae0-fd7c60fed5f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1365 microversion: 2.1 time: 0.502089 May 10 02:33:33.136023 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2330/4688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:32 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1365 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:33.209500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:33.210197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:33.225049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:33.226678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:33.229641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:33.230124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:33.777569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:33.787580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3e34aa0-9bea-4109-a496-f352ece0e2b1 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.582992 May 10 02:33:33.788184 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2359/4689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:33 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:34.153594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:34.154587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:34.168278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:34.169127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:34.170194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:34.170889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:34.546437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:34.575680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c058e76-b69a-45db-bac5-d24f3dd5d3a7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1554 microversion: 2.1 time: 0.415214 May 10 02:33:34.576803 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2331/4690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:34 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1554 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:34.593720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:34.594264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:34.610566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:34.610941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:34.611961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:34.613235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:34.763078 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3eeea928-6b30-425e-96af-204c6ee6ba9b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173467 May 10 02:33:34.763831 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2360/4691] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:33:34 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:34.806217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:34.807005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:34.825367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:34.825981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:34.828915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:34.829401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:35.124713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:35.134338 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c1de38e-e783-4bc9-aad5-82929af6c876 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.333067 May 10 02:33:35.134917 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2332/4692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:34 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:35.355357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6e8ea1da-1c98-435a-9dc6-406b9faf624a req-890d3120-8d59-4307-92fb-37055de3d042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d03407-4292-4494-9567-5b99d67bbff8", "tag": "030535b8-7d06-408f-8ffe-56b82f3131d5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:35.396979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6e8ea1da-1c98-435a-9dc6-406b9faf624a req-890d3120-8d59-4307-92fb-37055de3d042 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:35.402904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6e8ea1da-1c98-435a-9dc6-406b9faf624a req-890d3120-8d59-4307-92fb-37055de3d042 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:35.436009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6e8ea1da-1c98-435a-9dc6-406b9faf624a req-890d3120-8d59-4307-92fb-37055de3d042 service nova] Creating event network-changed:030535b8-7d06-408f-8ffe-56b82f3131d5 for instance 15d03407-4292-4494-9567-5b99d67bbff8 on n-h2-841089-2 May 10 02:33:35.449019 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6e8ea1da-1c98-435a-9dc6-406b9faf624a req-890d3120-8d59-4307-92fb-37055de3d042 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097408 May 10 02:33:35.452562 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2361/4693] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:36.151294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:36.152077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:36.172115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:36.172929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:36.174125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:36.174732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:36.585153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:36.595762 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ee94bb3-c43d-48fa-bd0a-777273398607 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.448421 May 10 02:33:36.610351 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2333/4694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:36 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:37.384026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e5bb38df-ba55-4217-9e26-05eda4d1cd4c req-d2fa5005-5157-4226-9725-254289a5b937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4aa7ac0-2fe6-4523-9195-33e40f831359", "tag": "31a08f81-9058-46ff-8d70-0ec2d0a64e1e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:37.401748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e5bb38df-ba55-4217-9e26-05eda4d1cd4c req-d2fa5005-5157-4226-9725-254289a5b937 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:37.402224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e5bb38df-ba55-4217-9e26-05eda4d1cd4c req-d2fa5005-5157-4226-9725-254289a5b937 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:37.434870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e5bb38df-ba55-4217-9e26-05eda4d1cd4c req-d2fa5005-5157-4226-9725-254289a5b937 service nova] Creating event network-changed:31a08f81-9058-46ff-8d70-0ec2d0a64e1e for instance f4aa7ac0-2fe6-4523-9195-33e40f831359 on n-h1-841089-2 May 10 02:33:37.443574 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e5bb38df-ba55-4217-9e26-05eda4d1cd4c req-d2fa5005-5157-4226-9725-254289a5b937 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062638 May 10 02:33:37.444759 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2362/4695] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:37.617899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:37.619153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:37.631257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:37.631961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:37.636610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:37.637236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:37.936541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:37.948092 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b19b2845-84ac-4702-9154-07eac14ad636 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.334188 May 10 02:33:37.950454 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2334/4696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:37 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:38.967298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:38.968203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:38.984547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:38.985156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:38.986200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:38.986869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:39.345155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:39.354820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-577ceaec-ef68-4ea1-a989-0b400bb51c87 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.392581 May 10 02:33:39.355497 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2363/4697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:38 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:40.376717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:40.377340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:40.389152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:40.389617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:40.390419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:40.390889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:40.580258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:40.588922 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d766895a-ac8a-4534-ba79-574f0cdcb0e7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.216043 May 10 02:33:40.619529 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2335/4698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:40 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:41.635674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:41.637047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:41.648841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:41.650185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:41.651310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:41.651961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:42.003938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:42.013240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55219da0-f239-4926-ad8a-390bda177c32 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.381327 May 10 02:33:42.023857 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2364/4699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:41 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:43.029960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:43.030719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:43.049232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:43.049677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:43.051239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:43.051688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:43.463942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:43.471466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e1e74cc-154c-433a-93ce-a2338b82675a tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.445326 May 10 02:33:43.473418 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2336/4700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:43 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:33:44.158106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0c5f9908-689c-4011-ac42-80629808d0cf req-bc652b57-c716-4829-a8db-c8474eb375ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d03407-4292-4494-9567-5b99d67bbff8", "name": "network-vif-plugged", "status": "completed", "tag": "030535b8-7d06-408f-8ffe-56b82f3131d5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:44.170649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0c5f9908-689c-4011-ac42-80629808d0cf req-bc652b57-c716-4829-a8db-c8474eb375ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:44.171423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0c5f9908-689c-4011-ac42-80629808d0cf req-bc652b57-c716-4829-a8db-c8474eb375ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:44.187359 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0c5f9908-689c-4011-ac42-80629808d0cf req-bc652b57-c716-4829-a8db-c8474eb375ae service nova] Creating event network-vif-plugged:030535b8-7d06-408f-8ffe-56b82f3131d5 for instance 15d03407-4292-4494-9567-5b99d67bbff8 on n-h2-841089-2 May 10 02:33:44.193077 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0c5f9908-689c-4011-ac42-80629808d0cf req-bc652b57-c716-4829-a8db-c8474eb375ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038685 May 10 02:33:44.193954 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2365/4701] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:44.497325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:44.497325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:44.506969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:44.507465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:44.508906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:44.509694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:44.792001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:44.809949 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cd2d326f-6749-485d-b354-1c2e645123cc tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1312 microversion: 2.1 time: 0.319050 May 10 02:33:44.814336 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2337/4702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:44 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:45.830666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:45.831410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:45.840407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:45.841473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:45.842295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:45.842747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:46.218173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:46.226307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-522d2144-5c33-496d-99a9-8aa507abae2e tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1497 microversion: 2.1 time: 0.401302 May 10 02:33:46.240020 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2366/4703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:45 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1497 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:46.245219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8152c0d6-4f99-42ae-a380-ed5990fb349c tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:46.277790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.server_groups [None req-8152c0d6-4f99-42ae-a380-ed5990fb349c tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Querying cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) for 1 instances {{(pid=118717) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 10 02:33:46.278721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8152c0d6-4f99-42ae-a380-ed5990fb349c tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:46.281145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8152c0d6-4f99-42ae-a380-ed5990fb349c tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:46.318000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8152c0d6-4f99-42ae-a380-ed5990fb349c tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/777e1aea-6af1-49f4-b056-8f6b107cc378" status: 200 len: 221 microversion: 2.1 time: 0.078397 May 10 02:33:46.319646 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2338/4704] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:33:46 2022] GET /compute/v2.1/os-server-groups/777e1aea-6af1-49f4-b056-8f6b107cc378 => generated 221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:33:46.328999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:46.329730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:46.336708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:46.337357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:46.338328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:46.338925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:46.369041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:33:46.494112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a96ee429-f88f-4f91-aceb-81b32b78fd2f tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 204 len: 0 microversion: 2.1 time: 0.168295 May 10 02:33:46.499751 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2367/4705] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:33:46 2022] DELETE /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:46.505405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:46.506167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:46.512336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:46.513088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:46.514108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:46.514795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:46.683056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:46.691394 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4bcf4b1b-5285-4373-b2de-f98c66b2f577 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1503 microversion: 2.1 time: 0.190420 May 10 02:33:46.703129 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2339/4706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:46 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:47.709777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:47.710511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:47.721943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:47.722411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:47.723402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:47.723666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:48.486150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:48.498224 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f10910bb-aa4f-4dbc-ba0f-c65d2c637555 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1503 microversion: 2.1 time: 0.792918 May 10 02:33:48.500144 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2368/4707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:47 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1503 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:49.516507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:49.517151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:49.527929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a937fe8d-aa6e-4cf6-a7ad-ebefeb382cfe req-9c1fd324-6bd3-43c6-9747-bb7c7e439f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d03407-4292-4494-9567-5b99d67bbff8", "name": "network-vif-deleted", "tag": "030535b8-7d06-408f-8ffe-56b82f3131d5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:49.540380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a937fe8d-aa6e-4cf6-a7ad-ebefeb382cfe req-9c1fd324-6bd3-43c6-9747-bb7c7e439f99 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:49.546452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:49.547032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:49.552066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:49.552757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a937fe8d-aa6e-4cf6-a7ad-ebefeb382cfe req-9c1fd324-6bd3-43c6-9747-bb7c7e439f99 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:49.556369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:49.609092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a937fe8d-aa6e-4cf6-a7ad-ebefeb382cfe req-9c1fd324-6bd3-43c6-9747-bb7c7e439f99 service nova] Creating event network-vif-deleted:030535b8-7d06-408f-8ffe-56b82f3131d5 for instance 15d03407-4292-4494-9567-5b99d67bbff8 on n-h2-841089-2 May 10 02:33:49.631022 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a937fe8d-aa6e-4cf6-a7ad-ebefeb382cfe req-9c1fd324-6bd3-43c6-9747-bb7c7e439f99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106596 May 10 02:33:49.639112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2369/4708] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:33:49.753386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21521f4e4c3741a0adcd157025df7e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e6ddbe45704a4180d392633b7db925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:49.762899 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2bc92339-3ea4-41f6-90f9-3e419366afc7 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 200 len: 1297 microversion: 2.1 time: 0.250143 May 10 02:33:49.766165 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2340/4709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:49 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 1297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:33:50.783325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:50.784315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:50.806603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:50.807471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:50.810272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:50.812184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:50.846200 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 HTTP/1.1 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '15d03407-4292-4494-9567-5b99d67bbff8'} May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:50.850404 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:50.854381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:50.858669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:50.872762 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c583c44f-4f66-4223-982b-d7d755ec2f84 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 404 len: 111 microversion: 2.1 time: 0.094045 May 10 02:33:50.890630 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2370/4710] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:50 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:33:50.901454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69c1b0f8-f20f-4046-b962-f491bf1ef205 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:50.940894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.compute.server_groups [None req-69c1b0f8-f20f-4046-b962-f491bf1ef205 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Querying cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) for 1 instances {{(pid=118717) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 10 02:33:50.942443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69c1b0f8-f20f-4046-b962-f491bf1ef205 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:50.945430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69c1b0f8-f20f-4046-b962-f491bf1ef205 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:50.966727 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-69c1b0f8-f20f-4046-b962-f491bf1ef205 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.069623 May 10 02:33:50.971291 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2341/4711] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:33:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:50.980424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10c3893a-a17c-40d7-a8cd-02d0f707f888 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.003246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.compute.server_groups [None req-10c3893a-a17c-40d7-a8cd-02d0f707f888 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Querying cell 50c27daa-103b-4462-9947-4d3303b846b7(cell1) for 1 instances {{(pid=118716) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 10 02:33:51.005853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10c3893a-a17c-40d7-a8cd-02d0f707f888 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:51.010430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10c3893a-a17c-40d7-a8cd-02d0f707f888 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:51.062385 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10c3893a-a17c-40d7-a8cd-02d0f707f888 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/777e1aea-6af1-49f4-b056-8f6b107cc378" status: 200 len: 183 microversion: 2.1 time: 0.085665 May 10 02:33:51.066788 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2371/4712] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 02:33:50 2022] GET /compute/v2.1/os-server-groups/777e1aea-6af1-49f4-b056-8f6b107cc378 => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:33:51.076839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.077409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:51.088753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:51.093783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:51.095086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:51.096186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:51.117140 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 HTTP/1.1 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '15d03407-4292-4494-9567-5b99d67bbff8'} May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:33:51.133233 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.137960 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.142409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:51.145347 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e486204-919c-4a6c-803b-a3a6bc3b5bd9 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 404 len: 111 microversion: 2.1 time: 0.074582 May 10 02:33:51.147676 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2342/4713] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:33:51 2022] DELETE /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:33:51.155902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.156897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] [instance: 15d03407-4292-4494-9567-5b99d67bbff8] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:51.166784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:51.170400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:51.172848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:51.177766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:51.243959 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 HTTP/1.1 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '15d03407-4292-4494-9567-5b99d67bbff8'} May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.245554 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance 15d03407-4292-4494-9567-5b99d67bbff8 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:51.249214 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-176de1f2-9801-486c-96c8-39465d4ed622 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8" status: 404 len: 111 microversion: 2.1 time: 0.096809 May 10 02:33:51.252638 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2372/4714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:51 2022] GET /compute/v2.1/servers/15d03407-4292-4494-9567-5b99d67bbff8 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:33:51.258754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a449971-0f75-45a9-a3e7-b17a62805668 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.268250 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3a449971-0f75-45a9-a3e7-b17a62805668 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance group b22960b7-c55e-4943-b604-e881bc2df8af could not be found. May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a449971-0f75-45a9-a3e7-b17a62805668 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-server-groups/b22960b7-c55e-4943-b604-e881bc2df8af HTTP/1.1 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance group b22960b7-c55e-4943-b604-e881bc2df8af could not be found. May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'b22960b7-c55e-4943-b604-e881bc2df8af'} May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b22960b7-c55e-4943-b604-e881bc2df8af could not be found. May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b22960b7-c55e-4943-b604-e881bc2df8af could not be found. May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.274412 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.278524 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.278524 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.278524 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:51.278524 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:51.278524 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b22960b7-c55e-4943-b604-e881bc2df8af could not be found. May 10 02:33:51.278524 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.281872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a449971-0f75-45a9-a3e7-b17a62805668 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance group b22960b7-c55e-4943-b604-e881bc2df8af could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:51.282695 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a449971-0f75-45a9-a3e7-b17a62805668 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b22960b7-c55e-4943-b604-e881bc2df8af" status: 404 len: 117 microversion: 2.1 time: 0.028841 May 10 02:33:51.300611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71dfcae6-46ac-43a8-841d-48380dbb3b73 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.308690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2343/4715] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:51 2022] DELETE /compute/v2.1/os-server-groups/b22960b7-c55e-4943-b604-e881bc2df8af => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:33:51.315163 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-71dfcae6-46ac-43a8-841d-48380dbb3b73 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance group 1b031f58-cf9b-470a-b97f-3507cbad5664 could not be found. May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71dfcae6-46ac-43a8-841d-48380dbb3b73 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-server-groups/1b031f58-cf9b-470a-b97f-3507cbad5664 HTTP/1.1 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance group 1b031f58-cf9b-470a-b97f-3507cbad5664 could not be found. May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1b031f58-cf9b-470a-b97f-3507cbad5664'} May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1b031f58-cf9b-470a-b97f-3507cbad5664 could not be found. May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1b031f58-cf9b-470a-b97f-3507cbad5664 could not be found. May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.337661 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1b031f58-cf9b-470a-b97f-3507cbad5664 could not be found. May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71dfcae6-46ac-43a8-841d-48380dbb3b73 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance group 1b031f58-cf9b-470a-b97f-3507cbad5664 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:51.341959 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71dfcae6-46ac-43a8-841d-48380dbb3b73 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/1b031f58-cf9b-470a-b97f-3507cbad5664" status: 404 len: 117 microversion: 2.1 time: 0.043377 May 10 02:33:51.349094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc4ec170-83b5-4b83-806e-26f1d6b7f2df tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.356649 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2373/4716] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:51 2022] DELETE /compute/v2.1/os-server-groups/1b031f58-cf9b-470a-b97f-3507cbad5664 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:33:51.361156 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-fc4ec170-83b5-4b83-806e-26f1d6b7f2df tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance group 753670ce-0ece-469a-aba5-de9816fb3eb8 could not be found. May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc4ec170-83b5-4b83-806e-26f1d6b7f2df tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-server-groups/753670ce-0ece-469a-aba5-de9816fb3eb8 HTTP/1.1 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance group 753670ce-0ece-469a-aba5-de9816fb3eb8 could not be found. May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '753670ce-0ece-469a-aba5-de9816fb3eb8'} May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 753670ce-0ece-469a-aba5-de9816fb3eb8 could not be found. May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 753670ce-0ece-469a-aba5-de9816fb3eb8 could not be found. May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.372522 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.377823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.377823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.377823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:51.377823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:51.377823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 753670ce-0ece-469a-aba5-de9816fb3eb8 could not be found. May 10 02:33:51.377823 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:33:51.382278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc4ec170-83b5-4b83-806e-26f1d6b7f2df tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance group 753670ce-0ece-469a-aba5-de9816fb3eb8 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:51.383756 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc4ec170-83b5-4b83-806e-26f1d6b7f2df tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/753670ce-0ece-469a-aba5-de9816fb3eb8" status: 404 len: 117 microversion: 2.1 time: 0.038998 May 10 02:33:51.394144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2344/4717] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:51 2022] DELETE /compute/v2.1/os-server-groups/753670ce-0ece-469a-aba5-de9816fb3eb8 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:33:51.414166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f5a56bd-7c6a-4574-a202-e2cdd274c924 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.436548 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-8f5a56bd-7c6a-4574-a202-e2cdd274c924 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] HTTP exception thrown: Instance group e819d934-a417-4730-b174-6f81c282a53b could not be found. May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f5a56bd-7c6a-4574-a202-e2cdd274c924 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Request method failure captured: May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-server-groups/e819d934-a417-4730-b174-6f81c282a53b HTTP/1.1 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec71pv3YQElo1-C0FrKDs7tlfbOIH2MVCM4zcYQdqm87tIPKEKZmeasrQgJsZmFn8xZlPQUuhtHccFQDDnQTp1i_4slHxsAFkO2mk9GZ4HOSrniK0tu5Quwx9fMnpJopHCHkfHBQrlKB6m1DL8WyCCwcqm11wRUpbWCb9msiSYWsWQw May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_15e6ddbe45704a4180d392633b7db925", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/15e6ddbe45704a4180d392633b7db925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 15e6ddbe45704a4180d392633b7db925 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerGroupTestJSON-1776663925 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 21521f4e4c3741a0adcd157025df7e78 May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerGroupTestJSON-1776663925-project May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance group e819d934-a417-4730-b174-6f81c282a53b could not be found. May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e819d934-a417-4730-b174-6f81c282a53b'} May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e819d934-a417-4730-b174-6f81c282a53b could not be found. May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e819d934-a417-4730-b174-6f81c282a53b could not be found. May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.439429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:33:51.443636 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:33:51.443636 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:33:51.443636 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:33:51.443636 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:33:51.443636 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e819d934-a417-4730-b174-6f81c282a53b could not be found. May 10 02:33:51.443636 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:33:51.445199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f5a56bd-7c6a-4574-a202-e2cdd274c924 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Returning 404 to user: Instance group e819d934-a417-4730-b174-6f81c282a53b could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:33:51.446388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f5a56bd-7c6a-4574-a202-e2cdd274c924 tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/e819d934-a417-4730-b174-6f81c282a53b" status: 404 len: 117 microversion: 2.1 time: 0.051366 May 10 02:33:51.448461 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2374/4718] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:51 2022] DELETE /compute/v2.1/os-server-groups/e819d934-a417-4730-b174-6f81c282a53b => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:33:51.456613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3ff8dbe-c87e-42c4-a744-6d1997cc1aec tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:51.499085 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c3ff8dbe-c87e-42c4-a744-6d1997cc1aec tempest-ServerGroupTestJSON-1776663925 tempest-ServerGroupTestJSON-1776663925-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/777e1aea-6af1-49f4-b056-8f6b107cc378" status: 204 len: 0 microversion: 2.1 time: 0.047031 May 10 02:33:51.503607 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2345/4719] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:33:51 2022] DELETE /compute/v2.1/os-server-groups/777e1aea-6af1-49f4-b056-8f6b107cc378 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:33:58.004213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-542620276", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:33:58.101320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:33:58.923112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:33:58.923795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:33:58.924798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:33:58.925448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:33:58.926066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:33:58.946041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:58.946789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:58.947867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:33:58.948531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:33:58.986330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:33:58.992333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:33:59.006051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:33:59.009241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:33:59.072009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fe96aa58-9c90-4b2e-991b-f8322b2cf326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274480 May 10 02:33:59.083870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afcacd1a-633e-4532-a677-dfb49d091dd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:33:59.084624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afcacd1a-633e-4532-a677-dfb49d091dd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:33:59.090724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2375/4720] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:33:59.255360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afcacd1a-633e-4532-a677-dfb49d091dd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:33:59.274734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afcacd1a-633e-4532-a677-dfb49d091dd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1192 microversion: 2.1 time: 0.194488 May 10 02:33:59.276288 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2346/4721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:33:59 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1192 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:34:00.305633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:00.306273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:00.353581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:00.354300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:00.355344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:00.355991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:00.448519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:00.458088 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d752120d-08cb-499f-bab5-5723b5570118 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1244 microversion: 2.1 time: 0.158211 May 10 02:34:00.459678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2376/4722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:00 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1244 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:01.478842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:01.479506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:01.491495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:01.492236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:01.496173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:01.501343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:02.103473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:02.111438 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0efa72e-46a9-46d1-abab-d84065b4f160 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.638851 May 10 02:34:02.112741 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2347/4723] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:01 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:34:03.129440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:03.130383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:03.140047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:03.142557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:03.147536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:03.148010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:03.297666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-cd27396e-790e-48b0-af9f-24217d646018 req-21c839a4-8e09-4c96-8bd8-4bdfd3a77c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbfd489-3ea1-4e99-ba41-9e5429f42fc4", "tag": "25b197db-3ad8-48ed-be24-6bffaa9ec535"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:03.314733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cd27396e-790e-48b0-af9f-24217d646018 req-21c839a4-8e09-4c96-8bd8-4bdfd3a77c58 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:03.320144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cd27396e-790e-48b0-af9f-24217d646018 req-21c839a4-8e09-4c96-8bd8-4bdfd3a77c58 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:03.349147 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-cd27396e-790e-48b0-af9f-24217d646018 req-21c839a4-8e09-4c96-8bd8-4bdfd3a77c58 service nova] Creating event network-changed:25b197db-3ad8-48ed-be24-6bffaa9ec535 for instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 on n-h2-841089-2 May 10 02:34:03.364188 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-cd27396e-790e-48b0-af9f-24217d646018 req-21c839a4-8e09-4c96-8bd8-4bdfd3a77c58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067733 May 10 02:34:03.365011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2348/4724] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:03.759398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:03.770438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff6385fc-362a-4ff0-8219-4c7fb1dcb032 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.645123 May 10 02:34:03.771039 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2377/4725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:03 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:04.525630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:04.527302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:04.543743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.545774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.546743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.548314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.606477 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-877cc6c0-e7df-4f71-9202-612834ed4ccc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/ips" status: 200 len: 149 microversion: 2.1 time: 0.089396 May 10 02:34:04.607687 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2349/4726] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:34:04 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:04.619902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:04.622187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:04.632311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.633247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.635404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.636037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.756947 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Invalid volume: volume bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb is already attached to instances: 868a9602-d66a-4a42-b74c-48bd9bc11aff May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/os-volume_attachments HTTP/1.1 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 74 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: {"volumeAttachment": {"volumeId": "bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb"}} May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid volume: volume bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb is already attached to instances: 868a9602-d66a-4a42-b74c-48bd9bc11aff May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'server_id': 'f4aa7ac0-2fe6-4523-9195-33e40f831359', 'body': {'volumeAttachment': {'volumeId': 'bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb'}}} May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb is already attached to instances: 868a9602-d66a-4a42-b74c-48bd9bc11aff May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:34:04.763694 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb is already attached to instances: 868a9602-d66a-4a42-b74c-48bd9bc11aff May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb is already attached to instances: 868a9602-d66a-4a42-b74c-48bd9bc11aff May 10 02:34:04.769388 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:04.772425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 400 to user: Invalid volume: volume bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb is already attached to instances: 868a9602-d66a-4a42-b74c-48bd9bc11aff {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:34:04.773558 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0041c0a-8830-4b02-8f22-3035026e9cb9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159790 May 10 02:34:04.774698 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2378/4727] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:34:04 2022] POST /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:34:04.784256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:04.784998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:04.804340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:04.809319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:04.809842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.812805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.817214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.820042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.836651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.843922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.849459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:04.853538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:04.945745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:34:05.151451 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54d3b817-1cbe-4648-8063-629396b18649 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 204 len: 0 microversion: 2.1 time: 0.372079 May 10 02:34:05.152282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2350/4728] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:34:04 2022] DELETE /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:34:05.165966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:05.166867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:05.176935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:05.182182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:05.183300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:05.183925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:05.293504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:05.304704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f9dbe85-5b8b-4ad1-bd96-0a10bebabf61 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.510740 May 10 02:34:05.305682 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2379/4729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:04 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:05.989598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:06.001935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-666f079c-8334-4602-a6aa-86db4c10c73f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1679 microversion: 2.1 time: 0.845144 May 10 02:34:06.002567 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2351/4730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:05 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1679 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:06.321736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:06.322367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:06.329650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:06.330921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:06.331966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:06.332572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:06.909592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:06.910108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:06.919040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:06.922287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:06.931439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:06.932175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:06.974837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:34:07.166259 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38834f76-449e-4222-8184-4d9bb205ce4b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "DELETE /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 204 len: 0 microversion: 2.32 time: 0.569954 May 10 02:34:07.169940 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2352/4731] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:34:06 2022] DELETE /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 02:34:07.172592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:07.173308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:07.189419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:07.190452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:07.191380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:07.191837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:07.343513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:07.384255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d5904fd-9a21-4b76-902f-b8ff215cb00b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 1.066242 May 10 02:34:07.388803 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2380/4732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:06 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:07.398292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:07.400656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:07.435568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:07.436949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:07.456104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:07.462615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:07.821796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:07.830374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04656745-eb67-4d75-bf11-2dd0d16479ba tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1679 microversion: 2.1 time: 0.661781 May 10 02:34:07.834704 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2353/4733] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:07 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1679 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:08.053013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-40e27fb1-ea05-41b6-a6f5-d560b2e03fe4 req-f532ffa5-f55f-4def-aaa5-5a8ad0f9f4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4aa7ac0-2fe6-4523-9195-33e40f831359", "name": "network-vif-deleted", "tag": "31a08f81-9058-46ff-8d70-0ec2d0a64e1e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:08.079215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-40e27fb1-ea05-41b6-a6f5-d560b2e03fe4 req-f532ffa5-f55f-4def-aaa5-5a8ad0f9f4fd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:08.079682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-40e27fb1-ea05-41b6-a6f5-d560b2e03fe4 req-f532ffa5-f55f-4def-aaa5-5a8ad0f9f4fd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:08.113158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-40e27fb1-ea05-41b6-a6f5-d560b2e03fe4 req-f532ffa5-f55f-4def-aaa5-5a8ad0f9f4fd service nova] Creating event network-vif-deleted:31a08f81-9058-46ff-8d70-0ec2d0a64e1e for instance f4aa7ac0-2fe6-4523-9195-33e40f831359 on n-h1-841089-2 May 10 02:34:08.120882 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-40e27fb1-ea05-41b6-a6f5-d560b2e03fe4 req-f532ffa5-f55f-4def-aaa5-5a8ad0f9f4fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072263 May 10 02:34:08.128695 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2354/4734] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:08.271263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:08.291715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:08.297685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:08.303260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2007f616-31ad-4e5e-9891-e3910ac47239 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2957 microversion: 2.32 time: 0.911909 May 10 02:34:08.321588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2381/4735] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:07 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2957 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:08.401444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:08.402194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:08.429126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:08.429598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:08.447121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:08.448860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:08.851006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:08.853492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:08.877184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:08.894417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:08.895582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:08.897781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:08.966770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:08.974365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9a44a9a3-ea61-4d9c-ad89-da599b6bf9bc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.577299 May 10 02:34:08.978124 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2355/4736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:08 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:09.072291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:09.091981 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-44d83a67-1f4a-45b3-ace4-eeb7c12b5ea4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 200 len: 1613 microversion: 2.1 time: 0.243164 May 10 02:34:09.095637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2382/4737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:08 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 1613 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:34:09.343343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:09.344219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:09.356506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:09.357234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:09.358190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:09.358790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:09.994955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:09.995787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:10.009015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:10.015316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:10.021200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:10.023359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:10.496650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:10.512125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:10.514629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:10.516156 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-baf66d6b-1361-4326-a5bb-da7418cceeec tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2957 microversion: 2.32 time: 1.177012 May 10 02:34:10.519840 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2356/4738] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:09 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2957 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:10.527308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:10.527942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:10.561371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:10.561837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:10.562635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:10.571902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:10.609178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 HTTP/1.1 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f4aa7ac0-2fe6-4523-9195-33e40f831359'} May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:10.611252 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:34:10.617028 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:10.618828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:34:10.619751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec06d8de-4d95-4608-880c-ece6f19a5e0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 404 len: 111 microversion: 2.1 time: 0.098895 May 10 02:34:10.620321 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2357/4739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:10 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:34:10.631442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c10adc8-8518-446a-a336-7095a8f41195 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '.version_select at 0x7f3d3664e670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:10.667260 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c10adc8-8518-446a-a336-7095a8f41195 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428871594" status: 202 len: 0 microversion: 2.1 time: 0.042203 May 10 02:34:10.668410 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2358/4740] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428871594 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:34:10.752544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:10.771632 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0a61eb7-11ea-4b69-af89-df74d38087a9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.781706 May 10 02:34:10.772520 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2383/4741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:09 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:11.538031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:11.539680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:11.555182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:11.557387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:11.561330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:11.562013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:11.579362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ffbbf7d4-8153-4513-b6dd-568c59704dc6 req-6ccd596b-f09e-4878-957f-788faade9a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:11.606745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ffbbf7d4-8153-4513-b6dd-568c59704dc6 req-6ccd596b-f09e-4878-957f-788faade9a99 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:11.610708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ffbbf7d4-8153-4513-b6dd-568c59704dc6 req-6ccd596b-f09e-4878-957f-788faade9a99 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:11.658458 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ffbbf7d4-8153-4513-b6dd-568c59704dc6 req-6ccd596b-f09e-4878-957f-788faade9a99 service nova] Creating event network-vif-unplugged:2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:11.679925 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ffbbf7d4-8153-4513-b6dd-568c59704dc6 req-6ccd596b-f09e-4878-957f-788faade9a99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101979 May 10 02:34:11.681214 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2384/4742] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:11.792492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:11.793493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:11.804138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:11.808731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:11.809774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:11.811891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:12.196493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:12.207420 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6477ff6-10b0-4bad-b8ce-5a184805a13d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.419982 May 10 02:34:12.208618 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2385/4743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:11 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:34:12.326456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:12.337813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:12.343384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:12.345023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28089eb7-d0c9-4dbd-89bd-7cb6110d9166 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2957 microversion: 2.32 time: 0.812863 May 10 02:34:12.348401 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2359/4744] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:11 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2957 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:13.230129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:13.233500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:13.250702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:13.257681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:13.257681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:13.257681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:13.369278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:13.369916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:13.381101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:13.381788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:13.383230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:13.383957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:13.973127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:13.985753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fea7f05c-2ef1-45bc-96fd-b96125cecc9e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.765258 May 10 02:34:13.987349 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2386/4745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:13 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:14.004716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:14.005244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:14.027674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:14.029043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:14.030458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:14.031369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:14.161680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lazy-loading 'services' on Instance uuid 868a9602-d66a-4a42-b74c-48bd9bc11aff {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:34:14.210823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:14.227887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:14.233694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:14.239742 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7c15e064-6203-4414-9a0e-ea0cd38e7f77 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2936 microversion: 2.32 time: 0.875344 May 10 02:34:14.244998 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2360/4746] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:13 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2936 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:14.253347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d2f9e5ac-01b0-4d25-99fb-f005987172c0 req-1da2f9b6-bc55-46ea-a86d-7838a79c9ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-unplugged", "status": "completed", "tag": "142271ce-0d6a-47b7-88f4-74833f70d123"}, {"server_uuid": "dcbfd489-3ea1-4e99-ba41-9e5429f42fc4", "name": "network-vif-plugged", "status": "completed", "tag": "25b197db-3ad8-48ed-be24-6bffaa9ec535"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:14.280551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d2f9e5ac-01b0-4d25-99fb-f005987172c0 req-1da2f9b6-bc55-46ea-a86d-7838a79c9ef7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:14.281019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d2f9e5ac-01b0-4d25-99fb-f005987172c0 req-1da2f9b6-bc55-46ea-a86d-7838a79c9ef7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:14.292597 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ade8a6c-e912-4cdd-a73c-d5a1c68cb89f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments/bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb" status: 202 len: 0 microversion: 2.1 time: 0.299767 May 10 02:34:14.292597 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2387/4747] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:34:13 2022] DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments/bcc14be4-8b1e-40a4-bd5b-bd251a06d3bb => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:34:14.309367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:14.311702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:14.324342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d2f9e5ac-01b0-4d25-99fb-f005987172c0 req-1da2f9b6-bc55-46ea-a86d-7838a79c9ef7 service nova] Creating event network-vif-unplugged:142271ce-0d6a-47b7-88f4-74833f70d123 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:14.324885 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d2f9e5ac-01b0-4d25-99fb-f005987172c0 req-1da2f9b6-bc55-46ea-a86d-7838a79c9ef7 service nova] Creating event network-vif-plugged:25b197db-3ad8-48ed-be24-6bffaa9ec535 for instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 on n-h2-841089-2 May 10 02:34:14.331830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:14.335625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:14.338034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:14.338518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:14.346968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d2f9e5ac-01b0-4d25-99fb-f005987172c0 req-1da2f9b6-bc55-46ea-a86d-7838a79c9ef7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.099320 May 10 02:34:14.347664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2361/4748] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:14.409209 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-126af441-72a3-4572-b4ac-5835d7ebb9e1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111968 May 10 02:34:14.410198 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2388/4749] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:14 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:15.007752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:15.009627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:15.024140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:15.025084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:15.028420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:15.031305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:15.266604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:15.267275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:15.280877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:15.283787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:15.284718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:15.285185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:15.940232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:15.953364 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f06bb721-3b55-4ac4-9472-ef0abc4c5e26 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1292 microversion: 2.1 time: 0.952741 May 10 02:34:15.954256 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2362/4750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:14 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1292 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:15.962775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:15.977800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:15.980672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:15.981503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:15.982493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:15.984747 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a5b3279-48b3-4c58-9662-be7cd9040a3d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2915 microversion: 2.32 time: 0.723385 May 10 02:34:15.990451 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2389/4751] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:15 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2915 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:16.005454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:16.007117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:16.012930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:16.014212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:16.091299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5613dce1-ba78-40bf-8036-892fb8c09170 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133473 May 10 02:34:16.092048 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2363/4752] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:15 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:16.494790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-unplugged", "status": "completed", "tag": "923ee96f-7965-470c-b993-497366970f03"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2f01f1dc-4f00-4813-8bb2-213d0724b05b"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-unplugged", "status": "completed", "tag": "56d91969-4b69-4350-be46-fc0367169266"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:16.511303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:16.524709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:16.547152 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] Creating event network-vif-unplugged:923ee96f-7965-470c-b993-497366970f03 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:16.548033 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] Creating event network-vif-unplugged:2f01f1dc-4f00-4813-8bb2-213d0724b05b for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:16.548815 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] Creating event network-vif-unplugged:56d91969-4b69-4350-be46-fc0367169266 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:16.556260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-30afe927-678f-462c-9028-6865d06954af req-15cbfc81-18a6-4eb4-b5ed-450b7888947e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.065566 May 10 02:34:16.557413 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2390/4753] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:16.970031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:16.970699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:16.981706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:16.982385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:16.983226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:16.983669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:17.008839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:17.010112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:17.020505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:17.027377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:17.029027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:17.031519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:17.514684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:17.524570 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b6fba1e-1855-4881-812d-28cbd5eba477 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1474 microversion: 2.1 time: 0.558645 May 10 02:34:17.562370 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2364/4754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:16 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1474 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:17.575061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:17.578362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:17.585526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:17.586250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:17.587260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:17.587871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:17.633869 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a57aa01-1d3c-4e52-85e5-0979fe4cc52e tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066815 May 10 02:34:17.634672 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2365/4755] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:17 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:17.713786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4b7655aa-82c0-489b-8985-b3432d8efd7c req-03e2b152-4b76-4cdf-8260-f53821beaf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-deleted", "tag": "56d91969-4b69-4350-be46-fc0367169266"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:17.733189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4b7655aa-82c0-489b-8985-b3432d8efd7c req-03e2b152-4b76-4cdf-8260-f53821beaf7f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:17.733857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4b7655aa-82c0-489b-8985-b3432d8efd7c req-03e2b152-4b76-4cdf-8260-f53821beaf7f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:17.749075 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4b7655aa-82c0-489b-8985-b3432d8efd7c req-03e2b152-4b76-4cdf-8260-f53821beaf7f service nova] Creating event network-vif-deleted:56d91969-4b69-4350-be46-fc0367169266 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:17.755180 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4b7655aa-82c0-489b-8985-b3432d8efd7c req-03e2b152-4b76-4cdf-8260-f53821beaf7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045197 May 10 02:34:17.756167 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2366/4756] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:17.764459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1398837686", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:17.856681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:34:17.929217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:17.947083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:17.951928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:17.954298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eec69bcd-96ad-4e17-9d5e-1593928d2b76 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2868 microversion: 2.32 time: 0.950372 May 10 02:34:17.958662 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2391/4757] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:17 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2868 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:18.650921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:18.651932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:18.667950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:18.668433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:18.669284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:18.669744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:18.721841 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-629d3bc5-11a1-4c78-8d6e-7adf6d0c2913 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074835 May 10 02:34:18.722790 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2392/4758] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:18 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:18.976618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:18.977484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:18.998393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:18.998873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:18.999735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:19.000190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:19.481153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:19.492264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:19.496278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:19.500334 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b939cdde-20f6-4264-994f-c1a655a93adc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2488 microversion: 2.32 time: 0.528249 May 10 02:34:19.504130 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2393/4759] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:18 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2488 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:19.733890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:19.741830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:19.756497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:19.757390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:19.758617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:19.761489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:19.836444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5756009e-317c-47a9-884b-c108c5b8c039 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106514 May 10 02:34:19.847414 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2394/4760] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:19 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:19.858750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-959424c7-3ff6-4eae-a004-4e0d856b2d41 req-c1e9e422-91b6-44ea-91e2-ef9e8f8b53ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-deleted", "tag": "2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-deleted", "tag": "923ee96f-7965-470c-b993-497366970f03"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:19.870693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-959424c7-3ff6-4eae-a004-4e0d856b2d41 req-c1e9e422-91b6-44ea-91e2-ef9e8f8b53ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:19.871491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-959424c7-3ff6-4eae-a004-4e0d856b2d41 req-c1e9e422-91b6-44ea-91e2-ef9e8f8b53ae service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:19.895492 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-959424c7-3ff6-4eae-a004-4e0d856b2d41 req-c1e9e422-91b6-44ea-91e2-ef9e8f8b53ae service nova] Creating event network-vif-deleted:2e4cdb8a-fa6e-4e1f-972b-72d8b1a9855f for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:19.896327 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-959424c7-3ff6-4eae-a004-4e0d856b2d41 req-c1e9e422-91b6-44ea-91e2-ef9e8f8b53ae service nova] Creating event network-vif-deleted:923ee96f-7965-470c-b993-497366970f03 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:19.903678 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-959424c7-3ff6-4eae-a004-4e0d856b2d41 req-c1e9e422-91b6-44ea-91e2-ef9e8f8b53ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054627 May 10 02:34:19.904561 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2395/4761] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:20.459248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:34:20.459694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:34:20.460272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:34:20.460701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:34:20.461127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:34:20.505596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:20.506066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:20.506922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:20.514982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:20.525546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:20.526781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:20.554174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:20.555917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:20.560208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:20.562409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:20.565743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:34:20.591318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:34:20.628973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:34:20.630911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: c7f2fd9d-0499-41d4-9a03-7d88574b60ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:34:20.806252 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [96576b52-2072-47c6-a496-4ce4951bf46d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 02:34:20.876178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:20.885304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:20.894657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:20.896116 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4487d00-3fd3-444c-9485-1750e26ebaff tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 2213 microversion: 2.32 time: 0.376340 May 10 02:34:20.899927 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2396/4762] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:20 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 2213 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:20.910057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:20.913276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:20.926323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:20.926870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:20.930832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:20.931525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:20.997842 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51fc7fad-394e-432c-b6b6-28604e515d84 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096682 May 10 02:34:20.998745 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2397/4763] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:20 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:21.816407 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [96576b52-2072-47c6-a496-4ce4951bf46d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 49316. May 10 02:34:21.835522 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6691d417-3012-48f3-b92c-56021882732e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.074860 May 10 02:34:21.844557 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2367/4764] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:34:21.850419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e6d5b6ba-880d-41e1-8b23-1a8d429c5fca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:21.851261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6d5b6ba-880d-41e1-8b23-1a8d429c5fca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: c7f2fd9d-0499-41d4-9a03-7d88574b60ce] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:21.899790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6d5b6ba-880d-41e1-8b23-1a8d429c5fca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: c7f2fd9d-0499-41d4-9a03-7d88574b60ce] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:34:21.921678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:21.922704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:21.936094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:21.936883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:21.938120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:21.939858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:22.142003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:22.172173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:22.174254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:22.175602 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a7d0e04-9986-4541-a8c9-5d1475500f75 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.259362 May 10 02:34:22.180435 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2368/4765] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:21 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:22.185386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1bcb509a-c5e6-4291-a8cd-00e1d39c2d39 req-b4a9f6ca-82f2-4a59-8e10-5bcded4c62b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-deleted", "tag": "2f01f1dc-4f00-4813-8bb2-213d0724b05b"}, {"server_uuid": "78a53feb-85bb-40b7-ac54-c37fd183c5e0", "name": "network-vif-deleted", "tag": "142271ce-0d6a-47b7-88f4-74833f70d123"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:22.209301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1bcb509a-c5e6-4291-a8cd-00e1d39c2d39 req-b4a9f6ca-82f2-4a59-8e10-5bcded4c62b8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:22.209762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1bcb509a-c5e6-4291-a8cd-00e1d39c2d39 req-b4a9f6ca-82f2-4a59-8e10-5bcded4c62b8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:22.240473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1bcb509a-c5e6-4291-a8cd-00e1d39c2d39 req-b4a9f6ca-82f2-4a59-8e10-5bcded4c62b8 service nova] Creating event network-vif-deleted:2f01f1dc-4f00-4813-8bb2-213d0724b05b for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:22.240991 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1bcb509a-c5e6-4291-a8cd-00e1d39c2d39 req-b4a9f6ca-82f2-4a59-8e10-5bcded4c62b8 service nova] Creating event network-vif-deleted:142271ce-0d6a-47b7-88f4-74833f70d123 for instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 on n-h1-841089-2 May 10 02:34:22.248997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1bcb509a-c5e6-4291-a8cd-00e1d39c2d39 req-b4a9f6ca-82f2-4a59-8e10-5bcded4c62b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067238 May 10 02:34:22.249904 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2369/4766] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:22.264752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:22.266047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:22.286283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:22.286729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:22.287585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:22.288029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:22.388443 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72fc66d0-9031-4a78-a49d-068fa8e0a6c1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134251 May 10 02:34:22.393253 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2370/4767] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:22 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:22.429700 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e6d5b6ba-880d-41e1-8b23-1a8d429c5fca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce" status: 204 len: 0 microversion: 2.1 time: 0.584708 May 10 02:34:22.431384 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2398/4768] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:34:21 2022] DELETE /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:34:22.441950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-017a49b9-65ae-45c0-8429-38c9a71a924e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:22.442636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-017a49b9-65ae-45c0-8429-38c9a71a924e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: c7f2fd9d-0499-41d4-9a03-7d88574b60ce] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:22.482476 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-017a49b9-65ae-45c0-8429-38c9a71a924e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-017a49b9-65ae-45c0-8429-38c9a71a924e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce HTTP/1.1 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'c7f2fd9d-0499-41d4-9a03-7d88574b60ce'} May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:22.494424 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-017a49b9-65ae-45c0-8429-38c9a71a924e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:34:22.499931 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-017a49b9-65ae-45c0-8429-38c9a71a924e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce" status: 404 len: 111 microversion: 2.1 time: 0.061940 May 10 02:34:22.513131 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2371/4769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:22 2022] GET /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:34:22.759339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-241525552", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:22.866742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:34:23.198335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:23.198335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:23.208260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:23.209307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:23.210428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:23.211162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:23.381447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:23.391747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:23.393646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:23.395121 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5a2a8e1a-455f-43c0-a93d-eca6207c968c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.201174 May 10 02:34:23.396573 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2372/4770] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:23 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:23.414181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:23.415460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:23.428872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:23.432036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:23.433214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:23.433881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:23.526021 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-792d168c-b14f-4453-b2ae-c66402d44529 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118285 May 10 02:34:23.528306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2373/4771] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:23 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:23.728444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:34:23.729057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:34:23.729358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:34:23.729984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:34:23.730610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:34:23.743397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:23.744242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:23.745376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:23.746167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:23.766799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:34:23.773780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:34:23.789062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:34:23.791906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:34:23.854694 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a79ab412-4ace-41bb-8eef-c0d208aaf415 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099210 May 10 02:34:23.856012 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2399/4772] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:34:23.866185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da5d3644-e711-42cb-a9f5-7b55c573f027 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:23.866870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da5d3644-e711-42cb-a9f5-7b55c573f027 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:24.057611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da5d3644-e711-42cb-a9f5-7b55c573f027 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:24.072239 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da5d3644-e711-42cb-a9f5-7b55c573f027 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1220 microversion: 2.1 time: 0.209811 May 10 02:34:24.072905 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2374/4773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:23 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:24.423806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:24.424770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:24.437563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:24.438472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:24.440119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:24.441022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:24.540576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:24.542163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:24.563887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:24.564624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:24.565658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:24.566030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:24.619114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:24.640048 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-83b8cc9b-469e-4571-b5e8-161d08f4f8e9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103369 May 10 02:34:24.641235 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2375/4774] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:24 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:24.651479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:24.655369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:24.658755 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-be7cf17d-cfca-484d-9aec-8d4aa46a6f1e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.242688 May 10 02:34:24.661464 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2400/4775] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:24 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:25.089337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:25.091036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:25.099691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:25.100165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:25.100990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:25.103979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:25.604698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:25.615914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57a09455-6a37-4382-a6d1-f9befee71bce tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1272 microversion: 2.1 time: 0.530635 May 10 02:34:25.616977 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2376/4776] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:25 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1272 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:25.652947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:25.656159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:25.664374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:25.665003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:25.666367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:25.667099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:25.680251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:25.681118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:25.697824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:25.698893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:25.699847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:25.700403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:25.738890 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5713ffa5-2ff0-436c-947d-98e75d2178b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090106 May 10 02:34:25.746461 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2401/4777] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:25 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:25.840668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:25.857851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:25.860141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:25.862486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b98da10b-61ac-410b-8271-2ffccdfa7a62 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.188417 May 10 02:34:25.864011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2377/4778] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:25 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:26.633816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:26.635292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:26.644567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:26.645208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:26.646172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:26.646787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:26.765845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:26.770302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:26.794585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:26.803706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:26.804763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:26.806625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:26.807596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:26.816250 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-efe07d06-5db2-4de4-9c2b-fbc2e29a614e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1278 microversion: 2.1 time: 0.183773 May 10 02:34:26.817003 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2402/4779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:26 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:26.858829 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e87462d-b06c-4497-a0a6-5ed5cc6b74a2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108451 May 10 02:34:26.860144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2378/4780] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:26 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:26.885877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:26.886589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:26.894282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:26.894995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:26.896039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:26.897185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:27.008200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:27.018495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:27.029477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:27.030995 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ebd008b0-ea6f-445a-a80a-1baa01d0c77d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.148994 May 10 02:34:27.031495 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2403/4781] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:26 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:27.835533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:27.835533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:27.842004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:27.842466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:27.852146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:27.853117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:27.869999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:27.870996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:27.881546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:27.882015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:27.888600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:27.889294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:27.969084 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-feade2cd-cd21-454a-a23a-ca8277fc40f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102640 May 10 02:34:27.976359 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2404/4782] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:27 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:28.034298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-febecb40-019b-40cb-98b7-ffca2f4c555b req-349a9aa7-8eca-442b-bc82-e7a0fc39f22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1759af67-b3af-477e-8ebc-cb26361dc079", "tag": "62bc96b4-13f1-45cf-a729-f4488e0129a2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:28.049136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-febecb40-019b-40cb-98b7-ffca2f4c555b req-349a9aa7-8eca-442b-bc82-e7a0fc39f22e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:28.053141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-febecb40-019b-40cb-98b7-ffca2f4c555b req-349a9aa7-8eca-442b-bc82-e7a0fc39f22e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:28.090145 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-febecb40-019b-40cb-98b7-ffca2f4c555b req-349a9aa7-8eca-442b-bc82-e7a0fc39f22e service nova] Creating event network-changed:62bc96b4-13f1-45cf-a729-f4488e0129a2 for instance 1759af67-b3af-477e-8ebc-cb26361dc079 on n-h1-841089-2 May 10 02:34:28.096625 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-febecb40-019b-40cb-98b7-ffca2f4c555b req-349a9aa7-8eca-442b-bc82-e7a0fc39f22e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066708 May 10 02:34:28.097856 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2405/4783] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:28.104286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:28.105494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:28.117924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:28.118624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:28.119704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:28.120372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:28.264872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:28.275737 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c00bb53-01aa-4ba5-ae03-428daec83294 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1320 microversion: 2.1 time: 0.446003 May 10 02:34:28.282184 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2379/4784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:27 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:28.303569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:28.318302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:28.319858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:28.321057 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1b9b271-f635-4b20-858d-c4a8749f1e04 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.221891 May 10 02:34:28.327785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2406/4785] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:28 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:28.986961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:28.988639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:29.005927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:29.006969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:29.010505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:29.013692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:29.066919 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d4c1f82-38d8-40cc-987e-f54b071428e5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084464 May 10 02:34:29.067981 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2380/4786] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:28 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:29.303238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:29.304442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:29.312987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:29.313758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:29.314675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:29.315359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:29.346592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:29.347247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:29.382537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:29.387294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:29.389578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:29.390432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:29.510037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:29.526999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:29.529458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:29.532243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7cd80db-f31e-4e8e-8e1c-32dde5ad2d67 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.190273 May 10 02:34:29.534298 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2381/4787] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:29 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:29.553164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:29.566144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1bf51200-5747-4a4d-a925-cc588c3acb55 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1320 microversion: 2.1 time: 0.270177 May 10 02:34:29.566501 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2407/4788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:29 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:30.083890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:30.085926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:30.097004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:30.099058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:30.100692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:30.102129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:30.185359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-687f1b3e-065e-4bae-a446-6740ffa5bb4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109055 May 10 02:34:30.186481 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2382/4789] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:30 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:30.556526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:30.558047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:30.583444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:30.584372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:30.606058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:30.606697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:30.607609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:30.608064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:30.616787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:30.618698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:30.621980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:30.623651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:30.832988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:30.864061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:30.871045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:30.872994 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3dc937f3-8410-4011-8388-c4ddf3bdef49 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.324785 May 10 02:34:30.876058 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2408/4790] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:30 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:31.052617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:31.061635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d638ab17-a8e9-4e93-8d71-082084a90781 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1320 microversion: 2.1 time: 0.483589 May 10 02:34:31.071648 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2383/4791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:30 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:31.197541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:31.198755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:31.206159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:31.206857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:31.207852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:31.208506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:31.241823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09d7887b-f11d-411a-b91e-bd7606889b27 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048246 May 10 02:34:31.245957 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2409/4792] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:31 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:31.900193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:31.901597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:31.930791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:31.932763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:31.940850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:31.941971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:32.083793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:32.086769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:32.089809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:32.097312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:32.098905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:32.104115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:32.105072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:32.105802 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60478b8c-b9ec-4652-8a50-f915eb61206a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.209875 May 10 02:34:32.106816 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2384/4793] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:31 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:32.107683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:32.108380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:32.253848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:32.254794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:32.269064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:32.269930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:32.270988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:32.272110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:32.336550 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0704659d-c658-4550-89aa-83bddff46d3d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086658 May 10 02:34:32.337478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2385/4794] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:32 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:32.434066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:32.447481 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b35490ab-f91c-4c35-a354-b555b6460f45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1320 microversion: 2.1 time: 0.371346 May 10 02:34:32.449506 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2410/4795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:32 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:33.125852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:33.132995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:33.148849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.149577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:33.152459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.155109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:33.332982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:33.349752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:33.350731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:33.369784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:33.411720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.412214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:33.413043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.413494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:33.417097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:33.418346 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b3cb05ab-7e21-494a-a20f-ff2b853190c1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.297501 May 10 02:34:33.430072 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2386/4796] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:33 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:33.458662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bcf9b93b-e3e7-4c37-8660-d970872c2db4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112236 May 10 02:34:33.460773 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2411/4797] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:33 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:33.467709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:33.468606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:33.486920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.487664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:33.488656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.489286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:33.822331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:33.833503 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85d7e551-b1c4-4015-9142-931abb23e2eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1320 microversion: 2.1 time: 0.369419 May 10 02:34:33.836259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2387/4798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:33 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:33.939385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-759b3525-69ea-43f8-bd23-71748d293348 req-ef558e3b-9407-4422-8c14-2f80c8958ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1759af67-b3af-477e-8ebc-cb26361dc079", "name": "network-vif-plugged", "status": "completed", "tag": "62bc96b4-13f1-45cf-a729-f4488e0129a2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:33.954074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-759b3525-69ea-43f8-bd23-71748d293348 req-ef558e3b-9407-4422-8c14-2f80c8958ad7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:33.956356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-759b3525-69ea-43f8-bd23-71748d293348 req-ef558e3b-9407-4422-8c14-2f80c8958ad7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.005904 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-759b3525-69ea-43f8-bd23-71748d293348 req-ef558e3b-9407-4422-8c14-2f80c8958ad7 service nova] Creating event network-vif-plugged:62bc96b4-13f1-45cf-a729-f4488e0129a2 for instance 1759af67-b3af-477e-8ebc-cb26361dc079 on n-h1-841089-2 May 10 02:34:34.024279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-759b3525-69ea-43f8-bd23-71748d293348 req-ef558e3b-9407-4422-8c14-2f80c8958ad7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089443 May 10 02:34:34.033783 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2412/4799] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:34.438395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:34.443015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:34.459915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.466975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.468658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.469371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.480666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:34.482283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:34.500078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.503719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.504750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.505521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.606765 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-15539c7c-941a-49c6-822a-3978f7124f8a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137884 May 10 02:34:34.616397 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2413/4800] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:34:34 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 02:34:34.636380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:34.656092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:34.665746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:34.679346 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-111202cb-4fb5-438b-b4d9-cea29140a80a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.244873 May 10 02:34:34.680486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2388/4801] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:34 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:34.853154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:34.854026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:34.863604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.866918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.868035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.868779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.891785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:34.893245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:34.906685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.907532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.909713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:34.911725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:34.997559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:34:35.167471 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3f5a772a-d99e-4e39-99c8-db8cacac2752 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 204 len: 0 microversion: 2.1 time: 0.280426 May 10 02:34:35.172834 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2389/4802] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:34:34 2022] DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:34:35.199910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:35.202590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:35.216440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:35.217167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:35.218242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:35.218916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:35.409235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:35.420440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9724c9e9-34d3-4a1f-b3a7-bba5c0053599 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1320 microversion: 2.1 time: 0.571264 May 10 02:34:35.434707 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2414/4803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:34 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1320 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:35.445093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:35.467329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-239fe587-01d7-4725-be38-79f12c2bf8ed tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1680 microversion: 2.1 time: 0.290421 May 10 02:34:35.502350 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2390/4804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:35 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1680 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:35.703950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:35.705286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:35.718734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:35.725637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:35.727677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:35.728173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:36.456775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:36.457539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:36.483124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:36.486757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:36.492799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:36.493562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:36.728443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:36.746489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:36.748356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:36.756030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b781371-a0e4-4809-bfb2-47054d0d4756 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 1.050407 May 10 02:34:36.758817 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2415/4805] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:35 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:36.772725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:36.775281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:36.801639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:36.803873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:36.807919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:36.808335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:38.551715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:38.565673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-83172661-4ec4-4100-8607-717ed3ae9ac6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1680 microversion: 2.1 time: 1.798621 May 10 02:34:38.567989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:38.576698 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68ce8c72-3873-414c-a12d-f2ce35a6a473 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1501 microversion: 2.1 time: 2.138840 May 10 02:34:38.577294 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2416/4806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:36 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1680 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:38.583907 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2391/4807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:36 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1501 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:38.601182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:38.601741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:38.604829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:38.608041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:38.610202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:38.610941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:38.612113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:38.613661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:38.628367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:38.628569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:38.631206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:38.631206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:39.551909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:39.567672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:39.569471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:39.576810 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bcf44fb-8507-41b6-8d40-d4c8e4175f9f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.997832 May 10 02:34:39.577571 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2417/4808] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:38 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:39.600405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:39.602922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:39.616968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:39.618008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:39.619966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:39.621805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:39.862098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:39.874523 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f0241df-0887-4c69-acde-ff2f573f805e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1501 microversion: 2.1 time: 1.277099 May 10 02:34:39.890199 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2392/4809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:38 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1501 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:39.897375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:39.898107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:39.904990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:39.905805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:39.906876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:39.907629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:39.957097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:39.960111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:34:39.967054 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25ef75ea-be50-4d60-a863-28a8ea1832e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1613 microversion: 2.1 time: 0.383667 May 10 02:34:39.970312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2418/4810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:39 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1613 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:40.228909 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82eef9ae-5ada-47b3-9ad8-7dee85cc4cbb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 204 len: 0 microversion: 2.1 time: 0.336607 May 10 02:34:40.229505 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2393/4811] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:34:39 2022] DELETE /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:34:40.242059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:40.242951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:40.253088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:40.255369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:40.256383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:40.257170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:40.597190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:40.598222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:40.620277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:40.622336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:40.623456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:40.624262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:41.001248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:41.010755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:41.025144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:41.026541 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-84634b59-445f-4352-967d-4505ee68c0ae tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.434120 May 10 02:34:41.038770 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2394/4812] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:40 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:41.046036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:41.052006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:41.064120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:41.064868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:41.068078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:41.068730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:41.241955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:41.249428 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf161404-a62a-42cc-9ecd-ab0fa7e9e3f4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1613 microversion: 2.1 time: 0.209323 May 10 02:34:41.250018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2395/4813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:41 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1613 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:41.319476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:41.332446 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e282ce03-8958-48a6-a6bc-cc1c46cfd93e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1507 microversion: 2.1 time: 1.097929 May 10 02:34:41.344641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2419/4814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:40 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1507 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:41.574147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-25cb53bf-2bfa-4fd1-ab76-89f4e7b19428 req-5425e872-c61c-4bba-8fd6-271c79cedbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868a9602-d66a-4a42-b74c-48bd9bc11aff", "name": "network-vif-deleted", "tag": "d64460fa-37a0-4af1-a0e1-c55f47ad456f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:41.595106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-25cb53bf-2bfa-4fd1-ab76-89f4e7b19428 req-5425e872-c61c-4bba-8fd6-271c79cedbd8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:41.595552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-25cb53bf-2bfa-4fd1-ab76-89f4e7b19428 req-5425e872-c61c-4bba-8fd6-271c79cedbd8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:41.650109 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-25cb53bf-2bfa-4fd1-ab76-89f4e7b19428 req-5425e872-c61c-4bba-8fd6-271c79cedbd8 service nova] Creating event network-vif-deleted:d64460fa-37a0-4af1-a0e1-c55f47ad456f for instance 868a9602-d66a-4a42-b74c-48bd9bc11aff on n-h2-841089-2 May 10 02:34:41.669911 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-25cb53bf-2bfa-4fd1-ab76-89f4e7b19428 req-5425e872-c61c-4bba-8fd6-271c79cedbd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093551 May 10 02:34:41.672733 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2396/4815] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:42.058045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:42.058864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:42.071396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.072528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.075204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.075918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.250565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:42.260189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:42.267309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:42.268497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:42.269006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b132489-8f39-488a-bfad-138935fff72c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.215682 May 10 02:34:42.269884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:42.277819 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2420/4816] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:42 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:42.309511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.309976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.310783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.311274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.350521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:42.352040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:42.360186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.370643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.371801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.372407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.457314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:42.457782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:42.458258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lazy-loading 'fault' on Instance uuid 868a9602-d66a-4a42-b74c-48bd9bc11aff {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:34:42.650167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:42.669358 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb77c5fe-ae1e-42ec-915f-a88d479be86f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 200 len: 1331 microversion: 2.1 time: 0.402784 May 10 02:34:42.684291 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2397/4817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:42 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 1331 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:42.810426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:42.820843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9227f835-dc38-4a41-b554-03709d2e363a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1507 microversion: 2.1 time: 0.474194 May 10 02:34:42.831815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2421/4818] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:42 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:34:43.289004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:43.290460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:43.306626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:43.312358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:43.317516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:43.318000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:43.688363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:43.689706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:43.709211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:43.710284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:43.715019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:43.717532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:43.768978 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff HTTP/1.1 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '868a9602-d66a-4a42-b74c-48bd9bc11aff'} May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:43.773004 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:34:43.778547 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:43.780283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:34:43.788356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1d72751-c050-400c-ac84-f689ac3bce6a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 404 len: 111 microversion: 2.1 time: 0.104078 May 10 02:34:43.793176 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2422/4819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:43 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:34:43.805089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61e05576-e12c-4149-bb21-aee10f82db2f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '.version_select at 0x7f3d370d09d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:43.843178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61e05576-e12c-4149-bb21-aee10f82db2f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235960262" status: 202 len: 0 microversion: 2.1 time: 0.048497 May 10 02:34:43.847561 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2423/4820] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235960262 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:34:43.855818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:43.856645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:43.868925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:43.873521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:43.874583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:43.875191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:44.228403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:44.239757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:44.245624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:44.251903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:44.253437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53347c56-4781-476b-a7a4-52e91c6e0924 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.969632 May 10 02:34:44.254807 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2398/4821] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:43 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:44.271783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8326d1a1-9e3e-48dc-bb48-e5e9aef5d735 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1465 microversion: 2.1 time: 0.426188 May 10 02:34:44.289404 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2424/4822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:43 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1465 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:44.640507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e1e5d147-efd3-4298-9a43-03fc711493a9 req-576ffb11-903b-41a2-adff-346819e787a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1759af67-b3af-477e-8ebc-cb26361dc079", "name": "network-vif-deleted", "tag": "62bc96b4-13f1-45cf-a729-f4488e0129a2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:44.682564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e1e5d147-efd3-4298-9a43-03fc711493a9 req-576ffb11-903b-41a2-adff-346819e787a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:44.700428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e1e5d147-efd3-4298-9a43-03fc711493a9 req-576ffb11-903b-41a2-adff-346819e787a3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:44.731563 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e1e5d147-efd3-4298-9a43-03fc711493a9 req-576ffb11-903b-41a2-adff-346819e787a3 service nova] Creating event network-vif-deleted:62bc96b4-13f1-45cf-a729-f4488e0129a2 for instance 1759af67-b3af-477e-8ebc-cb26361dc079 on n-h1-841089-2 May 10 02:34:44.740983 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e1e5d147-efd3-4298-9a43-03fc711493a9 req-576ffb11-903b-41a2-adff-346819e787a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106788 May 10 02:34:44.742965 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2399/4823] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:45.274409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:45.276398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:45.290805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:45.291640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:45.292705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:45.294757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:45.297505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:45.311543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:45.324664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:45.327668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:45.328721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:45.329860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:45.459953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:45.469400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:45.471116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lazy-loading 'fault' on Instance uuid 1759af67-b3af-477e-8ebc-cb26361dc079 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:34:45.694278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:45.714193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:45.716151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:45.718387 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d7616bf9-4f5d-4eb9-a93f-1aebdc6fde54 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.447720 May 10 02:34:45.721470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2425/4824] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:45 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:45.771451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:45.784391 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-73d0a33e-d52a-47b7-912a-9cd2af0d78d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 200 len: 1310 microversion: 2.1 time: 0.491375 May 10 02:34:45.785666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2400/4825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:45 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 1310 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:46.280771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a00dc658-1f6a-4b91-8b4c-ba760b27fd4a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: .version_select at 0x7f3d371e04c0>, body: {"keypair": {"name": "tempest-keypair-2127576028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR7spP1cE9+9bmSsVt+/a7/4YJryzK85FDfIsJ9TgA3Vxrr4kYeLZAO+YWOCNHmB1XOWFOpoE081fAT0Ake9AAJcMQ92yIBMYRz+KMfFV4dI6kp4bdRf8FweFcFLAFE3g=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:46.316840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a00dc658-1f6a-4b91-8b4c-ba760b27fd4a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:34:46.335504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a00dc658-1f6a-4b91-8b4c-ba760b27fd4a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:34:46.392352 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a00dc658-1f6a-4b91-8b4c-ba760b27fd4a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118392 May 10 02:34:46.393637 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2426/4826] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:34:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:34:46.741574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:46.742766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:46.773277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:46.775529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:46.776565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:46.783753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:46.802949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:46.803996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:46.828170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:46.828640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:46.830010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:46.830464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:46.889167 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 HTTP/1.1 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1759af67-b3af-477e-8ebc-cb26361dc079'} May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:46.895938 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:34:46.899760 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-647e8fdd-bec1-4835-a896-dfe6a14dc0cc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 404 len: 111 microversion: 2.1 time: 0.099598 May 10 02:34:46.905979 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2427/4827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:46 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:34:46.919923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f61955a-cbe1-45e8-8fca-76bc80e67c5b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: .version_select at 0x7f3d36e86310>, body: {"keypair": {"name": "tempest-key-2110506478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCF9RZkNBmO6Z5BDGwL62/tgWjTqLI8SW7Uakk49IlvHEK0KOQ7oT5I7n4Du9fiW9JGgAf6LShEALcHsIi+DYcu3/2P3c5uc+rjbYbvy49cQ69Jai67KJLdgLcFI7Yk9jg=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:46.958325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9f61955a-cbe1-45e8-8fca-76bc80e67c5b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:34:46.973781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9f61955a-cbe1-45e8-8fca-76bc80e67c5b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:34:47.037031 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f61955a-cbe1-45e8-8fca-76bc80e67c5b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.129586 May 10 02:34:47.038313 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2428/4828] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:34:46 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:47.047653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35bbba17-cb7d-4f04-a5b7-0d4e117f03e7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '.version_select at 0x7f3d37908310>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:47.050727 n-d-841089-2 devstack@n-api.service[118716]: WARNING oslo_db.sqlalchemy.utils [None req-35bbba17-cb7d-4f04-a5b7-0d4e117f03e7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Unique keys not in sort_keys. The sorting order may be unstable. May 10 02:34:47.086946 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35bbba17-cb7d-4f04-a5b7-0d4e117f03e7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.042987 May 10 02:34:47.088912 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2429/4829] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:34:47 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:47.210757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:47.223655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-564096972", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-key-2110506478", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:47.236826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:47.241788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:47.243227 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b170a3ba-7ffa-4e12-8551-40a026db32dc tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.505510 May 10 02:34:47.255472 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2401/4830] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:46 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:47.364950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:34:48.262181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:48.265726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:48.279932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:48.280693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:48.285388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:48.287348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:48.610493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:48.641293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:48.658701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:48.662558 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d7d549e-4bf9-4f25-b9db-d5779457fa58 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.404682 May 10 02:34:48.675601 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2402/4831] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:48 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:49.343055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:34:49.343673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:34:49.344514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:34:49.346542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:34:49.347200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:34:49.357990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:49.358712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:49.359847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:49.361325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:49.406947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:34:49.415335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:34:49.443276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:34:49.445672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:34:49.542459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-404977526", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b17ef216-a989-4dab-a21d-9ac51c1b13b9"}], "security_groups": [{"name": "tempest-securitygroup--1696375178"}], "key_name": "tempest-keypair-2127576028", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:49.607738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ac4b866-2ad0-46fa-9705-a29eb8bd1101 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.388876 May 10 02:34:49.608426 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2430/4832] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:34:49.621685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8625bf1b-78d2-4c7d-a4e4-b90e3952b734 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:49.622324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8625bf1b-78d2-4c7d-a4e4-b90e3952b734 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:50.145255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] validate_networks() for [('b17ef216-a989-4dab-a21d-9ac51c1b13b9', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:34:50.149052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8625bf1b-78d2-4c7d-a4e4-b90e3952b734 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:50.156749 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8625bf1b-78d2-4c7d-a4e4-b90e3952b734 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1228 microversion: 2.1 time: 0.538977 May 10 02:34:50.158785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2431/4833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:49 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1228 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:50.186159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:50.187974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:50.206104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:50.206617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:50.207773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:50.208346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:50.463197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:50.479933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:50.481694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:50.483001 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2e991097-0baf-4862-b1f6-2d7f5603d9d6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.308609 May 10 02:34:50.499926 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2432/4834] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:50 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:51.177269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:51.178240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:51.192703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:51.193758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:51.194752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:51.196102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:51.299134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:51.313320 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbd25aba-c36b-4743-97ca-963fcc038daa tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1286 microversion: 2.1 time: 0.142517 May 10 02:34:51.318957 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2433/4835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:51 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:51.513592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:51.514262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:51.526925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:51.527953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:51.528946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:51.529796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:51.672331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:34:51.673472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:34:51.674196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:34:51.675196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:34:51.675799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:34:51.693828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:51.695803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:51.696855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:51.699636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:51.704170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:51.717525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:51.724435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:51.727747 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f01b203-ea00-4af1-be38-77e1403a364d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.219579 May 10 02:34:51.741251 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2434/4836] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:51 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:51.753630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:34:51.760022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:34:51.776631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:34:51.779556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:34:51.863538 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0570519b-3835-4952-9310-20350fbeb945 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.326200 May 10 02:34:51.864203 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2403/4837] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:34:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:34:51.874255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16f463f0-b71a-43a7-86dd-78822f9b8d21 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:51.875043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16f463f0-b71a-43a7-86dd-78822f9b8d21 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:52.023537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-16f463f0-b71a-43a7-86dd-78822f9b8d21 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:52.031543 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16f463f0-b71a-43a7-86dd-78822f9b8d21 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1241 microversion: 2.1 time: 0.161061 May 10 02:34:52.044889 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2435/4838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:51 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:52.341350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:52.342293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:52.361476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:52.362254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:52.363292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:52.363957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:52.749713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:52.751507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:52.759284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:52.769298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:52.770404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:52.771185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:53.021500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:53.029628 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f934c88b-d591-4800-95d3-55ebdf4667c7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1328 microversion: 2.1 time: 0.700583 May 10 02:34:53.045635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:53.049524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2404/4839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:52 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1328 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:53.061806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:53.066549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:53.070369 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-89b277fb-421f-4591-acd2-20b3fb737d4a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.325014 May 10 02:34:53.091332 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2436/4840] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:52 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:53.103644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:53.104585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:53.114423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:53.115133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:53.117876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:53.118498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:53.240942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:53.266361 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a139ccc9-ae2e-436f-9ff0-e73785edaef4 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1293 microversion: 2.1 time: 0.195724 May 10 02:34:53.269641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2405/4841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:53 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:54.047330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:54.048071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:54.062005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.080285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.080546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.081010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.110399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:54.111237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:54.129905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.130275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.132119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.132781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.659387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:54.675209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:54.678987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:54.680903 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-70e2a3d4-90fd-4adb-b2b2-f83728cc8d6f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.575467 May 10 02:34:54.682114 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2406/4842] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:54 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:34:54.687017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:54.687938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:54.697481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.698255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.699318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.700007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.875041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:54.882988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:54.884433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8f8cb3d-c398-4a39-90c7-67ac6709e97e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1328 microversion: 2.1 time: 0.841017 May 10 02:34:54.889384 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2437/4843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:54 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1328 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:54.892655 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8c7839b-8231-4e34-a6b7-28391a066879 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1299 microversion: 2.1 time: 0.208827 May 10 02:34:54.901566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4aa1240a-d502-417b-ba4a-dd73c9477571 req-6ccce600-ba8d-4fe1-ab95-de82286a7281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db925971-d3e7-4e7e-b5ff-036a46d33147", "tag": "bb91ba71-4d65-4f64-a905-2b7a70f782ee"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:34:54.912137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4aa1240a-d502-417b-ba4a-dd73c9477571 req-6ccce600-ba8d-4fe1-ab95-de82286a7281 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:54.912842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4aa1240a-d502-417b-ba4a-dd73c9477571 req-6ccce600-ba8d-4fe1-ab95-de82286a7281 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:54.912995 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2407/4844] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:54 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:54.930314 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4aa1240a-d502-417b-ba4a-dd73c9477571 req-6ccce600-ba8d-4fe1-ab95-de82286a7281 service nova] Creating event network-changed:bb91ba71-4d65-4f64-a905-2b7a70f782ee for instance db925971-d3e7-4e7e-b5ff-036a46d33147 on n-h1-841089-2 May 10 02:34:54.936145 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4aa1240a-d502-417b-ba4a-dd73c9477571 req-6ccce600-ba8d-4fe1-ab95-de82286a7281 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044919 May 10 02:34:54.937479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2438/4845] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:34:55.701327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:55.702566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:55.721422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:55.722954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:55.727454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:55.728399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:55.906575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:55.908849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:55.926026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:55.926786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:55.927831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:55.929636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:55.998205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:56.018340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:56.023409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:56.025967 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fde9bf4e-2234-4c4f-8f17-fa3f48187411 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.328159 May 10 02:34:56.028695 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2408/4846] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:55 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:56.041106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:56.043808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:56.065620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:56.066313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:56.069574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:56.070273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:56.335407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:56.347133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-144738d2-9221-4e7a-8126-785ef50e728f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1299 microversion: 2.1 time: 0.316992 May 10 02:34:56.351511 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2409/4847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:56 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1299 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:56.434661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:56.446196 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b8a34bd5-f4da-4b49-9f3a-129f27c1a607 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1328 microversion: 2.1 time: 0.544755 May 10 02:34:56.459233 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2439/4848] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:55 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1328 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:57.056457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:57.059720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:57.079851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:57.080545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:57.081512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:57.082112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:57.368366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:57.371644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:57.396875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:57.397740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:57.398793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:57.399475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:57.546270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:57.565732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:57.577515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:57.578913 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2fb3d70-fd81-4cd2-b625-107dfbbe949e tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.531923 May 10 02:34:57.582545 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2410/4849] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:57 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:57.602337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:57.603245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:57.622480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:57.632944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:57.644970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:57.645628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:57.967613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:57.983760 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8646d364-c59e-4f6f-9ca5-49a59063fbe6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1328 microversion: 2.1 time: 0.397561 May 10 02:34:57.984369 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2411/4850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:57 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1328 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:34:58.172441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:58.196057 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a016d507-2a3d-48b1-b93c-7149d4431ea8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.831986 May 10 02:34:58.205477 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2440/4851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:57 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:34:58.601225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:58.602060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:58.616562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:58.616941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:58.617759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:58.618207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:58.997435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:59.003242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:59.004961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:59.007764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:59.009312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:59.010523 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c5a3c7d4-2c3a-43fa-9dfe-0357da02cf50 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.414017 May 10 02:34:59.022656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:59.023597 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2412/4852] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:34:58 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:34:59.025125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:59.027404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:59.029609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:59.221764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:34:59.222876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:34:59.231548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:59.243844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:59.244997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:34:59.245616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:34:59.912625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:34:59.921903 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1bdb8f37-42dc-48d1-8099-cda81080c019 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.704540 May 10 02:34:59.931353 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2413/4853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:59 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:00.042960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:00.043879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:00.057338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:00.057995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:00.058980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:00.059612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:00.270140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:00.285668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:00.295002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:00.296914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eda88f07-8834-4966-ae0c-a4b454ff9cf3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.258864 May 10 02:35:00.301198 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2414/4854] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:00 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:00.316222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:00.334235 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a123cf3-d8a5-4891-a58a-55517273a9a5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1328 microversion: 2.1 time: 1.334417 May 10 02:35:00.335201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2441/4855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:34:58 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1328 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:00.941170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:00.941803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:00.950572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:00.951031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:00.951860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:00.952307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.320512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:01.321152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:01.334859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:01.335356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.336176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:01.336632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.568386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:01.584710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:01.586453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:01.587843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1151d277-e3e3-477f-8714-35ecf989ac59 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.271266 May 10 02:35:01.589437 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2442/4856] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:01 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:01.596386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:01.607967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:01.622812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:01.623386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.624101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:01.624550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.635878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:01.651420 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa1b5ada-90dc-4281-b860-6493f0712403 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.711658 May 10 02:35:01.663024 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2415/4857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:00 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:01.667777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7128ba8f-a065-46e8-8373-1100239fb71a req-76929029-8291-4ae5-9143-c65f7b93e580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db925971-d3e7-4e7e-b5ff-036a46d33147", "name": "network-vif-plugged", "status": "completed", "tag": "bb91ba71-4d65-4f64-a905-2b7a70f782ee"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:01.697156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7128ba8f-a065-46e8-8373-1100239fb71a req-76929029-8291-4ae5-9143-c65f7b93e580 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:01.699473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7128ba8f-a065-46e8-8373-1100239fb71a req-76929029-8291-4ae5-9143-c65f7b93e580 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.723045 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7128ba8f-a065-46e8-8373-1100239fb71a req-76929029-8291-4ae5-9143-c65f7b93e580 service nova] Creating event network-vif-plugged:bb91ba71-4d65-4f64-a905-2b7a70f782ee for instance db925971-d3e7-4e7e-b5ff-036a46d33147 on n-h1-841089-2 May 10 02:35:01.737395 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7128ba8f-a065-46e8-8373-1100239fb71a req-76929029-8291-4ae5-9143-c65f7b93e580 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078840 May 10 02:35:01.738031 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2416/4858] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:01.749215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-82e32b41-72b9-4612-9639-fbc9af3d10c2 req-56305e8c-42c3-4f4c-afd5-7f761c473cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3824f1-711a-45b4-a4c2-7c54dda66522", "tag": "7e58a505-7ed2-4d5d-86e0-72939510499a"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:01.777496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-82e32b41-72b9-4612-9639-fbc9af3d10c2 req-56305e8c-42c3-4f4c-afd5-7f761c473cfe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:01.777966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-82e32b41-72b9-4612-9639-fbc9af3d10c2 req-56305e8c-42c3-4f4c-afd5-7f761c473cfe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:01.796381 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-82e32b41-72b9-4612-9639-fbc9af3d10c2 req-56305e8c-42c3-4f4c-afd5-7f761c473cfe service nova] Creating event network-changed:7e58a505-7ed2-4d5d-86e0-72939510499a for instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 on n-h2-841089-2 May 10 02:35:01.802981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-82e32b41-72b9-4612-9639-fbc9af3d10c2 req-56305e8c-42c3-4f4c-afd5-7f761c473cfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061829 May 10 02:35:01.804013 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2417/4859] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:02.245991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:02.254804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-679a51d6-ce4f-4747-8849-d59cf0bed36f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1328 microversion: 2.1 time: 0.662709 May 10 02:35:02.270350 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2443/4860] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:01 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1328 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:02.609402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:02.611085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:02.623920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:02.624667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:02.628560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:02.629178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:02.669184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:02.670394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:02.705240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:02.705830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:02.706691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:02.707177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:02.831772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:02.848226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:02.850274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:02.851812 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82bc5a42-8889-4a2b-9f17-7117af7be4f0 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.246953 May 10 02:35:02.867465 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2418/4861] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:02 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:03.094722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:03.103311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b6eb2f5-7697-418b-bce3-d9636c836903 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.437806 May 10 02:35:03.108093 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2444/4862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:02 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:03.277023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:03.278130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:03.289021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:03.289850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:03.292338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:03.293036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:03.563708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:03.572892 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3605afa-e327-4583-9c38-6b8b7fd90dbe tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1510 microversion: 2.1 time: 0.299924 May 10 02:35:03.585424 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2419/4863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:03 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:03.589384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:03.590016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:03.626291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:03.630459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:03.631349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:03.632495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:03.872432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:03.873810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:03.886603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:03.889898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:03.892242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:03.894686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:04.177971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:04.195923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:04.205123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:04.206737 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d443c8be-ba9f-4531-bd0a-f8d4431214f8 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.338220 May 10 02:35:04.218603 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2420/4864] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:03 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:04.227002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:04.234444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:04.250179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:04.250847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:04.252440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:04.255925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:04.407541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:04.427409 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff262487-226b-4df4-b7df-34dcb16834d2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1510 microversion: 2.1 time: 0.840712 May 10 02:35:04.428042 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2445/4865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:03 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1510 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:04.450032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:04.450959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:04.469024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:04.469814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:04.471938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:04.475035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:04.565541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:35:04.786298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16ab2af9-d603-4c38-b850-e7952ed03e54 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 204 len: 0 microversion: 2.1 time: 0.345495 May 10 02:35:04.801138 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2446/4866] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:35:04 2022] DELETE /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:35:04.807635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:04.808683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:04.821628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:04.823676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:04.826071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:04.828894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:05.289720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:05.297278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdcc4177-bb1a-4c84-b880-9f379c09a66a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 1.076538 May 10 02:35:05.303620 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2421/4867] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:04 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:05.312552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:05.324286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:05.334505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:05.345744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:05.346855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:05.347568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:05.482403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:05.490330 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54ed3d21-e37d-4a41-8a04-262bb374fe36 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1516 microversion: 2.1 time: 0.687459 May 10 02:35:05.499739 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2447/4868] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:04 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1516 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:05.567384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:05.577926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:05.589382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:05.590795 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5940a582-182f-4380-b053-fe4c81b30af1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.285975 May 10 02:35:05.591531 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2422/4869] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:05 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:06.318505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:06.319166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:06.333178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:06.336723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:06.339587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:06.345369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:06.517230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:06.523532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:06.542753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:06.544554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:06.545725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:06.550291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:06.664502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:06.678783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1865f1f1-e1fc-4340-b4e8-efa003883667 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.365096 May 10 02:35:06.683501 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2448/4870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:06 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:06.698573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:06.706560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:06.742277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:06.743624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:06.752891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:06.754764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:06.944489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:06.957706 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51992e1f-f91e-42cb-8497-3f81ee9fbbe4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1516 microversion: 2.1 time: 0.444860 May 10 02:35:06.964938 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2423/4871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:06 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1516 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:07.017495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:07.028613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:07.030323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:07.031764 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5c98919-a83c-4215-a39b-a507d02cb215 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.347041 May 10 02:35:07.043882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2449/4872] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:06 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:07.702315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:07.710739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:07.727636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:07.730255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:07.733856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:07.734630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:07.984241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:07.985399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:08.009495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:08.010862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:08.017479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:08.019470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:08.336070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:08.347040 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-680861e4-f459-49a3-95b0-7ab75837136e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 200 len: 1474 microversion: 2.1 time: 0.369303 May 10 02:35:08.348032 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2450/4873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:07 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 1474 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:08.363760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:08.364437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:08.379314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:08.385506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:08.386865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:08.390438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:08.428909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:08.438258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ffdc5da9-7fe4-4f97-bebb-cdafd9ea7701 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.745176 May 10 02:35:08.442148 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2424/4874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:07 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:08.453169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-21f4be33-06a3-4d61-a0df-0b078f240209 req-64deac5f-b30b-4b24-abbd-eca86f730790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db925971-d3e7-4e7e-b5ff-036a46d33147", "name": "network-vif-deleted", "tag": "bb91ba71-4d65-4f64-a905-2b7a70f782ee"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:08.472599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21f4be33-06a3-4d61-a0df-0b078f240209 req-64deac5f-b30b-4b24-abbd-eca86f730790 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:08.473565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21f4be33-06a3-4d61-a0df-0b078f240209 req-64deac5f-b30b-4b24-abbd-eca86f730790 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:08.509846 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-21f4be33-06a3-4d61-a0df-0b078f240209 req-64deac5f-b30b-4b24-abbd-eca86f730790 service nova] Creating event network-vif-deleted:bb91ba71-4d65-4f64-a905-2b7a70f782ee for instance db925971-d3e7-4e7e-b5ff-036a46d33147 on n-h1-841089-2 May 10 02:35:08.526199 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-21f4be33-06a3-4d61-a0df-0b078f240209 req-64deac5f-b30b-4b24-abbd-eca86f730790 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079967 May 10 02:35:08.533716 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2425/4875] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:08.720755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:08.736945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:08.758125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:08.761030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4880a082-9bc2-4c5c-a964-744d8d017746 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.411969 May 10 02:35:08.782821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2451/4876] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:08 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:09.367891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:09.368725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:09.385815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:09.386272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:09.394372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:09.395171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:09.457945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:09.458654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:09.465187 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:35:09.466368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 HTTP/1.1 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'db925971-d3e7-4e7e-b5ff-036a46d33147'} May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:09.470505 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:09.475308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:09.475308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:09.475308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:35:09.475308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:35:09.475308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:35:09.475308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:09.476027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:09.476479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:35:09.479712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:09.481211 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4839b9a4-fe19-4b42-ba38-ff72d6a56616 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 404 len: 111 microversion: 2.1 time: 0.119303 May 10 02:35:09.481863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:09.485993 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2426/4877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:09 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:35:09.502634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9be244ca-a2c5-4817-946e-d1f5482e121b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '.version_select at 0x7f3d365b0af0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:09.559431 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9be244ca-a2c5-4817-946e-d1f5482e121b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-key-2110506478" status: 202 len: 0 microversion: 2.1 time: 0.071867 May 10 02:35:09.565997 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2427/4878] 10.222.0.52 () {58 vars in 1208 bytes} [Tue May 10 02:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2110506478 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:35:09.782949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1231930517", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:09.867692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:35:10.553983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:10.565671 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc3eee1f-12b1-4b85-8a7e-c60253022c33 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 1.111959 May 10 02:35:10.568600 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2452/4879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:09 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:10.579543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:10.594729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:10.617395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:10.617858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:10.618663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:10.619129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:10.927222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:10.940911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:10.942447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:10.943692 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88685ab6-910c-4336-8269-367206a2bf8a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.374588 May 10 02:35:10.951468 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2453/4880] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:10 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:10.961750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c7449ea3-df0c-4f2d-97b1-9c45c0428d1c req-ba88090b-ae8b-403d-ad26-982425b385e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3824f1-711a-45b4-a4c2-7c54dda66522", "name": "network-vif-plugged", "status": "completed", "tag": "7e58a505-7ed2-4d5d-86e0-72939510499a"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:10.983403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c7449ea3-df0c-4f2d-97b1-9c45c0428d1c req-ba88090b-ae8b-403d-ad26-982425b385e4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:10.984178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c7449ea3-df0c-4f2d-97b1-9c45c0428d1c req-ba88090b-ae8b-403d-ad26-982425b385e4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:11.005619 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c7449ea3-df0c-4f2d-97b1-9c45c0428d1c req-ba88090b-ae8b-403d-ad26-982425b385e4 service nova] Creating event network-vif-plugged:7e58a505-7ed2-4d5d-86e0-72939510499a for instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 on n-h2-841089-2 May 10 02:35:11.020778 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c7449ea3-df0c-4f2d-97b1-9c45c0428d1c req-ba88090b-ae8b-403d-ad26-982425b385e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067733 May 10 02:35:11.021512 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2454/4881] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:11.586539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:11.587949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:11.607793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:11.608563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:11.610046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:11.610657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:11.793170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:35:11.793737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:35:11.794306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:35:11.794839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:35:11.795385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:35:11.825670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:11.827095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:11.828054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:11.829461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:11.888083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:35:11.896395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:35:11.930092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:35:11.942832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:35:12.050242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19c1d64f-e28d-4247-9ac2-a04f35d12110 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272695 May 10 02:35:12.051237 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2428/4882] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:35:12.069493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:12.070323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:12.077262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:12.086148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:12.087301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:12.088749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:12.096429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:12.114572 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d0a9e36-9350-4b90-96db-d51dd37c1d46 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1367 microversion: 2.1 time: 0.533839 May 10 02:35:12.124182 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2455/4883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:11 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:12.130606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e849bdfd-6ff4-4145-8953-943fbbbfe056 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:12.138231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e849bdfd-6ff4-4145-8953-943fbbbfe056 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:12.257390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:12.277261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:12.283387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:12.283770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e849bdfd-6ff4-4145-8953-943fbbbfe056 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:12.285237 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c968c58-29bd-4c9f-86e2-8481e071cf16 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.232821 May 10 02:35:12.288659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2429/4884] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:12 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:12.291611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e849bdfd-6ff4-4145-8953-943fbbbfe056 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1209 microversion: 2.1 time: 0.165293 May 10 02:35:12.292065 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2456/4885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:12 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1209 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:13.141541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:13.144060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:13.159336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.160303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.164628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.165264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.315842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:13.317021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:13.348017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.352396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.355592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.358192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.511185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:13.526881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:13.528869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:13.530611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0e92a21-ccdd-4d94-843a-207b29ca4ce7 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.218759 May 10 02:35:13.531375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2457/4886] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:13 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:13.542113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:13.542113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:13.550003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.550792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.551908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.552594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.723346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:13.741200 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2075735f-938e-47ab-8bf7-e58f42166b5a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1557 microversion: 2.1 time: 0.604932 May 10 02:35:13.753408 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2430/4887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:13 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1557 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:13.778198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:13.779639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:13.796498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.797655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.798574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:13.800191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:13.848725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:13.864964 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5665376-3f1b-4c3f-a5c1-f38e081476d0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1269 microversion: 2.1 time: 0.332301 May 10 02:35:13.875029 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2458/4888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:13 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1269 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:13.975115 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-041fff39-24ad-4946-b0a7-f2f874307a22 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209614 May 10 02:35:13.975724 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2431/4889] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:35:13 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:35:14.550970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:14.552319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:14.566004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:14.566405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:14.567296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:14.567758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:14.694389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:14.705967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:14.709223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:14.712423 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f2bc5f3-a65d-458f-817c-47cc85d918de tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.166756 May 10 02:35:14.714238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2459/4890] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:14 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:14.882125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:14.882737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:14.894159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:14.894888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:14.895883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:14.903931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:15.630375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:15.643472 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a45a93c-5fa4-4bfc-8b96-642366fd5955 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.763962 May 10 02:35:15.645481 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2432/4891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:14 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:15.731870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:15.732500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:15.747730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:15.748501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:15.749504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:15.750658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:15.891238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:15.900900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:15.916437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:15.917960 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bd19f1cb-7e70-4e14-ab9e-bec4b1dc20d3 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.190225 May 10 02:35:15.918734 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2460/4892] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:15 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:16.662242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:16.662871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:16.676455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:16.676931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:16.680335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:16.680834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:16.938228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:16.938878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:16.957094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:16.957924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:16.959118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:16.959660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:17.142048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:17.162119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a9ae190-b152-4b22-9c43-1664c2d104d4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.500990 May 10 02:35:17.163111 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2433/4893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:16 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:17.180046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:17.194793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:17.196538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:17.200630 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1bde740-3c91-49b7-80e1-96e961b48fc1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.267255 May 10 02:35:17.202849 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2461/4894] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:16 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:17.625491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4cc120fb-0bc5-4ce6-989a-8c270317a9d9 req-3af710e6-183e-471c-8e3e-aa9c8857cb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cff26c-4d8b-4295-9fd6-cb4ddfeef060", "tag": "02dddf15-3d00-4080-8dc7-a945bb521270"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:17.641024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4cc120fb-0bc5-4ce6-989a-8c270317a9d9 req-3af710e6-183e-471c-8e3e-aa9c8857cb8b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:17.650068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4cc120fb-0bc5-4ce6-989a-8c270317a9d9 req-3af710e6-183e-471c-8e3e-aa9c8857cb8b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:17.687548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4cc120fb-0bc5-4ce6-989a-8c270317a9d9 req-3af710e6-183e-471c-8e3e-aa9c8857cb8b service nova] Creating event network-changed:02dddf15-3d00-4080-8dc7-a945bb521270 for instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 on n-h1-841089-2 May 10 02:35:17.694219 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4cc120fb-0bc5-4ce6-989a-8c270317a9d9 req-3af710e6-183e-471c-8e3e-aa9c8857cb8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072713 May 10 02:35:17.700929 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2434/4895] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:18.179696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:18.181166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:18.194154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:18.198478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:18.199760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:18.202433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:18.220851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:18.221569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:18.240503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:18.241335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:18.242308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:18.242961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:18.556865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:18.568903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:18.571558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:18.573257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8ce72c3e-0204-4c6a-acba-1a9f1da0996a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.357208 May 10 02:35:18.574443 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2435/4896] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:18 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:18.778960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:18.790275 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc8c1e8b-572f-4099-b0c3-9c24da920729 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.614900 May 10 02:35:18.800035 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2462/4897] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:18 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:19.597813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:19.598718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:19.619455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:19.620092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:19.621098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:19.621717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:19.745733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:19.759366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:19.769797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:19.771370 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-692a9f20-129b-45c9-8ac8-05a6c82da191 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.181329 May 10 02:35:19.772105 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2436/4898] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:19 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:19.807468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:19.808091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:19.824779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:19.825257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:19.826066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:19.826508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:20.232720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:20.240279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-11e0a7c4-8e6f-43ef-bd4f-0b7d42edbccb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.436796 May 10 02:35:20.244131 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2463/4899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:19 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:20.357145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a3aeaa12-4888-4710-84d5-005a1e183bdf req-e59a3d50-24a6-45cb-b774-bf8d0013acfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3824f1-711a-45b4-a4c2-7c54dda66522", "tag": "7e58a505-7ed2-4d5d-86e0-72939510499a"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:20.366186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a3aeaa12-4888-4710-84d5-005a1e183bdf req-e59a3d50-24a6-45cb-b774-bf8d0013acfb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:20.371988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a3aeaa12-4888-4710-84d5-005a1e183bdf req-e59a3d50-24a6-45cb-b774-bf8d0013acfb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:20.397906 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a3aeaa12-4888-4710-84d5-005a1e183bdf req-e59a3d50-24a6-45cb-b774-bf8d0013acfb service nova] Creating event network-changed:7e58a505-7ed2-4d5d-86e0-72939510499a for instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 on n-h2-841089-2 May 10 02:35:20.404638 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a3aeaa12-4888-4710-84d5-005a1e183bdf req-e59a3d50-24a6-45cb-b774-bf8d0013acfb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052057 May 10 02:35:20.415917 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2437/4900] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:20.791749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:20.792927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:20.800798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:20.801651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:20.802731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:20.803450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:21.258474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:21.259950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:21.271424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:21.274159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:21.275266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:21.277138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:21.532040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:21.548947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:21.550865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:21.561763 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-554adb2c-9a0d-4a92-9221-39f32b25a2d1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.774166 May 10 02:35:21.566037 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2464/4901] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:20 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:21.646779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:21.671537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68c964a3-cb40-42bd-855c-b6750cd0e1e8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.402554 May 10 02:35:21.672640 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2438/4902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:21 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:22.584905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:22.585621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:22.593253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:22.594008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:22.595665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:22.596314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:22.690217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:22.693063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:22.703706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:22.717256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:22.722275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:22.723950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:22.724425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:22.725337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:22.725786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:22.729438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9429644-1eb0-47a9-b571-8ab54aed8049 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.148535 May 10 02:35:22.732196 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2465/4903] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:22 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:22.949263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:22.957485 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-351aea1f-7332-4b41-a345-571478758a6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.272233 May 10 02:35:22.960606 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2439/4904] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:22 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:23.750437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:23.751751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:23.762165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:23.762886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:23.763920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:23.764726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:23.886159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:23.907059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:23.912860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:23.915729 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65798d67-9907-49ac-a37f-6b305f7ddb0b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.169732 May 10 02:35:23.917661 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2466/4905] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:23 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:23.975996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:23.977528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:23.985194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:23.985983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:23.987313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:23.988124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:24.053998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fcb5a312-f04e-4ba0-8f9e-f4476333eb18 req-5ce68880-adb2-43b8-9fe5-6b6a21268456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cff26c-4d8b-4295-9fd6-cb4ddfeef060", "name": "network-vif-plugged", "status": "completed", "tag": "02dddf15-3d00-4080-8dc7-a945bb521270"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:24.081225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fcb5a312-f04e-4ba0-8f9e-f4476333eb18 req-5ce68880-adb2-43b8-9fe5-6b6a21268456 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:24.084932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fcb5a312-f04e-4ba0-8f9e-f4476333eb18 req-5ce68880-adb2-43b8-9fe5-6b6a21268456 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:24.112255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fcb5a312-f04e-4ba0-8f9e-f4476333eb18 req-5ce68880-adb2-43b8-9fe5-6b6a21268456 service nova] Creating event network-vif-plugged:02dddf15-3d00-4080-8dc7-a945bb521270 for instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 on n-h1-841089-2 May 10 02:35:24.130849 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fcb5a312-f04e-4ba0-8f9e-f4476333eb18 req-5ce68880-adb2-43b8-9fe5-6b6a21268456 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080662 May 10 02:35:24.131960 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2467/4906] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:35:24.303341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:24.316247 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e6ab21b5-4a82-4507-8d42-23d3027d08ee tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.344189 May 10 02:35:24.316836 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2440/4907] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:23 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:24.935418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:24.936144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:24.951188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:24.951844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:24.952668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:24.953689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:25.143926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:25.156534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:25.158092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:25.164824 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d11935b-0142-4b34-8313-2f8308de9da6 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.228321 May 10 02:35:25.167090 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2468/4908] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:24 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:25.334614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:25.335430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:25.351472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:25.352386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:25.353626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:25.354296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:25.884741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:25.893529 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f822da5f-d757-4c15-9e00-4ad72c940a81 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1309 microversion: 2.1 time: 0.563882 May 10 02:35:25.904417 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2441/4909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:25 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1309 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:26.188867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:26.189492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:26.205976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:26.213475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:26.214544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:26.215195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:26.652811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:26.667802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:26.672549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:26.677527 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0f4cb17-23e3-45d3-ac88-db9ed0928490 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.490281 May 10 02:35:26.679567 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2469/4910] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:26 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:26.918690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:26.919344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:26.929389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:26.930212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:26.954056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:26.954947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:27.696557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:27.697213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:27.697856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:27.708552 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f546b7d3-c74d-4c6e-80ef-5d7b84001251 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1491 microversion: 2.1 time: 0.793219 May 10 02:35:27.709748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:27.710395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:27.711164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:27.711511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:27.729037 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2442/4911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:26 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1491 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:27.956889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:27.957716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1231930517", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:27.973997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:27.978156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:27.981966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b31d88c6-cfb2-40c0-8b09-f24186a71c2b tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.289173 May 10 02:35:27.985034 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2470/4912] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:27 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:28.059874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:35:29.005694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:29.017620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:29.046764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:29.047658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:29.048485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:29.048917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:29.216796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:29.232848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:29.234428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:29.252083 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-517e6b1f-a9d8-4ca9-8d72-a11ab4769f02 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.251852 May 10 02:35:29.254955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2471/4913] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:28 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:29.407447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:35:29.410454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:35:29.411400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:35:29.415379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:35:29.416182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:35:29.444506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:29.446314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:29.448424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:29.451034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:29.525432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:35:29.533774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:35:29.550455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:35:29.553458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:35:29.606351 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2cb554c-65ea-4e98-ad65-58de83021479 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652529 May 10 02:35:29.623669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bbd72c78-c14c-4e43-b462-d7e4cd7340b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:29.624616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bbd72c78-c14c-4e43-b462-d7e4cd7340b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:29.630371 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2443/4914] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:35:29.896000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bbd72c78-c14c-4e43-b462-d7e4cd7340b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:29.908399 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bbd72c78-c14c-4e43-b462-d7e4cd7340b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1209 microversion: 2.1 time: 0.293550 May 10 02:35:29.908906 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2472/4915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:29 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1209 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:30.273227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:30.273859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:30.292165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:30.297081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:30.300254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:30.301641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:30.513286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:30.536050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:30.537986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:30.545602 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e15f31e-adfc-4338-9619-69dfcbdbe3e9 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.277219 May 10 02:35:30.546878 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2444/4916] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:30 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:30.926628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:30.928088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:30.935468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:30.936145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:30.937928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:30.938672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:31.065592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:31.078785 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e59128d1-c1fd-4b1f-a6a5-5577dd3aa9f4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1205 microversion: 2.1 time: 0.155946 May 10 02:35:31.079791 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2473/4917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:30 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1205 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:31.567042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:31.567873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:31.602213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:31.603356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:31.605826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:31.606713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:32.096742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:32.097394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:32.113980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:32.114437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:32.115288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:32.126385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:32.417321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:32.426840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:32.428454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:32.429712 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5798d79a-982f-4be5-9b03-73c3aa2ca30d tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.868254 May 10 02:35:32.430299 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2445/4918] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:31 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:32.449961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:32.474710 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0639fc00-6128-4765-a479-5e3880cd93f7 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1267 microversion: 2.1 time: 0.382387 May 10 02:35:32.478282 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2474/4919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:32 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1267 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:33.456960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:33.457658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:33.468999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:33.472172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:33.475966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:33.476727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:33.494297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:33.494943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:33.524082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:33.525584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:33.526593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:33.531615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:33.924277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:33.934254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:33.944234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:33.952130 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dce7cfe1-75cd-4101-97cd-451194bff83f tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.502336 May 10 02:35:33.955587 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2446/4920] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:33 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:34.145570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:34.161785 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b05f98ae-0431-4b45-a43e-962dfb1c67d9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.670430 May 10 02:35:34.162464 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2475/4921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:33 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:34.973574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:34.974209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:34.982629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:34.983113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:34.983951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:34.984402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:35.179276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:35.180517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:35.198164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:35.201686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:35.202777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:35.203453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:35.213760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:35.228798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:35.239295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:35.244431 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd28ffbf-bb5d-423b-ba2c-985f4d8924e1 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.274795 May 10 02:35:35.245363 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2447/4922] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:34 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:35.415482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a3db6f57-1831-4d2d-88af-eac1d0afa4a5 req-dfa17c05-a954-4885-89e7-0c1d35ef55a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b39fb20-6c72-4629-9fb0-3183c378d4c5", "tag": "408aeaa3-2c83-4da5-8092-7dc19ec910ce"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:35.434244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a3db6f57-1831-4d2d-88af-eac1d0afa4a5 req-dfa17c05-a954-4885-89e7-0c1d35ef55a0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:35.434697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a3db6f57-1831-4d2d-88af-eac1d0afa4a5 req-dfa17c05-a954-4885-89e7-0c1d35ef55a0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:35.477119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a3db6f57-1831-4d2d-88af-eac1d0afa4a5 req-dfa17c05-a954-4885-89e7-0c1d35ef55a0 service nova] Creating event network-changed:408aeaa3-2c83-4da5-8092-7dc19ec910ce for instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 on n-h2-841089-2 May 10 02:35:35.504990 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a3db6f57-1831-4d2d-88af-eac1d0afa4a5 req-dfa17c05-a954-4885-89e7-0c1d35ef55a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099058 May 10 02:35:35.513796 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2448/4923] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 10 02:35:35.629980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:35.637531 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99224de8-606d-468f-97eb-2b8936873b42 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.463086 May 10 02:35:35.638128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2476/4924] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:35 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:36.270082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:36.270800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:36.290560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:36.291925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:36.293006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:36.293943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:36.438881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:36.464185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:36.469014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:36.474562 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c684fe4-c9f7-4b55-aefa-718c5889d237 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.213805 May 10 02:35:36.477827 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2449/4925] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:36 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:36.663635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:36.664394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:36.704631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:36.709325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:36.714612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:36.715290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:37.036596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:37.049317 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e31b4fc3-7355-4337-ab51-f643360d12f8 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.398143 May 10 02:35:37.050511 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2477/4926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:36 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:37.498462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:37.505108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:37.531477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:37.535508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:37.538964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:37.539785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:37.710062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:37.730251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:37.739260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:37.743733 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60b8aba7-7bf3-419f-8221-32867ade46dd tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.251055 May 10 02:35:37.759990 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2450/4927] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:37 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:38.078381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:38.079949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:38.099417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:38.100264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:38.101320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:38.103542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:38.368461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:38.378326 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b4ec8da-a3bc-4a49-b601-b29ec1b7422b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.314205 May 10 02:35:38.388918 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2478/4928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:38 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:38.762972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:38.763622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:38.773433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:38.779959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:38.781846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:38.782516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:38.988077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:38.999178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:39.017415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:39.021066 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1749e6db-0da7-4c19-9ca3-2401f39b2813 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.260804 May 10 02:35:39.021761 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2451/4929] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:38 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:39.396744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:39.398023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:39.405123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:39.416065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:39.417347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:39.417973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:39.690486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:39.703606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4847d6a5-4429-4d13-83a2-0bbaca6df39a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.306731 May 10 02:35:39.713334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2479/4930] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:39 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:40.042692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:40.044283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:40.064574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:40.068666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:40.069659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:40.077251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:40.231009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:40.248198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:40.249808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:40.251020 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-509904d3-f342-4160-9a7f-5193a3c4806c tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.214448 May 10 02:35:40.256099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2452/4931] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:40 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:40.726716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:40.727386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:40.749009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:40.751480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:40.754614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:40.755309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:41.047041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:41.055390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e332540e-1a11-401d-a13f-345490f1cfac tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.336231 May 10 02:35:41.076783 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2480/4932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:40 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:41.269636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:41.270268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:41.279386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:41.288009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:41.289004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:41.289459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:41.372427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:41.387119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:41.393013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:41.395963 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a7ff3fd-5747-4604-87cf-f1425718fd0a tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.129427 May 10 02:35:41.397879 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2453/4933] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:41 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:35:42.085071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:42.085713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:42.110997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:42.110997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:42.110997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:42.110997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:42.418297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:42.418906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:42.438455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:42.438913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:42.439741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:42.440180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:42.770079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:42.781539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:42.783061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46d1961d957b4971abe3829138adc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca02e648ae54ea0b81cec26d8d88dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:42.784300 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-11c08d9e-6dfa-4a36-a086-fad7e85e7608 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 200 len: 1604 microversion: 2.32 time: 0.370433 May 10 02:35:42.789499 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2454/4934] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:42 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:35:42.820951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-5a3022a3-a4e8-4eda-88c7-46536163ab8b req-ff60dad8-4ae4-4d55-8db1-2031a5e2b44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b39fb20-6c72-4629-9fb0-3183c378d4c5", "name": "network-vif-plugged", "status": "completed", "tag": "408aeaa3-2c83-4da5-8092-7dc19ec910ce"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:42.868462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5a3022a3-a4e8-4eda-88c7-46536163ab8b req-ff60dad8-4ae4-4d55-8db1-2031a5e2b44f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:42.869358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-5a3022a3-a4e8-4eda-88c7-46536163ab8b req-ff60dad8-4ae4-4d55-8db1-2031a5e2b44f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:42.900511 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-5a3022a3-a4e8-4eda-88c7-46536163ab8b req-ff60dad8-4ae4-4d55-8db1-2031a5e2b44f service nova] Creating event network-vif-plugged:408aeaa3-2c83-4da5-8092-7dc19ec910ce for instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 on n-h2-841089-2 May 10 02:35:42.907012 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-5a3022a3-a4e8-4eda-88c7-46536163ab8b req-ff60dad8-4ae4-4d55-8db1-2031a5e2b44f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112681 May 10 02:35:42.914925 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2455/4935] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:43.050179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:43.059672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-335d88c2-1078-4e6d-9f04-1ed0b482ef7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.978916 May 10 02:35:43.066210 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2481/4936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:42 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:43.808549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:43.811746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:43.826765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:43.828004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:43.829399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:43.829863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:43.851778 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] HTTP exception thrown: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Request method failure captured: May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 HTTP/1.1 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec2OZ7CBXCjA0_-MzfmNGJu3vKCE6EH7oZWalz_UWmwHRZht-hZHyv9AwMe_1XcuEdIcLmNO16GJgA8Muji1RJiMBSjD_3mqIT07qlaNpidka40RRzGIOWjprkty0hilh6alRiGat7Kt3odcZqFeIlq2sa0lMeciY9T_QNiyRSPDjoc May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.32 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 2ca02e648ae54ea0b81cec26d8d88dbd May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ca02e648ae54ea0b81cec26d8d88dbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 2ca02e648ae54ea0b81cec26d8d88dbd May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TaggedBootDevicesTest-1378925499-project May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 46d1961d957b4971abe3829138adc2c2 May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TaggedBootDevicesTest-1378925499-project May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '78a53feb-85bb-40b7-ac54-c37fd183c5e0'} May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:43.853929 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Returning 404 to user: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-107d8b70-1c02-46bd-826a-726b2f7bf633 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 404 len: 111 microversion: 2.32 time: 0.054181 May 10 02:35:43.859580 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2456/4937] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:43 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:35:43.865203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b8a3d4be-9aae-4dbd-bb72-b71ebfe45828 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '.version_select at 0x7f3d3704e700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:43.907522 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b8a3d4be-9aae-4dbd-bb72-b71ebfe45828 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621481917" status: 204 len: 0 microversion: 2.32 time: 0.046036 May 10 02:35:43.911620 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2482/4938] 10.222.0.52 () {60 vars in 1258 bytes} [Tue May 10 02:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621481917 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 02:35:44.077015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:44.078287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:44.093103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:44.095609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:44.101269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:44.101833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:44.435877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:44.449052 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37c1c1dd-8699-473e-9ba5-66e21b762de5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1309 microversion: 2.1 time: 0.375774 May 10 02:35:44.463929 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2457/4939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:44 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:45.467107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:45.467840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:45.482599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:45.483084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:45.484517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:45.484979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:45.947988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:45.959616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c5681ed-107d-4858-bde6-bfc14f4e4367 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1490 microversion: 2.1 time: 0.497594 May 10 02:35:45.962862 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2483/4940] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:45 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1490 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:45.980205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:45.981652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:45.990949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:45.991765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:45.992784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:45.993455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:46.351463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:46.360455 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-99435463-2f02-4288-9447-bf0e34cf771a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1491 microversion: 2.1 time: 0.384226 May 10 02:35:46.361365 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2458/4941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:45 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1491 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:46.377948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:46.378775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:46.385260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:46.385943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:46.387245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:46.387858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:47.245305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:47.254071 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e3f1f39-e2b4-42f6-bc35-d1f76c6c3c2e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1490 microversion: 2.1 time: 0.880954 May 10 02:35:47.256758 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2484/4942] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:46 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1490 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:47.276269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:47.277400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:47.298159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:47.300926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:47.304011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:47.305548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:47.369447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:35:47.488127 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a00b86c-19b2-402d-93dc-0ec298a34d4a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 204 len: 0 microversion: 2.1 time: 0.216493 May 10 02:35:47.489506 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2459/4943] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:35:47 2022] DELETE /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:35:47.497874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:47.498700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:47.517119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:47.524896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:47.526884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:47.529419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:47.869229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:47.882390 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-935ead0f-7324-42a6-91f3-b32dc3d75346 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1496 microversion: 2.1 time: 0.387232 May 10 02:35:47.902921 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2485/4944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:47 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1496 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:48.902046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:48.902768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:48.919813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:48.920276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:48.921644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:48.922092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:49.708794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:49.737279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7fe60bb2-33e9-4f7f-8812-9cc807d18e6e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1496 microversion: 2.1 time: 0.835646 May 10 02:35:49.740276 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2460/4945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:48 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1496 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:50.757035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:50.757895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:50.765190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:50.777292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:50.778311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:50.778778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:51.160081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:51.160899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:51.171261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:51.175764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:51.176757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:51.177443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:51.231356 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f44baad-9d24-48d9-bb49-6c276c8bee95 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/ips" status: 200 len: 150 microversion: 2.1 time: 0.065874 May 10 02:35:51.238144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2461/4946] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:35:51 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:51.485153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:51.506726 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff9d8f95-ab1d-4357-8a80-e1690d1e19ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 200 len: 1496 microversion: 2.1 time: 0.752303 May 10 02:35:51.509215 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2486/4947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:50 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 1496 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:51.839464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-59c2c830-a523-4c71-b968-d1ef3a1d0623 req-b5d2076a-bd35-444d-b7ee-1116482aa978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b39fb20-6c72-4629-9fb0-3183c378d4c5", "name": "network-vif-deleted", "tag": "408aeaa3-2c83-4da5-8092-7dc19ec910ce"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:51.868459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-59c2c830-a523-4c71-b968-d1ef3a1d0623 req-b5d2076a-bd35-444d-b7ee-1116482aa978 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:51.869079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-59c2c830-a523-4c71-b968-d1ef3a1d0623 req-b5d2076a-bd35-444d-b7ee-1116482aa978 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:51.884413 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-59c2c830-a523-4c71-b968-d1ef3a1d0623 req-b5d2076a-bd35-444d-b7ee-1116482aa978 service nova] Creating event network-vif-deleted:408aeaa3-2c83-4da5-8092-7dc19ec910ce for instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 on n-h2-841089-2 May 10 02:35:51.895172 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-59c2c830-a523-4c71-b968-d1ef3a1d0623 req-b5d2076a-bd35-444d-b7ee-1116482aa978 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065374 May 10 02:35:51.897020 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2462/4948] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:52.526703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:52.527370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:52.550668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:52.557170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:52.560142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:52.561645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:52.602034 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 HTTP/1.1 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '0b39fb20-6c72-4629-9fb0-3183c378d4c5'} May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:52.612344 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:52.617214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:52.617214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:52.617214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:35:52.617214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:35:52.617214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:35:52.617214 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:52.625515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:35:52.629323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79dde1a2-8670-4860-a492-c80da1d17e04 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 404 len: 111 microversion: 2.1 time: 0.104967 May 10 02:35:52.631056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2487/4949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:52 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:35:52.640137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:52.640753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:52.662912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:52.665440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:52.669348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:52.669810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:52.744660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:35:52.954731 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd7aaa18-3365-4de0-adc5-00ebcfcbcf4b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 204 len: 0 microversion: 2.1 time: 0.319839 May 10 02:35:52.958748 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2463/4950] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:35:52 2022] DELETE /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:35:52.967118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:52.968044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:52.985809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:52.986503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:52.987566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:52.989943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:54.089693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:54.090446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:54.115380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:54.115853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:54.116657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:54.117104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:54.168009 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] HTTP exception thrown: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Request method failure captured: May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 HTTP/1.1 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec2OZ7CBXCjA0_-MzfmNGJu3vKCE6EH7oZWalz_UWmwHRZht-hZHyv9AwMe_1XcuEdIcLmNO16GJgA8Muji1RJiMBSjD_3mqIT07qlaNpidka40RRzGIOWjprkty0hilh6alRiGat7Kt3odcZqFeIlq2sa0lMeciY9T_QNiyRSPDjoc May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.32 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 2ca02e648ae54ea0b81cec26d8d88dbd May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ca02e648ae54ea0b81cec26d8d88dbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 2ca02e648ae54ea0b81cec26d8d88dbd May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TaggedBootDevicesTest-1378925499-project May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 46d1961d957b4971abe3829138adc2c2 May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TaggedBootDevicesTest-1378925499-project May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '78a53feb-85bb-40b7-ac54-c37fd183c5e0'} May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:35:54.169755 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Returning 404 to user: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-48b831fd-c18b-4397-ba60-558105d5ed92 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "DELETE /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 404 len: 111 microversion: 2.32 time: 0.089688 May 10 02:35:54.174124 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2464/4951] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:35:54 2022] DELETE /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:35:54.185674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:54.193539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] [instance: 78a53feb-85bb-40b7-ac54-c37fd183c5e0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:54.210324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:54.211701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:54.215272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:54.215812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:54.245366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] HTTP exception thrown: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Request method failure captured: May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 HTTP/1.1 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec2OZ7CBXCjA0_-MzfmNGJu3vKCE6EH7oZWalz_UWmwHRZht-hZHyv9AwMe_1XcuEdIcLmNO16GJgA8Muji1RJiMBSjD_3mqIT07qlaNpidka40RRzGIOWjprkty0hilh6alRiGat7Kt3odcZqFeIlq2sa0lMeciY9T_QNiyRSPDjoc May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.32 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 2ca02e648ae54ea0b81cec26d8d88dbd May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ca02e648ae54ea0b81cec26d8d88dbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ca02e648ae54ea0b81cec26d8d88dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 2ca02e648ae54ea0b81cec26d8d88dbd May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1378925499 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TaggedBootDevicesTest-1378925499-project May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 46d1961d957b4971abe3829138adc2c2 May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TaggedBootDevicesTest-1378925499-project May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '78a53feb-85bb-40b7-ac54-c37fd183c5e0'} May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:54.247406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] Returning 404 to user: Instance 78a53feb-85bb-40b7-ac54-c37fd183c5e0 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a1b95df-27da-41b0-93cb-1992a2b86d24 tempest-TaggedBootDevicesTest-1378925499 tempest-TaggedBootDevicesTest-1378925499-project] 10.222.0.52 "GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0" status: 404 len: 111 microversion: 2.32 time: 0.072709 May 10 02:35:54.252534 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2465/4952] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:35:54 2022] GET /compute/v2.1/servers/78a53feb-85bb-40b7-ac54-c37fd183c5e0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:35:54.573717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:54.597456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ba060c74-8acf-4cbb-a6cd-39d381815283 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1497 microversion: 2.1 time: 1.634295 May 10 02:35:54.598666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2488/4953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:52 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1497 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:55.223423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2d80d4-3347-4150-8c09-72ef1a2be3e9"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:55.226564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:55.248296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:55.254256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:55.255966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:55.256438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:55.326239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f26ce3c4-aad8-42b9-acb4-dcc4a40f7368 req-99e2f2d1-9408-4747-a93b-b98c6e716ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cff26c-4d8b-4295-9fd6-cb4ddfeef060", "name": "network-vif-deleted", "tag": "02dddf15-3d00-4080-8dc7-a945bb521270"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:55.366369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f26ce3c4-aad8-42b9-acb4-dcc4a40f7368 req-99e2f2d1-9408-4747-a93b-b98c6e716ee8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:55.369246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f26ce3c4-aad8-42b9-acb4-dcc4a40f7368 req-99e2f2d1-9408-4747-a93b-b98c6e716ee8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:55.414932 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f26ce3c4-aad8-42b9-acb4-dcc4a40f7368 req-99e2f2d1-9408-4747-a93b-b98c6e716ee8 service nova] Creating event network-vif-deleted:02dddf15-3d00-4080-8dc7-a945bb521270 for instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 on n-h1-841089-2 May 10 02:35:55.433979 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f26ce3c4-aad8-42b9-acb4-dcc4a40f7368 req-99e2f2d1-9408-4747-a93b-b98c6e716ee8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114431 May 10 02:35:55.437951 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2489/4954] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:35:55.618913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:55.619857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:55.643859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:55.676014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:55.682199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:55.689415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:55.810005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:55.813136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:55.813792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lazy-loading 'fault' on Instance uuid e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:35:55.932231 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-deeb39b3-38ed-49c6-9aed-542657476d06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717484 May 10 02:35:55.933506 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2466/4955] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:35:55 2022] POST /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:35:56.085991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:56.097417 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d80a94e6-a40a-4c58-a1b0-f9e5ded53c89 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 200 len: 1299 microversion: 2.1 time: 0.486416 May 10 02:35:56.098669 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2490/4956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:55 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 1299 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:35:56.976876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1309482638", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "4cf1b09b-2348-448f-b906-d9a7dd8458db"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:57.054045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] validate_networks() for [('4cf1b09b-2348-448f-b906-d9a7dd8458db', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:35:57.116107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:57.117314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:57.180740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:57.185461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:57.190434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:57.195514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:57.240969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 HTTP/1.1 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e3cff26c-4d8b-4295-9fd6-cb4ddfeef060'} May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:57.242652 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:35:57.246728 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:35:57.246728 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:35:57.246728 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:35:57.246728 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:35:57.246728 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:35:57.246728 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:35:57.250589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:35:57.251720 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0cab8057-35c9-457d-8376-ddfbb54a504d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 404 len: 111 microversion: 2.1 time: 0.140297 May 10 02:35:57.252886 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2491/4957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:57 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:35:57.370745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-371245316", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:35:57.448023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:35:58.414259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:35:58.415440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:35:58.416204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:35:58.416986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:35:58.417605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:35:58.437553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:58.442126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:58.443294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:58.443966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:58.492435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:35:58.504623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:35:58.538782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:35:58.541635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:35:58.682456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-de68f94c-43bb-4e87-a045-58905640a6db tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315614 May 10 02:35:58.691693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2492/4958] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:35:58.724734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-82657525-72b1-4327-a871-1923eae12768 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:58.725499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-82657525-72b1-4327-a871-1923eae12768 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:59.435920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:35:59.437033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:35:59.437706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:35:59.438277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:35:59.439307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:35:59.476955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:59.481765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:59.482975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:35:59.485978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:35:59.554148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Getting quotas for project a49a6cdbc8eb4ac5a1316799ff42d5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:35:59.578089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-82657525-72b1-4327-a871-1923eae12768 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:59.586257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Getting quotas for user 8cb811c671a6458e8230667f5c11c9c2 and project a49a6cdbc8eb4ac5a1316799ff42d5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:35:59.588658 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-82657525-72b1-4327-a871-1923eae12768 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1208 microversion: 2.1 time: 0.871900 May 10 02:35:59.589426 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2493/4959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:58 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1208 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:35:59.632039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:35:59.636021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:35:59.715699 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-99965293-75aa-4fd8-906a-8b60e72c7037 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.754046 May 10 02:35:59.717892 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2467/4960] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:35:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:35:59.761089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-693b268e-8824-4028-bc3f-3d16b7f12f4c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:35:59.766550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-693b268e-8824-4028-bc3f-3d16b7f12f4c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:35:59.869274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-693b268e-8824-4028-bc3f-3d16b7f12f4c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:35:59.876884 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-693b268e-8824-4028-bc3f-3d16b7f12f4c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1214 microversion: 2.1 time: 0.131466 May 10 02:35:59.877483 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2494/4961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:35:59 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:00.606383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:00.607743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:00.626994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:00.631913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:00.633143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:00.633846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:00.895319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:00.895969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:00.923658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:00.924130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:00.924944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:00.925396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:01.110690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:01.118890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c209834d-b8ff-4c7e-9d56-3072a293eec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1268 microversion: 2.1 time: 0.516724 May 10 02:36:01.123659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2468/4962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:00 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1268 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:01.245726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:01.276260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-209a2a44-08d9-43e8-89ca-01d17d931b61 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1210 microversion: 2.1 time: 0.385364 May 10 02:36:01.295481 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2495/4963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:00 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1210 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:02.137157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:02.137789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:02.146196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:02.146665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:02.147489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:02.147953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:02.295148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:02.297002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:02.308463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:02.314076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:02.323466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:02.324357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:02.890694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:02.899359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-91164090-314c-414f-a237-5f22b652cd21 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1266 microversion: 2.1 time: 0.765974 May 10 02:36:02.911518 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2469/4964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:02 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1266 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:03.015612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:03.027276 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-182e87e1-892c-473c-83b1-76369a8344e1 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1272 microversion: 2.1 time: 0.737257 May 10 02:36:03.037505 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2496/4965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:02 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1272 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:03.916901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:03.918149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:03.933188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:03.936424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:03.939335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:03.940573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:04.044724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:04.045413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:04.056944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:04.071973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:04.073077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:04.075530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:04.424188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:04.431958 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-23c6bdba-980a-4e04-a05d-ab3f1ba24dbd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1272 microversion: 2.1 time: 0.391157 May 10 02:36:04.451473 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2497/4966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:04 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1272 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:04.962041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:04.978794 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7b617ff0-5172-4f91-827f-eb03ea329e57 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 1.065784 May 10 02:36:04.992279 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2470/4967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:03 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:05.302227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-85be303f-48e6-4a31-9b79-ba94eb4869a5 req-d99a67e8-a9e8-43cc-8214-fab0a426d1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7f972b-a763-4df0-8fc2-b2ce842374c2", "tag": "34f9d9a2-01ae-4e15-b598-470600638784"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:05.315672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-85be303f-48e6-4a31-9b79-ba94eb4869a5 req-d99a67e8-a9e8-43cc-8214-fab0a426d1db service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:05.321057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-85be303f-48e6-4a31-9b79-ba94eb4869a5 req-d99a67e8-a9e8-43cc-8214-fab0a426d1db service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:05.343044 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-85be303f-48e6-4a31-9b79-ba94eb4869a5 req-d99a67e8-a9e8-43cc-8214-fab0a426d1db service nova] Creating event network-changed:34f9d9a2-01ae-4e15-b598-470600638784 for instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 on n-h1-841089-2 May 10 02:36:05.352564 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-85be303f-48e6-4a31-9b79-ba94eb4869a5 req-d99a67e8-a9e8-43cc-8214-fab0a426d1db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054081 May 10 02:36:05.357301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2498/4968] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:05.464479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:05.465109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:05.477168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:05.477650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:05.482295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:05.482857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:05.997486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:05.998930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:06.012065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:06.012644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:06.016614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:06.017396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:06.489988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:06.501258 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13bd4e44-af3a-4992-90a5-3fe09a011a54 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 1.046652 May 10 02:36:06.509170 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2471/4969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:05 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:06.752245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:06.760357 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bc717fe-5912-416b-a97d-681d33fd1b18 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 0.768067 May 10 02:36:06.775748 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2499/4970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:05 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:07.525843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:07.528183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:07.540134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:07.544870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:07.558782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:07.559924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:07.784186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:07.784823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:07.794833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:07.803228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:07.804613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:07.805326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:08.104985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:08.113443 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e778384-7a35-4ce5-b255-b5b8917c9c3f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 0.593352 May 10 02:36:08.119185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2472/4971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:07 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:08.350002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:08.357571 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d769ca4a-6204-4842-ae95-b15b2033b9c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 0.577937 May 10 02:36:08.361777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2500/4972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:07 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:08.824641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-59b1e164-1669-4eaa-9295-923e9f1b3f82 req-c24f29a9-5a72-4000-9a54-9812d40f804b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c053bc1-9fc1-495b-bee1-07667b00ee39", "tag": "0595d84f-abeb-4204-b6b5-94119950883c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:08.846164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-59b1e164-1669-4eaa-9295-923e9f1b3f82 req-c24f29a9-5a72-4000-9a54-9812d40f804b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:08.846934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-59b1e164-1669-4eaa-9295-923e9f1b3f82 req-c24f29a9-5a72-4000-9a54-9812d40f804b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:08.865549 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-59b1e164-1669-4eaa-9295-923e9f1b3f82 req-c24f29a9-5a72-4000-9a54-9812d40f804b service nova] Creating event network-changed:0595d84f-abeb-4204-b6b5-94119950883c for instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 on n-h1-841089-2 May 10 02:36:08.875785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-59b1e164-1669-4eaa-9295-923e9f1b3f82 req-c24f29a9-5a72-4000-9a54-9812d40f804b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057040 May 10 02:36:08.876828 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2473/4973] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:09.133785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:09.134407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:09.149906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:09.150367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:09.151191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:09.151636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:09.377281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:09.378305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:09.391414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:09.393537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:09.396864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:09.397974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:09.736654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:09.748140 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c3a6421-9783-4f03-bb31-7d65c2bd2f40 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 0.376803 May 10 02:36:09.751736 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2474/4974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:09 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:09.839510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:09.866663 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-796bf4a0-43ee-4f4e-bea9-38de9fb1a75b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 0.735216 May 10 02:36:09.871115 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2501/4975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:09 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:10.773221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:10.774796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:10.808216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:10.809039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:10.810019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:10.814713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:10.893892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:10.895849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:10.923573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:10.924369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:10.926345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:10.931915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:11.293899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:11.302331 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bee1abb5-c083-44f0-90b1-fbcd99dc3ca3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 0.536934 May 10 02:36:11.315887 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2475/4976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:10 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:11.398771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:11.413626 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38a3a81e-bbf2-4d03-921f-0b95c26a613f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 0.529006 May 10 02:36:11.415388 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2502/4977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:10 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:12.318454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:12.319374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:12.327994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:12.328712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:12.329651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:12.330216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:12.431847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:12.433112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:12.442983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:12.444006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:12.444969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:12.455046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:13.430551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:13.439563 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe1edad9-7a0e-4e1b-88b7-30a4960348cd tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 1.125106 May 10 02:36:13.461886 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2476/4978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:12 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:13.698991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:13.711227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1c961ba-3099-4900-adfe-58673e4513ef tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 1.280461 May 10 02:36:13.711961 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2503/4979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:12 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:14.467332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:14.467839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:14.487375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:14.487900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:14.488748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:14.497714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:14.728597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:14.729208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:14.747228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:14.748750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:14.749567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:14.750020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:15.183963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:15.193929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9430d954-2beb-41f2-9737-7d8b1af2029b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 0.731737 May 10 02:36:15.199384 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2477/4980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:14 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:15.389833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:15.410963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56f9f8a7-2a52-4951-81db-f5180877087a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 0.685922 May 10 02:36:15.425692 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2504/4981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:14 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:16.171870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b453cd0f-7cbf-4b71-98b1-13c438c7f49c req-4c68434a-78dc-4980-8991-118d90713a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7f972b-a763-4df0-8fc2-b2ce842374c2", "name": "network-vif-plugged", "status": "completed", "tag": "34f9d9a2-01ae-4e15-b598-470600638784"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:16.192436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b453cd0f-7cbf-4b71-98b1-13c438c7f49c req-4c68434a-78dc-4980-8991-118d90713a05 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:16.192904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b453cd0f-7cbf-4b71-98b1-13c438c7f49c req-4c68434a-78dc-4980-8991-118d90713a05 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:16.214578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:16.215241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:16.226103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:16.227614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:16.230419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:16.231183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:16.236211 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b453cd0f-7cbf-4b71-98b1-13c438c7f49c req-4c68434a-78dc-4980-8991-118d90713a05 service nova] Creating event network-vif-plugged:34f9d9a2-01ae-4e15-b598-470600638784 for instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 on n-h1-841089-2 May 10 02:36:16.279252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b453cd0f-7cbf-4b71-98b1-13c438c7f49c req-4c68434a-78dc-4980-8991-118d90713a05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111676 May 10 02:36:16.281525 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2478/4982] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:36:16.434400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:16.436468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:16.451403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:16.452298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:16.462868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:16.463725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:17.293664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:17.302362 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec17fa48-4f21-4875-b72f-6f85d9df85da tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1308 microversion: 2.1 time: 1.092704 May 10 02:36:17.311793 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2505/4983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:16 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1308 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:17.429122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:17.443694 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61afab7a-3db1-4ff0-b79c-b5e41fdcc98a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 1.016457 May 10 02:36:17.444796 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2479/4984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:16 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:18.319864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:18.321664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:18.338088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:18.338907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:18.343542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:18.348822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:18.463477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:18.464226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:18.474303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:18.490240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:18.494318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:18.496834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:19.071033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:19.099426 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f378870f-5796-4ad3-8288-695e03f9b970 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 0.640533 May 10 02:36:19.109686 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2480/4985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:18 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:19.206686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:19.230966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f24b7cc-eadf-46d8-8845-d79064732685 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1490 microversion: 2.1 time: 0.900439 May 10 02:36:19.232882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2506/4986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:18 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1490 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:19.256164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:19.257451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:19.287310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:19.288468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:19.289657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:19.290108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:19.396629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-26d9cec1-235f-496f-aaa7-1da25dc7418a req-9c381172-ceee-4fa7-b9f2-844bc39f0028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c053bc1-9fc1-495b-bee1-07667b00ee39", "name": "network-vif-plugged", "status": "completed", "tag": "0595d84f-abeb-4204-b6b5-94119950883c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:19.422373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-26d9cec1-235f-496f-aaa7-1da25dc7418a req-9c381172-ceee-4fa7-b9f2-844bc39f0028 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:19.423772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-26d9cec1-235f-496f-aaa7-1da25dc7418a req-9c381172-ceee-4fa7-b9f2-844bc39f0028 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:19.458652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-26d9cec1-235f-496f-aaa7-1da25dc7418a req-9c381172-ceee-4fa7-b9f2-844bc39f0028 service nova] Creating event network-vif-plugged:0595d84f-abeb-4204-b6b5-94119950883c for instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 on n-h1-841089-2 May 10 02:36:19.470107 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a49fc422-cd9b-4244-a48d-2b1542bbb7a4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "PUT /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1085 microversion: 2.1 time: 0.225689 May 10 02:36:19.471498 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-26d9cec1-235f-496f-aaa7-1da25dc7418a req-9c381172-ceee-4fa7-b9f2-844bc39f0028 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080139 May 10 02:36:19.474315 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2507/4987] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:19.492531 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2481/4988] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:36:19 2022] PUT /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1085 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:19.502534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:19.506300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:19.540619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:19.541720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:19.544475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:19.545927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.009105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:20.027428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f92015fa-d9b6-49f6-99c6-e7c2c5d9e186 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1511 microversion: 2.1 time: 0.534534 May 10 02:36:20.029887 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2508/4989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:19 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1511 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:20.048244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:20.049163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:20.056689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.059291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.061155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.061777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.117666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:20.118776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:20.130987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.133396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.134418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.147165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.429447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:20.438675 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10b35ed0-ca8a-41e5-927a-5a5abc0d1c55 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1314 microversion: 2.1 time: 0.325123 May 10 02:36:20.448841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2509/4990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:20 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:20.536303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:20.545458 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6acafa28-dc53-4e2b-b9c3-48e9c1f3eb79 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1511 microversion: 2.1 time: 0.501137 May 10 02:36:20.556301 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2482/4991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:20 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:20.564172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:20.564650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:20.571713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.572189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.572968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.573411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.626536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:36:20.770295 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f76983f3-64a0-4fb5-87c4-a8ce39f1e45a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 204 len: 0 microversion: 2.1 time: 0.210913 May 10 02:36:20.779734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:20.780699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:20.784305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2510/4992] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:36:20 2022] DELETE /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:36:20.788229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.789348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:20.790388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:20.791037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:21.092075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:21.100447 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1451531-ac45-457d-b7bb-a95f1674ffd5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1517 microversion: 2.1 time: 0.324646 May 10 02:36:21.101282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2483/4993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:20 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1517 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:21.467746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:21.468483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:21.493005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:21.493555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:21.494687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:21.494985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:21.865683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:21.874656 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fbb65cfb-8a85-4f19-b732-6f014b7b6f51 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1497 microversion: 2.1 time: 0.411976 May 10 02:36:21.875275 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2511/4994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:21 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:22.120486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:22.122043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:22.154830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:22.156968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:22.159499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:22.161299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:22.734616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:22.736653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:22.754019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:22.754494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:22.764122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:22.764694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:22.814753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:36:22.819118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:22.827540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6f623506-574c-4ada-aa26-4a2922fde381 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1517 microversion: 2.1 time: 0.713716 May 10 02:36:22.834717 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2484/4995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:22 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1517 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:22.998804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c4e1a9a-6d13-4953-9c0a-64049b933271 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 204 len: 0 microversion: 2.1 time: 0.267809 May 10 02:36:23.001671 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2512/4996] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:36:22 2022] DELETE /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:36:23.009542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:23.011119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:23.020898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:23.021983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:23.023006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:23.023655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:23.426834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:23.440468 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c3ef825-8c43-4ae4-adf1-e1e91247f484 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1503 microversion: 2.1 time: 0.434738 May 10 02:36:23.443425 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2485/4997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:23 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:23.851897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:23.853980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:23.868006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:23.889563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:23.893534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:23.894018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:24.461320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:24.462023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:24.483373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:24.491849 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-365f87e6-66bc-44af-b343-3a1687ef23e4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1517 microversion: 2.1 time: 0.644401 May 10 02:36:24.492445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2513/4998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:23 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1517 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:24.493562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:24.494130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:24.496823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:24.497291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:25.086683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:25.111874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07a2f5c3-e995-440a-af94-7de31cf05d64 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1503 microversion: 2.1 time: 0.653183 May 10 02:36:25.113253 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2486/4999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:24 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:25.201779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f8cf99d8-f3e5-4865-a1b0-188f449ed509 req-c485befa-3d51-4089-8849-734ec19b5bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7f972b-a763-4df0-8fc2-b2ce842374c2", "name": "network-vif-deleted", "tag": "34f9d9a2-01ae-4e15-b598-470600638784"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:25.244514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f8cf99d8-f3e5-4865-a1b0-188f449ed509 req-c485befa-3d51-4089-8849-734ec19b5bdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:25.247110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f8cf99d8-f3e5-4865-a1b0-188f449ed509 req-c485befa-3d51-4089-8849-734ec19b5bdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:25.291896 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f8cf99d8-f3e5-4865-a1b0-188f449ed509 req-c485befa-3d51-4089-8849-734ec19b5bdd service nova] Creating event network-vif-deleted:34f9d9a2-01ae-4e15-b598-470600638784 for instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 on n-h1-841089-2 May 10 02:36:25.305904 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f8cf99d8-f3e5-4865-a1b0-188f449ed509 req-c485befa-3d51-4089-8849-734ec19b5bdd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120293 May 10 02:36:25.311646 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2514/5000] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:25.370158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-216d609a-1d4a-448c-beb8-931ce375ae45 req-92c2cf73-23cd-47dc-a609-d23ca3fa9e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c053bc1-9fc1-495b-bee1-07667b00ee39", "name": "network-vif-deleted", "tag": "0595d84f-abeb-4204-b6b5-94119950883c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:25.384624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-216d609a-1d4a-448c-beb8-931ce375ae45 req-92c2cf73-23cd-47dc-a609-d23ca3fa9e72 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:25.389587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-216d609a-1d4a-448c-beb8-931ce375ae45 req-92c2cf73-23cd-47dc-a609-d23ca3fa9e72 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:25.406528 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-216d609a-1d4a-448c-beb8-931ce375ae45 req-92c2cf73-23cd-47dc-a609-d23ca3fa9e72 service nova] Creating event network-vif-deleted:0595d84f-abeb-4204-b6b5-94119950883c for instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 on n-h1-841089-2 May 10 02:36:25.421101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-216d609a-1d4a-448c-beb8-931ce375ae45 req-92c2cf73-23cd-47dc-a609-d23ca3fa9e72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055525 May 10 02:36:25.421735 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2487/5001] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:25.512821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:25.514809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:25.563447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:25.564414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:25.566544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:25.567287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:25.687470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:25.688277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:25.688989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lazy-loading 'fault' on Instance uuid 6f7f972b-a763-4df0-8fc2-b2ce842374c2 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:36:25.839253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:25.855272 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bf86cc9-88f0-40f4-b2f5-f5839c9d8909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 200 len: 1319 microversion: 2.1 time: 0.347487 May 10 02:36:25.857133 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2515/5002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:25 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:26.130415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:26.131465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:26.154161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:26.156388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:26.158812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:26.159888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:26.205366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:26.206153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:26.206887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lazy-loading 'fault' on Instance uuid 8c053bc1-9fc1-495b-bee1-07667b00ee39 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:36:26.273062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:26.283429 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07e52b44-a07f-4c83-a5be-0159e969b0aa tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 200 len: 1466 microversion: 2.1 time: 0.157721 May 10 02:36:26.286329 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2488/5003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:26 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:26.875115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:26.876512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:26.885352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:26.886203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:26.887322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:26.888007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:26.953949 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 HTTP/1.1 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f7f972b-a763-4df0-8fc2-b2ce842374c2'} May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:26.956061 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:26.962639 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:36:26.962639 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:36:26.962639 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:36:26.962639 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:36:26.962639 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:36:26.962639 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:26.965650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:36:26.965741 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9397a073-212c-4673-afb6-4d58d7175293 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 404 len: 111 microversion: 2.1 time: 0.095911 May 10 02:36:26.982233 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2516/5004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:26 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:36:27.039075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1813892335", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "69faff99-a78e-42c9-bd3a-904adfc9e420"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:27.107831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] validate_networks() for [('69faff99-a78e-42c9-bd3a-904adfc9e420', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:36:27.308985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:27.313044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 8c053bc1-9fc1-495b-bee1-07667b00ee39] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:27.332532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:27.337636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:27.340399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:27.341899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:27.411860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] HTTP exception thrown: Instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 could not be found. May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Request method failure captured: May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 HTTP/1.1 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec-IDuK9-h5opx2mdG6S41k8xLy3uk1cWLKvExw9DG7iFad-BKtA5Rw0VBQd3n6SuJ4v2Bh9uH1K5ac3Vn11oBCngB4O_r-VOPAyIwbJMjXbt2uISQgVhmYcVrjEyC3L0pvY2f5ty4tBNcHu3rxC6b5X7g73DlXTepLkH4DdJAu4vrY May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a49a6cdbc8eb4ac5a1316799ff42d5c8 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesActionsTest-158491907 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a49a6cdbc8eb4ac5a1316799ff42d5c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a49a6cdbc8eb4ac5a1316799ff42d5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a49a6cdbc8eb4ac5a1316799ff42d5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a49a6cdbc8eb4ac5a1316799ff42d5c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesActionsTest-158491907 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a49a6cdbc8eb4ac5a1316799ff42d5c8 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesActionsTest-158491907 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesActionsTest-158491907-project May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 8cb811c671a6458e8230667f5c11c9c2 May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesActionsTest-158491907-project May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 could not be found. May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '8c053bc1-9fc1-495b-bee1-07667b00ee39'} May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 could not be found. May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 could not be found. May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:36:27.419051 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 could not be found. May 10 02:36:27.425330 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:36:27.428984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Returning 404 to user: Instance 8c053bc1-9fc1-495b-bee1-07667b00ee39 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:36:27.430309 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8465b2e-f8c9-4cbb-bc0f-6fbfcbdfbb8e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39" status: 404 len: 111 microversion: 2.1 time: 0.130100 May 10 02:36:27.431470 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2517/5005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:27 2022] GET /compute/v2.1/servers/8c053bc1-9fc1-495b-bee1-07667b00ee39 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:36:27.489175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-321136400", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "4cf1b09b-2348-448f-b906-d9a7dd8458db"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:27.568441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] validate_networks() for [('4cf1b09b-2348-448f-b906-d9a7dd8458db', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:36:28.227994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:36:28.228548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:36:28.228906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:36:28.229350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:36:28.229775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:36:28.248709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:28.249180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:28.250244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:28.250718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:28.289916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:36:28.305557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Getting quotas for user 0ec6aa75658145d4a8c245fdadce33f8 and project 7eed04f968eb418794b3f542569be647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:36:28.343276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:36:28.349298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:36:28.453499 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-442310b9-1caa-41e2-9e57-06385014b326 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.424232 May 10 02:36:28.454719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2489/5006] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:36:28.465677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2d80d4-3347-4150-8c09-72ef1a2be3e9"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:28.470285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:28.482460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:28.486861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:28.490476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:28.492849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:28.711701 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Invalid volume: volume 6c2d80d4-3347-4150-8c09-72ef1a2be3e9 is already attached to instances: 8d3824f1-711a-45b4-a4c2-7c54dda66522 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments HTTP/1.1 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 74 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: {"volumeAttachment": {"volumeId": "6c2d80d4-3347-4150-8c09-72ef1a2be3e9"}} May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid volume: volume 6c2d80d4-3347-4150-8c09-72ef1a2be3e9 is already attached to instances: 8d3824f1-711a-45b4-a4c2-7c54dda66522 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '8d3824f1-711a-45b4-a4c2-7c54dda66522', 'body': {'volumeAttachment': {'volumeId': '6c2d80d4-3347-4150-8c09-72ef1a2be3e9'}}} May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c2d80d4-3347-4150-8c09-72ef1a2be3e9 is already attached to instances: 8d3824f1-711a-45b4-a4c2-7c54dda66522 May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:36:28.713794 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c2d80d4-3347-4150-8c09-72ef1a2be3e9 is already attached to instances: 8d3824f1-711a-45b4-a4c2-7c54dda66522 May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c2d80d4-3347-4150-8c09-72ef1a2be3e9 is already attached to instances: 8d3824f1-711a-45b4-a4c2-7c54dda66522 May 10 02:36:28.718266 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:36:28.730947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 400 to user: Invalid volume: volume 6c2d80d4-3347-4150-8c09-72ef1a2be3e9 is already attached to instances: 8d3824f1-711a-45b4-a4c2-7c54dda66522 {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:36:28.732411 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c7a9693-704e-4f9a-83d3-449211f297b1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.276454 May 10 02:36:28.733616 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2490/5007] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:36:28 2022] POST /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 174 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:36:28.744038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec473e75-f7a5-4afb-8a9c-4803a56714a0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:28.746543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec473e75-f7a5-4afb-8a9c-4803a56714a0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:29.781432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec473e75-f7a5-4afb-8a9c-4803a56714a0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:29.805058 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec473e75-f7a5-4afb-8a9c-4803a56714a0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1209 microversion: 2.1 time: 1.070181 May 10 02:36:29.808369 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2491/5008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:28 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1209 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:29.821278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:29.822581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:29.831634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:29.839331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:29.841056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:29.841795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.021376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lazy-loading 'services' on Instance uuid 8d3824f1-711a-45b4-a4c2-7c54dda66522 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:36:30.189791 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ff42f7e-1c85-462a-afcf-4d2c561daa96 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments/6c2d80d4-3347-4150-8c09-72ef1a2be3e9" status: 202 len: 0 microversion: 2.1 time: 0.374934 May 10 02:36:30.190824 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2492/5009] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:36:29 2022] DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments/6c2d80d4-3347-4150-8c09-72ef1a2be3e9 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:36:30.225954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:30.235601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:30.248894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:36:30.249410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:36:30.249856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:36:30.250639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:36:30.251149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:36:30.263386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:30.272339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.272927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:30.273339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.274154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:30.274599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.279321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:30.282442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.353816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Getting quotas for project a49a6cdbc8eb4ac5a1316799ff42d5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:36:30.379582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Getting quotas for user 8cb811c671a6458e8230667f5c11c9c2 and project a49a6cdbc8eb4ac5a1316799ff42d5c8. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:36:30.396302 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71014990-d871-4466-b08c-72dbf63e995a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200424 May 10 02:36:30.401807 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2493/5010] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:30 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:30.473194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:36:30.481327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:36:30.603923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-97b950bc-3b1c-4bec-ab5a-e4665ad83b0a tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.118762 May 10 02:36:30.604585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2518/5011] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:36:30.619226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98bdca84-f761-49f6-8d63-d6491c8b0f2b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:30.619869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98bdca84-f761-49f6-8d63-d6491c8b0f2b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:30.760959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98bdca84-f761-49f6-8d63-d6491c8b0f2b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:30.769800 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98bdca84-f761-49f6-8d63-d6491c8b0f2b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1213 microversion: 2.1 time: 0.157975 May 10 02:36:30.771334 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2494/5012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:30 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:30.825094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:30.825873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:30.837723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:30.838269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.841907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:30.842387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:30.992888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:31.003728 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6f5e7e8-d784-4de5-82db-543fad288072 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1267 microversion: 2.1 time: 0.181940 May 10 02:36:31.005352 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2519/5013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:30 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:31.410850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:31.411910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:31.429139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:31.430526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:31.434860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:31.435697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:31.512118 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9fec01cd-0d02-4047-97c9-f291bc1abf7d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106333 May 10 02:36:31.517200 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2495/5014] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:31 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:31.789569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:31.789973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:31.798158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:31.798915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:31.799916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:31.800552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:31.918448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:31.930172 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e875f4b3-ef53-4217-86be-8d0d4e428d49 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1265 microversion: 2.1 time: 0.146454 May 10 02:36:31.930795 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2520/5015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:31 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:32.022798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:32.023776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:32.037428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:32.037910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:32.041371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:32.041836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:32.217529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:32.230519 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-86b1c2d0-1f31-4cff-88cf-be0774020482 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1267 microversion: 2.1 time: 0.212402 May 10 02:36:32.231974 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2496/5016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:32 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:32.525229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:32.526481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:32.534383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:32.537175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:32.538179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:32.539605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:32.614440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3f5a2b2-4ebf-4865-9aa8-9b05d691ace1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093173 May 10 02:36:32.617884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2521/5017] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:32 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:32.948539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:32.950016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:32.964981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:32.965407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:32.971546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:32.982778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:33.249292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:33.249988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:33.274878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:33.275449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:33.278758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:33.279680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:33.502655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:33.511342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-030ccfca-f892-44a7-b007-025948e2a109 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1271 microversion: 2.1 time: 0.567534 May 10 02:36:33.522189 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2497/5018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:32 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1271 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:33.629687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:33.630639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:33.644463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:33.645222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:33.646823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:33.647473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:33.741757 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89542ac2-8031-4dc7-95bc-7182b39fd2d9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116216 May 10 02:36:33.745225 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2498/5019] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:33 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:33.928569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:33.947655 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4ef1926f-28e5-4a88-90a5-171d26794d1b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 0.703803 May 10 02:36:33.957954 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2522/5020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:33 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:34.528289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:34.529590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:34.539143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:34.546531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:34.549493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:34.550225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:34.757571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:34.759336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:34.773750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:34.778340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:34.780626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:34.782519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:34.871637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c75edcd-47f1-4c25-b840-d9e8667aa90a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119352 May 10 02:36:34.872684 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2523/5021] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:34 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:34.966002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:34.967131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:34.982670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:34.991043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:34.992939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:34.999666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:35.871224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:35.883494 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-516ca598-bdae-4ae4-96e2-8dbb5442859e tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 1.357260 May 10 02:36:35.886556 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2499/5022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:34 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:35.910854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:35.912250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:35.934621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:35.943757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:35.944823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:35.945444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:36.011710 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1295e8e1-d46c-483e-8957-b25fdb58fa40 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123322 May 10 02:36:36.013922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2500/5023] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:35 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:36.022659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:36.033699 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63b66ad3-55bc-42aa-8f0d-6cf98d46e683 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 1.072428 May 10 02:36:36.034283 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2524/5024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:34 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:36.905853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:36.906489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:36.920509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:36.920982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:36.921792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:36.922246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:37.324964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:37.330213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:37.346743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:37.349761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:37.350759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:37.351457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:37.417941 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e183e19-d0ef-4e25-8816-65302ef43fea tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.397997 May 10 02:36:37.424663 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2525/5025] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:37 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:37.429900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:37.433392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:37.450068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:37.450899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:37.451445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:37.451979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:37.708393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:37.717034 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63931e35-a545-4d30-8060-deee3c4e0036 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 0.290432 May 10 02:36:37.727502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2526/5026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:37 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:37.739090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3d61b480-96a9-4267-a33a-36aa83520a99 req-fdb7d14a-6d6b-45a9-896c-801a60550f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a750d7-2936-4000-8faf-55afd407bd2d", "tag": "ca36a7d0-0496-49bf-821b-f4ee5e23d0a6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:37.757291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3d61b480-96a9-4267-a33a-36aa83520a99 req-fdb7d14a-6d6b-45a9-896c-801a60550f8c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:37.757750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3d61b480-96a9-4267-a33a-36aa83520a99 req-fdb7d14a-6d6b-45a9-896c-801a60550f8c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:37.808035 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3d61b480-96a9-4267-a33a-36aa83520a99 req-fdb7d14a-6d6b-45a9-896c-801a60550f8c service nova] Creating event network-changed:ca36a7d0-0496-49bf-821b-f4ee5e23d0a6 for instance 01a750d7-2936-4000-8faf-55afd407bd2d on n-h1-841089-2 May 10 02:36:37.814843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3d61b480-96a9-4267-a33a-36aa83520a99 req-fdb7d14a-6d6b-45a9-896c-801a60550f8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085513 May 10 02:36:37.815998 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2527/5027] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:37.942860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:37.954748 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-210c83ab-ace3-4b7f-8f42-dd4607db1e12 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 1.057417 May 10 02:36:37.955637 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2501/5028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:36 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:38.439392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:38.440890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:38.457449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.458225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:38.460051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.460681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:38.462267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-687f34b7-f749-4ab1-a930-f9cc4a36af70 req-2ff868ed-dd27-4380-8bb6-1e40ab88831f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a67ff13-ab57-4e40-8443-c03966c9b19a", "tag": "621c4211-f025-4fd8-88af-42b050e35ea4"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:38.489315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-687f34b7-f749-4ab1-a930-f9cc4a36af70 req-2ff868ed-dd27-4380-8bb6-1e40ab88831f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.504619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-687f34b7-f749-4ab1-a930-f9cc4a36af70 req-2ff868ed-dd27-4380-8bb6-1e40ab88831f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:38.536017 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-687f34b7-f749-4ab1-a930-f9cc4a36af70 req-2ff868ed-dd27-4380-8bb6-1e40ab88831f service nova] Creating event network-changed:621c4211-f025-4fd8-88af-42b050e35ea4 for instance 4a67ff13-ab57-4e40-8443-c03966c9b19a on n-h2-841089-2 May 10 02:36:38.551471 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-08b421c0-ba91-459f-834e-4941cf912193 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125380 May 10 02:36:38.552460 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2528/5029] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:38 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:38.556076 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-687f34b7-f749-4ab1-a930-f9cc4a36af70 req-2ff868ed-dd27-4380-8bb6-1e40ab88831f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095891 May 10 02:36:38.556774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2502/5030] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:36:38.736135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:38.736767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:38.750933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.751875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:38.755276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.755723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:38.972077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:38.972781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:38.985907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.986371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:38.987191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:38.987639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:39.048718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:39.059053 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-66c62ef5-38a9-4d7a-9f58-3ba5e7e6ed5c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 0.325670 May 10 02:36:39.069125 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2529/5031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:38 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:39.332989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:39.341050 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7152105b-039c-4c6b-ad46-35f3cf2e574b tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.372970 May 10 02:36:39.342187 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2503/5032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:38 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:39.563723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:39.564692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:39.581565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:39.582333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:39.583350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:39.585408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:39.677217 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a0235ee-9b1c-419f-bdbc-f0fe271c95a6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110401 May 10 02:36:39.678088 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2530/5033] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:39 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:40.079176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:40.079799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:40.104746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:40.107762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:40.108781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:40.109387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:40.362963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:40.364076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:40.377516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:40.381362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:40.383334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:40.384312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:41.176955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:41.191042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b9a49707-5045-4eb1-b102-4ad11defac22 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.832755 May 10 02:36:41.193238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2531/5034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:40 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:41.205333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:41.206577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:41.213141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:41.213889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:41.215311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:41.216747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:41.250042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d920daa-5d2c-417c-a640-665c3f66c3f5 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055496 May 10 02:36:41.254432 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2532/5035] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:41 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:41.360650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:41.373061 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7f7a9943-4b6f-4473-b63a-68e118db8b7b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 1.295856 May 10 02:36:41.373686 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2504/5036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:40 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:42.213010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:42.214220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:42.226133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:42.226874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:42.228313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:42.229109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:42.264447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:42.265452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:42.290983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:42.291474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:42.292281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:42.294262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:42.395930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cba28a33-8eb8-49bc-85e6-7e19ceba4735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133915 May 10 02:36:42.401842 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2505/5037] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:42 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:42.420272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:42.421915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:42.429375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:42.429845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:42.430711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:42.431336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:42.760616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:42.770832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d9e1583-d2a6-4ed4-88f1-db102ddb15b6 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.561431 May 10 02:36:42.784602 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2533/5038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:42 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:42.970643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:42.982185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29e4bbc9-aa25-44bc-ae49-91425e3fe6c1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 0.578251 May 10 02:36:42.982681 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2506/5039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:42 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:43.410930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:43.414790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:43.434423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:43.439002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:43.442922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:43.443247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:43.501215 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f891378e-3458-48ac-99cf-2ae8ee481618 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095963 May 10 02:36:43.502132 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2534/5040] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:43 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:43.804250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:43.805648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:43.829534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:43.831578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:43.832728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:43.835102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:44.000399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:44.001705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:44.012266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:44.016887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:44.020025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:44.023268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:44.384929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:44.393694 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f1464d29-8d85-4a13-9c8a-f4141fd6c51c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.605289 May 10 02:36:44.403347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2507/5041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:43 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:44.514085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:44.515037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:44.536663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:44.540682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:44.542632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:44.543139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:44.648620 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9423be59-66a5-4593-a701-352af27f265a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134324 May 10 02:36:44.652004 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2508/5042] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:44 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:44.756541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:44.771769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5134022b-400a-4221-ba18-3378fa0fe50b tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 0.777438 May 10 02:36:44.784186 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2535/5043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:43 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:45.415502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:45.418466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:45.456697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:45.456826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:45.457628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:45.467456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:45.664595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:45.667494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:45.705179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:45.708995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:45.711445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:45.714610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:45.812464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65696153-1c94-496a-aff9-0338f503a98f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156013 May 10 02:36:45.818353 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2536/5044] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:45 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:45.824470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:45.826279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:45.834645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:45.835226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:45.836033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:45.836480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:46.331480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:46.358793 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7899dfe7-ddd2-4bb3-b6b8-94ae19c68cfd tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.951377 May 10 02:36:46.374586 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2509/5045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:45 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:46.827518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:46.828530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:46.844983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:46.845717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:46.847237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:46.847701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:46.927956 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ea0ebceb-5348-4c2e-bf21-444b00cf7e30 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106592 May 10 02:36:46.931850 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2510/5046] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:46 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:47.382570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:47.383254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:47.394730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:47.395231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:47.396046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:47.405640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:47.462738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:47.473621 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d6ac12a-2068-48e1-a5f8-c8236b106190 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 1.651559 May 10 02:36:47.477012 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2537/5047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:45 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:47.839362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fa0a2e01-3296-4d93-99e0-0250b030dae4 req-2fa4355f-ec32-4382-a465-af3c4836df6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a750d7-2936-4000-8faf-55afd407bd2d", "name": "network-vif-plugged", "status": "completed", "tag": "ca36a7d0-0496-49bf-821b-f4ee5e23d0a6"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:47.857132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fa0a2e01-3296-4d93-99e0-0250b030dae4 req-2fa4355f-ec32-4382-a465-af3c4836df6e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:47.864555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fa0a2e01-3296-4d93-99e0-0250b030dae4 req-2fa4355f-ec32-4382-a465-af3c4836df6e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:47.898324 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fa0a2e01-3296-4d93-99e0-0250b030dae4 req-2fa4355f-ec32-4382-a465-af3c4836df6e service nova] Creating event network-vif-plugged:ca36a7d0-0496-49bf-821b-f4ee5e23d0a6 for instance 01a750d7-2936-4000-8faf-55afd407bd2d on n-h1-841089-2 May 10 02:36:47.904565 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fa0a2e01-3296-4d93-99e0-0250b030dae4 req-2fa4355f-ec32-4382-a465-af3c4836df6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068924 May 10 02:36:47.905207 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2538/5048] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:36:47.942115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:47.944313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:47.975112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:47.977137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:47.978580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:47.981057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:48.022395 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3434aac6-2a54-4e4e-b5e0-f62b88d1435d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085871 May 10 02:36:48.026861 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2539/5049] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:47 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:48.493546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:48.494177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:48.513640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:48.514095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:48.515103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:48.515388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:48.556593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:48.574284 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-84a75138-02d9-4d23-9fe1-443033c3fc70 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 1.198091 May 10 02:36:48.576076 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2511/5050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:47 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:48.939640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:48.952051 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7b510fd5-d1ed-4d72-8259-2c063a869a43 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1309 microversion: 2.1 time: 0.462646 May 10 02:36:48.957342 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2540/5051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:48 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1309 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:49.034174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:49.035132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:49.042147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:49.042607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:49.056200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:49.058988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:49.179869 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db4dba2f-cf43-4d17-b608-c911ea69ddb3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149687 May 10 02:36:49.187166 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2512/5052] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:49 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:49.594003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:49.595254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:49.613715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:49.614449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:49.615473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:49.616086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:49.976981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:49.978626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:50.001670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:50.012857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:50.014009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:50.015632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:50.131089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:50.149892 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c33e1e9-345c-43af-a7bf-5b54f5e20026 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.560508 May 10 02:36:50.150531 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2541/5053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:49 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:50.163775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d4f7f7e0-f8bb-4ce2-bd37-259ae101d613 req-a89289c6-9d3e-4328-98ce-6db354d00d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67ff13-ab57-4e40-8443-c03966c9b19a", "name": "network-vif-plugged", "status": "completed", "tag": "621c4211-f025-4fd8-88af-42b050e35ea4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:50.185610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d4f7f7e0-f8bb-4ce2-bd37-259ae101d613 req-a89289c6-9d3e-4328-98ce-6db354d00d20 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:50.186449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d4f7f7e0-f8bb-4ce2-bd37-259ae101d613 req-a89289c6-9d3e-4328-98ce-6db354d00d20 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:50.203121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d4f7f7e0-f8bb-4ce2-bd37-259ae101d613 req-a89289c6-9d3e-4328-98ce-6db354d00d20 service nova] Creating event network-vif-plugged:621c4211-f025-4fd8-88af-42b050e35ea4 for instance 4a67ff13-ab57-4e40-8443-c03966c9b19a on n-h2-841089-2 May 10 02:36:50.208611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d4f7f7e0-f8bb-4ce2-bd37-259ae101d613 req-a89289c6-9d3e-4328-98ce-6db354d00d20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056725 May 10 02:36:50.209419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2542/5054] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:50.214871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:50.216727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:50.223557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:50.224261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:50.234853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:50.236384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:50.305301 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c68ebe59-c8c8-4c05-9259-07b45c962ecc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094388 May 10 02:36:50.305825 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2543/5055] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:50 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:51.151146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:51.163482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-91762628-ab42-4041-befb-f15b4e3ce94e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1490 microversion: 2.1 time: 1.191730 May 10 02:36:51.164889 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2513/5056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:49 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1490 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:51.167321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:51.167961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:51.176115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.176965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.177950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.178560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.185480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-605188594"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:51.186956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:51.195122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.195802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.196890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.197500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.266081 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c8a1376-aef4-4a75-a6ef-0925cea7496d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "PUT /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1074 microversion: 2.1 time: 0.089269 May 10 02:36:51.275596 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2514/5057] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:36:51 2022] PUT /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1074 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:51.281383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:51.282169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:51.288581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.289046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.289819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.290257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.701039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:51.713117 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e72f42f-6700-4538-936b-b757af62fe95 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1313 microversion: 2.1 time: 0.550287 May 10 02:36:51.714170 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2544/5058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:51 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:51.719095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:51.720222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:51.727047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.727624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.728489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.729013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.760580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-611343d1-c836-4ece-9653-d2389805d269 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 May 10 02:36:51.765093 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2545/5059] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:51 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:51.819266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:51.828304 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e744229-6ce3-4b1c-a7bc-536c08e80a45 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1500 microversion: 2.1 time: 0.551553 May 10 02:36:51.839725 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2515/5060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:51 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1500 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:51.845875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:51.846620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:51.852858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.853323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:51.854100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:51.854543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:52.291659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:52.299413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-612e8297-3113-4ad9-b311-4a8b4f5ba5ad tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1500 microversion: 2.1 time: 0.457406 May 10 02:36:52.300087 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2546/5061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:51 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1500 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:52.315053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02e3984d-cb70-4e26-8ff3-10c35402f738 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:52.322964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02e3984d-cb70-4e26-8ff3-10c35402f738 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:52.323637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02e3984d-cb70-4e26-8ff3-10c35402f738 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:52.349941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02e3984d-cb70-4e26-8ff3-10c35402f738 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 02:36:52.400307 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02e3984d-cb70-4e26-8ff3-10c35402f738 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "POST /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d/action" status: 202 len: 0 microversion: 2.1 time: 0.088480 May 10 02:36:52.402282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2516/5062] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:36:52 2022] POST /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:36:52.412563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:52.413504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:52.423341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:52.424100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:52.425074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:52.425782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:52.734312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:52.735091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:52.744293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:52.745145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:52.747466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:52.748325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:53.244653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:53.254110 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff83c33a-17c6-4d3b-96d9-48c766ddcbc6 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.846835 May 10 02:36:53.254841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2547/5063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:52 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:53.260129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:53.261404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:53.268761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:53.269356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:53.270273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:53.270824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:53.300768 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4f726c0-d033-4c87-8ae7-bbd3d7f6273c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 May 10 02:36:53.304557 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2548/5064] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:53 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:53.462899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:53.472681 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ade27e8-3b12-4759-a79e-e2b5ee0dfe13 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1496 microversion: 2.1 time: 0.742786 May 10 02:36:53.484938 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2517/5065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:52 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1496 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:54.058012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:54.058833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:54.067344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:54.068725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:54.070367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:54.071266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:54.106391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:36:54.272172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:54.273159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:54.280600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2b4761e-28c4-419b-90cf-8a622343087f tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 204 len: 0 microversion: 2.1 time: 0.227013 May 10 02:36:54.282654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:54.288657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:54.290383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:54.290835 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2549/5066] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:36:54 2022] DELETE /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:36:54.291438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:54.301627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:54.313915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:54.334160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:54.337984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:54.339112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:54.339805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:55.130139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:55.143746 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d99f116c-d735-45a1-83b6-577ac6c574eb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.871545 May 10 02:36:55.144664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2518/5067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:54 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:55.157119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:55.158378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:55.172489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:55.176568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:55.177709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:55.179817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:55.258117 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe665c6d-3816-499c-afe5-60e68a7ab368 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112005 May 10 02:36:55.259099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2519/5068] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:55 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:36:55.264669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:55.275588 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06b20f09-5e00-405c-95f1-e5dbc5095358 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1502 microversion: 2.1 time: 0.978164 May 10 02:36:55.277498 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2550/5069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:54 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1502 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:56.162128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:56.162758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:56.176986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.177762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.178790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.179453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.270409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:56.272007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:56.284204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.285028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.286437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.287253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.441271 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f63e476-ae26-464b-acba-f9e352821c93 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175151 May 10 02:36:56.449254 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2551/5070] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:36:56 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:36:56.455202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:56.456017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:56.466856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.467608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.468793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.470044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.845979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:56.857530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a87c1ce9-2bbd-4a5e-8dd0-1072bc05dac8 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1502 microversion: 2.1 time: 0.405692 May 10 02:36:56.860798 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2552/5071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:56 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:56.870204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:56.872144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:56.880373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.881207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.882160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:56.884175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:56.902387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:56.910860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3143d04-90d9-48d6-83d7-3c8cde826a07 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.752572 May 10 02:36:56.916972 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2520/5072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:56 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:56.954923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:36:57.170837 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cb08e921-9796-45cf-a0cd-8f7620ea4969 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 204 len: 0 microversion: 2.1 time: 0.308386 May 10 02:36:57.171785 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2553/5073] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:36:56 2022] DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:36:57.179988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:57.181150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:57.216727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.221715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:57.222787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.227437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:57.849118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:57.868586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba5d017d-715a-4c9b-b67d-c704160f657a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1682 microversion: 2.1 time: 0.691207 May 10 02:36:57.871737 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2521/5074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:57 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1682 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:57.884948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1b274967-acc5-4fd0-be76-2a42a7d1185d req-a4edda56-a989-4a18-912d-9b5bd3e257e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67ff13-ab57-4e40-8443-c03966c9b19a", "name": "network-vif-deleted", "tag": "621c4211-f025-4fd8-88af-42b050e35ea4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:36:57.885497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:57.887456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:57.900315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1b274967-acc5-4fd0-be76-2a42a7d1185d req-a4edda56-a989-4a18-912d-9b5bd3e257e8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.900776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1b274967-acc5-4fd0-be76-2a42a7d1185d req-a4edda56-a989-4a18-912d-9b5bd3e257e8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:57.903876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.904825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:57.905832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.911821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:57.929637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1b274967-acc5-4fd0-be76-2a42a7d1185d req-a4edda56-a989-4a18-912d-9b5bd3e257e8 service nova] Creating event network-vif-deleted:621c4211-f025-4fd8-88af-42b050e35ea4 for instance 4a67ff13-ab57-4e40-8443-c03966c9b19a on n-h2-841089-2 May 10 02:36:57.938769 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1b274967-acc5-4fd0-be76-2a42a7d1185d req-a4edda56-a989-4a18-912d-9b5bd3e257e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058206 May 10 02:36:57.943443 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2554/5075] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:36:57.953222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:57.953883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:57.968491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.969258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:57.970289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:57.971166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:58.161059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:58.173007 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb96aec0-63cc-491e-8548-66c3db9022d9 tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1460 microversion: 2.1 time: 0.297671 May 10 02:36:58.174436 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2522/5076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:57 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1460 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:58.864389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:58.878116 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e14ded28-a7c8-4e13-ba72-f13fdea84fea tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.933307 May 10 02:36:58.888700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2555/5077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:57 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:58.894901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:58.895575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:58.908596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:58.910784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:58.913649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:58.914498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:59.191913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:59.192919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:59.205162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:59.211965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:59.213117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:59.213808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:59.282560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:59.285934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:59.286670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lazy-loading 'fault' on Instance uuid 4a67ff13-ab57-4e40-8443-c03966c9b19a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:36:59.772892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb811c671a6458e8230667f5c11c9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a6cdbc8eb4ac5a1316799ff42d5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:59.780624 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e857fee-057e-4a37-8792-6edfc2a7d77d tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 200 len: 1303 microversion: 2.1 time: 0.593068 May 10 02:36:59.790741 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2556/5078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:59 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 1303 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:36:59.868849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:36:59.880195 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8d28dc29-e729-4bc8-81e8-7fe81b743df1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1682 microversion: 2.1 time: 0.987178 May 10 02:36:59.881162 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2523/5079] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:58 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1682 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:36:59.899477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:36:59.900246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:36:59.916129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:59.916587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:36:59.917836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:36:59.918470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:00.433847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:00.441944 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee9ded36-66bd-44a6-9071-9acbe6b837e5 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.546288 May 10 02:37:00.449385 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2557/5080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:36:59 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:00.798375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:00.799942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] [instance: 4a67ff13-ab57-4e40-8443-c03966c9b19a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:00.814854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:00.816400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:00.817963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:00.821603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:00.858754 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] HTTP exception thrown: Instance 4a67ff13-ab57-4e40-8443-c03966c9b19a could not be found. May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Request method failure captured: May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a HTTP/1.1 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec-IDuK9-h5opx2mdG6S41k8xLy3uk1cWLKvExw9DG7iFad-BKtA5Rw0VBQd3n6SuJ4v2Bh9uH1K5ac3Vn11oBCngB4O_r-VOPAyIwbJMjXbt2uISQgVhmYcVrjEyC3L0pvY2f5ty4tBNcHu3rxC6b5X7g73DlXTepLkH4DdJAu4vrY May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a49a6cdbc8eb4ac5a1316799ff42d5c8 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesActionsTest-158491907 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a49a6cdbc8eb4ac5a1316799ff42d5c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a49a6cdbc8eb4ac5a1316799ff42d5c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a49a6cdbc8eb4ac5a1316799ff42d5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a49a6cdbc8eb4ac5a1316799ff42d5c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesActionsTest-158491907 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a49a6cdbc8eb4ac5a1316799ff42d5c8 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesActionsTest-158491907 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesActionsTest-158491907-project May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 8cb811c671a6458e8230667f5c11c9c2 May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesActionsTest-158491907-project May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4a67ff13-ab57-4e40-8443-c03966c9b19a could not be found. May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4a67ff13-ab57-4e40-8443-c03966c9b19a'} May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a67ff13-ab57-4e40-8443-c03966c9b19a could not be found. May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a67ff13-ab57-4e40-8443-c03966c9b19a could not be found. May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:00.860940 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a67ff13-ab57-4e40-8443-c03966c9b19a could not be found. May 10 02:37:00.865970 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:00.870778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] Returning 404 to user: Instance 4a67ff13-ab57-4e40-8443-c03966c9b19a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:00.871982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f2e9bb8-7e27-4998-b6a3-373829d6122c tempest-VolumesActionsTest-158491907 tempest-VolumesActionsTest-158491907-project] 10.222.0.52 "GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a" status: 404 len: 111 microversion: 2.1 time: 0.078076 May 10 02:37:00.872771 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2558/5081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:00 2022] GET /compute/v2.1/servers/4a67ff13-ab57-4e40-8443-c03966c9b19a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:00.896407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-992cb946-3546-4d1d-923a-297a61d3c715 req-e33e32fb-061e-48c8-8808-a0e13259ecfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3824f1-711a-45b4-a4c2-7c54dda66522", "name": "network-vif-unplugged", "status": "completed", "tag": "7e58a505-7ed2-4d5d-86e0-72939510499a"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:00.904772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:00.908436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:00.921582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:00.924224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:00.925075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-992cb946-3546-4d1d-923a-297a61d3c715 req-e33e32fb-061e-48c8-8808-a0e13259ecfd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:00.926133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:00.926770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-992cb946-3546-4d1d-923a-297a61d3c715 req-e33e32fb-061e-48c8-8808-a0e13259ecfd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:00.928285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:00.986201 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-992cb946-3546-4d1d-923a-297a61d3c715 req-e33e32fb-061e-48c8-8808-a0e13259ecfd service nova] Creating event network-vif-unplugged:7e58a505-7ed2-4d5d-86e0-72939510499a for instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 on n-h2-841089-2 May 10 02:37:01.004586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-992cb946-3546-4d1d-923a-297a61d3c715 req-e33e32fb-061e-48c8-8808-a0e13259ecfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.263031 May 10 02:37:01.006691 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2524/5082] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:37:01.463641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:01.469196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:01.474002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:01.491778 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21e69efe-2543-489c-9a51-f4d9a87fc02c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1682 microversion: 2.1 time: 0.589208 May 10 02:37:01.507105 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2559/5083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:00 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1682 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:37:01.507573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:01.507573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:01.507573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:01.507573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:02.247811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:02.267701 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9bdfb87-2af5-474d-bd09-f0c987c64126 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.807523 May 10 02:37:02.268334 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2525/5084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:01 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:02.496016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9826769f-cdab-467e-b8cc-40b984d73277 req-6a00a01b-b352-4c0a-a215-4ad3ca43b3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3824f1-711a-45b4-a4c2-7c54dda66522", "name": "network-vif-deleted", "tag": "7e58a505-7ed2-4d5d-86e0-72939510499a"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:02.518724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:02.519795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:02.524315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9826769f-cdab-467e-b8cc-40b984d73277 req-6a00a01b-b352-4c0a-a215-4ad3ca43b3e6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:02.527342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9826769f-cdab-467e-b8cc-40b984d73277 req-6a00a01b-b352-4c0a-a215-4ad3ca43b3e6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:02.537326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:02.539249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:02.541376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:02.548215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:02.575028 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9826769f-cdab-467e-b8cc-40b984d73277 req-6a00a01b-b352-4c0a-a215-4ad3ca43b3e6 service nova] Creating event network-vif-deleted:7e58a505-7ed2-4d5d-86e0-72939510499a for instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 on n-h2-841089-2 May 10 02:37:02.599553 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9826769f-cdab-467e-b8cc-40b984d73277 req-6a00a01b-b352-4c0a-a215-4ad3ca43b3e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114535 May 10 02:37:02.600186 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2560/5085] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:37:02.798200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:02.810542 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-495c4f06-df80-4c76-b3a9-7cdbb8cca134 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 200 len: 1326 microversion: 2.1 time: 0.293308 May 10 02:37:02.810542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2526/5086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:02 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 1326 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:37:03.289876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:03.290622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:03.309738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:03.311753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:03.319580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:03.323242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:03.787263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:03.798705 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-912773f9-9684-4e59-b46d-3d6b028472dc tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.514892 May 10 02:37:03.801227 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2561/5087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:03 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:03.826758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:03.827459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:03.838811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:03.842910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:03.848020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:03.848730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:03.877644 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 HTTP/1.1 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8d3824f1-711a-45b4-a4c2-7c54dda66522'} May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:03.882016 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:37:03.887732 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:03.889253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:03.891913 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbf22e24-e08c-4a7b-821a-446bed7d0364 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 404 len: 111 microversion: 2.1 time: 0.070006 May 10 02:37:03.895108 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2527/5088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:03 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:03.902561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aaa2e171-ff4f-4b11-bdfa-f7b0770404a9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '.version_select at 0x7f3d36fdbd30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:03.939114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aaa2e171-ff4f-4b11-bdfa-f7b0770404a9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127576028" status: 202 len: 0 microversion: 2.1 time: 0.041014 May 10 02:37:03.941570 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2562/5089] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 02:37:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127576028 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:37:04.819821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:04.820858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:04.833933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:04.835223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:04.838496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:04.839882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:05.570675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:05.582318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71b9cb60-b71a-4ff2-a3cd-44a0ab9d0ec4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.768293 May 10 02:37:05.588958 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2528/5090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:04 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:06.188465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d470c800-ea1b-4149-aba6-585a9125aa11 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: .version_select at 0x7f3d36247160>, body: {"keypair": {"name": "tempest-keypair-304254898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxW/xlJJ7nw/LRXHzoLLCgrFd/vT0hKLN21y4bu/CQhtumTfSYnP50Ircf0MMu5TEfXmFsOanjNLw1GukGAH6J63RHi9vB4Y+dStZA2cuek9yyvonLoTHYZIHhW5uSgFA=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:06.300788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d470c800-ea1b-4149-aba6-585a9125aa11 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:37:06.317175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d470c800-ea1b-4149-aba6-585a9125aa11 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:37:06.369348 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d470c800-ea1b-4149-aba6-585a9125aa11 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189601 May 10 02:37:06.378021 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2563/5091] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:37:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:37:06.600948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:06.602337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:06.626651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:06.633457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:06.634697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:06.635657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:07.725747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:07.734853 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7b293f8-aa75-43e0-9a94-dc6f3cf24fa3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 1.138981 May 10 02:37:07.738795 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2529/5092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:06 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:08.757577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:08.758214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:08.769740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:08.770214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:08.771027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:08.775391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:09.142958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:09.155261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7c12903-efe8-4115-94ce-c0770263d026 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.404083 May 10 02:37:09.155853 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2564/5093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:08 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:10.173062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:10.174446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:10.187791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:10.188236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:10.189233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:10.189843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:10.781288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:10.798908 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afbe7c39-7a9e-40cc-bef6-22f9ab05172e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.626169 May 10 02:37:10.803379 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2530/5094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:10 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:11.832048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:11.835808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:11.852645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:11.858081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:11.861408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:11.866716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:12.508424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:12.521038 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-46e3a3be-d16e-4b2c-83a1-6c73fbbc6cd4 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.704499 May 10 02:37:12.521639 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2565/5095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:11 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:13.538561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:13.539258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:13.548505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:13.548962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:13.549747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:13.550208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:13.798661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1789177335", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b17ef216-a989-4dab-a21d-9ac51c1b13b9"}], "security_groups": [{"name": "tempest-securitygroup--289372236"}], "key_name": "tempest-keypair-304254898", "user_data": "}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:14.459210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] validate_networks() for [('b17ef216-a989-4dab-a21d-9ac51c1b13b9', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:37:15.475259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:15.505354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68cfeea7-4528-4a85-ad4f-5d75b6e0926a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 1.956708 May 10 02:37:15.518736 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2531/5096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:13 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:16.523805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:16.524439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:16.538750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:16.541491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:16.544698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:16.545615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:16.845904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:37:16.846619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:37:16.846945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:37:16.847296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:37:16.847727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:37:16.866784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:16.867280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:16.868116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:16.868574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:16.942823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:37:16.956457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Getting quotas for user 614ccf5942ce45fa83ba9999e23aea03 and project e530b3feb70b459f83910d6e4ced55da. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:37:17.021053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:37:17.023724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:37:17.159378 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14e83f0e-9041-4edd-b7b0-b4a63a1b16b9 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.360720 May 10 02:37:17.166432 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2566/5097] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:37:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 3373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:37:17.177642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80fc8cd0-7606-4766-b37b-ab87f99e07be tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:17.178675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-80fc8cd0-7606-4766-b37b-ab87f99e07be tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:17.359508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:17.365863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-80fc8cd0-7606-4766-b37b-ab87f99e07be tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:17.372112 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aa5af736-dbb8-4535-8273-76be2b2dd810 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1510 microversion: 2.1 time: 0.852415 May 10 02:37:17.379351 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80fc8cd0-7606-4766-b37b-ab87f99e07be tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1241 microversion: 2.1 time: 0.206764 May 10 02:37:17.381297 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2567/5098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:17 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:37:17.387961 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2532/5099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:16 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1510 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:18.392347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:18.397657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:18.398280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:18.399789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:18.422203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:18.422700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:18.427518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:18.429517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:18.431558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:18.432770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:18.437433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:18.441632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:19.472454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:19.483119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e4ce5eb-304c-4e2e-bc17-3e4984772aa3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1237 microversion: 2.1 time: 1.089452 May 10 02:37:19.499163 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2533/5100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:18 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1237 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:20.516015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:20.516822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:20.542135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:20.546683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:20.548070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:20.551645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:21.608463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:21.621888 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-951a3ee6-7beb-4b16-9319-e83b8995cc3c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1299 microversion: 2.1 time: 1.110223 May 10 02:37:21.624559 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2534/5101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:20 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1299 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:21.674657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:21.690907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1bcace5-3d60-4194-a899-6ed6f3dd9142 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1487 microversion: 2.1 time: 3.303906 May 10 02:37:21.695848 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2568/5102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:18 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1487 bytes in 3309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:21.713561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1233026149"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:21.715107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:21.725775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:21.732012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:21.733167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:21.734054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:21.845088 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e76fd574-5880-40a6-8944-e5e9802d7c12 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "PUT /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1061 microversion: 2.1 time: 0.136217 May 10 02:37:21.845951 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2535/5103] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:37:21 2022] PUT /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1061 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:21.868747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:21.869629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:21.903626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:21.904486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:21.906063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:21.906771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:22.513086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:22.526519 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57418565-aaec-4c35-a03b-d3cf25f8aaeb tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1488 microversion: 2.1 time: 0.670310 May 10 02:37:22.533313 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2569/5104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:21 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1488 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:22.548936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:22.549678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:22.558825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:22.564181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:22.567262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:22.568541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:22.641079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:22.642015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:22.666045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:22.670853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:22.673576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:22.677538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:23.052115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:23.062954 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2cfe7832-e0ae-4122-a369-0c1445ac85c0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1299 microversion: 2.1 time: 0.426294 May 10 02:37:23.067141 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2570/5105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:22 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1299 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:23.551708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:23.565364 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b094ad8-7555-4337-b43c-3f34e1b1b6b3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1488 microversion: 2.1 time: 1.020615 May 10 02:37:23.568060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2536/5106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:22 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1488 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:23.585143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:23.585674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:23.600410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:23.604566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:23.607635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:23.608333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:23.675644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:37:23.825338 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f206087-1f75-4315-b06e-cbe5e6033a0c tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 204 len: 0 microversion: 2.1 time: 0.243582 May 10 02:37:23.830286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2571/5107] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:23 2022] DELETE /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:37:23.836564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:23.837199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:23.860149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:23.860780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:23.861638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:23.865165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:24.082371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:24.083024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:24.092767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:24.093237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:24.094062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:24.094521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:24.308053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:24.326521 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5b77091-1a8b-49f5-82bf-3849c8d184a0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1299 microversion: 2.1 time: 0.248496 May 10 02:37:24.329904 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2572/5108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:24 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:24.942171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:24.958337 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de52d9a5-6e6c-435c-917a-d93310982d87 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1494 microversion: 2.1 time: 1.126107 May 10 02:37:24.961574 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2537/5109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:23 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1494 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:37:25.349028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:25.350483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:25.364893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:25.365355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:25.366153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:25.366593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:25.941230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:25.952874 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-be8cef26-39d6-4af0-ab28-f321f528929c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 0.610223 May 10 02:37:25.963519 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2573/5110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:25 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:25.985076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:25.986756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:26.002301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:26.010399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:26.015894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:26.017298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:26.643336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:26.654805 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fed6cf68-de40-40f6-863a-0616b549b94f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1494 microversion: 2.1 time: 0.677558 May 10 02:37:26.656144 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2538/5111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:25 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1494 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:26.975284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:26.977007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:26.996734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:26.998041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:26.999379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:27.000078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:27.516357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8600e6d5-422b-4247-9ff7-fba20bf7653b req-d94328ec-9762-4869-8ab7-dd6e58e5c715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a750d7-2936-4000-8faf-55afd407bd2d", "name": "network-vif-deleted", "tag": "ca36a7d0-0496-49bf-821b-f4ee5e23d0a6"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:27.535554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8600e6d5-422b-4247-9ff7-fba20bf7653b req-d94328ec-9762-4869-8ab7-dd6e58e5c715 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:27.539663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8600e6d5-422b-4247-9ff7-fba20bf7653b req-d94328ec-9762-4869-8ab7-dd6e58e5c715 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:27.605126 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8600e6d5-422b-4247-9ff7-fba20bf7653b req-d94328ec-9762-4869-8ab7-dd6e58e5c715 service nova] Creating event network-vif-deleted:ca36a7d0-0496-49bf-821b-f4ee5e23d0a6 for instance 01a750d7-2936-4000-8faf-55afd407bd2d on n-h1-841089-2 May 10 02:37:27.627834 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8600e6d5-422b-4247-9ff7-fba20bf7653b req-d94328ec-9762-4869-8ab7-dd6e58e5c715 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119077 May 10 02:37:27.630396 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2539/5112] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 10 02:37:27.673923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:27.674825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:27.686851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:27.689000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:27.695020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:27.696552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:27.791502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:27.791972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:27.792452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lazy-loading 'fault' on Instance uuid 01a750d7-2936-4000-8faf-55afd407bd2d {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:37:28.468467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:28.490122 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b723b2c-0f27-4ca7-abbb-9a8e900d095c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 1.522386 May 10 02:37:28.490904 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2574/5113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:26 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:28.545095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:28.559168 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3e19739-f33d-4db5-85eb-d79277c839ca tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 200 len: 1310 microversion: 2.1 time: 0.890207 May 10 02:37:28.567323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2540/5114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:27 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 1310 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:29.236217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-517b39c3-5849-491a-ab32-7ccab1d60865 req-58243024-1f63-4a10-b9ab-97529449c9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37018b70-71d7-42fb-9f73-347d6bd170fe", "tag": "2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:29.275212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-517b39c3-5849-491a-ab32-7ccab1d60865 req-58243024-1f63-4a10-b9ab-97529449c9b7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.277246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-517b39c3-5849-491a-ab32-7ccab1d60865 req-58243024-1f63-4a10-b9ab-97529449c9b7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.331635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-517b39c3-5849-491a-ab32-7ccab1d60865 req-58243024-1f63-4a10-b9ab-97529449c9b7 service nova] Creating event network-changed:2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4 for instance 37018b70-71d7-42fb-9f73-347d6bd170fe on n-h2-841089-2 May 10 02:37:29.345060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-517b39c3-5849-491a-ab32-7ccab1d60865 req-58243024-1f63-4a10-b9ab-97529449c9b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114635 May 10 02:37:29.347763 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2575/5115] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:37:29.509923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:29.510470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:29.527429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.527821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.528651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.529089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.577065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:29.578399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:29.592306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.596354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.599108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.600207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.630779 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d HTTP/1.1 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '01a750d7-2936-4000-8faf-55afd407bd2d'} May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.640400 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.645781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.645781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.645781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:29.645781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:29.645781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.645781 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.649195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:29.651302 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26c78c25-d1aa-4f13-984a-2382ca991800 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 404 len: 111 microversion: 2.1 time: 0.078881 May 10 02:37:29.654332 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2576/5116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:29 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:37:29.672614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:29.680768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:29.691195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.691666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.692479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.703017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.768875 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d HTTP/1.1 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '01a750d7-2936-4000-8faf-55afd407bd2d'} May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:29.773743 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.779381 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.786254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:29.791883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29849334-b092-4a60-8d63-80ce335d4bd9 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 404 len: 111 microversion: 2.1 time: 0.125321 May 10 02:37:29.794027 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2577/5117] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:29 2022] DELETE /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:29.805335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:29.811895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 01a750d7-2936-4000-8faf-55afd407bd2d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:29.820772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.822318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.823624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.825030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.847772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d HTTP/1.1 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '01a750d7-2936-4000-8faf-55afd407bd2d'} May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.849654 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.854772 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.854772 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.854772 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:29.854772 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:29.854772 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. May 10 02:37:29.854772 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.857939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 01a750d7-2936-4000-8faf-55afd407bd2d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:29.862411 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eda5810a-abe6-417d-83fa-857ea7857219 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d" status: 404 len: 111 microversion: 2.1 time: 0.060856 May 10 02:37:29.864688 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2578/5118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:29 2022] GET /compute/v2.1/servers/01a750d7-2936-4000-8faf-55afd407bd2d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:29.872864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:29.883708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:29.912166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.912758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.913928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:29.915295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:29.963517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 HTTP/1.1 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f7f972b-a763-4df0-8fc2-b2ce842374c2'} May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:29.966981 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:29.971961 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3fcc643-d399-4bf9-8300-06987116da72 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 404 len: 111 microversion: 2.1 time: 0.099869 May 10 02:37:29.979864 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2579/5119] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:29 2022] DELETE /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:29.994642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.002324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 6f7f972b-a763-4df0-8fc2-b2ce842374c2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.021122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.024986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.026042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.029952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.072652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 HTTP/1.1 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f7f972b-a763-4df0-8fc2-b2ce842374c2'} May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.075878 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.081767 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.081767 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.081767 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.081767 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.081767 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. May 10 02:37:30.081767 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.085282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 6f7f972b-a763-4df0-8fc2-b2ce842374c2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.107707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4d7d295-6ac2-4163-9e5d-7a80d5eb23c0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2" status: 404 len: 111 microversion: 2.1 time: 0.104102 May 10 02:37:30.115452 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2580/5120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:29 2022] GET /compute/v2.1/servers/6f7f972b-a763-4df0-8fc2-b2ce842374c2 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:37:30.137141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.143240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.176112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.178029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.178875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.179372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.229063 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 HTTP/1.1 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '0b39fb20-6c72-4629-9fb0-3183c378d4c5'} May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.231321 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.236193 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.237023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.239286 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75b7f005-11f0-41c9-b4e1-f3f32da3d7be tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 404 len: 111 microversion: 2.1 time: 0.118052 May 10 02:37:30.241241 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2581/5121] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:30 2022] DELETE /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.257662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.259952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 0b39fb20-6c72-4629-9fb0-3183c378d4c5] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.291405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.292182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.295496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.296201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.356690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 HTTP/1.1 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '0b39fb20-6c72-4629-9fb0-3183c378d4c5'} May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.365606 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.371202 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.371202 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.371202 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.371202 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.371202 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. May 10 02:37:30.371202 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.374465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 0b39fb20-6c72-4629-9fb0-3183c378d4c5 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.376583 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-793be3c8-5e42-4fb0-aae4-28ce77294592 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5" status: 404 len: 111 microversion: 2.1 time: 0.132702 May 10 02:37:30.380179 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2582/5122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:30 2022] GET /compute/v2.1/servers/0b39fb20-6c72-4629-9fb0-3183c378d4c5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.389385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.396559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.422510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.423628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.424790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.425582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.471404 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 HTTP/1.1 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e3cff26c-4d8b-4295-9fd6-cb4ddfeef060'} May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.473149 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.477565 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.483375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.487766 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd08c106-fe8f-4c71-9891-b96c83171faf tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 404 len: 111 microversion: 2.1 time: 0.103426 May 10 02:37:30.489685 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2583/5123] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:30 2022] DELETE /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.497498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.508368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: e3cff26c-4d8b-4295-9fd6-cb4ddfeef060] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.522057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.523411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.524878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.525505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.548359 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 HTTP/1.1 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'e3cff26c-4d8b-4295-9fd6-cb4ddfeef060'} May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.550512 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.555374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.555374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.555374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.555374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.555374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. May 10 02:37:30.555374 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.557131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.558239 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-718a635a-896c-478d-9be1-bfc33aea3909 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060" status: 404 len: 111 microversion: 2.1 time: 0.064927 May 10 02:37:30.559245 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2584/5124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:30 2022] GET /compute/v2.1/servers/e3cff26c-4d8b-4295-9fd6-cb4ddfeef060 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.570816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.571844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.581495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.582692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.583747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.584620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.604939 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 HTTP/1.1 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'db925971-d3e7-4e7e-b5ff-036a46d33147'} May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.608350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.613037 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.614700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.616304 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc70c1bd-7c98-4ed3-a42c-209ad7004a78 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 404 len: 111 microversion: 2.1 time: 0.051065 May 10 02:37:30.618860 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2585/5125] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:30 2022] DELETE /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.640332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.640976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: db925971-d3e7-4e7e-b5ff-036a46d33147] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.662063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.662536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.676332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.678567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.762083 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 HTTP/1.1 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'db925971-d3e7-4e7e-b5ff-036a46d33147'} May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.768667 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.773944 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.773944 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.773944 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.773944 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.773944 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. May 10 02:37:30.773944 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.781344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance db925971-d3e7-4e7e-b5ff-036a46d33147 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.783336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9cf2fa5f-d6f3-4db5-875b-0b8d9f6454c2 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147" status: 404 len: 111 microversion: 2.1 time: 0.157934 May 10 02:37:30.784995 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2586/5126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:30 2022] GET /compute/v2.1/servers/db925971-d3e7-4e7e-b5ff-036a46d33147 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.805637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:30.819875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:30.844935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.850934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.854774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:30.858960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:30.929089 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 HTTP/1.1 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1759af67-b3af-477e-8ebc-cb26361dc079'} May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:30.933217 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:30.937726 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:30.945115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:30.956799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da2688c7-4160-499e-9c02-e7fd5036dbfc tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 1.450843 May 10 02:37:30.975483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:30.976262 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2541/5127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:29 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:30.978680 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4f54307-dcb1-4532-8a9d-730d006b5c1e tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 404 len: 111 microversion: 2.1 time: 0.186186 May 10 02:37:30.982449 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2587/5128] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:30 2022] DELETE /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:30.999363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:31.000333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: 1759af67-b3af-477e-8ebc-cb26361dc079] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:31.023295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:31.024475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:31.028636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:31.029531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:31.079959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 HTTP/1.1 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1759af67-b3af-477e-8ebc-cb26361dc079'} May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.083139 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.087783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:31.087783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:31.087783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:31.087783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:31.087783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. May 10 02:37:31.087783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.098210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance 1759af67-b3af-477e-8ebc-cb26361dc079 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:31.101026 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f61ebaed-141b-42d3-a365-0cf18ccdc57f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079" status: 404 len: 111 microversion: 2.1 time: 0.109290 May 10 02:37:31.106950 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2542/5129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:30 2022] GET /compute/v2.1/servers/1759af67-b3af-477e-8ebc-cb26361dc079 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:31.115680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ddaf2c6-b4ed-4fe5-930c-eb436e0546f1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:31.116565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0ddaf2c6-b4ed-4fe5-930c-eb436e0546f1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: c7f2fd9d-0499-41d4-9a03-7d88574b60ce] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:31.128102 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0ddaf2c6-b4ed-4fe5-930c-eb436e0546f1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ddaf2c6-b4ed-4fe5-930c-eb436e0546f1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce HTTP/1.1 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'c7f2fd9d-0499-41d4-9a03-7d88574b60ce'} May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:31.135423 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.140462 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:37:31.148988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ddaf2c6-b4ed-4fe5-930c-eb436e0546f1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:31.152703 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ddaf2c6-b4ed-4fe5-930c-eb436e0546f1 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce" status: 404 len: 111 microversion: 2.1 time: 0.040818 May 10 02:37:31.155089 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2588/5130] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:31 2022] DELETE /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:31.169312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-baadf5b6-b542-461b-bca3-6819f77261a3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:31.170379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-baadf5b6-b542-461b-bca3-6819f77261a3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: c7f2fd9d-0499-41d4-9a03-7d88574b60ce] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:31.176752 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-baadf5b6-b542-461b-bca3-6819f77261a3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-baadf5b6-b542-461b-bca3-6819f77261a3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce HTTP/1.1 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'c7f2fd9d-0499-41d4-9a03-7d88574b60ce'} May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:31.180793 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:31.184940 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:31.184940 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:31.184940 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. May 10 02:37:31.184940 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:31.189867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-baadf5b6-b542-461b-bca3-6819f77261a3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance c7f2fd9d-0499-41d4-9a03-7d88574b60ce could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:31.192751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-baadf5b6-b542-461b-bca3-6819f77261a3 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce" status: 404 len: 111 microversion: 2.1 time: 0.033833 May 10 02:37:31.194907 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2543/5131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:31 2022] GET /compute/v2.1/servers/c7f2fd9d-0499-41d4-9a03-7d88574b60ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:31.205867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:31.211332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:31.239686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:31.240331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:31.243141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:31.244034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:31.344629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:37:31.678356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d702d083-ffbb-4a52-94a4-cbde25529767 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 204 len: 0 microversion: 2.1 time: 0.479884 May 10 02:37:31.684380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2589/5132] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:37:31 2022] DELETE /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:37:31.691982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:31.694081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:31.709119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:31.709901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:31.713201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:31.714116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:31.982296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:31.983030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:32.002389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:32.005383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:32.011894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:32.012456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:32.336880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:32.352086 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ded685dc-c8c4-4c52-983e-c376bb1bf0e0 tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1480 microversion: 2.1 time: 0.665244 May 10 02:37:32.354913 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2544/5133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:31 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1480 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:32.427355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:32.438120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18554b7f-c47a-4354-a85e-583cf073feb1 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 0.460567 May 10 02:37:32.439301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2590/5134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:31 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:33.371117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:33.371857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:33.396064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:33.396687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:33.397758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:33.398480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:33.455646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:33.456977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:33.475663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:33.476446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:33.477447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:33.479179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:34.253688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:34.278137 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20b114f3-0f65-4aa7-aa50-372ce4e8ce7a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1480 microversion: 2.1 time: 0.908195 May 10 02:37:34.284622 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2545/5135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:33 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1480 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:35.283840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:35.301740 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1783d5c9-5ea2-4bdd-aa05-c56abc9095e0 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 1.842000 May 10 02:37:35.304370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:35.305428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2591/5136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:33 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:35.318287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:35.337849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:35.338623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:35.349221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:35.349687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:35.934051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:35.945868 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff983d0c-4638-47bf-a5c7-139861109f2f tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1480 microversion: 2.1 time: 0.650235 May 10 02:37:35.962673 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2546/5137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:35 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1480 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:36.321623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:36.322859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:36.345884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:36.350656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:36.354221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:36.354949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:36.821253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fbf0319f-f7d2-485a-8214-148ff96d17c0 req-36296bf4-70da-4a9f-901a-57e604e09c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbfd489-3ea1-4e99-ba41-9e5429f42fc4", "name": "network-vif-deleted", "tag": "25b197db-3ad8-48ed-be24-6bffaa9ec535"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:36.847419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fbf0319f-f7d2-485a-8214-148ff96d17c0 req-36296bf4-70da-4a9f-901a-57e604e09c23 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:36.847884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fbf0319f-f7d2-485a-8214-148ff96d17c0 req-36296bf4-70da-4a9f-901a-57e604e09c23 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:36.877018 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fbf0319f-f7d2-485a-8214-148ff96d17c0 req-36296bf4-70da-4a9f-901a-57e604e09c23 service nova] Creating event network-vif-deleted:25b197db-3ad8-48ed-be24-6bffaa9ec535 for instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 on n-h2-841089-2 May 10 02:37:36.893343 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fbf0319f-f7d2-485a-8214-148ff96d17c0 req-36296bf4-70da-4a9f-901a-57e604e09c23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075767 May 10 02:37:36.895846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2547/5138] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:37:36.974152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:36.975022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:37.020207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:37.023372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:37.026032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:37.028297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:37.050072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:37.076066 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a89fe1ce-940e-4375-abf6-7720b8c23735 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 0.757467 May 10 02:37:37.078183 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2592/5139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:36 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:37.180134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:37.187280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:37.187813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lazy-loading 'fault' on Instance uuid dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:37:38.098035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:38.101361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:38.118712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:38.119577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:38.121356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:38.122212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:38.184074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec6aa75658145d4a8c245fdadce33f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eed04f968eb418794b3f542569be647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:38.191956 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47316a26-d81d-4a28-9a09-413f40206e5a tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 200 len: 1282 microversion: 2.1 time: 1.229777 May 10 02:37:38.212038 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2548/5140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:36 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 1282 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:38.693721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:38.705654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4408acbc-8f6e-48e0-8fce-a8be4bc0c70f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 0.613286 May 10 02:37:38.706672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2593/5141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:38 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:37:39.220070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:39.220693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] [instance: dcbfd489-3ea1-4e99-ba41-9e5429f42fc4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:39.230303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:39.238079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:39.239184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:39.241981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:39.280787 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] HTTP exception thrown: Instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 could not be found. May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Request method failure captured: May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 HTTP/1.1 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec8VlCjJUKq5KNzHLsEd69tN6jcI19qsKutwXxGZcWlaKO25ADrS4_3GTCmX6W85mZgiFlYmQQHcd5L_6M-k8eTZ1NiSmU2k3WJpQfVq4dfU02Mua-mo4gMkVRUTZpteZShS4Cv7jmq-VIf5Thc043rTX0bwgoeV0-2vx3MKnBgwR3U May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7eed04f968eb418794b3f542569be647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7eed04f968eb418794b3f542569be647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7eed04f968eb418794b3f542569be647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersTestJSON-1633810705 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7eed04f968eb418794b3f542569be647 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersTestJSON-1633810705 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersTestJSON-1633810705-project May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ec6aa75658145d4a8c245fdadce33f8 May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersTestJSON-1633810705-project May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 could not be found. May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'dcbfd489-3ea1-4e99-ba41-9e5429f42fc4'} May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 could not be found. May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 could not be found. May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:39.282627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:37:39.290056 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:37:39.290056 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:37:39.290056 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:37:39.290056 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:37:39.290056 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 could not be found. May 10 02:37:39.290056 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:37:39.294781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] Returning 404 to user: Instance dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:37:39.299162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-05708f17-8e60-4dff-b4f4-1b3ed5f4b46d tempest-ServersTestJSON-1633810705 tempest-ServersTestJSON-1633810705-project] 10.222.0.52 "GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4" status: 404 len: 111 microversion: 2.1 time: 0.083113 May 10 02:37:39.301613 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2549/5142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:39 2022] GET /compute/v2.1/servers/dcbfd489-3ea1-4e99-ba41-9e5429f42fc4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:37:39.699407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0428568f-2e20-4fc1-9af1-04738e094189 req-631bc4ae-4b83-4ac0-bbce-975f7832c664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37018b70-71d7-42fb-9f73-347d6bd170fe", "name": "network-vif-plugged", "status": "completed", "tag": "2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:39.726516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0428568f-2e20-4fc1-9af1-04738e094189 req-631bc4ae-4b83-4ac0-bbce-975f7832c664 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:39.726944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0428568f-2e20-4fc1-9af1-04738e094189 req-631bc4ae-4b83-4ac0-bbce-975f7832c664 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:39.728853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:39.729496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:39.741048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:39.746137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:39.748856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:39.751194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:39.767788 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0428568f-2e20-4fc1-9af1-04738e094189 req-631bc4ae-4b83-4ac0-bbce-975f7832c664 service nova] Creating event network-vif-plugged:2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4 for instance 37018b70-71d7-42fb-9f73-347d6bd170fe on n-h2-841089-2 May 10 02:37:39.786510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0428568f-2e20-4fc1-9af1-04738e094189 req-631bc4ae-4b83-4ac0-bbce-975f7832c664 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093256 May 10 02:37:39.788744 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2594/5143] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:37:40.425484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:40.440951 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5894582b-4f51-4afc-9dd9-e773d05cb937 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 0.721022 May 10 02:37:40.441566 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2550/5144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:39 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:41.463537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:41.464940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:41.478963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:41.482407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:41.483725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:41.484194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:42.443941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:42.462290 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae00d329-93ca-41b2-97d3-ea7f2075e1af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1366 microversion: 2.1 time: 0.999632 May 10 02:37:42.463093 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2595/5145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:41 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1366 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:43.482255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:43.483583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:43.497331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:43.502553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:43.507447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:43.508173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:44.336003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:44.364932 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54efac78-80ec-470a-a2ae-2b8c309e2978 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1555 microversion: 2.1 time: 0.889471 May 10 02:37:44.386310 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2551/5146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:37:43 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1555 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:37:44.389840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:44.390376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:44.426533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:44.427007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:44.427867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:44.453972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:44.989121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aba885a2-7f6c-44f2-a31f-9e5d7d1e4c82 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.603319 May 10 02:37:44.995957 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2596/5147] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 02:37:44 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-interface => generated 284 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:37:46.044864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1700107161", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": "none"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:49.667813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0c1eba2a-23c5-442b-802e-30e6e8ed25fe req-2d3d3131-fa29-4c69-96d0-a7517bdfb7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37018b70-71d7-42fb-9f73-347d6bd170fe", "tag": "2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:49.688081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0c1eba2a-23c5-442b-802e-30e6e8ed25fe req-2d3d3131-fa29-4c69-96d0-a7517bdfb7ad service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:49.689041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0c1eba2a-23c5-442b-802e-30e6e8ed25fe req-2d3d3131-fa29-4c69-96d0-a7517bdfb7ad service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:49.745958 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0c1eba2a-23c5-442b-802e-30e6e8ed25fe req-2d3d3131-fa29-4c69-96d0-a7517bdfb7ad service nova] Creating event network-changed:2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4 for instance 37018b70-71d7-42fb-9f73-347d6bd170fe on n-h2-841089-2 May 10 02:37:49.766797 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0c1eba2a-23c5-442b-802e-30e6e8ed25fe req-2d3d3131-fa29-4c69-96d0-a7517bdfb7ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099309 May 10 02:37:49.770990 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2597/5148] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:37:52.809138 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 02:37:52.809708 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 02:37:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! May 10 02:37:53.718706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:37:53.720116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:37:53.720685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:37:53.721798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:37:53.722285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:37:53.758368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:53.778303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:53.781128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:53.784435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:53.836485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Getting quotas for project 7cc35800f81344bfae154db9b04845c6. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:37:53.872200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Getting quotas for user 2db2de1520b348e482b2639d149e8460 and project 7cc35800f81344bfae154db9b04845c6. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:37:53.949419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:37:53.957398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:37:54.127001 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-10c147e3-c565-4765-8492-319ea97e67cb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 8.477462 May 10 02:37:54.130879 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2552/5149] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 8480 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:37:54.139000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b80387f-0650-4fda-8242-e431887ceaef tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:54.140064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b80387f-0650-4fda-8242-e431887ceaef tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:54.894592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b80387f-0650-4fda-8242-e431887ceaef tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:54.923236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b80387f-0650-4fda-8242-e431887ceaef tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:54.926394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b80387f-0650-4fda-8242-e431887ceaef tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:54.932951 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b80387f-0650-4fda-8242-e431887ceaef tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1278 microversion: 2.54 time: 0.796592 May 10 02:37:54.944736 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2598/5150] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:37:54 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1278 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:37:55.956564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:55.958094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:55.988578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:55.989428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:55.990491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:55.992530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:56.188114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:56.203090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:56.207015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:56.212125 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-17f4d879-928a-4693-adc8-3275c82f18be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1330 microversion: 2.54 time: 0.259663 May 10 02:37:56.218271 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2553/5151] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:37:55 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1330 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:37:57.240512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:57.241189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:57.253506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:57.261942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:57.265863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:57.266601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:57.425275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:57.439578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:57.444920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:57.455639 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7110fe49-71b8-457c-8831-008f4071f435 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1336 microversion: 2.54 time: 0.224302 May 10 02:37:57.457322 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2599/5152] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:37:57 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1336 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:37:58.476439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:58.477855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:58.500103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:58.500573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:58.506457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:58.507399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:58.913318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:58.925073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:58.926999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:58.931602 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5229f740-d4c9-404a-bc46-014d171b35d8 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1357 microversion: 2.54 time: 0.459873 May 10 02:37:58.935790 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2554/5153] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:37:58 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1357 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:37:58.953894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b283bd8-e1f0-4e7c-94f4-83d2d7e5c1b7 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Action: 'create', calling method: .version_select at 0x7f3d362cd310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-893509204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+XXwC+iV4E0eAXItS0LzrrRk/JFerfEW5eAL8Or9fUzqVDOB9SVEF+c0yhIO6TNMH6D6Iz/mbDgmlGCGHSHIq5RAGgJnukMrnxvulA7RRTBXFszlz5jJ+io7aFBaIJtg=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:58.984550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1b283bd8-e1f0-4e7c-94f4-83d2d7e5c1b7 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Getting quotas for project 7cc35800f81344bfae154db9b04845c6. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:37:59.003967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-1b283bd8-e1f0-4e7c-94f4-83d2d7e5c1b7 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Getting quotas for user 2db2de1520b348e482b2639d149e8460 and project 7cc35800f81344bfae154db9b04845c6. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:37:59.060507 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b283bd8-e1f0-4e7c-94f4-83d2d7e5c1b7 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.109311 May 10 02:37:59.090055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-893509204", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:37:59.105925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:59.125238 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2600/5154] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:37:58 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:37:59.147012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:59.148904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:59.154326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:59.155230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:59.403029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:37:59.405541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:37:59.411690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:37:59.412550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:37:59.413526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:37:59.608337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:59.641351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:59.647726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:59.651002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:59.652545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:59.786984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f6867da0-f45f-4f39-8b55-b70e4e2c4993 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "POST /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1/action" status: 202 len: 1139 microversion: 2.54 time: 0.713045 May 10 02:37:59.788201 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2555/5155] 10.222.0.52 () {62 vars in 1319 bytes} [Tue May 10 02:37:59 2022] POST /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1/action => generated 1139 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 10 02:37:59.808599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:37:59.809725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:37:59.820791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:59.821772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:59.822777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:37:59.824345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:37:59.957396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:59.972441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:59.974390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:37:59.976010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e3aa8d1-c5eb-4483-8c5d-9759bb537d8f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.175671 May 10 02:37:59.976878 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2601/5156] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:37:59 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:00.998059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:00.998674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:01.018878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:01.019757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:01.020582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:01.023647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:01.236359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:01.266004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:01.269282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:01.270374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13ef334f-40b6-4679-b1fa-df72c261cdcb tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.276515 May 10 02:38:01.290142 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2556/5157] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:00 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:02.294201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:02.295604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:02.312587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:02.313296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:02.314291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:02.314901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:02.458798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:02.475134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:02.482372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:02.484843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39e80727-69ef-4deb-aa7d-4c9c7cecdc8e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.196606 May 10 02:38:02.499940 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2602/5158] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:02 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:03.505634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:03.506252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:03.515368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:03.515826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:03.516604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:03.517183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:03.715854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:03.731900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:03.733474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:03.734702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3255c890-40a5-483b-922e-9d343a299055 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.232872 May 10 02:38:03.753311 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2557/5159] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:03 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:04.755476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:04.756756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:04.768813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:04.771158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:04.773993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:04.774471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:05.071314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:05.086393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:05.090960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:05.094573 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0151a6c3-cf16-430f-8e91-83c7b3280c4e tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.343346 May 10 02:38:05.110386 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2603/5160] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:04 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:06.117486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:06.118158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:06.136727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:06.138364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:06.143112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:06.143650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:06.344143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:06.358982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:06.365091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:06.368768 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-be2af4b6-0522-4158-9b94-bd12f6aa1685 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.255852 May 10 02:38:06.382851 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2558/5161] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:06 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:07.391775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:07.392644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:07.405765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:07.406222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:07.407018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:07.407503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:07.587145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:07.610693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:07.626038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:07.630596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7621c38-05eb-4404-a1b1-8758afd74a9b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.244581 May 10 02:38:07.646756 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2604/5162] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:07 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:08.653925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:08.654554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:08.662485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:08.663332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:08.664476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:08.664981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:08.799400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:08.828266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:08.829774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:08.840158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47338969-5f59-45a4-a2c7-573fdf0356ca tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.192550 May 10 02:38:08.840771 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2559/5163] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:08 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:09.860287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:09.860992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:09.875425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:09.876223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:09.879036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:09.889892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:10.135989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:10.145566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:10.147110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:10.148342 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-20c014f2-9060-4c1e-af32-a008a2b4d9f5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.292995 May 10 02:38:10.148919 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2605/5164] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:09 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:11.167123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:11.168319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:11.178239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:11.179891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:11.183124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:11.183796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:11.301908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:11.314483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:11.316037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:11.326402 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57a35f12-8b1e-4671-bd31-0420d16fd988 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.154049 May 10 02:38:11.337630 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2560/5165] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:11 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:12.347623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:12.349887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:12.380483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:12.381410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:12.384110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:12.387590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:12.656910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:12.666054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:12.682110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:12.688795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a6514c01-9529-4d23-a185-0298ab06518b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.347284 May 10 02:38:12.694644 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2606/5166] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:12 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:13.713828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:13.715187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:13.745329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:13.746523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:13.747672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:13.749307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:13.921935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:13.937704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:13.943000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:13.952911 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-81da4358-4129-49ab-87b2-b7f895930dc2 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.235428 May 10 02:38:13.953960 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2561/5167] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:13 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:14.971797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:14.972430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:14.989398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:14.989797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:14.990607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:14.992354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:15.170552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:15.178802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:15.180364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:15.182162 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c8510b2-8286-4dc0-b99b-8a4e6945e30b tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.213693 May 10 02:38:15.195437 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2607/5168] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:14 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:16.202079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:16.204392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:16.214632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:16.216834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:16.218439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:16.219312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:16.333821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:16.361763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:16.364911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:16.366944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a481cca-54c2-474b-9784-3017a1ddf714 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.170905 May 10 02:38:16.379445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2562/5169] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:16 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:17.386352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:17.386964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:17.399168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:17.399168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:17.403662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:17.404133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:17.563796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:17.574542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:17.577560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:17.579271 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-037bba57-22b1-4249-ba94-b0b010c5326c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.197381 May 10 02:38:17.580562 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2608/5170] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:17 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:18.598876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:18.600298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:18.622718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:18.623471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:18.626847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:18.627574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:18.900522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:18.918988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:18.926137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:18.930504 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-821f9012-8b75-4a16-aefe-a257ba6aea26 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.334989 May 10 02:38:18.932922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2563/5171] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:18 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:19.647731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:19.648250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:19.662785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:19.663276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:19.664068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:19.664512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:19.728226 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12802ba5-99b7-46fe-9dd7-4a2aae4b1a2c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/ips" status: 200 len: 149 microversion: 2.1 time: 0.084211 May 10 02:38:19.735105 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2609/5172] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:38:19 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:38:19.955563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:19.956520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:19.966517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:19.970336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:19.974279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:19.974815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:20.164691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:20.174208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:20.186377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:20.188341 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de7b9d39-eb1c-4af6-b267-c7a6c5ad6f38 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.238271 May 10 02:38:20.197965 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2564/5173] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:19 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:21.211961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:21.213191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:21.227225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:21.228184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:21.229198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:21.229848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:21.459787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:21.467923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:21.471777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:21.480930 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76bd9d91-4c33-4a70-8e02-eede120e7ff5 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.275382 May 10 02:38:21.481634 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2610/5174] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:21 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:22.500720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:22.503153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:22.514300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:22.529813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:22.536501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:22.537042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:22.753595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:22.764793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:22.773256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:22.779498 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3462554f-b066-4a9b-9cdb-9261160265be tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.282779 May 10 02:38:22.780832 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2565/5175] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:22 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:23.700881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8720c43-544c-458c-bae1-0193fcc063d1"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:38:23.702206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:23.709289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:23.717268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:23.718343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:23.719014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:23.807887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:23.809046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:23.847848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:23.849954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:23.852408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:23.855529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:24.039672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:24.049408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:24.056250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:24.057654 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba973f7f-149c-4a34-a7c5-21d11fe7dfb3 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.256440 May 10 02:38:24.060799 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2566/5176] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:23 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:24.173716 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55928fab-d953-4c7f-9fa2-809edb8167d6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "POST /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478421 May 10 02:38:24.175390 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2611/5177] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:38:23 2022] POST /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:38:25.081550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:25.082221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:25.097436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:25.098480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:25.101566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:25.102242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:25.253040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:25.266337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:25.269329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:25.270999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ec3565c-8a9c-482e-bdf8-09b7f241449f tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.195283 May 10 02:38:25.285310 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2567/5178] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:25 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:26.294597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:26.295479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:26.308786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:26.311410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:26.312484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:26.314110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:26.983151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:26.991950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:27.000634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:27.004922 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9634951-9f05-4d39-a4ff-443e67022216 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1408 microversion: 2.54 time: 0.715002 May 10 02:38:27.006423 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2612/5179] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:26 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1408 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:28.026623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:28.027059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:28.037652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:28.038108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:28.038897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:28.039370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:28.232559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:28.242660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:28.261565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:28.266976 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a14c1cb-e87a-496c-b5fa-ca9beed9e621 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1414 microversion: 2.54 time: 0.245734 May 10 02:38:28.290565 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2568/5180] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:28 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1414 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:29.290036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:29.291281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:29.306815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:29.310320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:29.313594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:29.316327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:29.539839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:29.556881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:29.558491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:29.567992 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98655ba1-e694-482e-8a77-fe47c4ec98c4 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1399 microversion: 2.54 time: 0.283288 May 10 02:38:29.585608 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2613/5181] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:29 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1399 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:38:29.591040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed471713-588f-4b31-8d48-97d7eb6fc576 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '.version_select at 0x7f3d35d18670>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:29.668624 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed471713-588f-4b31-8d48-97d7eb6fc576 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-893509204" status: 204 len: 0 microversion: 2.54 time: 0.074626 May 10 02:38:29.672071 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2569/5182] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-893509204 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:38:29.684732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:29.685375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:29.694062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:29.694366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:29.700788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:29.701455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:29.769651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:38:30.062285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37b04a7c-00c5-4bc4-9344-03efb163d309 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 204 len: 0 microversion: 2.54 time: 0.381681 May 10 02:38:30.062913 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2614/5183] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:38:29 2022] DELETE /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:38:30.071548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:30.073122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:30.082919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:30.088418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:30.089640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:30.090331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:30.403361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:30.417699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:30.420260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:30.437150 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-31f6e0b9-2327-494d-820c-15cab912b121 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1405 microversion: 2.54 time: 0.369835 May 10 02:38:30.439161 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2570/5184] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:30 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1405 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:31.477217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:31.480959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:31.530882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:31.537656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:31.538937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:31.539648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:31.790175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:31.817246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:31.827553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2db2de1520b348e482b2639d149e8460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc35800f81344bfae154db9b04845c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:38:31.834356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35bccb14-8ac5-48c5-8c71-96350a7f023c tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 200 len: 1405 microversion: 2.54 time: 0.369704 May 10 02:38:31.838416 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2615/5185] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:31 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:38:32.882198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:32.888964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] [instance: d7051e0d-1fa4-4197-b9e5-de6f99fd13e1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:32.913793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:32.914990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:32.916565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:32.917289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:32.940807 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] HTTP exception thrown: Instance d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 could not be found. May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Request method failure captured: May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 HTTP/1.1 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec_52PVkrszZMAgD7I9QFHzUCgAS-bfIe_4xgas4Qi2EH2AQ72opxMZxpUryw0o2Jb4QGLq0_0JC_lgDI6BEImg-9Shshg-xiUxU4aDeXD9az3w-QT9_-amqG2Ca5NOB8X_mtUc1nfFPSl-CN2cSdjKtAsMMJtl0EhPD2nTXiHRE49w May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.54 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 7cc35800f81344bfae154db9b04845c6 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerShowV254Test-843715289 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7cc35800f81344bfae154db9b04845c6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cc35800f81344bfae154db9b04845c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7cc35800f81344bfae154db9b04845c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7cc35800f81344bfae154db9b04845c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerShowV254Test-843715289 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 7cc35800f81344bfae154db9b04845c6 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerShowV254Test-843715289 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerShowV254Test-843715289-project May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2db2de1520b348e482b2639d149e8460 May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerShowV254Test-843715289-project May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 could not be found. May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd7051e0d-1fa4-4197-b9e5-de6f99fd13e1'} May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 could not be found. May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 could not be found. May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:38:32.942662 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 could not be found. May 10 02:38:32.949596 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:38:32.952195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] Returning 404 to user: Instance d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:38:32.953296 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-52434b8c-94de-4ebb-944c-1c0cab037688 tempest-ServerShowV254Test-843715289 tempest-ServerShowV254Test-843715289-project] 10.222.0.52 "GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1" status: 404 len: 111 microversion: 2.54 time: 0.100590 May 10 02:38:32.954140 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2571/5186] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:38:32 2022] GET /compute/v2.1/servers/d7051e0d-1fa4-4197-b9e5-de6f99fd13e1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:38:54.093943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-96fc5fee-8d67-4ab3-99f8-d78abc2e27f5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Action: 'create', calling method: .version_select at 0x7f3d36301a60>, body: {"keypair": {"name": "tempest-keypair-1477111006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmxzwgGBQis/iS/TNDyC20PhArbVc0hDJcdEQhYnupAGmhKlN/cj5OxUokDx27b4BxYLLNzIEVym8kH2RsVJvk9oh4oXVI/wYWQuifp4TlzZ9YdFitf0gPOwxSMXZ7zCA=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:38:54.145083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-96fc5fee-8d67-4ab3-99f8-d78abc2e27f5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Getting quotas for project d2e613152df54ce2bda1a071df09d6dd. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:38:54.169653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-96fc5fee-8d67-4ab3-99f8-d78abc2e27f5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Getting quotas for user d6cc75baab3a4df6a7f69007e79e31e9 and project d2e613152df54ce2bda1a071df09d6dd. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:38:54.239486 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-96fc5fee-8d67-4ab3-99f8-d78abc2e27f5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.148053 May 10 02:38:54.240707 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2616/5187] 10.222.0.52 () {62 vars in 1199 bytes} [Tue May 10 02:38:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 02:38:55.261398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:55.262563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:55.280717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:55.281182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:55.282013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:55.282486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:55.523781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lazy-loading 'services' on Instance uuid 37018b70-71d7-42fb-9f73-347d6bd170fe {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:38:55.753419 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-413a73b5-10d9-4f0e-bb7a-b267a1b0070c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments/c8720c43-544c-458c-bae1-0193fcc063d1" status: 202 len: 0 microversion: 2.1 time: 0.496995 May 10 02:38:55.754026 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2572/5188] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:38:55 2022] DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments/c8720c43-544c-458c-bae1-0193fcc063d1 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:38:55.764733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:55.767321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:55.792186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:55.793459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:55.810612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:55.813648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:55.888444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c1a7fe0-d651-4d33-8069-c6e2db07559b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129744 May 10 02:38:55.889721 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2617/5189] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:38:55 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:38:56.903434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:56.905221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:56.926700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:56.933973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:56.942010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:56.948623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:57.099701 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-232004b2-6f4f-423b-8ceb-79f64e2d9657 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199899 May 10 02:38:57.103176 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2573/5190] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:38:56 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:38:58.114007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:58.119107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:58.130088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:58.131126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:58.133743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:58.134452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:58.185760 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0071e302-5366-4fbc-818e-e70193d7c458 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076372 May 10 02:38:58.191261 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2618/5191] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:38:58 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:38:58.812752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1154350292", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1bc8d803-b0f2-410a-a640-47429e7b7f89"}, {"port": "ebcbedbd-f752-4ab1-929f-8e485c0ceed3", "tag": "port-1"}, {"port": "17ea3ba3-bf94-49d0-a60f-8818331d1f75", "tag": "port-2"}, {"uuid": "d075c434-f025-4c86-a958-623a632e9f0b", "tag": "net-1"}, {"uuid": "d075c434-f025-4c86-a958-623a632e9f0b"}, {"uuid": "3071be72-5fb4-45b9-81a8-01459a44f4ef", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3071be72-5fb4-45b9-81a8-01459a44f4ef", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "04a4d690-01e8-4a68-95e4-eade4e0a2fb7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e655eeab-d84b-4191-9d4c-0411524fffa0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "31e633d4-a4ab-403e-89f0-dc0c08e6caf2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--948985684"}], "key_name": "tempest-keypair-1477111006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:38:59.059543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] validate_networks() for [('1bc8d803-b0f2-410a-a640-47429e7b7f89', None, None, None, None, None), (None, None, 'ebcbedbd-f752-4ab1-929f-8e485c0ceed3', None, None, None), (None, None, '17ea3ba3-bf94-49d0-a60f-8818331d1f75', None, None, None), ('d075c434-f025-4c86-a958-623a632e9f0b', None, None, None, None, None), ('d075c434-f025-4c86-a958-623a632e9f0b', None, None, None, None, None), ('3071be72-5fb4-45b9-81a8-01459a44f4ef', '10.2.2.100', None, None, None, None), ('3071be72-5fb4-45b9-81a8-01459a44f4ef', '10.2.2.200', None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:38:59.201118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:38:59.202230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:38:59.222431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:59.222935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:59.226023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:38:59.227713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:38:59.340091 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f00aac63-4941-4b21-a5d6-ebc7422755c2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146068 May 10 02:38:59.342997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2619/5192] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:38:59 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:00.355556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:00.356746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:00.375908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:00.377499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:00.381923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:00.385118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:00.500712 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a89371e-b49d-4e46-9b3c-9b5756e5052d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150100 May 10 02:39:00.513236 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2620/5193] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:00 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:01.512499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:01.513476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:01.533061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:01.533526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:01.534555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:01.535476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:01.595430 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-407f0eb1-3a7a-489e-aa92-8f8e6e101ec2 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087007 May 10 02:39:01.597920 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2621/5194] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:01 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:02.607864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:02.609620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:02.636747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:02.642754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:02.646890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:02.647415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:02.769557 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-40125e3a-0a7a-4a5d-be53-9801c3cbb0d8 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165752 May 10 02:39:02.779205 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2622/5195] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:02 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:03.790382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:03.792368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:03.812868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:03.815029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:03.817375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:03.819620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:03.952627 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e1baf56-8f0f-4a86-bc69-b8d41e0fc5b3 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166279 May 10 02:39:03.956291 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2623/5196] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:03 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:04.966477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:04.968262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:04.985350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:04.993625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:04.996395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:04.998541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:05.054225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:39:05.055322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:39:05.055991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:39:05.056612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:39:05.057213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:39:05.074233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:05.074981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:05.076003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:05.077509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:05.110223 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ac6c108-3118-4403-a330-ee1fa2d53f58 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148242 May 10 02:39:05.118051 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2624/5197] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:04 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:05.123299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Getting quotas for project d2e613152df54ce2bda1a071df09d6dd. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:39:05.137469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Getting quotas for user d6cc75baab3a4df6a7f69007e79e31e9 and project d2e613152df54ce2bda1a071df09d6dd. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:39:06.123894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:06.125008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:06.137707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:06.139651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:06.142844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:06.145914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:06.227050 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ba444ce-a91c-40ef-8b0c-c68f440d6f0d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108126 May 10 02:39:06.228283 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2625/5198] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:06 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:06.305366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:39:06.308116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='04a4d690-01e8-4a68-95e4-eade4e0a2fb7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e655eeab-d84b-4191-9d4c-0411524fffa0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31e633d4-a4ab-403e-89f0-dc0c08e6caf2',volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:39:07.241661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:07.243020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:07.286716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:07.309221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:07.322106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:07.337163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:07.480284 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1980e924-0c00-4ab6-8970-a556624b487b tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243452 May 10 02:39:07.487420 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2626/5199] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:07 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:08.012924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee614ad4-7ca8-4416-bc16-8bf2ee344cc0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 9.205829 May 10 02:39:08.022295 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2574/5200] 10.222.0.52 () {62 vars in 1188 bytes} [Tue May 10 02:38:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 9216 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:39:08.024939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac1b8da2-a334-4ff3-b6a0-b962a92a750c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:08.025816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac1b8da2-a334-4ff3-b6a0-b962a92a750c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:08.248254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac1b8da2-a334-4ff3-b6a0-b962a92a750c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:08.258357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac1b8da2-a334-4ff3-b6a0-b962a92a750c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:08.260187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac1b8da2-a334-4ff3-b6a0-b962a92a750c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:08.280421 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac1b8da2-a334-4ff3-b6a0-b962a92a750c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1286 microversion: 2.42 time: 0.259921 May 10 02:39:08.281882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2627/5201] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:08 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:08.499187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:08.500463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:08.511009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:08.517775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:08.518584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:08.519021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:08.621019 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e21c84e6-c9af-4dfd-b3bd-709c3f95bc51 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126409 May 10 02:39:08.640500 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2575/5202] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:08 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:09.307380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58a3bbe2-7e58-46fe-8277-85ce49c7dbca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:09.308637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58a3bbe2-7e58-46fe-8277-85ce49c7dbca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:09.633311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:09.634891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:09.663649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:09.669807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:09.674200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:09.682259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:09.820786 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4f263654-14f9-463c-968b-508d1b4806af tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191311 May 10 02:39:09.826378 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2576/5203] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:09 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:10.693899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58a3bbe2-7e58-46fe-8277-85ce49c7dbca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:10.716340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58a3bbe2-7e58-46fe-8277-85ce49c7dbca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:10.717285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58a3bbe2-7e58-46fe-8277-85ce49c7dbca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:10.722298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58a3bbe2-7e58-46fe-8277-85ce49c7dbca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1286 microversion: 2.42 time: 1.419057 May 10 02:39:10.722999 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2628/5204] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:09 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1286 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:10.834177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:10.835321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:10.853074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:10.860685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:10.862735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:10.866328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:11.003122 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-311c01e1-cc13-4e17-bb63-2cba614a4f29 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172881 May 10 02:39:11.003122 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2577/5205] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:10 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:11.741493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:11.742264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:11.754895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:11.761310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:11.762190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:11.763821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:11.916564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:11.925903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:11.929350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:11.940198 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6300b0cc-cd86-42c8-a0b9-b028268b9210 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1594 microversion: 2.42 time: 0.202894 May 10 02:39:11.941440 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2629/5206] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:11 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1594 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:12.014070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:12.014999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:12.029911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:12.033255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:12.034412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:12.035785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:12.111539 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4f66510-3976-4ea1-a69f-38086e951d02 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096868 May 10 02:39:12.112482 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2578/5207] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:12 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:12.959748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:12.960367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:12.971884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:12.972641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:12.973612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:12.987841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:13.124768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:13.125811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:13.168845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:13.170928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:13.176151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:13.183215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:13.256434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:13.266635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:13.279406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:13.281185 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a069e16-6388-4147-b830-6378a9f756a5 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1594 microversion: 2.42 time: 0.325421 May 10 02:39:13.281996 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2630/5208] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:12 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1594 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:13.336942 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c5dfaf5-340b-4464-b0a8-1d914859c57c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216409 May 10 02:39:13.337551 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2579/5209] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:13 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:14.302024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:14.302569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:14.325226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:14.326068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:14.327120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:14.327806 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:14.354016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:14.361670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:14.410659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:14.411579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:14.412718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:14.413418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:14.450137 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbbd152f-c18f-42d2-b4d8-3e3d6614af4d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105907 May 10 02:39:14.451917 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2580/5210] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:14 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:14.703045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:14.717856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:14.720741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:14.724016 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25c72ce4-815a-4848-9f2f-4420b2aab8dc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1661 microversion: 2.42 time: 0.426025 May 10 02:39:14.749128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2631/5211] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:14 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1661 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:15.463587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:15.465110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:15.479415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:15.480251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:15.482212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:15.483951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:15.554088 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e7efd83-bb97-4046-9511-d98ba18e337d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092108 May 10 02:39:15.557204 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2581/5212] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:15 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:15.777149 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:15.786249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:15.803539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:15.804023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:15.804880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:15.805336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:16.247058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:16.262334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:16.268445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:16.271025 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37c20f62-aa28-42d8-b7ad-da6f1e044481 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1707 microversion: 2.42 time: 0.505118 May 10 02:39:16.287860 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2632/5213] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:15 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1707 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:16.566540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:16.568059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:16.585456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:16.605259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:16.606760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:16.608988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:16.689736 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-272fab76-0f6a-4672-85a4-7d0eb0e95e5f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127365 May 10 02:39:16.690632 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2582/5214] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 02:39:16 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 02:39:17.025070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:17.026148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:17.037324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:17.039815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:17.041144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:17.045112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:17.121072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:39:17.294350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:17.295345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:17.306148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:17.309735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:17.312012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:17.317162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:17.385608 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1bcbf2e-6aeb-4d1d-a284-33459133cc1a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 204 len: 0 microversion: 2.1 time: 0.363432 May 10 02:39:17.388596 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2633/5215] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:39:17 2022] DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:39:17.401864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:17.402574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:17.423449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:17.423934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:17.424861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:17.425438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:18.233795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:18.316120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:18.325020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:18.329978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:18.330966 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c44b3479-1c97-4ef7-91a1-448bbcce9910 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1753 microversion: 2.42 time: 1.039805 May 10 02:39:18.348754 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2583/5216] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:17 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1753 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:18.367913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90240b4b-ad33-44d2-ab86-483ee8031485 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1680 microversion: 2.1 time: 0.967052 May 10 02:39:18.368892 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2634/5217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:17 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1680 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:39:19.357717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:19.359024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:19.370924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:19.373055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:19.387272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:19.388953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:19.394184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:19.396728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:19.405689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:19.406163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:19.406941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:19.408744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:20.085427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:20.097451 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-31d76df1-6f28-4165-836c-58f9cbd6cee6 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1680 microversion: 2.1 time: 0.715377 May 10 02:39:20.098514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2635/5218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:19 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1680 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:39:20.157658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:20.172112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:20.174045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:20.178492 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1ae1885-70be-4096-b618-5b38b2075ebb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1753 microversion: 2.42 time: 0.825053 May 10 02:39:20.182793 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2584/5219] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:19 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1753 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:21.134720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:21.137162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:21.167288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:21.167288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:21.173480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:21.178057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:21.203177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:21.204750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:21.224351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:21.226252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:21.232433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:21.237669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:21.861120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:21.868833 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bf614d1e-9d45-4636-93d6-2277e7705b43 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1680 microversion: 2.1 time: 0.739104 May 10 02:39:21.869433 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2636/5220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:21 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1680 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:39:22.131243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:22.145904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:22.150474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:22.154429 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c072befa-e14c-425b-a9bb-0050c76f8308 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1799 microversion: 2.42 time: 0.955947 May 10 02:39:22.156997 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2585/5221] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:21 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1799 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:22.887916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:22.888564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:22.901036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:22.901508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:22.902320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:22.902770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:23.130459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:23.164703 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-273f8f9f-1bb3-4dc5-a24c-11bbe8560176 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1613 microversion: 2.1 time: 0.281665 May 10 02:39:23.167465 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2637/5222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:22 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1613 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:39:23.186243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:23.186934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:23.202278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:23.202764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:23.203602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:23.207503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:23.883359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:23.921792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:23.935897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:23.943147 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42133114-d525-42e3-8fd2-4bd7686df3c8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1845 microversion: 2.42 time: 0.759353 May 10 02:39:23.945735 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2586/5223] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:23 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1845 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:24.184392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:24.185216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:24.200373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:24.201627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:24.204445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:24.205105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:24.236334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-45ea040a-be6e-4570-a89c-038d3bc4426b req-9cb90cb6-c513-491c-9a52-24d239360ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37018b70-71d7-42fb-9f73-347d6bd170fe", "name": "network-vif-deleted", "tag": "2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:24.264159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-45ea040a-be6e-4570-a89c-038d3bc4426b req-9cb90cb6-c513-491c-9a52-24d239360ed4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:24.268620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-45ea040a-be6e-4570-a89c-038d3bc4426b req-9cb90cb6-c513-491c-9a52-24d239360ed4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:24.311673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:24.315474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:24.315835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lazy-loading 'fault' on Instance uuid 37018b70-71d7-42fb-9f73-347d6bd170fe {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:39:24.324895 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-45ea040a-be6e-4570-a89c-038d3bc4426b req-9cb90cb6-c513-491c-9a52-24d239360ed4 service nova] Creating event network-vif-deleted:2a92f3e1-1e2a-4c3a-ac53-7c44f27ff1b4 for instance 37018b70-71d7-42fb-9f73-347d6bd170fe on n-h2-841089-2 May 10 02:39:24.342862 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-45ea040a-be6e-4570-a89c-038d3bc4426b req-9cb90cb6-c513-491c-9a52-24d239360ed4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.532941 May 10 02:39:24.345871 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2638/5224] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:24.455764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:24.471024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ddef8fc1-758e-4491-aa15-f9853c5cafdb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1331 microversion: 2.1 time: 0.291081 May 10 02:39:24.472837 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2587/5225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:24 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1331 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:39:24.964701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:24.965350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:24.983193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:24.984678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:24.987697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:24.993166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:25.608800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:25.649717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:25.658043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:25.663141 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c26021d-9383-48a8-9cfd-d64c2cf71e2e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1845 microversion: 2.42 time: 0.705185 May 10 02:39:25.667035 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2588/5226] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:24 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1845 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:25.693538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:25.698899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:25.720114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:25.735318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:25.736504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:25.742464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:25.751222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8731af70-2eeb-46d2-babe-0675be91ec07 req-8e5e9bb5-2d80-4c25-8065-534911bd21fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "03d41542-4a81-4658-b31f-590f0f2ea996"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:25.776158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8731af70-2eeb-46d2-babe-0675be91ec07 req-8e5e9bb5-2d80-4c25-8065-534911bd21fc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:25.776670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8731af70-2eeb-46d2-babe-0675be91ec07 req-8e5e9bb5-2d80-4c25-8065-534911bd21fc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:25.833228 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8731af70-2eeb-46d2-babe-0675be91ec07 req-8e5e9bb5-2d80-4c25-8065-534911bd21fc service nova] Creating event network-changed:03d41542-4a81-4658-b31f-590f0f2ea996 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:25.852577 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8731af70-2eeb-46d2-babe-0675be91ec07 req-8e5e9bb5-2d80-4c25-8065-534911bd21fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.964683 May 10 02:39:25.854732 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2639/5227] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:25.970366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:25.978089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:25.979385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lazy-loading 'fault' on Instance uuid 37018b70-71d7-42fb-9f73-347d6bd170fe {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:39:26.681103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614ccf5942ce45fa83ba9999e23aea03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e530b3feb70b459f83910d6e4ced55da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:26.689522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:26.691821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:26.692747 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71ac1788-39ad-4fd2-bf5c-492896990e06 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 200 len: 1331 microversion: 2.1 time: 1.018236 May 10 02:39:26.696142 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2589/5228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:25 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 1331 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:39:26.715032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:26.715549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:26.716367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:26.716821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:27.430934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:27.443452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:27.449717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:27.456061 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2790ef05-8296-4ded-84a4-5000547dfe5e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1866 microversion: 2.42 time: 0.771503 May 10 02:39:27.459146 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2640/5229] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:26 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1866 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:39:27.712201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:27.713870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:27.724623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:27.726745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:27.727979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:27.728858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:27.763539 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe HTTP/1.1 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '37018b70-71d7-42fb-9f73-347d6bd170fe'} May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:39:27.766208 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:39:27.771114 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13f7d3a2-91b6-4c18-b9fe-6fedcc5e90e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 404 len: 111 microversion: 2.1 time: 0.062422 May 10 02:39:27.773670 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2590/5230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:27 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:39:27.781003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4521f698-586b-49b5-9ee5-28a78c4af4c7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '.version_select at 0x7f3d36301a60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:27.816062 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4521f698-586b-49b5-9ee5-28a78c4af4c7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-304254898" status: 202 len: 0 microversion: 2.1 time: 0.039833 May 10 02:39:27.819479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2641/5231] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-304254898 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:39:27.886967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-125e5914-f14b-45c1-acb6-61b7e424cb49 req-f7b0163e-7c00-4c9c-9128-609604fc3887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "ebcbedbd-f752-4ab1-929f-8e485c0ceed3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:27.904895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-125e5914-f14b-45c1-acb6-61b7e424cb49 req-f7b0163e-7c00-4c9c-9128-609604fc3887 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:27.905757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-125e5914-f14b-45c1-acb6-61b7e424cb49 req-f7b0163e-7c00-4c9c-9128-609604fc3887 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:27.952030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-125e5914-f14b-45c1-acb6-61b7e424cb49 req-f7b0163e-7c00-4c9c-9128-609604fc3887 service nova] Creating event network-changed:ebcbedbd-f752-4ab1-929f-8e485c0ceed3 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:27.983424 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-125e5914-f14b-45c1-acb6-61b7e424cb49 req-f7b0163e-7c00-4c9c-9128-609604fc3887 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087507 May 10 02:39:27.988054 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2591/5232] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:28.475964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:28.477028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:28.484639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:28.496010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:28.498901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:28.503186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:29.349576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:29.364026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:29.375507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:29.387338 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-213bff7b-2312-4935-8db2-c786c4cbad75 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.914466 May 10 02:39:29.389412 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2642/5233] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:28 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:30.089895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-30c9ed39-a013-421f-a2fb-b133f0ac9f19 req-8c3b810d-3f8f-47aa-a351-ba8e0e9bae4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "17ea3ba3-bf94-49d0-a60f-8818331d1f75"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:30.111874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-30c9ed39-a013-421f-a2fb-b133f0ac9f19 req-8c3b810d-3f8f-47aa-a351-ba8e0e9bae4d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:30.112561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-30c9ed39-a013-421f-a2fb-b133f0ac9f19 req-8c3b810d-3f8f-47aa-a351-ba8e0e9bae4d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:30.171421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-30c9ed39-a013-421f-a2fb-b133f0ac9f19 req-8c3b810d-3f8f-47aa-a351-ba8e0e9bae4d service nova] Creating event network-changed:17ea3ba3-bf94-49d0-a60f-8818331d1f75 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:30.188506 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-30c9ed39-a013-421f-a2fb-b133f0ac9f19 req-8c3b810d-3f8f-47aa-a351-ba8e0e9bae4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104103 May 10 02:39:30.191674 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2592/5234] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:30.407480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:30.408110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:30.421121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:30.421605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:30.422518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:30.422863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:31.612238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:31.627736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:31.629574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:31.634895 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-470cfbe8-c0d4-42e1-8ed4-dad343e30a57 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.231479 May 10 02:39:31.640299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2643/5235] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:30 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:32.659255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:32.660857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:32.664642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-45e1c320-f6d5-4156-8d07-1dd37b7d615d req-e4288a3f-bcd9-4428-a505-cec941cb4e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "524ef9b2-c4b1-4920-9b01-d6a636efe97c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:32.682691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:32.687676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:32.688545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:32.693198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:32.699416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-45e1c320-f6d5-4156-8d07-1dd37b7d615d req-e4288a3f-bcd9-4428-a505-cec941cb4e2b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:32.700011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-45e1c320-f6d5-4156-8d07-1dd37b7d615d req-e4288a3f-bcd9-4428-a505-cec941cb4e2b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:32.751890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-45e1c320-f6d5-4156-8d07-1dd37b7d615d req-e4288a3f-bcd9-4428-a505-cec941cb4e2b service nova] Creating event network-changed:524ef9b2-c4b1-4920-9b01-d6a636efe97c for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:32.773585 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-45e1c320-f6d5-4156-8d07-1dd37b7d615d req-e4288a3f-bcd9-4428-a505-cec941cb4e2b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126638 May 10 02:39:32.774206 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2593/5236] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:34.086287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:34.102219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:34.108405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:34.109648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2a6c10c-0c9e-4a4a-8261-fa4a5b28d318 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.454586 May 10 02:39:34.130907 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2644/5237] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:32 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:39:34.829842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-df78b70b-acec-4129-b158-f5e3c187ba00 req-c111fc16-6f27-4dab-9234-befd2840ece6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "b29b86f4-aa60-4bf8-9ce5-f4154354e21b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:34.843591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-df78b70b-acec-4129-b158-f5e3c187ba00 req-c111fc16-6f27-4dab-9234-befd2840ece6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:34.844051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-df78b70b-acec-4129-b158-f5e3c187ba00 req-c111fc16-6f27-4dab-9234-befd2840ece6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:34.886049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-df78b70b-acec-4129-b158-f5e3c187ba00 req-c111fc16-6f27-4dab-9234-befd2840ece6 service nova] Creating event network-changed:b29b86f4-aa60-4bf8-9ce5-f4154354e21b for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:34.903214 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-df78b70b-acec-4129-b158-f5e3c187ba00 req-c111fc16-6f27-4dab-9234-befd2840ece6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078056 May 10 02:39:34.907372 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2594/5238] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:35.129990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:35.130627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:35.155518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:35.161678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:35.166275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:35.166748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:36.240235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:36.260936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:36.275644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:36.279773 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e53ff78-b890-4100-a8cd-f126282e4c09 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.153565 May 10 02:39:36.295961 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2645/5239] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:35 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:37.057731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-abbc3ea1-af5f-42f8-a262-0fe6d6ce20cf req-52bcf965-23e5-4768-93a6-e11dd1e81926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "915b783c-c028-4503-95c9-c4a588f78d66"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:37.096220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-abbc3ea1-af5f-42f8-a262-0fe6d6ce20cf req-52bcf965-23e5-4768-93a6-e11dd1e81926 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:37.096687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-abbc3ea1-af5f-42f8-a262-0fe6d6ce20cf req-52bcf965-23e5-4768-93a6-e11dd1e81926 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:37.138374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-abbc3ea1-af5f-42f8-a262-0fe6d6ce20cf req-52bcf965-23e5-4768-93a6-e11dd1e81926 service nova] Creating event network-changed:915b783c-c028-4503-95c9-c4a588f78d66 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:37.153992 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-abbc3ea1-af5f-42f8-a262-0fe6d6ce20cf req-52bcf965-23e5-4768-93a6-e11dd1e81926 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100729 May 10 02:39:37.158799 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2595/5240] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:39:37.306940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:37.307609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:37.321545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:37.327947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:37.330309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:37.338619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:38.739869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:38.752971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:38.765378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:38.767050 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4353a0da-b06e-48e8-b5f5-ba5312a064ce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.467617 May 10 02:39:38.778424 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2646/5241] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:37 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:39.798189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:39.799968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:39.813695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:39.815623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:39.816758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:39.820324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:39.957340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e4f549b2-0c3b-4ee2-bc2c-1742bd49591e req-2d27e69c-cebc-44a2-a661-39b7ed855a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "8ebe326a-6371-48e0-b2c2-fc7da49b1838"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:39:40.009383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e4f549b2-0c3b-4ee2-bc2c-1742bd49591e req-2d27e69c-cebc-44a2-a661-39b7ed855a59 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:40.012375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e4f549b2-0c3b-4ee2-bc2c-1742bd49591e req-2d27e69c-cebc-44a2-a661-39b7ed855a59 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:40.054744 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e4f549b2-0c3b-4ee2-bc2c-1742bd49591e req-2d27e69c-cebc-44a2-a661-39b7ed855a59 service nova] Creating event network-changed:8ebe326a-6371-48e0-b2c2-fc7da49b1838 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:39:40.087001 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e4f549b2-0c3b-4ee2-bc2c-1742bd49591e req-2d27e69c-cebc-44a2-a661-39b7ed855a59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133209 May 10 02:39:40.095291 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2647/5242] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:39:40.514330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:40.528823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:40.533083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:40.537697 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2eb3d11f-1179-44ee-8c4c-99fe8cdd090b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.743808 May 10 02:39:40.543715 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2596/5243] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:39 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:41.562856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:41.564174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:41.582016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:41.591364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:41.597706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:41.601017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:42.081803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:42.098591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:42.101602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:42.127824 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-db533802-d133-4d75-a2c3-fecd97637c11 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.564787 May 10 02:39:42.137237 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2648/5244] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:41 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:43.162620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:43.163798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:43.180270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:43.183552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:43.186758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:43.187413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:43.890349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:43.916468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:43.918203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:43.943693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdf0e81e-0feb-49e0-b8ee-95e254a31a40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.761251 May 10 02:39:43.944903 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2597/5245] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:43 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:44.971385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:44.972846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:44.995965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:44.996727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:44.999649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:45.003296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:45.818321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:45.846698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:45.850039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:45.861200 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce5ce005-29f4-4662-9eaf-939e1fd9c50d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.894963 May 10 02:39:45.868982 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2649/5246] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:44 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:46.890037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:46.891617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:46.912647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:46.913979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:46.920178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:46.921910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:47.705470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:47.719903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:47.737698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:47.742623 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7c21b568-a676-4474-877c-95f9d3bb02ee tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.856711 May 10 02:39:47.743905 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2598/5247] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:46 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:48.763270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:48.764105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:48.779663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:48.780330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:48.787373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:48.788209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:49.471455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:49.486360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:49.503271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:49.512279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee6407e7-f1c1-4d7c-8dc8-f19a5307a4b7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.750321 May 10 02:39:49.513012 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2650/5248] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:48 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:50.541280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:50.542123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:50.559550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:50.564852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:50.567426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:50.569359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:51.160325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:51.176832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:51.178832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:51.180311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-568f4630-f03e-40fd-908e-fbba26cd7dc9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.643684 May 10 02:39:51.184021 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2599/5249] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:50 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:52.202964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:52.204716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:52.223533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:52.224440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:52.227412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:52.231643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:52.772800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:52.788611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:52.791596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:52.793250 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7da02020-6bb0-4f7f-b1c6-bc75f33e0574 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.595314 May 10 02:39:52.795107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2651/5250] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:52 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:52.930808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:52.931453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:52.957353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:52.957819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:52.958634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:52.959098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:53.010482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe HTTP/1.1 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '37018b70-71d7-42fb-9f73-347d6bd170fe'} May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:39:53.015715 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:39:53.020484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5392555-92e9-4c16-8be5-3b271d5773ef tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 404 len: 111 microversion: 2.1 time: 0.091333 May 10 02:39:53.026785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:53.027518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 37018b70-71d7-42fb-9f73-347d6bd170fe] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:53.036433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:53.036893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:53.038234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:53.038570 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2600/5251] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:39:52 2022] DELETE /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:39:53.061980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:53.156460 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe HTTP/1.1 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '37018b70-71d7-42fb-9f73-347d6bd170fe'} May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:39:53.158158 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 37018b70-71d7-42fb-9f73-347d6bd170fe could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c2d578d0-d798-4545-862e-2971bc4a381f tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe" status: 404 len: 111 microversion: 2.1 time: 0.137148 May 10 02:39:53.164513 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2652/5252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:39:53 2022] GET /compute/v2.1/servers/37018b70-71d7-42fb-9f73-347d6bd170fe => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:39:53.813405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:53.814156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:53.827843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:53.840097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:53.841093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:53.842513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:54.573516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:54.583103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:54.593011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:54.604243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac5b7f96-aad1-4202-8c40-0b28984293d7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.794972 May 10 02:39:54.618850 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2601/5253] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:53 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:55.625838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:55.627263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:55.637064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:55.650581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:55.651808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:55.652462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:56.239020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:56.248349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:56.249887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:56.251094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ecd85554-aaff-4bcf-83dc-e44b7e51389c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.629146 May 10 02:39:56.264165 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2653/5254] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:55 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:57.282946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:57.283648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:57.294477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:57.294942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:57.295776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:57.296224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:57.965045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:57.977530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:57.981614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:57.991337 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f0c2fc6d-fe67-4697-aa5c-7eedd9e33ece tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.712507 May 10 02:39:58.003914 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2602/5255] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:57 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:39:59.010608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:39:59.018490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:39:59.042261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:59.046193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:59.052281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:39:59.059808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:39:59.606564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:59.623162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:59.625973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:39:59.629307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0aa2636-75b2-49a4-8f3b-511a27f03f7c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.622483 May 10 02:39:59.641826 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2654/5256] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:39:59 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:00.649891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:00.650517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:00.705793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:00.706074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:00.713402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:00.716471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:01.508663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:01.542315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:01.550648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:01.557635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b36ad9fa-3312-4a2b-8ea3-b32864fd020f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.912021 May 10 02:40:01.562311 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2603/5257] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:00 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:02.578290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:02.579741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:02.599222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:02.608708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:02.611007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:02.615764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:03.239137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:03.249548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:03.260976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:03.267413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e82f882f-8fdf-4fca-a1f3-bfa2a0325c24 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.688556 May 10 02:40:03.280588 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2655/5258] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:02 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:04.288577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:04.289841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:04.311904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:04.315975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:04.317594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:04.321377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:04.932816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:04.942555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:04.957198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:04.961475 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-97eafabb-f2a2-4992-9818-1a76c028345d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.678460 May 10 02:40:04.969053 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2604/5259] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:04 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:05.987333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:05.988647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:06.008963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:06.010988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:06.012098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:06.014443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:06.596850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:06.613210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:06.618300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:06.622285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc3f8ed3-43e0-45ca-8a13-847ca47e852d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.637446 May 10 02:40:06.647134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2656/5260] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:05 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:07.657023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:07.657922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:07.678826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:07.683608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:07.684665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:07.687696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:08.228435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:08.243288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:08.245474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:08.248768 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e1aaaa7-cecc-4c6f-bd94-78ec399b4c4e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.596375 May 10 02:40:08.253690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2605/5261] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:07 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:09.269506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:09.270755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:09.286880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:09.291665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:09.292755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:09.293424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:09.903682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:09.913757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:09.931506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:09.932868 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3f71515-464e-4a2e-b2af-40939b11445c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.667236 May 10 02:40:09.933472 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2657/5262] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:09 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:10.953051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:10.953695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:10.970840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:10.971383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:10.972135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:10.972588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.468680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:11.485327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:11.491602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:11.493205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dfe51bcb-348d-49df-9d51-a6dd8d9f8153 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.544275 May 10 02:40:11.495186 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2606/5263] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:10 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:11.684629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:11.685176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:11.704078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.705324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.706590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.710190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.755438 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 HTTP/1.1 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '8d3824f1-711a-45b4-a4c2-7c54dda66522'} May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:40:11.758545 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.764989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.773243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:11.776563 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-55af11dd-c1ff-4560-a2fa-123403129cfb tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 404 len: 111 microversion: 2.1 time: 0.094159 May 10 02:40:11.777374 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2658/5264] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:40:11 2022] DELETE /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:11.786244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:11.787760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 8d3824f1-711a-45b4-a4c2-7c54dda66522] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:11.797987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.800786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.801823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.802476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.835924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 HTTP/1.1 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8d3824f1-711a-45b4-a4c2-7c54dda66522'} May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:11.843933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. May 10 02:40:11.850469 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:11.852191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 8d3824f1-711a-45b4-a4c2-7c54dda66522 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:11.853227 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abb8e84e-bc6a-4e12-9e97-2b6af66800fa tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522" status: 404 len: 111 microversion: 2.1 time: 0.071706 May 10 02:40:11.856072 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2607/5265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:11 2022] GET /compute/v2.1/servers/8d3824f1-711a-45b4-a4c2-7c54dda66522 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:11.864422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:11.865193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:11.875502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.879439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.881384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.882021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.942261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 HTTP/1.1 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f4aa7ac0-2fe6-4523-9195-33e40f831359'} May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:40:11.945086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f7919e3-799b-46ce-ab19-5a21ae3fd49c tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 404 len: 111 microversion: 2.1 time: 0.086023 May 10 02:40:11.951121 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2659/5266] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:40:11 2022] DELETE /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:11.954269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:11.954906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: f4aa7ac0-2fe6-4523-9195-33e40f831359] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:11.967735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.968376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:11.969465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:11.969923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:12.012437 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 HTTP/1.1 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f4aa7ac0-2fe6-4523-9195-33e40f831359'} May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:12.013999 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. May 10 02:40:12.018993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:12.019652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance f4aa7ac0-2fe6-4523-9195-33e40f831359 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:12.020241 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74d19718-e40e-4079-ad04-120be7c3f50d tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359" status: 404 len: 111 microversion: 2.1 time: 0.069835 May 10 02:40:12.021123 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2608/5267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:11 2022] GET /compute/v2.1/servers/f4aa7ac0-2fe6-4523-9195-33e40f831359 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:12.513287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:12.514751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:12.521986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:12.526084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:12.535517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:12.536213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:13.207677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:13.236518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:13.241346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:13.250402 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d70fa44-31a5-4777-9c3f-4ddab4c9c63b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.741041 May 10 02:40:13.251862 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2660/5268] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:12 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:14.270703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:14.270703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:14.297980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:14.305716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:14.306967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:14.307572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:14.793012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:14.819252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:14.820562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:14.823518 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18d227d1-3681-435e-b99d-ad6820c2a744 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.557648 May 10 02:40:14.826028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2609/5269] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:14 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:15.844604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:15.845380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:15.860300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:15.868882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:15.871331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:15.879821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:16.537834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:16.559890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:16.567051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:16.571913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afcb0e7f-c511-4981-be97-ba8dc8dc208e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.731736 May 10 02:40:16.573043 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2661/5270] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:15 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:17.591302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:17.592114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:17.600174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:17.610691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:17.611588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:17.612050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:18.152326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:18.169227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:18.170529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:18.171935 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5c22461-a37f-4e7d-ad5f-51ebeec8f1b2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.584727 May 10 02:40:18.172533 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2610/5271] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:17 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:19.191083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:19.193769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:19.215684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:19.216441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:19.217635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:19.218355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:19.782171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:19.798308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:19.805845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:19.810616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41a9c3ed-d61c-43e9-9c6f-d9ce1ecb5649 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.623010 May 10 02:40:19.811758 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2662/5272] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:19 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:20.832606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:20.841519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:20.855373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:20.855847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:20.856668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:20.857125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:21.397567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:21.414166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:21.415673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:21.416858 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5b43c2e3-cb81-4edf-b382-6bdbb211e711 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.589942 May 10 02:40:21.431373 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2611/5273] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:20 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:22.439645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:22.440983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:22.452765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:22.455701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:22.457487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:22.459618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:22.852387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba73bf7c-6780-48cf-9ba1-7b1294697160 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Action: 'create', calling method: .version_select at 0x7f3d3630e8b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1767419357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1i9CxM7D09w0A4YmNWOHqVHDNDUFUU8p0SEH09oBdu3gi59zHvOuFIpZh1JI5Jq0NWvFuBv74+Y7+aHmqwv19vZlA7KOSm7hV95lbnlkCDQQuHxLCJG1OvWa9w2OR3vQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:40:22.903765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ba73bf7c-6780-48cf-9ba1-7b1294697160 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Getting quotas for project 427fd13845524abfa44ac6869999d2d3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:40:22.925907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ba73bf7c-6780-48cf-9ba1-7b1294697160 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Getting quotas for user f8078381eed748e2bdb2c8d630fb8981 and project 427fd13845524abfa44ac6869999d2d3. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:40:22.944194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:22.961722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:22.970047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:22.972447 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-78da6e5b-af12-4e92-ab54-7309920c0ce6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.537247 May 10 02:40:22.973554 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ba73bf7c-6780-48cf-9ba1-7b1294697160 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.666045 May 10 02:40:22.975444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2663/5274] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:40:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:40:22.983482 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2612/5275] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:22 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:23.998152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:23.999489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:24.012826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:24.013688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:24.016545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:24.017344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:24.544770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:24.577507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:24.579178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:24.580388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ded95726-769b-4abd-b913-4a9d7c6a2297 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.587957 May 10 02:40:24.597419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2664/5276] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:23 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:25.621788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:25.622407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:25.637993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:25.638456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:25.639288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:25.639733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:26.177544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:26.187533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:26.189737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:26.191151 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b35d2f3-a6c0-41ef-9529-0a4d6b03cf69 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.573509 May 10 02:40:26.192201 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2613/5277] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:25 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:27.213647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:27.215761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:27.245255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:27.247554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:27.248978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:27.251343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:27.476587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:27.477175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:27.485523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:27.485997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:27.486778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:27.487254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:27.549900 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff HTTP/1.1 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '868a9602-d66a-4a42-b74c-48bd9bc11aff'} May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:40:27.554079 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:27.559734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a84b327-ba92-450e-af7e-8abb2d57d2e7 tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 404 len: 111 microversion: 2.1 time: 0.083986 May 10 02:40:27.562971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2614/5278] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:40:27 2022] DELETE /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:27.577271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:27.581116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] [instance: 868a9602-d66a-4a42-b74c-48bd9bc11aff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:27.600696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:27.601259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:27.602072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:27.605516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:27.645558 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] HTTP exception thrown: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Request method failure captured: May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff HTTP/1.1 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec6IV4z8QtfLF3JkhGj3JteuJCEWUrP7fXjAru7akFdzcEnIkjRY7z9n8tZ_GnBCca0_iZdGdACTEZym_z3kzAIMq4MKrd6A5CqDrSMlwKKDN1PzHCuy0mBSiPAt1-60Xvs3k6VHQKO_ESvTMPw1U_aQwMB-iGUzfw_stYUDHmcNTTc May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e530b3feb70b459f83910d6e4ced55da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e530b3feb70b459f83910d6e4ced55da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e530b3feb70b459f83910d6e4ced55da May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870239260 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 614ccf5942ce45fa83ba9999e23aea03 May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-AttachVolumeNegativeTest-870239260-project May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '868a9602-d66a-4a42-b74c-48bd9bc11aff'} May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:27.650657 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:27.655376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] Returning 404 to user: Instance 868a9602-d66a-4a42-b74c-48bd9bc11aff could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:27.657922 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9183121-3e39-47e6-b836-65ce129f466a tempest-AttachVolumeNegativeTest-870239260 tempest-AttachVolumeNegativeTest-870239260-project] 10.222.0.52 "GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff" status: 404 len: 111 microversion: 2.1 time: 0.090641 May 10 02:40:27.663378 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2615/5279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:27 2022] GET /compute/v2.1/servers/868a9602-d66a-4a42-b74c-48bd9bc11aff => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:27.773002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:27.782079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:27.783633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:27.785087 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc16096f-7820-477c-a9ae-c3b2d0296400 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.578760 May 10 02:40:27.796419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2665/5280] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:27 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:28.806072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:28.821473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:28.855200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:28.859735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:28.869281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:28.871369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:29.194018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:29.213460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:29.220724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:29.224049 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a8502d2-ed6c-4e2b-8333-c8c69f1e92ab tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.424558 May 10 02:40:29.227410 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2616/5281] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:28 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:30.243449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:30.244140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:30.260760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:30.261233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:30.262060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:30.262519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:31.219697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:31.252611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:31.281471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:31.291172 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33b2d1b9-eda0-4002-bc41-e96b8ec155cb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.048944 May 10 02:40:31.295700 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2666/5282] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:30 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:32.314871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:32.316152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:32.337248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:32.339652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:32.345132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:32.347173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:32.956131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:32.980732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:32.987352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:32.990458 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72125431-2d14-44dd-a924-4e8d8ef95c95 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.678878 May 10 02:40:32.992859 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2617/5283] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:32 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:34.013925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:34.015009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:34.042271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:34.044323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:34.056968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:34.058277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:34.653838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:34.691844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:34.699002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:34.706853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b01869c2-0ece-432f-963b-0fc128bb5508 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.698412 May 10 02:40:34.719099 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2667/5284] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:34 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:35.731528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:35.733140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:35.749754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:35.758596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:35.761834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:35.762745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:36.394127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:36.414526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:36.418319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:36.422271 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9275f3ea-9acd-4457-89b3-65c0349e483d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.696059 May 10 02:40:36.425179 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2618/5285] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:35 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:37.443654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:37.444943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:37.459682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:37.461573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:37.462590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:37.465440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:38.287837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:38.300579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:38.302676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:38.313502 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6378b630-437d-4e31-9ada-9686da40884b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.874368 May 10 02:40:38.315632 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2668/5286] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:37 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:39.335089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:39.337514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:39.354937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:39.360956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:39.363131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:39.365841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:40.023893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:40.041401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:40.048191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:40.051319 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ec7d41d-7cd6-42e3-9696-fa2607bbe5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.721347 May 10 02:40:40.063895 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2619/5287] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:39 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:41.083387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:41.087550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:41.109126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:41.111507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:41.114518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:41.121430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:41.663430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:41.682603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:41.688999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:41.691898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c161d02f-5711-4a53-b622-0bdb5c4a0d62 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.621523 May 10 02:40:41.706755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2669/5288] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:41 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:40:42.714322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:42.715817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:42.744193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:42.759527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:42.762115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:42.764121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:44.081485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:44.103243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:44.112142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:44.117090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a73a3274-c9f0-493a-b4a6-a2ed4cd28928 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.407570 May 10 02:40:44.132970 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2620/5289] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:42 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:44.900683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1568486505-access_point-763227567", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "b5cb364e-eac4-4a49-8cef-373621f87bb6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1767419357", "security_groups": [{"name": "tempest-secgroup_access--643236643"}, {"name": "tempest-secgroup_general--684216116"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:40:45.138581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:45.139301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:45.156040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:45.156538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:45.164118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:45.164708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:45.386139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] validate_networks() for [('b5cb364e-eac4-4a49-8cef-373621f87bb6', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:40:46.012146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:46.038291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:46.044199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:46.055796 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c365e7e3-03e2-4f61-bae1-97381ff89f35 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.910953 May 10 02:40:46.073447 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2621/5290] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:45 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:47.038913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:40:47.039519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:40:47.039844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:40:47.040268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:40:47.040695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:40:47.048589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42f5b012-0183-4bbc-8a2b-9aa5482fd766 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Action: 'create', calling method: .version_select at 0x7f3d35c07b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-992801733", "metadata": {"Type": "work"}}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42f5b012-0183-4bbc-8a2b-9aa5482fd766 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Request method failure captured: May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 121 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedCug9JS_VIccDHJSknCt2wRj-Jvw_SDwm99kUbo9gGiO4s93xXtLsJnxQirpAlX4e3P-aJ2Nm2vep30CeO4-XWgjx8pFICrdvA5wylzEEseIgVWKZOYbK3DrJ-IKZyXz44kCrclIbIC2xHromgTL18y_xWYMGDD4AebVCRdPEY7-ME May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46b5a7daf8d040beb2d567a3994834f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 712f533f2f2c45628ca4a7f666074d4e May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-992801733", "metadata": {"Type": "work"}}} May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-992801733', 'metadata': {'Type': 'work'}}}} May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi '#$%' May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:40:47.052756 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 02:40:47.055839 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.063252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42f5b012-0183-4bbc-8a2b-9aa5482fd766 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:47.064430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42f5b012-0183-4bbc-8a2b-9aa5482fd766 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.239099 May 10 02:40:47.065217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2622/5291] 10.222.0.52 () {60 vars in 1155 bytes} [Tue May 10 02:40:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 02:40:47.071434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:47.071911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:47.074610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:47.075120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:47.078490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:47.079498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:47.087934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:47.088723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:47.089738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:47.090397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:47.139858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Getting quotas for project 427fd13845524abfa44ac6869999d2d3. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:40:47.162538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Getting quotas for user f8078381eed748e2bdb2c8d630fb8981 and project 427fd13845524abfa44ac6869999d2d3. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:40:47.198705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:40:47.203788 n-d-841089-2 devstack@n-api.service[118716]: WARNING nova.utils [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1568486505-access_point-763227567 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1568486505-ac May 10 02:40:47.205525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:40:47.331178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c4ff471-40c6-4e15-9526-8e45b0fd1b15 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.433237 May 10 02:40:47.332400 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2670/5292] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:40:44 2022] POST /compute/v2.1/servers => generated 456 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:40:47.341011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdf9e2c-9f6d-4784-af40-f08c8cb9a2cc tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Action: 'create', calling method: .version_select at 0x7f3d36328040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-404131865", "metadata": {"Type": "work"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdf9e2c-9f6d-4784-af40-f08c8cb9a2cc tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Request method failure captured: May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 119 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedCug9JS_VIccDHJSknCt2wRj-Jvw_SDwm99kUbo9gGiO4s93xXtLsJnxQirpAlX4e3P-aJ2Nm2vep30CeO4-XWgjx8pFICrdvA5wylzEEseIgVWKZOYbK3DrJ-IKZyXz44kCrclIbIC2xHromgTL18y_xWYMGDD4AebVCRdPEY7-ME May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46b5a7daf8d040beb2d567a3994834f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 712f533f2f2c45628ca4a7f666074d4e May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-404131865", "metadata": {"Type": "work"}}} May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-404131865', 'metadata': {'Type': 'work'}}}} May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '0' May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:40:47.357347 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdf9e2c-9f6d-4784-af40-f08c8cb9a2cc tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:47.360431 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afdf9e2c-9f6d-4784-af40-f08c8cb9a2cc tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022197 May 10 02:40:47.365362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2671/5293] 10.222.0.52 () {60 vars in 1155 bytes} [Tue May 10 02:40:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:40:47.378180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1841ddff-afff-4747-bf8b-be222cffa13f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:47.378840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1841ddff-afff-4747-bf8b-be222cffa13f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:47.552133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1841ddff-afff-4747-bf8b-be222cffa13f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:47.560095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1841ddff-afff-4747-bf8b-be222cffa13f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1294 microversion: 2.1 time: 0.189791 May 10 02:40:47.561802 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2672/5294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:47 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:40:47.575908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdc0fdc-ee3d-4572-8fc8-f784adc9dd6e tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Action: 'create', calling method: .version_select at 0x7f3d36e8a430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1457206703", "metadata": {"Type": "work"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdc0fdc-ee3d-4572-8fc8-f784adc9dd6e tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Request method failure captured: May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 119 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedCug9JS_VIccDHJSknCt2wRj-Jvw_SDwm99kUbo9gGiO4s93xXtLsJnxQirpAlX4e3P-aJ2Nm2vep30CeO4-XWgjx8pFICrdvA5wylzEEseIgVWKZOYbK3DrJ-IKZyXz44kCrclIbIC2xHromgTL18y_xWYMGDD4AebVCRdPEY7-ME May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46b5a7daf8d040beb2d567a3994834f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 712f533f2f2c45628ca4a7f666074d4e May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1457206703", "metadata": {"Type": "work"}}} May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1457206703', 'metadata': {'Type': 'work'}}}} May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise error May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi '' May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 02:40:47.588110 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-afdc0fdc-ee3d-4572-8fc8-f784adc9dd6e tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:47.591585 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-afdc0fdc-ee3d-4572-8fc8-f784adc9dd6e tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026647 May 10 02:40:47.597092 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2673/5295] 10.222.0.52 () {60 vars in 1155 bytes} [Tue May 10 02:40:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 02:40:47.614434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-192444d1-379e-469b-8d15-ea86adacbbde tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Calling method '.version_select at 0x7f3d374a33a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:47.716971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:47.732256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:47.733960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:47.735203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1081d4b-ed51-4595-8c2a-564f60f2e45d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.661477 May 10 02:40:47.739413 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2623/5296] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:47 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:47.759811 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-192444d1-379e-469b-8d15-ea86adacbbde tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] HTTP exception thrown: Volume tempest-invalid-2071253139 could not be found. May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-192444d1-379e-469b-8d15-ea86adacbbde tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Request method failure captured: May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2071253139 HTTP/1.1 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedCug9JS_VIccDHJSknCt2wRj-Jvw_SDwm99kUbo9gGiO4s93xXtLsJnxQirpAlX4e3P-aJ2Nm2vep30CeO4-XWgjx8pFICrdvA5wylzEEseIgVWKZOYbK3DrJ-IKZyXz44kCrclIbIC2xHromgTL18y_xWYMGDD4AebVCRdPEY7-ME May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46b5a7daf8d040beb2d567a3994834f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 712f533f2f2c45628ca4a7f666074d4e May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: exception: Volume tempest-invalid-2071253139 could not be found. May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'tempest-invalid-2071253139'} May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2071253139 could not be found. (HTTP 404) (Request-ID: req-7313ff1f-4bd6-4a66-a188-0cde79a6c42c) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:40:47.784983 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2071253139 could not be found. May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2071253139 could not be found. May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2071253139 could not be found. May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-192444d1-379e-469b-8d15-ea86adacbbde tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Returning 404 to user: Volume tempest-invalid-2071253139 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:47.788846 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-192444d1-379e-469b-8d15-ea86adacbbde tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2071253139" status: 404 len: 99 microversion: 2.1 time: 0.188438 May 10 02:40:47.799464 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2674/5297] 10.222.0.52 () {58 vars in 1217 bytes} [Tue May 10 02:40:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2071253139 => generated 99 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 02:40:47.799928 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bda85a81-0a52-4f26-8f1d-452711c47073 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004781 May 10 02:40:47.803470 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2624/5298] 10.222.0.52 () {58 vars in 1139 bytes} [Tue May 10 02:40:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 02:40:47.815228 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab40be90-4181-401d-ae78-ffb82efdb70b tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006680 May 10 02:40:47.819203 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2675/5299] 10.222.0.52 () {58 vars in 1136 bytes} [Tue May 10 02:40:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 02:40:47.837955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f71ea842-db80-46ba-aec3-4401dc694014 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Calling method '.version_select at 0x7f3d35c70dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:47.931153 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f71ea842-db80-46ba-aec3-4401dc694014 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] HTTP exception thrown: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f71ea842-db80-46ba-aec3-4401dc694014 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Request method failure captured: May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/os-volumes/1af8d703-bad2-4fef-9d7b-b5c64d07c97e HTTP/1.1 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedCug9JS_VIccDHJSknCt2wRj-Jvw_SDwm99kUbo9gGiO4s93xXtLsJnxQirpAlX4e3P-aJ2Nm2vep30CeO4-XWgjx8pFICrdvA5wylzEEseIgVWKZOYbK3DrJ-IKZyXz44kCrclIbIC2xHromgTL18y_xWYMGDD4AebVCRdPEY7-ME May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46b5a7daf8d040beb2d567a3994834f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 712f533f2f2c45628ca4a7f666074d4e May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: exception: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1af8d703-bad2-4fef-9d7b-b5c64d07c97e'} May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. (HTTP 404) (Request-ID: req-9f6d39c5-b87b-414d-b589-4962a7b09c0a) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:40:47.934007 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. May 10 02:40:47.937571 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:40:47.941115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f71ea842-db80-46ba-aec3-4401dc694014 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Returning 404 to user: Volume 1af8d703-bad2-4fef-9d7b-b5c64d07c97e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:47.943295 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f71ea842-db80-46ba-aec3-4401dc694014 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1af8d703-bad2-4fef-9d7b-b5c64d07c97e" status: 404 len: 109 microversion: 2.1 time: 0.114255 May 10 02:40:47.944077 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2625/5300] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:40:47 2022] DELETE /compute/v2.1/os-volumes/1af8d703-bad2-4fef-9d7b-b5c64d07c97e => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:47.956090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff90fcc3-f0cf-4b15-95f8-1a1accd66064 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Calling method '.version_select at 0x7f3d36198d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:48.010611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ff90fcc3-f0cf-4b15-95f8-1a1accd66064 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] HTTP exception thrown: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff90fcc3-f0cf-4b15-95f8-1a1accd66064 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Request method failure captured: May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-volumes/3592d986-8ddb-462c-a957-0fe392f9f716 HTTP/1.1 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedCug9JS_VIccDHJSknCt2wRj-Jvw_SDwm99kUbo9gGiO4s93xXtLsJnxQirpAlX4e3P-aJ2Nm2vep30CeO4-XWgjx8pFICrdvA5wylzEEseIgVWKZOYbK3DrJ-IKZyXz44kCrclIbIC2xHromgTL18y_xWYMGDD4AebVCRdPEY7-ME May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46b5a7daf8d040beb2d567a3994834f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46b5a7daf8d040beb2d567a3994834f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesNegativeTest-1191828821 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 46b5a7daf8d040beb2d567a3994834f6 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesNegativeTest-1191828821 May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 712f533f2f2c45628ca4a7f666074d4e May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesNegativeTest-1191828821-project May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: exception: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '3592d986-8ddb-462c-a957-0fe392f9f716'} May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. (HTTP 404) (Request-ID: req-48323635-c220-4e6a-b4ce-fe8570c03569) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:40:48.012925 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff90fcc3-f0cf-4b15-95f8-1a1accd66064 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] Returning 404 to user: Volume 3592d986-8ddb-462c-a957-0fe392f9f716 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff90fcc3-f0cf-4b15-95f8-1a1accd66064 tempest-VolumesNegativeTest-1191828821 tempest-VolumesNegativeTest-1191828821-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3592d986-8ddb-462c-a957-0fe392f9f716" status: 404 len: 109 microversion: 2.1 time: 0.063545 May 10 02:40:48.022569 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2676/5301] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:40:47 2022] GET /compute/v2.1/os-volumes/3592d986-8ddb-462c-a957-0fe392f9f716 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:40:48.584874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:48.585579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:48.604696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:48.605932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:48.608921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:48.610965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:48.759935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:48.760568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:48.790807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:48.791312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:48.792126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:48.792576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:48.908279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:48.926150 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3cbab22c-be88-4c46-9647-c8d07eaf3aad tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1290 microversion: 2.1 time: 0.346089 May 10 02:40:48.931751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2626/5302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:48 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1290 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:40:49.446228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:49.467747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:49.469562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:49.472461 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72d6c717-e17f-414c-b3f2-03928166a62d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.720995 May 10 02:40:49.507997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2677/5303] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:48 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:49.944014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:49.944659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:49.965372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:49.972572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:49.977064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:49.978229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:50.287302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:50.298229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e1991ba-725e-4e67-b073-0caba4b719fb tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1352 microversion: 2.1 time: 0.359391 May 10 02:40:50.302001 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2627/5304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:49 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1352 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:40:50.496753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:50.497386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:50.513083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:50.513623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:50.514518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:50.519242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:51.318013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:51.319389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:51.337298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:51.339140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:51.347482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:51.348794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:52.010671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:52.019851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:52.021372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:52.022552 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ece7b65c-c561-45b7-b3da-0c67b5e8ffaa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.531920 May 10 02:40:52.030195 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2678/5305] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:50 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:52.394482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:52.409236 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef5edc09-be38-4817-bb64-629c02a4671e tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 1.095159 May 10 02:40:52.421060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2628/5306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:51 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:40:53.041646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:53.042450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:53.060902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:53.064946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:53.072123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:53.072900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:53.429458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:53.430216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:53.448189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:53.448656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:53.456916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:53.457484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:53.667819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:53.680556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:53.684152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:53.685544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-921ab2c2-f28d-4c62-856d-c4fad9e4a83b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 0.648232 May 10 02:40:53.691400 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2679/5307] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:53 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:54.551829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:54.574032 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-690c4c00-349f-4991-bbbe-880e185f4061 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 1.138578 May 10 02:40:54.576388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2629/5308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:53 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:40:54.708981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:54.709604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:54.721782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:54.722246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:54.723083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:54.723528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:55.595043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:55.596488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:55.612693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:55.615405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:55.616613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:55.617490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:56.389201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:56.407710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:56.413140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:56.417148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f844636-7651-4abe-9d32-932bcd685c30 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1887 microversion: 2.42 time: 1.711164 May 10 02:40:56.424618 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2680/5309] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:54 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1887 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:56.439551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-79d7d28e-baa7-4e4e-9765-57a996e47b2a req-3a3b623f-d367-47a1-b352-29a5d917b6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f", "tag": "598b389f-a941-4599-b4cf-67afb7f5d035"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:40:56.462140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-79d7d28e-baa7-4e4e-9765-57a996e47b2a req-3a3b623f-d367-47a1-b352-29a5d917b6b3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:56.464380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-79d7d28e-baa7-4e4e-9765-57a996e47b2a req-3a3b623f-d367-47a1-b352-29a5d917b6b3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:56.498175 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-79d7d28e-baa7-4e4e-9765-57a996e47b2a req-3a3b623f-d367-47a1-b352-29a5d917b6b3 service nova] Creating event network-changed:598b389f-a941-4599-b4cf-67afb7f5d035 for instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f on n-h2-841089-2 May 10 02:40:56.533748 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-79d7d28e-baa7-4e4e-9765-57a996e47b2a req-3a3b623f-d367-47a1-b352-29a5d917b6b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106191 May 10 02:40:56.540506 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2681/5310] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:40:56.547195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:56.569947 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ed7f59f-db07-4881-ba3f-3a64c4250277 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 0.972304 May 10 02:40:56.572732 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2630/5311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:55 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:40:57.446496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:57.448073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:57.515001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:57.516614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:57.518564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:57.519977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:57.589145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:57.590594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:57.602575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:57.603044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:57.621178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:57.646728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:58.364860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:58.391590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:58.393464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:58.395233 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-08d0a179-f92b-4c4a-bcd8-768252b576fc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.954971 May 10 02:40:58.395801 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2682/5312] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:57 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:40:58.505655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:40:58.513942 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-090259c9-1ec1-46ea-a0de-8418a0b99fc1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 0.928626 May 10 02:40:58.521025 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2631/5313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:57 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:40:59.414498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:59.415747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:59.430044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:59.433513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:59.436009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:59.443765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:59.536928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:40:59.538250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:40:59.550913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:59.551578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:40:59.553883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:40:59.554490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:00.652741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:00.662880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:00.672382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:00.673614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f080758-17d7-43d3-8f5f-d8a43efb1458 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 1.263573 May 10 02:41:00.674188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2683/5314] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:40:59 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:41:00.704063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:00.721879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f28031b9-be01-43cb-8dc0-94efa5547127 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 1.183756 May 10 02:41:00.723316 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2632/5315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:40:59 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:01.704335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:01.708774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:01.740187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:01.741583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:01.744805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:01.745324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:01.746178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:01.746629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:01.753240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:01.757667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:01.758833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:01.760871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:02.242264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:02.251362 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96aaf486-ff18-4928-8aed-545d51e951bf tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 0.515243 May 10 02:41:02.272738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2633/5316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:01 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:02.570294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:02.599061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:02.611188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:02.621591 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3f261c3-8681-4259-a604-53b4898fe3c2 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.918489 May 10 02:41:02.635673 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2684/5317] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:01 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:03.269277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:03.271080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:03.281596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:03.284705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:03.286722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:03.288455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:03.643407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:03.644019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:03.656376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:03.656782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:03.657602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:03.658061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:03.664737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:03.672376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-510776be-1130-41a9-9a3a-ab9473f6feda tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 0.407307 May 10 02:41:03.672971 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2634/5318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:03 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:04.044532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-598565ee-aa12-4894-9bb9-5800cf52307b req-731b612f-9bc3-4e32-b658-0c8801f69a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f", "name": "network-vif-plugged", "status": "completed", "tag": "598b389f-a941-4599-b4cf-67afb7f5d035"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:04.074837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-598565ee-aa12-4894-9bb9-5800cf52307b req-731b612f-9bc3-4e32-b658-0c8801f69a55 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:04.079227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-598565ee-aa12-4894-9bb9-5800cf52307b req-731b612f-9bc3-4e32-b658-0c8801f69a55 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:04.122376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-598565ee-aa12-4894-9bb9-5800cf52307b req-731b612f-9bc3-4e32-b658-0c8801f69a55 service nova] Creating event network-vif-plugged:598b389f-a941-4599-b4cf-67afb7f5d035 for instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f on n-h2-841089-2 May 10 02:41:04.139447 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-598565ee-aa12-4894-9bb9-5800cf52307b req-731b612f-9bc3-4e32-b658-0c8801f69a55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096005 May 10 02:41:04.143598 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2635/5319] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:41:04.154032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:04.185504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:04.192475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:04.193853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37cb6561-8e08-4e83-9191-47dd17656bfa tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.554684 May 10 02:41:04.196819 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2685/5320] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:03 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:04.690255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:04.691559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:04.711683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:04.712064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:04.712923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:04.717177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:05.077189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:05.092213 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ecd8b7f4-74be-404b-bb69-d1efefefe42d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1470 microversion: 2.1 time: 0.405892 May 10 02:41:05.093584 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2636/5321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:04 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:05.218075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:05.219023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:05.246632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:05.251384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:05.252380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:05.254047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:05.747476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:05.764561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:05.766862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:05.769150 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e7d4b3f-9814-42cd-911b-6c97585d0628 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.557239 May 10 02:41:05.795790 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2686/5322] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:05 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:06.110466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:06.111127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:06.123904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.124369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.125175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.125620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.507164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:06.524146 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a9bd1fb0-f8ac-4f85-bf51-aeaaf4795e35 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1643 microversion: 2.1 time: 0.416158 May 10 02:41:06.525630 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2637/5323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:06 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1643 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:06.542975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:06.544104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:06.557139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.558978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.559967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.561849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.790996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:06.791658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:06.810915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.811892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.814561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.817884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.894035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:06.902566 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3375d8c7-b938-45fb-ad42-8782a26ed981 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1643 microversion: 2.1 time: 0.364331 May 10 02:41:06.903377 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2687/5324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:06 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1643 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:06.924181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:06.927216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:06.943270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.944483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:06.945786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:06.948522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:07.498732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:07.522486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:07.525524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:07.527521 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e63d1c20-8a4f-4d7b-a1ff-07ce5d04ef44 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.741086 May 10 02:41:07.528587 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2638/5325] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:06 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:41:08.083095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cb0b8971-06e1-47c0-beea-41602a106ebf tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1794 microversion: 2.1 time: 1.165073 May 10 02:41:08.085192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2688/5326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:06 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1794 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:08.558301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:08.560063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:08.570145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:08.570994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:08.572843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:08.573551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:09.217533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:09.231632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:09.235607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:09.236720 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c4e09d5-7694-4332-ba10-49f237ca6695 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.686344 May 10 02:41:09.242666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2639/5327] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:08 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:10.256921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:10.257555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:10.271293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:10.272226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:10.273647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:10.275038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:10.550100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:10.562009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:10.564456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:10.565659 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c51eb3bb-3340-4342-a1a9-a5f4814ebf8c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.314208 May 10 02:41:10.568444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2689/5328] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:10 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:11.585422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:11.589134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:11.608021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:11.610567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:11.611662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:11.614187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:12.358627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:12.372107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:12.377275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:12.387333 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a89bd6c1-29c9-40ff-8c9a-f0ebc2fa4754 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.800658 May 10 02:41:12.404185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2640/5329] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:11 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:12.819961 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 02:41:12.820741 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 02:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 02:41:13.413215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:13.414500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:13.429854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:13.430548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:13.431627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:13.432296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:13.646339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c0f3e398-b716-4c0a-9b16-24a16cf0a6f1 req-cad8579f-e61a-4449-823b-14d790f899eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f", "tag": "598b389f-a941-4599-b4cf-67afb7f5d035"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:13.673540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c0f3e398-b716-4c0a-9b16-24a16cf0a6f1 req-cad8579f-e61a-4449-823b-14d790f899eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:13.674186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c0f3e398-b716-4c0a-9b16-24a16cf0a6f1 req-cad8579f-e61a-4449-823b-14d790f899eb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:13.704360 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c0f3e398-b716-4c0a-9b16-24a16cf0a6f1 req-cad8579f-e61a-4449-823b-14d790f899eb service nova] Creating event network-changed:598b389f-a941-4599-b4cf-67afb7f5d035 for instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f on n-h2-841089-2 May 10 02:41:13.724927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c0f3e398-b716-4c0a-9b16-24a16cf0a6f1 req-cad8579f-e61a-4449-823b-14d790f899eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083122 May 10 02:41:13.736489 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2641/5330] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:41:14.378415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:14.387891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:14.396982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:14.406721 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b697dd2-b226-411d-8380-ac707c2f8b12 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.999198 May 10 02:41:14.407573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2690/5331] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:13 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:15.435374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:15.436741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:15.463160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:15.463959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:15.465258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:15.465831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:16.346875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:16.357406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:16.371605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:16.372998 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38dcf7d8-360e-4b62-8048-fe3cea96fd6e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.943185 May 10 02:41:16.376359 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2642/5332] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:15 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:41:17.396189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:17.398272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:17.405624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:17.406128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:17.406938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:17.424241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:17.852844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:17.900486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:17.902717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:17.905222 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b6bc462b-afc2-4926-881b-aa236ed890f7 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.512600 May 10 02:41:17.919030 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2691/5333] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:17 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:18.924404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:18.925801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:18.945774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:18.946592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:18.947638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:18.948289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:19.657775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:19.680721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:19.693398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:19.699667 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c99ab2bd-91bc-4002-92a3-217c117f8bbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.778944 May 10 02:41:19.720553 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2643/5334] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:18 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:20.737003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:20.741000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:20.768041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:20.771468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:20.775215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:20.777318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:21.950124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:21.964025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:21.983723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:21.986670 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d257a1bd-5060-4f32-98c5-19a43f1360bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 1.259370 May 10 02:41:21.992484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2692/5335] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:20 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:23.008174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:23.008793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:23.021340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:23.023691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:23.024747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:23.026771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:23.883033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ca63f497-3a25-475b-ac36-48fc7ad7840f req-4f2eef33-09f4-4a0b-9f8b-a9e2e3bdbec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "ebcbedbd-f752-4ab1-929f-8e485c0ceed3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:23.922454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ca63f497-3a25-475b-ac36-48fc7ad7840f req-4f2eef33-09f4-4a0b-9f8b-a9e2e3bdbec4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:23.935834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ca63f497-3a25-475b-ac36-48fc7ad7840f req-4f2eef33-09f4-4a0b-9f8b-a9e2e3bdbec4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:23.978601 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ca63f497-3a25-475b-ac36-48fc7ad7840f req-4f2eef33-09f4-4a0b-9f8b-a9e2e3bdbec4 service nova] Creating event network-vif-plugged:ebcbedbd-f752-4ab1-929f-8e485c0ceed3 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:24.006858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ca63f497-3a25-475b-ac36-48fc7ad7840f req-4f2eef33-09f4-4a0b-9f8b-a9e2e3bdbec4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130107 May 10 02:41:24.014581 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2693/5336] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:41:24.167798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:24.184349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:24.186418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:24.187924 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72d6283d-8a13-4ad2-bb7b-f14c312e1a28 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 1.183724 May 10 02:41:24.203487 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2644/5337] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:23 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:25.223829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:25.224574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:25.252164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:25.252645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:25.253508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:25.253967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:25.669804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:25.681683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:25.683640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:25.685014 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f89cbaf-8501-4970-8f61-55e71b4c329a tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.467307 May 10 02:41:25.686204 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2694/5338] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:25 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:26.078533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2c78814c-1615-40a3-ac16-3ed06ff5820c req-072fac18-7563-420c-b1ad-49c6c841b1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "524ef9b2-c4b1-4920-9b01-d6a636efe97c"}, {"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "03d41542-4a81-4658-b31f-590f0f2ea996"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:26.098588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2c78814c-1615-40a3-ac16-3ed06ff5820c req-072fac18-7563-420c-b1ad-49c6c841b1f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:26.105018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2c78814c-1615-40a3-ac16-3ed06ff5820c req-072fac18-7563-420c-b1ad-49c6c841b1f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:26.141485 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2c78814c-1615-40a3-ac16-3ed06ff5820c req-072fac18-7563-420c-b1ad-49c6c841b1f9 service nova] Creating event network-vif-plugged:524ef9b2-c4b1-4920-9b01-d6a636efe97c for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:26.142013 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2c78814c-1615-40a3-ac16-3ed06ff5820c req-072fac18-7563-420c-b1ad-49c6c841b1f9 service nova] Creating event network-vif-plugged:03d41542-4a81-4658-b31f-590f0f2ea996 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:26.164294 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2c78814c-1615-40a3-ac16-3ed06ff5820c req-072fac18-7563-420c-b1ad-49c6c841b1f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089327 May 10 02:41:26.165527 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2645/5339] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:41:26.704921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:26.706283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:26.721020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:26.721826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:26.722821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:26.723727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:27.138988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:27.165330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:27.171622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:27.173708 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6008aea-f125-4078-8067-255a3ba5c9a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.472893 May 10 02:41:27.176137 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2695/5340] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:26 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:28.196371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:28.197087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:28.212867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:28.231346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:28.232212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:28.232662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:28.305137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "b29b86f4-aa60-4bf8-9ce5-f4154354e21b"}, {"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "8ebe326a-6371-48e0-b2c2-fc7da49b1838"}, {"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "17ea3ba3-bf94-49d0-a60f-8818331d1f75"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:28.334941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:28.337408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:28.377291 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] Creating event network-vif-plugged:b29b86f4-aa60-4bf8-9ce5-f4154354e21b for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:28.383853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] Creating event network-vif-plugged:8ebe326a-6371-48e0-b2c2-fc7da49b1838 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:28.385544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] Creating event network-vif-plugged:17ea3ba3-bf94-49d0-a60f-8818331d1f75 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:28.405721 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5705a3cd-e341-4fb5-bc04-b0cda815354c req-a4669a6e-6a4d-4b6b-9360-82e93e4102fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.102304 May 10 02:41:28.409560 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2696/5341] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:41:28.696767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-675187233", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:28.807659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] validate_networks() for None {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:41:29.625986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:29.644656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:29.649728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:29.652893 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7253b3bc-eaf7-477f-9a4b-5bfed918e1bc tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 1.460901 May 10 02:41:29.655631 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2646/5342] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:28 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:41:29.715032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:41:29.715527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:41:29.715977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:41:29.716399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:41:29.716975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:41:29.727651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:29.728287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:29.729430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:29.730197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:29.750315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Getting quotas for project 4c07d8f43529458c92d0a8b295e80a24. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:41:29.757584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Getting quotas for user e8e9f24a36da401cb418aab8edc0f683 and project 4c07d8f43529458c92d0a8b295e80a24. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:41:29.773278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:41:29.776298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:41:29.834041 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a05352cd-2e26-4906-9971-f2ee518ddfac tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143675 May 10 02:41:29.835051 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2697/5343] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:41:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:41:29.847966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7fc2ea8-710f-4fc4-9d3f-6c65ce9549f8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:29.851662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e7fc2ea8-710f-4fc4-9d3f-6c65ce9549f8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:29.966998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e7fc2ea8-710f-4fc4-9d3f-6c65ce9549f8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:29.980206 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7fc2ea8-710f-4fc4-9d3f-6c65ce9549f8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1214 microversion: 2.1 time: 0.137652 May 10 02:41:29.994237 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2647/5344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:29 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:30.473943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4d5e7d08-ddb3-4506-8427-0b20ca3a46b8 req-f850730f-983f-41c0-8ff4-2269cedf52b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-plugged", "status": "completed", "tag": "915b783c-c028-4503-95c9-c4a588f78d66"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:30.495434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4d5e7d08-ddb3-4506-8427-0b20ca3a46b8 req-f850730f-983f-41c0-8ff4-2269cedf52b4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:30.496226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4d5e7d08-ddb3-4506-8427-0b20ca3a46b8 req-f850730f-983f-41c0-8ff4-2269cedf52b4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:30.519301 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4d5e7d08-ddb3-4506-8427-0b20ca3a46b8 req-f850730f-983f-41c0-8ff4-2269cedf52b4 service nova] Creating event network-vif-plugged:915b783c-c028-4503-95c9-c4a588f78d66 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:30.546029 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4d5e7d08-ddb3-4506-8427-0b20ca3a46b8 req-f850730f-983f-41c0-8ff4-2269cedf52b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094191 May 10 02:41:30.546699 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2698/5345] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:41:30.674168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:30.675784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:30.685834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:30.691683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:30.692707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:30.693310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:30.999313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:31.000033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:31.013628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:31.014093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:31.014902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:31.015703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:31.223748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:31.255505 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-850a8a60-c1c9-46e2-af71-815f77de1c58 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1210 microversion: 2.1 time: 0.249857 May 10 02:41:31.256507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2699/5346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:30 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1210 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:41:31.262418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:31.275369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:31.277702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:31.279304 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3b64bc94-d161-41af-8ae6-2fd6e9d63675 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.610226 May 10 02:41:31.280222 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2648/5347] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:30 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:32.275747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:32.276613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:32.292067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:32.300913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:32.301554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:32.306837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:32.310972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:32.311467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:32.312961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:32.314253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:32.319623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:32.320093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:32.730776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:32.744130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53d519cd-9135-40f2-aefa-e743aab1f8b4 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1272 microversion: 2.1 time: 0.473090 May 10 02:41:32.747116 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2700/5348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:32 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:41:32.955926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:32.966162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:32.978377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:32.982279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1bc3f346-9f92-49d2-8370-545d0f9460e1 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1875 microversion: 2.42 time: 0.685527 May 10 02:41:32.997685 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2649/5349] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:32 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1875 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:33.767731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:33.769666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:33.786705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:33.789959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:33.790873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:33.791768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:34.002574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:34.004630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:34.017326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:34.027658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:34.028678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:34.029281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:34.481079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:34.493982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3f2e33b-6459-46e7-b5c2-a8fe20a30be7 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.730267 May 10 02:41:34.494908 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2701/5350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:33 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:34.565397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:34.579184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:34.587624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:34.589320 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff03409c-bdb3-4d0f-b734-cc6bd5740ea8 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2834 microversion: 2.42 time: 0.591104 May 10 02:41:34.590325 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2650/5351] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:41:33 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2834 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:34.612943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:34.614139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:34.628468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:34.629036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:34.629905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:34.630435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:34.935864 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5678cefe-9538-4c69-8a96-807b9db0d5bd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.327863 May 10 02:41:34.937404 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2702/5352] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:41:34 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04/os-interface => generated 1833 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:41:35.512302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:35.513044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:35.538764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:35.548286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:35.550695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:35.552472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:36.065988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:36.080322 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aca70a4b-1fc9-4ee2-ab02-1eda2253b084 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.566612 May 10 02:41:36.081915 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2651/5353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:35 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:36.490977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-de34be88-eb04-486e-b3a9-7b45d5d5b493 req-a82a236b-fb64-4e27-b422-ae8b81d6edf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e30d31a-d820-4cef-9455-9da4ba4dc4b3", "tag": "ff3ff5d4-e598-43d7-b3d1-50fddd58fd11"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:36.507637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-de34be88-eb04-486e-b3a9-7b45d5d5b493 req-a82a236b-fb64-4e27-b422-ae8b81d6edf0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:36.508288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-de34be88-eb04-486e-b3a9-7b45d5d5b493 req-a82a236b-fb64-4e27-b422-ae8b81d6edf0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:36.523594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-de34be88-eb04-486e-b3a9-7b45d5d5b493 req-a82a236b-fb64-4e27-b422-ae8b81d6edf0 service nova] Creating event network-changed:ff3ff5d4-e598-43d7-b3d1-50fddd58fd11 for instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 on n-h2-841089-2 May 10 02:41:36.529581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-de34be88-eb04-486e-b3a9-7b45d5d5b493 req-a82a236b-fb64-4e27-b422-ae8b81d6edf0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044236 May 10 02:41:36.530715 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2703/5354] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:41:37.098564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:37.100750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:37.117158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:37.117619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:37.118423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:37.118870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:37.964772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:37.976233 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f10687cb-700c-4594-a9ba-1a7ff53cf2b8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.882390 May 10 02:41:37.977145 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2652/5355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:37 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:38.735572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ee51e0d1-d460-452f-87b3-9ec01fdeec1b req-6b3d61d3-7cca-41eb-b3f9-465f976e19fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "tag": "03d41542-4a81-4658-b31f-590f0f2ea996"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:38.748706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ee51e0d1-d460-452f-87b3-9ec01fdeec1b req-6b3d61d3-7cca-41eb-b3f9-465f976e19fa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:38.749510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ee51e0d1-d460-452f-87b3-9ec01fdeec1b req-6b3d61d3-7cca-41eb-b3f9-465f976e19fa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:38.776607 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ee51e0d1-d460-452f-87b3-9ec01fdeec1b req-6b3d61d3-7cca-41eb-b3f9-465f976e19fa service nova] Creating event network-changed:03d41542-4a81-4658-b31f-590f0f2ea996 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:41:38.785469 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ee51e0d1-d460-452f-87b3-9ec01fdeec1b req-6b3d61d3-7cca-41eb-b3f9-465f976e19fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052598 May 10 02:41:38.786655 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2704/5356] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:41:38.993950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:38.994588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:39.010918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:39.012619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:39.014129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:39.014597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:40.047196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:40.061679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-82b9405e-e542-41e9-be33-29c2bc473da8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 1.072073 May 10 02:41:40.062681 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2653/5357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:38 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:41.080099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:41.081842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:41.097823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:41.099225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:41.100352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:41.102434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:41.378861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:41.386487 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10195cc6-fa14-444f-839d-5b39d31692f3 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.312248 May 10 02:41:41.387301 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2705/5358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:41 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:42.406988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:42.408154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:42.420241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:42.425227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:42.427262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:42.428469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:42.949360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:42.961907 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67b4f78c-422f-4df3-acd7-0f08e92afd3a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.560758 May 10 02:41:42.963572 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2654/5359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:42 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:43.989255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:43.990229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:44.009094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:44.010257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:44.013118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:44.013667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:44.146728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-74d59949-81d4-4711-86ef-f90626ca253f req-cd01f15f-6062-4bfa-8a60-a15605dded0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e30d31a-d820-4cef-9455-9da4ba4dc4b3", "name": "network-vif-plugged", "status": "completed", "tag": "ff3ff5d4-e598-43d7-b3d1-50fddd58fd11"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:44.161649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-74d59949-81d4-4711-86ef-f90626ca253f req-cd01f15f-6062-4bfa-8a60-a15605dded0e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:44.164134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-74d59949-81d4-4711-86ef-f90626ca253f req-cd01f15f-6062-4bfa-8a60-a15605dded0e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:44.195759 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-74d59949-81d4-4711-86ef-f90626ca253f req-cd01f15f-6062-4bfa-8a60-a15605dded0e service nova] Creating event network-vif-plugged:ff3ff5d4-e598-43d7-b3d1-50fddd58fd11 for instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 on n-h2-841089-2 May 10 02:41:44.203491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-74d59949-81d4-4711-86ef-f90626ca253f req-cd01f15f-6062-4bfa-8a60-a15605dded0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062481 May 10 02:41:44.204862 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2655/5360] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:41:44.529632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:44.547143 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dfb79730-6e6c-46f5-909b-d6cb4a8a29c1 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.564374 May 10 02:41:44.560108 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2706/5361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:43 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:45.565730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:45.566719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:45.580635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:45.581362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:45.582323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:45.583976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:46.171344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:46.204545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-827cf711-ea97-4f01-ad87-c35f0ffcd6d2 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1314 microversion: 2.1 time: 0.643913 May 10 02:41:46.211491 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2656/5362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:45 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:47.233637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:47.234904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:47.249333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:47.249995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:47.251597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:47.254044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:48.153487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:48.172094 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a54619ba-ee70-4427-a040-2081facb4972 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1464 microversion: 2.1 time: 0.944466 May 10 02:41:48.185869 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2707/5363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:47 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1464 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:48.238190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:48.238717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:48.254809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:48.255400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:48.256256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:48.256880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:48.310387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:41:48.491132 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abd6d030-bf31-4ecb-9a53-fc58f6dd9c9d tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 204 len: 0 microversion: 2.1 time: 0.257325 May 10 02:41:48.504083 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2657/5364] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:41:48 2022] DELETE /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:41:48.509920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:48.511114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:48.528545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:48.529128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:48.530147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:48.530838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:49.499935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:49.516652 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-787dbe26-dc80-456f-b5de-6cf1ee121278 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1470 microversion: 2.1 time: 1.009465 May 10 02:41:49.530232 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2708/5365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:48 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1470 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:50.537584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:50.538309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:50.557534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:50.557987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:50.563438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:50.564005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:52.398636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:52.420207 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5898e482-1031-4023-b389-0b4c63c4a2e8 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1470 microversion: 2.1 time: 1.874261 May 10 02:41:52.421312 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2658/5366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:50 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1470 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:53.439101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:53.440327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:53.458086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:53.458589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:53.462522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:53.462987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:53.891620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:53.909622 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e1910f0-eb21-433a-879e-5c015ff4580a tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1428 microversion: 2.1 time: 0.473971 May 10 02:41:53.925577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2709/5367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:53 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1428 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:41:54.177598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-05b8319a-70ea-4685-9d37-e031f11f3170 req-5e6e54e0-a3fb-42a3-8243-8e44e753f559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e30d31a-d820-4cef-9455-9da4ba4dc4b3", "name": "network-vif-deleted", "tag": "ff3ff5d4-e598-43d7-b3d1-50fddd58fd11"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:41:54.201113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-05b8319a-70ea-4685-9d37-e031f11f3170 req-5e6e54e0-a3fb-42a3-8243-8e44e753f559 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:54.201709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-05b8319a-70ea-4685-9d37-e031f11f3170 req-5e6e54e0-a3fb-42a3-8243-8e44e753f559 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:54.242611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-05b8319a-70ea-4685-9d37-e031f11f3170 req-5e6e54e0-a3fb-42a3-8243-8e44e753f559 service nova] Creating event network-vif-deleted:ff3ff5d4-e598-43d7-b3d1-50fddd58fd11 for instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 on n-h2-841089-2 May 10 02:41:54.255153 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-05b8319a-70ea-4685-9d37-e031f11f3170 req-5e6e54e0-a3fb-42a3-8243-8e44e753f559 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080229 May 10 02:41:54.256091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2659/5368] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:41:54.928026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:54.929343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:54.937439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:54.939534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:54.942970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:54.943714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:55.016124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:55.027976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:55.029742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lazy-loading 'fault' on Instance uuid 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:41:55.210809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e9f24a36da401cb418aab8edc0f683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c07d8f43529458c92d0a8b295e80a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:41:55.220469 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54d13334-4cfb-4fbc-8717-737809ed0feb tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 200 len: 1304 microversion: 2.1 time: 0.297882 May 10 02:41:55.221796 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2710/5369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:54 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:41:56.253796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:41:56.256368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] [instance: 6e30d31a-d820-4cef-9455-9da4ba4dc4b3] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:41:56.279487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:56.281218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:56.287575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:41:56.291334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:41:56.338153 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] HTTP exception thrown: Instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 could not be found. May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Request method failure captured: May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 HTTP/1.1 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedDTtd_uHKbIPiJF9uVdvOFDFYAdv6zvSeV8mxrQ6_ewWZZ-MhWaJtp0sUTiOsxCMEL4i_XO94Tnk8mXAF7NKe8PLdrC6eVlEvTJvXxpCHplkwWCiYpXN8bXrtx7S5Fw1g7ZsbTdDOSO-7myPJHwv77mDmeh7vcgJVSAMBodqEQjEEQ May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 4c07d8f43529458c92d0a8b295e80a24 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesNegativeTest-859149670 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4c07d8f43529458c92d0a8b295e80a24", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4c07d8f43529458c92d0a8b295e80a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4c07d8f43529458c92d0a8b295e80a24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4c07d8f43529458c92d0a8b295e80a24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesNegativeTest-859149670 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 4c07d8f43529458c92d0a8b295e80a24 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesNegativeTest-859149670 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesNegativeTest-859149670-project May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: e8e9f24a36da401cb418aab8edc0f683 May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesNegativeTest-859149670-project May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 could not be found. May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6e30d31a-d820-4cef-9455-9da4ba4dc4b3'} May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 could not be found. May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 could not be found. May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:41:56.350728 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 could not be found. May 10 02:41:56.355875 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:41:56.367567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] Returning 404 to user: Instance 6e30d31a-d820-4cef-9455-9da4ba4dc4b3 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:41:56.369790 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5d0737e-4590-41f2-819f-a438833159a6 tempest-VolumesNegativeTest-859149670 tempest-VolumesNegativeTest-859149670-project] 10.222.0.52 "GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3" status: 404 len: 111 microversion: 2.1 time: 0.134715 May 10 02:41:56.373869 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2660/5370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:41:56 2022] GET /compute/v2.1/servers/6e30d31a-d820-4cef-9455-9da4ba4dc4b3 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:42:05.372965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1479129381", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a63c6e5e-4d3f-4f04-8f02-231c448ad693"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1767419357", "security_groups": []}, "os:scheduler_hints": {"different_host": ["73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f"]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:05.492689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] validate_networks() for [('a63c6e5e-4d3f-4f04-8f02-231c448ad693', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:42:06.607211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:42:06.608692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:42:06.609889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:42:06.611575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:42:06.612266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:42:06.652511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:06.656288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:06.663309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:06.670249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:06.748093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Getting quotas for project 427fd13845524abfa44ac6869999d2d3. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:42:06.779867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Getting quotas for user f8078381eed748e2bdb2c8d630fb8981 and project 427fd13845524abfa44ac6869999d2d3. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:42:06.848283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:42:06.857854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:42:06.960280 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-732324bc-a72b-41e6-8eea-b5f6c2c01598 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.592039 May 10 02:42:06.963153 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2711/5371] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:42:05 2022] POST /compute/v2.1/servers => generated 361 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:42:06.973999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-177c2e18-cfa5-4f11-a7b7-f9d2532de7c1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:06.975437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-177c2e18-cfa5-4f11-a7b7-f9d2532de7c1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:07.325736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-177c2e18-cfa5-4f11-a7b7-f9d2532de7c1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:07.344081 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-177c2e18-cfa5-4f11-a7b7-f9d2532de7c1 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1242 microversion: 2.1 time: 0.372785 May 10 02:42:07.344718 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2661/5372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:06 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1242 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:08.364013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:08.364658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:08.386791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:08.387959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:08.390066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:08.397667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:08.720769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:08.745709 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c74e0c1-87fd-48b4-8d41-1f1f1f1b2880 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1238 microversion: 2.1 time: 0.385178 May 10 02:42:08.748934 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2712/5373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:08 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1238 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:09.594600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bc6dd5ce-5643-40a3-a74e-e23d0ba901cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1131022020", "availability_zone": "foo_zone"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:09.596856 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:09.596856 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:09.597764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.aggregate [None req-bc6dd5ce-5643-40a3-a74e-e23d0ba901cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Generated uuid 463de04e-9141-444b-9af9-41fd1df5d091 for aggregate {{(pid=118717) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 10 02:42:09.674478 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bc6dd5ce-5643-40a3-a74e-e23d0ba901cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.404158 May 10 02:42:09.688258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bc4e46d-6729-4f8f-9225-1a3af0f07e9b tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:09.690378 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:09.690378 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:42:09.695689 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2662/5374] 10.222.0.52 () {60 vars in 1163 bytes} [Tue May 10 02:42:09 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:09.743823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bc4e46d-6729-4f8f-9225-1a3af0f07e9b tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.059378 May 10 02:42:09.752521 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2713/5375] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:42:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:09.756024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2e0921a5-4d1b-4dc1-bcaf-c5bc66a3c73a tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:09.758347 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:09.758347 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:09.761143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e0921a5-4d1b-4dc1-bcaf-c5bc66a3c73a tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:09.761857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e0921a5-4d1b-4dc1-bcaf-c5bc66a3c73a tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:09.762857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e0921a5-4d1b-4dc1-bcaf-c5bc66a3c73a tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:09.763500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2e0921a5-4d1b-4dc1-bcaf-c5bc66a3c73a tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:09.776362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:09.779659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:09.811801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:09.812414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:09.815522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:09.817652 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2e0921a5-4d1b-4dc1-bcaf-c5bc66a3c73a tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066434 May 10 02:42:09.818204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:09.830420 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2663/5376] 10.222.0.52 () {58 vars in 1175 bytes} [Tue May 10 02:42:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:09.841181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc453f3a-1cdd-46fc-b9fc-4f9240f3f1b6 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:09.842256 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:09.842256 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:09.851702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc453f3a-1cdd-46fc-b9fc-4f9240f3f1b6 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019400 May 10 02:42:09.852438 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2664/5377] 10.222.0.52 () {58 vars in 1142 bytes} [Tue May 10 02:42:09 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:09.872323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a338bc0b-b2ee-4f81-be90-234beb18d1cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:09.875863 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:09.875863 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:09.900524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a338bc0b-b2ee-4f81-be90-234beb18d1cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:09.901170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a338bc0b-b2ee-4f81-be90-234beb18d1cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:10.005064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:10.013355 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a88f616d-6ade-4994-a3db-e449f19daa72 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.250103 May 10 02:42:10.019507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2714/5378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:09 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:10.684955 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a338bc0b-b2ee-4f81-be90-234beb18d1cb tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.824385 May 10 02:42:10.687824 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2665/5379] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:42:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:10.697386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2e3edb3-946e-4f69-ab25-ccb5bb69a932 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:10.698157 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:10.698157 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 02:42:10.711773 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2e3edb3-946e-4f69-ab25-ccb5bb69a932 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.019253 May 10 02:42:10.718925 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2715/5380] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:42:10 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:10.730595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd571d80-10f1-4b76-89e1-2d9574384391 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1488700504", "availability_zone": "foo_zone"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:10.737585 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:10.737585 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:10.900650 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd571d80-10f1-4b76-89e1-2d9574384391 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.174725 May 10 02:42:10.906880 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2666/5381] 10.222.0.52 () {60 vars in 1172 bytes} [Tue May 10 02:42:10 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:42:10.917097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3156e51-3bcc-45a2-82e5-fb9e8281170b tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:10.918635 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:10.918635 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:10.992575 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3156e51-3bcc-45a2-82e5-fb9e8281170b tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.078595 May 10 02:42:10.997775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2667/5382] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:42:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:11.023160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd00cb20-6eb5-432b-9370-5e57df672de7 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:11.027039 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:11.027039 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:11.046974 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd00cb20-6eb5-432b-9370-5e57df672de7 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.040602 May 10 02:42:11.068551 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2668/5383] 10.222.0.52 () {58 vars in 1151 bytes} [Tue May 10 02:42:11 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:11.077977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:11.091542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:11.125441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:11.129006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:11.133456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:11.137146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:11.484404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:11.502770 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1615b2f4-0060-44ec-aee3-bd898465b3b8 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1304 microversion: 2.1 time: 0.424809 May 10 02:42:11.516397 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2669/5384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:11 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1304 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:11.530017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f50ec5e5-7dc4-4d32-a87a-01d5e905c8c0 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-841089-2"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:11.538468 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:11.538468 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:11.581602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f50ec5e5-7dc4-4d32-a87a-01d5e905c8c0 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:11.586477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f50ec5e5-7dc4-4d32-a87a-01d5e905c8c0 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:11.847545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1092363519", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "3af38e58-7f48-436e-914e-ce6e731970aa"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:11.953327 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f50ec5e5-7dc4-4d32-a87a-01d5e905c8c0 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.443822 May 10 02:42:11.963253 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2670/5385] 10.222.0.52 () {60 vars in 1193 bytes} [Tue May 10 02:42:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:11.963682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] validate_networks() for [('3af38e58-7f48-436e-914e-ce6e731970aa', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:42:11.987524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c918e03f-b60a-4225-84d8-88ca70ec3f58 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:11.988464 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 02:42:11.988464 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 02:42:12.056702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c918e03f-b60a-4225-84d8-88ca70ec3f58 tempest-TestAggregatesBasicOps-719316742 tempest-TestAggregatesBasicOps-719316742-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.088332 May 10 02:42:12.057378 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2671/5386] 10.222.0.52 () {58 vars in 1154 bytes} [Tue May 10 02:42:11 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 10 02:42:12.546743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:12.548851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:12.559711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:12.560451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:12.561687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:12.562410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:12.777023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:12.794029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2024ee6b-b49d-45ac-807a-8dd6a72f420d tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.268225 May 10 02:42:12.796061 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2672/5387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:12 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:13.411492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d2de4638-665b-4206-a699-c43b1b93cf35 req-565dfef2-301a-4d64-85e2-7e0e013b3a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2471ba-8f2e-4052-9d1a-946664ee83b2", "tag": "edf2401a-d0e9-4ce3-a85c-e5d77965edda"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:13.437761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d2de4638-665b-4206-a699-c43b1b93cf35 req-565dfef2-301a-4d64-85e2-7e0e013b3a43 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:13.442666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d2de4638-665b-4206-a699-c43b1b93cf35 req-565dfef2-301a-4d64-85e2-7e0e013b3a43 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:13.498641 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d2de4638-665b-4206-a699-c43b1b93cf35 req-565dfef2-301a-4d64-85e2-7e0e013b3a43 service nova] Creating event network-changed:edf2401a-d0e9-4ce3-a85c-e5d77965edda for instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 on n-h1-841089-2 May 10 02:42:13.513611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d2de4638-665b-4206-a699-c43b1b93cf35 req-565dfef2-301a-4d64-85e2-7e0e013b3a43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108253 May 10 02:42:13.516093 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2673/5388] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:42:13.743635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:42:13.744077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:42:13.744527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:42:13.745114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:42:13.745702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:42:13.762297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:13.773253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:13.774416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:13.775262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:13.816159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:13.817170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:13.820793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Getting quotas for project 339918592f0343659aa895409acc40ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:42:13.830323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Getting quotas for user 67bfcfdea2b0457f909cf8261e2d6226 and project 339918592f0343659aa895409acc40ec. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:42:13.837181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:13.839176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:13.842038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:13.842630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:13.861756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:42:13.867987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:42:13.965589 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce0225f8-4888-4546-93ac-925d4bbaf21c tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.138686 May 10 02:42:13.971912 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2716/5389] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:42:13.977737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b422a37-0e26-4887-8639-5dd63aa2eb6a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:13.978721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b422a37-0e26-4887-8639-5dd63aa2eb6a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:14.238104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:14.250490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fbb8bba5-2750-438d-baaa-e4a06c76d877 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.442107 May 10 02:42:14.254188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2674/5390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:13 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:14.257005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b422a37-0e26-4887-8639-5dd63aa2eb6a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:14.271442 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b422a37-0e26-4887-8639-5dd63aa2eb6a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1214 microversion: 2.1 time: 0.295149 May 10 02:42:14.273705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2717/5391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:13 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:15.270835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:15.272469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:15.290348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:15.291377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:15.318241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:15.319765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:15.321391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:15.322637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:15.324765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:15.326064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:15.326799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:15.327498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:15.736592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:15.744923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4cc9d277-e0ed-41d2-a456-8cc187d65b01 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1266 microversion: 2.1 time: 0.459022 May 10 02:42:15.751326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2718/5392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:15 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:15.954168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:15.968619 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e51aba4-8a28-4d9b-ba13-d9ae395d6e79 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.702629 May 10 02:42:15.984491 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2675/5393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:15 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:16.769971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:16.770685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:16.788701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:16.790268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:16.792439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:16.794853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:16.987272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:17.000773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:17.002386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:17.010621 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d7a6b54f-a76b-48bb-a1b7-e6ec8bdfd42a tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1272 microversion: 2.1 time: 0.246982 May 10 02:42:17.015726 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2719/5394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:16 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:17.028874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:17.029345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:17.035052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:17.035545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:18.034473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:18.035144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:18.049517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:18.050147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:18.050954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:18.051435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:18.158296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:18.178052 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-facb0664-7717-4003-9ff0-6539b371e1b6 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 1.181710 May 10 02:42:18.178649 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2676/5395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:16 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:18.269197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:18.286446 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-829041c9-025a-4894-b865-ac17679edeab tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1272 microversion: 2.1 time: 0.256251 May 10 02:42:18.289045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2720/5396] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:18 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:18.880818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-284c3904-938d-42cd-a812-6ae3af7512f6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: .version_select at 0x7f3d35c49310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-521456621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoOKjEgAJB00/b6cR82BDOCuLXCqXMwyDQuNl8d5RkeCZS+TLV8cgROetGLErekFwNr6aRJV9fOnStllztk3vdd6YYT1Nev7k8eLjtxkvy7pTVJTzzA6WFyayvNqaZfUQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:18.910825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-284c3904-938d-42cd-a812-6ae3af7512f6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:42:18.926544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-284c3904-938d-42cd-a812-6ae3af7512f6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:42:18.965507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-284c3904-938d-42cd-a812-6ae3af7512f6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.535525 May 10 02:42:18.968226 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2677/5397] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:42:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:19.203351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:19.203980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:19.224484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:19.227838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:19.228701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:19.229148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:19.307454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:19.308076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:19.327802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:19.330198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:19.331962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:19.333396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:19.539670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:19.550940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab949b78-907e-44f2-868e-3d6794c88705 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.352303 May 10 02:42:19.553435 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2721/5398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:19 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:19.846212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:19.856526 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-330a49c0-6bbb-4093-9cdd-5cf595da230f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 0.554238 May 10 02:42:19.857317 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2678/5399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:19 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:20.572642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:20.574211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:20.579687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:20.580075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:20.586256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:20.589975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:20.591676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:20.592015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:20.592692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:20.593307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:20.594626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:20.596963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:21.106460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:21.117819 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e9a4f8ec-9e83-490c-af62-c8a29a3b67f4 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.551432 May 10 02:42:21.118538 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2722/5400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:20 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:21.128534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:21.129587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:21.140539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:21.141148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:21.143032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:21.147896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:21.525675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:21.537323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:21.538871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:21.549598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fdde0b4f-ff03-4e8b-9204-77872ae1ffbb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2953 microversion: 2.42 time: 0.975219 May 10 02:42:21.551517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2679/5401] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:42:20 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2953 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:42:21.579721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:21.580439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:21.601307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:21.601789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:21.602605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:21.603060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:21.725130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:21.737954 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6ddc555-2e1a-450a-8ace-51441d349a77 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 0.614015 May 10 02:42:21.738769 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2723/5402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:21 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:21.934287 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-808a1bc9-b8b0-42ad-83f1-5c82871f1008 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.366815 May 10 02:42:21.935237 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2680/5403] 10.222.0.52 () {60 vars in 1315 bytes} [Tue May 10 02:42:21 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04/os-interface => generated 1833 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:42:22.005987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-58cc351f-b51c-428f-83a7-75e1c9511f29 req-7aafde07-7939-4999-bc8d-1f60931232f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ccfd44-20a3-4539-a1d2-0dd362db32ab", "tag": "24915141-080d-410d-9b4e-65ce2098b41e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:22.019453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-58cc351f-b51c-428f-83a7-75e1c9511f29 req-7aafde07-7939-4999-bc8d-1f60931232f6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:22.025848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-58cc351f-b51c-428f-83a7-75e1c9511f29 req-7aafde07-7939-4999-bc8d-1f60931232f6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:22.046927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-58cc351f-b51c-428f-83a7-75e1c9511f29 req-7aafde07-7939-4999-bc8d-1f60931232f6 service nova] Creating event network-changed:24915141-080d-410d-9b4e-65ce2098b41e for instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab on n-h2-841089-2 May 10 02:42:22.069283 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-58cc351f-b51c-428f-83a7-75e1c9511f29 req-7aafde07-7939-4999-bc8d-1f60931232f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068784 May 10 02:42:22.075976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2681/5404] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:22.122849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9dcb27c8-7145-45df-b966-5b218624f5f7 req-763ffc06-b1c8-4461-839a-8de898ff0447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2471ba-8f2e-4052-9d1a-946664ee83b2", "name": "network-vif-plugged", "status": "completed", "tag": "edf2401a-d0e9-4ce3-a85c-e5d77965edda"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:22.135700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:22.136705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:22.146549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9dcb27c8-7145-45df-b966-5b218624f5f7 req-763ffc06-b1c8-4461-839a-8de898ff0447 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:22.148197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:22.148822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:22.149559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9dcb27c8-7145-45df-b966-5b218624f5f7 req-763ffc06-b1c8-4461-839a-8de898ff0447 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:22.150525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:22.153853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:22.175004 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9dcb27c8-7145-45df-b966-5b218624f5f7 req-763ffc06-b1c8-4461-839a-8de898ff0447 service nova] Creating event network-vif-plugged:edf2401a-d0e9-4ce3-a85c-e5d77965edda for instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 on n-h1-841089-2 May 10 02:42:22.188903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9dcb27c8-7145-45df-b966-5b218624f5f7 req-763ffc06-b1c8-4461-839a-8de898ff0447 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448637 May 10 02:42:22.189550 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2724/5405] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:22.574301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:22.596621 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8d05e6a-d6b7-465c-8d43-2216f6625e95 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.464564 May 10 02:42:22.646582 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2682/5406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:22 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:22.756062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:22.757448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:22.767542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:22.768183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:22.769157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:22.769760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:23.385880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:23.401191 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ea7f998-f2eb-4426-b3b2-a2d2cab7f328 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 0.650575 May 10 02:42:23.409493 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2725/5407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:22 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:23.637746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:23.639016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:23.651484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:23.659157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:23.662762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:23.663459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:24.194714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:24.202073 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18592cc9-7541-4a34-8dac-a7cb1f0b227b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1300 microversion: 2.1 time: 0.568733 May 10 02:42:24.215882 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2683/5408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:23 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1300 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:24.428697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:24.429822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:24.440524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:24.447780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:24.448843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:24.449444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:25.232592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:25.234642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:25.246971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:25.248488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:25.252255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:25.252815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:25.506565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:25.517885 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-58af6a35-5d9b-4cf4-8357-08adf305b4a7 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 1.095233 May 10 02:42:25.519056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2726/5409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:24 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:25.709395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:25.722309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bacbfbf0-097e-47b4-8aee-fc89def45b7f tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1473 microversion: 2.1 time: 0.491099 May 10 02:42:25.724020 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2684/5410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:25 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1473 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:25.739436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:25.740575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:25.748538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:25.751939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:25.757072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:25.757744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:26.014394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:26.028413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-af2d3a6e-9f3f-4636-a01a-07657c2eb1be tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1473 microversion: 2.1 time: 0.293188 May 10 02:42:26.029599 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2727/5411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:25 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:26.045676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:26.046533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:26.062783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:26.063571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:26.064558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:26.065183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:26.506251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d799eb0b-2f51-4a38-b0f8-42d3f5e42194 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1624 microversion: 2.1 time: 0.464425 May 10 02:42:26.517762 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2685/5412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:26 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1624 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:26.522664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:26.523978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:26.532052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:26.533405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:26.534684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:26.535388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:26.536043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:26.536662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:26.559123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:26.559853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:26.560711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:26.561164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:27.054018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17efa4d9-0b71-4357-a198-adf4456c7690 tempest-TestSecurityGroupsBasicOps-115981145 tempest-TestSecurityGroupsBasicOps-115981145-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1913 microversion: 2.1 time: 0.535311 May 10 02:42:27.072161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2728/5413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:26 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1913 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:27.154536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:27.162314 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ef8b2c6-4492-4a8a-85b8-c11c9b3decc1 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 0.630877 May 10 02:42:27.165817 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2686/5414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:26 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:27.236439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:27.236945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:27.253281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:27.253931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:27.254886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:27.255528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:27.298390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:42:27.450787 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-328a6a51-0b28-4443-8bf4-f031d7cec81a tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 204 len: 0 microversion: 2.1 time: 0.218646 May 10 02:42:27.452403 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2729/5415] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:42:27 2022] DELETE /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:42:27.460236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:27.460857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:27.467606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:27.468387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:27.469396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:27.470619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:27.600339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:27.608916 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a0eb537-f333-4efd-8a60-fea2ba2cc820 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1479 microversion: 2.1 time: 0.152519 May 10 02:42:27.611623 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2687/5416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:27 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1479 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:28.187059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:28.190799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:28.201732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:28.202576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:28.203648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:28.205214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:28.648823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:28.649479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:28.660701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:28.664495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:28.669779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:28.674854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:28.899790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:28.922068 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9852e308-467e-445e-93c7-265f9d9825fe tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1479 microversion: 2.1 time: 0.290521 May 10 02:42:28.932386 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2688/5417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:28 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1479 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:29.044436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:29.059169 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e1d88c8-ba6c-4071-90af-9f5621439a46 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 0.878846 May 10 02:42:29.062972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2730/5418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:28 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:29.941632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:29.942570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:29.970249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:29.970904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:29.972932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:29.976762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:30.081355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:30.082581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:30.098645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:30.099586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:30.100630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:30.102850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:30.604619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:30.615103 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-195a42d5-c993-4bd5-b14c-7369bd61651c tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1479 microversion: 2.1 time: 0.676673 May 10 02:42:30.617486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2689/5419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:29 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1479 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:30.633879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9cc8bc7e-7e4f-47ab-96c9-731abcc55c2e req-6aca4e96-cbc7-41c5-b509-0a1488519f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ccfd44-20a3-4539-a1d2-0dd362db32ab", "name": "network-vif-plugged", "status": "completed", "tag": "24915141-080d-410d-9b4e-65ce2098b41e"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:30.646339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9cc8bc7e-7e4f-47ab-96c9-731abcc55c2e req-6aca4e96-cbc7-41c5-b509-0a1488519f00 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:30.646999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9cc8bc7e-7e4f-47ab-96c9-731abcc55c2e req-6aca4e96-cbc7-41c5-b509-0a1488519f00 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:30.675085 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9cc8bc7e-7e4f-47ab-96c9-731abcc55c2e req-6aca4e96-cbc7-41c5-b509-0a1488519f00 service nova] Creating event network-vif-plugged:24915141-080d-410d-9b4e-65ce2098b41e for instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab on n-h2-841089-2 May 10 02:42:30.683316 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9cc8bc7e-7e4f-47ab-96c9-731abcc55c2e req-6aca4e96-cbc7-41c5-b509-0a1488519f00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053346 May 10 02:42:30.684193 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2690/5420] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:31.112092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:31.123530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-771eae24-2314-4603-86f1-c63be0594784 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 1.049286 May 10 02:42:31.135485 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2731/5421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:30 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:31.635806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:31.636558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:31.649230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:31.649780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:31.652467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:31.653582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:31.718335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f556ad65-c771-4023-92c5-3d9f5959c8ed req-c5350a01-714f-4249-8c38-4a0b1a237c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2471ba-8f2e-4052-9d1a-946664ee83b2", "name": "network-vif-deleted", "tag": "edf2401a-d0e9-4ce3-a85c-e5d77965edda"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:31.736475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f556ad65-c771-4023-92c5-3d9f5959c8ed req-c5350a01-714f-4249-8c38-4a0b1a237c25 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:31.737156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f556ad65-c771-4023-92c5-3d9f5959c8ed req-c5350a01-714f-4249-8c38-4a0b1a237c25 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:31.759244 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f556ad65-c771-4023-92c5-3d9f5959c8ed req-c5350a01-714f-4249-8c38-4a0b1a237c25 service nova] Creating event network-vif-deleted:edf2401a-d0e9-4ce3-a85c-e5d77965edda for instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 on n-h1-841089-2 May 10 02:42:31.767315 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f556ad65-c771-4023-92c5-3d9f5959c8ed req-c5350a01-714f-4249-8c38-4a0b1a237c25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053679 May 10 02:42:31.769005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2732/5422] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:42:31.876905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:31.891092 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85ded60a-1efa-4ac7-aa81-8e943d91dfa0 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 200 len: 1479 microversion: 2.1 time: 0.260428 May 10 02:42:31.891742 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2691/5423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:31 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 1479 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:32.149021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:32.149756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:32.157657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:32.158117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:32.165966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:32.167041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:32.712726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:32.725298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72f3de0c-27c0-42f2-92f7-d8558c18034f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1314 microversion: 2.1 time: 0.585840 May 10 02:42:32.729240 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2733/5424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:32 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:32.913539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:32.914158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 5d2471ba-8f2e-4052-9d1a-946664ee83b2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:32.931745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:32.932218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:32.935418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:32.935886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:32.960639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] HTTP exception thrown: Instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 could not be found. May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Request method failure captured: May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 HTTP/1.1 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedCTVVOCGwTvHkN_OVYGxcmb_R-9X-AApleiieftCbw4j-h8CUYShIF2oHCKJNFrZbH3g-czqDtPW2vlDpobdFdCkiXqqjPVGO0oY9QPkBpj_Ntgf0AZdPoNYOf4YJzE_iGOqycnDwen3P71-RUQjTJ7DcwxHBA5G8cwnIJ_wHEeyZw May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 427fd13845524abfa44ac6869999d2d3 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1568486505 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_427fd13845524abfa44ac6869999d2d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/427fd13845524abfa44ac6869999d2d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/427fd13845524abfa44ac6869999d2d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/427fd13845524abfa44ac6869999d2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1568486505 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 427fd13845524abfa44ac6869999d2d3 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1568486505 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestSecurityGroupsBasicOps-1568486505-project May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f8078381eed748e2bdb2c8d630fb8981 May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1568486505-project May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 could not be found. May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5d2471ba-8f2e-4052-9d1a-946664ee83b2'} May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 could not be found. May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 could not be found. May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:42:32.962726 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 could not be found. May 10 02:42:32.967347 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:32.968785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Returning 404 to user: Instance 5d2471ba-8f2e-4052-9d1a-946664ee83b2 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:42:32.971128 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab42e30d-6479-417d-b6ef-65d7ea91aadc tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2" status: 404 len: 111 microversion: 2.1 time: 0.067018 May 10 02:42:32.972874 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2692/5425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:32 2022] GET /compute/v2.1/servers/5d2471ba-8f2e-4052-9d1a-946664ee83b2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:42:33.756809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:33.757507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:33.786438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:33.789008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:33.792810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:33.793511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:34.398493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:34.412027 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a67bb57b-3c2c-4d6e-98d7-6328db7f783d tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1498 microversion: 2.1 time: 0.661977 May 10 02:42:34.412633 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2734/5426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:33 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1498 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:38.770166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1018094505", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "63321c5a-ca4e-4bed-92f8-bc59bbbe23a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-521456621", "security_groups": [{"name": "tempest-secgroup-smoke-348595378"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:38.990209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] validate_networks() for [('63321c5a-ca4e-4bed-92f8-bc59bbbe23a0', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:42:40.034646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:40.035220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:40.056771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:40.057321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:40.061108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:40.061578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:40.156383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:42:40.270859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-daf6fecf-69b0-4ed4-9418-cc4742a9dc6b tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 204 len: 0 microversion: 2.1 time: 0.241571 May 10 02:42:40.272148 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2735/5427] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:42:40 2022] DELETE /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:42:40.281204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:40.283651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:40.290907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:40.291644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:40.293002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:40.293787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:41.319319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:41.331189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:42:41.331930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:42:41.332110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:42:41.332534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:42:41.332973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:42:41.339335 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a0c0d475-ddcc-4736-b439-717d6c9f7ae9 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1504 microversion: 2.1 time: 1.062468 May 10 02:42:41.346187 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2736/5428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:40 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1504 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:41.346416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:41.346686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:41.347561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:41.348019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:41.371892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:42:41.378172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:42:41.391721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:42:41.394682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:42:41.496264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89eefe1a-9656-4c57-a0f9-1f8562636af2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.730568 May 10 02:42:41.502910 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2693/5429] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:42:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 2738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:42:41.508788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-13a7bd3b-94bd-46a0-aa92-d1c45c35f42d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:41.509840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-13a7bd3b-94bd-46a0-aa92-d1c45c35f42d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:41.656091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13a7bd3b-94bd-46a0-aa92-d1c45c35f42d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:41.670968 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-13a7bd3b-94bd-46a0-aa92-d1c45c35f42d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1266 microversion: 2.1 time: 0.160021 May 10 02:42:41.671761 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2737/5430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:41 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:42.371576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:42.372730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:42.392290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:42.392898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:42.393559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:42.400431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:42.689428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:42.690055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:42.705727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:42.711246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:42.712386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:42.715794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:42.908525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:42.917031 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-932d2d70-953f-4443-9a54-56439e7b0c3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1262 microversion: 2.1 time: 0.232599 May 10 02:42:42.934196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:42.938728 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2738/5431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:42 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1262 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:42.947613 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-990c4b58-5fc3-44d7-b8b4-cbcde6065c53 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1504 microversion: 2.1 time: 0.588796 May 10 02:42:42.959723 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2694/5432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:42 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:43.406069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4102239b-61d6-42d9-9f6c-62296a14944f req-28a91f25-bbfb-4fa8-aca0-deae0f7c09d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ccfd44-20a3-4539-a1d2-0dd362db32ab", "name": "network-vif-deleted", "tag": "24915141-080d-410d-9b4e-65ce2098b41e"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:43.421953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4102239b-61d6-42d9-9f6c-62296a14944f req-28a91f25-bbfb-4fa8-aca0-deae0f7c09d2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:43.425792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4102239b-61d6-42d9-9f6c-62296a14944f req-28a91f25-bbfb-4fa8-aca0-deae0f7c09d2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:43.454028 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4102239b-61d6-42d9-9f6c-62296a14944f req-28a91f25-bbfb-4fa8-aca0-deae0f7c09d2 service nova] Creating event network-vif-deleted:24915141-080d-410d-9b4e-65ce2098b41e for instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab on n-h2-841089-2 May 10 02:42:43.470710 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4102239b-61d6-42d9-9f6c-62296a14944f req-28a91f25-bbfb-4fa8-aca0-deae0f7c09d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065204 May 10 02:42:43.474621 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2739/5433] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:43.934628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:43.935383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:43.949952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:43.950425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:43.951266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:43.951721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:43.967362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:43.968384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:43.980446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:43.983516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:43.984608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:43.986003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:44.091012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:44.091609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:44.092337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lazy-loading 'fault' on Instance uuid 25ccfd44-20a3-4539-a1d2-0dd362db32ab {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:42:44.094984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:44.113926 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b112262d-85dd-4a7d-a60e-bb1438fd968d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1324 microversion: 2.1 time: 0.183910 May 10 02:42:44.117818 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2695/5434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:43 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:44.168915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bfcfdea2b0457f909cf8261e2d6226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339918592f0343659aa895409acc40ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:44.182479 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59aab426-c6b8-4559-bb78-259f5b6b2ca5 tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 200 len: 1304 microversion: 2.1 time: 0.215932 May 10 02:42:44.184308 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2740/5435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:43 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 1304 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:44.937715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:44.938735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:44.952326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:44.954522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:44.959909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:44.960581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.001783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:42:45.134910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:45.136955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:45.149004 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33c8e300-7c38-4493-aaed-f94c2220354b tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "DELETE /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 204 len: 0 microversion: 2.1 time: 0.213738 May 10 02:42:45.151624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.153721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.158329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.159738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2696/5436] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:42:44 2022] DELETE /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:42:45.162150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.166651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:45.168006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:45.176948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.178006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.178967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.179625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.310344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:45.324374 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-31f23b26-a789-455e-98c6-ed7d586c73c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1324 microversion: 2.1 time: 0.194956 May 10 02:42:45.324973 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2741/5437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:45 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:45.338381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:45.338981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] [instance: 25ccfd44-20a3-4539-a1d2-0dd362db32ab] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:45.346342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.354587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.356178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.357700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.394767 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] HTTP exception thrown: Instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab could not be found. May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Request method failure captured: May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab HTTP/1.1 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedD8uMB5RMzsTbcrutQzik5BxRkmraAf3K2XaHeKses5AatrNOm1ug4LAzeyOAIoblEJFaAZ1rZYvrhaIfie1ydlaB685qDoGjyuSh8VtXhLOYdJbC2DyRwKwzG19dh38eE4PvwvgOYpzzvbEbYlCp-FqiHZiT6n7eMyct4r0snxZj4 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 339918592f0343659aa895409acc40ec May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesActionsTest-1200008452 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_339918592f0343659aa895409acc40ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/339918592f0343659aa895409acc40ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/339918592f0343659aa895409acc40ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/339918592f0343659aa895409acc40ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesActionsTest-1200008452 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 339918592f0343659aa895409acc40ec May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesActionsTest-1200008452 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesActionsTest-1200008452-project May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 67bfcfdea2b0457f909cf8261e2d6226 May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesActionsTest-1200008452-project May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab could not be found. May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '25ccfd44-20a3-4539-a1d2-0dd362db32ab'} May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab could not be found. May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab could not be found. May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:42:45.404659 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab could not be found. May 10 02:42:45.410999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:42:45.413050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] Returning 404 to user: Instance 25ccfd44-20a3-4539-a1d2-0dd362db32ab could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:42:45.414225 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4a9d6f6-af77-44ec-82c7-0413236f485f tempest-VolumesActionsTest-1200008452 tempest-VolumesActionsTest-1200008452-project] 10.222.0.52 "GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab" status: 404 len: 111 microversion: 2.1 time: 0.087985 May 10 02:42:45.414702 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2742/5438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:45 2022] GET /compute/v2.1/servers/25ccfd44-20a3-4539-a1d2-0dd362db32ab => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:42:45.470680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:45.482068 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67617a53-c20d-444a-a5af-f52faeeda251 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1768 microversion: 2.1 time: 0.320564 May 10 02:42:45.489853 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2697/5439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:45 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1768 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:45.503310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d431799f-a555-476c-8b36-6e04fa7f5d74 req-4fb4e7e0-2c92-49e0-97f2-7d15898086bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f", "tag": "598b389f-a941-4599-b4cf-67afb7f5d035"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:45.526760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d431799f-a555-476c-8b36-6e04fa7f5d74 req-4fb4e7e0-2c92-49e0-97f2-7d15898086bb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:45.527641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d431799f-a555-476c-8b36-6e04fa7f5d74 req-4fb4e7e0-2c92-49e0-97f2-7d15898086bb service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:45.558921 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d431799f-a555-476c-8b36-6e04fa7f5d74 req-4fb4e7e0-2c92-49e0-97f2-7d15898086bb service nova] Creating event network-changed:598b389f-a941-4599-b4cf-67afb7f5d035 for instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f on n-h2-841089-2 May 10 02:42:45.568740 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d431799f-a555-476c-8b36-6e04fa7f5d74 req-4fb4e7e0-2c92-49e0-97f2-7d15898086bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069328 May 10 02:42:45.569357 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2743/5440] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:46.342824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:46.345347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:46.381026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:46.381553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:46.382454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:46.389242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:46.505465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:46.506363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:46.533336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:46.534083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:46.535055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:46.535666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:47.266324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:47.274282 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-060e265d-6473-4b7d-92fb-cfda9a03aa02 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.936433 May 10 02:42:47.279017 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2698/5441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:46 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:47.285443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-43b9ee94-225e-49b7-a228-e7a5fca2480a req-7623b0a4-9428-46ed-b59f-27a0f67d2a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:47.308102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-43b9ee94-225e-49b7-a228-e7a5fca2480a req-7623b0a4-9428-46ed-b59f-27a0f67d2a44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:47.308562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-43b9ee94-225e-49b7-a228-e7a5fca2480a req-7623b0a4-9428-46ed-b59f-27a0f67d2a44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:47.327696 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-43b9ee94-225e-49b7-a228-e7a5fca2480a req-7623b0a4-9428-46ed-b59f-27a0f67d2a44 service nova] Creating event network-changed:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h1-841089-2 May 10 02:42:47.345061 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-43b9ee94-225e-49b7-a228-e7a5fca2480a req-7623b0a4-9428-46ed-b59f-27a0f67d2a44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064690 May 10 02:42:47.346014 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2699/5442] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:42:47.956079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:47.965817 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4923ce8-2512-4801-9332-440330f24f91 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1768 microversion: 2.1 time: 1.464849 May 10 02:42:47.967396 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2744/5443] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:46 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1768 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:42:48.297765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:48.304774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:48.320975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:48.324952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:48.325799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:48.326579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:48.630649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:48.646278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3dcb991b-ca63-4e9e-8e8b-e44650dce20f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.356953 May 10 02:42:48.648150 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2700/5444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:48 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:48.795641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b0797452-7fb4-4086-9575-ef59ac50f52a req-d0b9069f-d33c-49a7-b349-658a209d0f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f", "name": "network-vif-deleted", "tag": "598b389f-a941-4599-b4cf-67afb7f5d035"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:48.812123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b0797452-7fb4-4086-9575-ef59ac50f52a req-d0b9069f-d33c-49a7-b349-658a209d0f1c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:48.813321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b0797452-7fb4-4086-9575-ef59ac50f52a req-d0b9069f-d33c-49a7-b349-658a209d0f1c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:48.865985 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b0797452-7fb4-4086-9575-ef59ac50f52a req-d0b9069f-d33c-49a7-b349-658a209d0f1c service nova] Creating event network-vif-deleted:598b389f-a941-4599-b4cf-67afb7f5d035 for instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f on n-h2-841089-2 May 10 02:42:48.882673 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b0797452-7fb4-4086-9575-ef59ac50f52a req-d0b9069f-d33c-49a7-b349-658a209d0f1c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090497 May 10 02:42:48.883923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2745/5445] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:42:48.986564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:48.996889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:49.013743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:49.017704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:49.023626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:49.024371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:49.143853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:49.144372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:49.145407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lazy-loading 'fault' on Instance uuid 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:42:49.345482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8078381eed748e2bdb2c8d630fb8981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427fd13845524abfa44ac6869999d2d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:49.366263 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-80da692f-dd52-4f98-9c3f-5c1bc0487fe5 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 200 len: 1384 microversion: 2.1 time: 0.386319 May 10 02:42:49.387046 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2701/5446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:48 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 1384 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:49.664456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:49.665763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:49.683544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:49.689730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:49.690760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:49.691336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:50.092326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:50.100443 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a605fae5-28bb-4052-abf4-11bfc108c848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.440396 May 10 02:42:50.102635 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2746/5447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:49 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:50.384709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:50.386672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] [instance: 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:50.396375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:50.397324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:50.400229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:50.400889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:50.431785 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] HTTP exception thrown: Instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f could not be found. May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Request method failure captured: May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f HTTP/1.1 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedCTVVOCGwTvHkN_OVYGxcmb_R-9X-AApleiieftCbw4j-h8CUYShIF2oHCKJNFrZbH3g-czqDtPW2vlDpobdFdCkiXqqjPVGO0oY9QPkBpj_Ntgf0AZdPoNYOf4YJzE_iGOqycnDwen3P71-RUQjTJ7DcwxHBA5G8cwnIJ_wHEeyZw May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 427fd13845524abfa44ac6869999d2d3 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1568486505 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_427fd13845524abfa44ac6869999d2d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/427fd13845524abfa44ac6869999d2d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/427fd13845524abfa44ac6869999d2d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/427fd13845524abfa44ac6869999d2d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1568486505 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 427fd13845524abfa44ac6869999d2d3 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1568486505 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestSecurityGroupsBasicOps-1568486505-project May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: f8078381eed748e2bdb2c8d630fb8981 May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1568486505-project May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f could not be found. May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f'} May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f could not be found. May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f could not be found. May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:42:50.438933 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f could not be found. May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Returning 404 to user: Instance 73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:42:50.442403 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-59e20e53-46d3-4d48-8f9a-e7238bf92783 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f" status: 404 len: 111 microversion: 2.1 time: 0.061227 May 10 02:42:50.448250 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2702/5448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:50 2022] GET /compute/v2.1/servers/73f2e2c3-31aa-4ee6-b523-2cb7eda75e3f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:42:51.118010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:51.118630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:51.128196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:51.129393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:51.130519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:51.131151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:51.480667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:51.491125 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0547bfcd-36ce-4d3a-8ee2-8a3ae35fd48b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.376992 May 10 02:42:51.492250 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2747/5449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:51 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:52.507665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:52.508300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:52.532501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:52.534285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:52.538961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:52.541979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:52.802818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:52.813404 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40b05967-d494-4db4-b3b4-68c284f50aaa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.309598 May 10 02:42:52.814603 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2703/5450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:52 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:53.832073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:53.832701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:53.848251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:53.848729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:53.849534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:53.849983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:54.233016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:54.256924 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4961ff29-f786-445a-bca1-0c78bf25af3c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.429302 May 10 02:42:54.281692 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2748/5451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:53 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:54.833651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-46c17257-c397-425f-829c-37e4c7aade9d req-321b4acc-3f73-463d-ba1b-1d07f452e761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "name": "network-vif-plugged", "status": "completed", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:42:54.849847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-46c17257-c397-425f-829c-37e4c7aade9d req-321b4acc-3f73-463d-ba1b-1d07f452e761 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:54.853779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-46c17257-c397-425f-829c-37e4c7aade9d req-321b4acc-3f73-463d-ba1b-1d07f452e761 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:54.891396 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-46c17257-c397-425f-829c-37e4c7aade9d req-321b4acc-3f73-463d-ba1b-1d07f452e761 service nova] Creating event network-vif-plugged:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h1-841089-2 May 10 02:42:54.907604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-46c17257-c397-425f-829c-37e4c7aade9d req-321b4acc-3f73-463d-ba1b-1d07f452e761 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077004 May 10 02:42:54.908982 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2704/5452] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:42:55.286821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:55.287495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:55.312640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:55.313360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:55.314201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:55.318840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:55.686345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:55.695545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4ae8f06-09ea-44b5-b21d-cd3acdc526c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1391 microversion: 2.1 time: 0.411392 May 10 02:42:55.696150 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2749/5453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:55 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1391 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:56.723773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:56.725413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:56.756720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:56.777042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:56.784937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:56.788948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:57.102062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:57.113276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43ed5c51-4faf-4c63-8d0f-4a81c178358c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1564 microversion: 2.1 time: 0.403823 May 10 02:42:57.114626 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2705/5454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:56 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1564 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:57.145485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:57.146721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:42:57.162406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:57.163267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:57.164906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:42:57.165589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:42:57.557027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:42:57.565770 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8dda07c5-6b1e-4abd-9d56-27839162e60e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1564 microversion: 2.1 time: 0.430824 May 10 02:42:57.579931 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2750/5455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:42:57 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1564 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:42:59.180201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49945bfa-78b6-478b-b63d-2a784e29a653 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] Calling method '.version_select at 0x7f3d37486310>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:42:59.210954 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49945bfa-78b6-478b-b63d-2a784e29a653 tempest-TestSecurityGroupsBasicOps-1568486505 tempest-TestSecurityGroupsBasicOps-1568486505-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1767419357" status: 202 len: 0 microversion: 2.1 time: 0.035001 May 10 02:42:59.212443 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2706/5456] 10.222.0.52 () {58 vars in 1277 bytes} [Tue May 10 02:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1767419357 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:43:02.932848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:02.934218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:02.944145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2dc551a8-fb63-4911-8c13-933a443fe116 req-19bbdff3-9490-4c83-b142-fa53c66eb3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:02.963569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:02.975914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:02.977216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:02.981678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2dc551a8-fb63-4911-8c13-933a443fe116 req-19bbdff3-9490-4c83-b142-fa53c66eb3cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:02.982497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:02.983277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2dc551a8-fb63-4911-8c13-933a443fe116 req-19bbdff3-9490-4c83-b142-fa53c66eb3cc service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:03.023265 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2dc551a8-fb63-4911-8c13-933a443fe116 req-19bbdff3-9490-4c83-b142-fa53c66eb3cc service nova] Creating event network-changed:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h1-841089-2 May 10 02:43:03.054075 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2dc551a8-fb63-4911-8c13-933a443fe116 req-19bbdff3-9490-4c83-b142-fa53c66eb3cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111335 May 10 02:43:03.054707 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2707/5457] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:43:03.361777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:03.377064 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63e2bbab-5660-4400-9fd6-928c48bf0197 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1564 microversion: 2.1 time: 0.448683 May 10 02:43:03.390311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2751/5458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:02 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1564 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:22.145482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:22.148279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:22.175194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:22.175667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:22.176474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:22.184898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:22.289180 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2bb0b150-1ece-41e0-8b54-a93c79c3d0ab tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action" status: 200 len: 24568 microversion: 2.1 time: 0.152013 May 10 02:43:22.295956 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2708/5459] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:43:22 2022] POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action => generated 24568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:43:28.702326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:28.703098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:28.715469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:28.716612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:28.719145 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:28.720285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:29.857511 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a215c176-f1dc-4127-9506-0439a6a0aefc tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1834 microversion: 2.1 time: 1.158596 May 10 02:43:29.875346 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2752/5460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:28 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1834 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:29.880892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:29.881719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:29.894608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:29.896814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:29.900912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:29.903953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:30.362206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:30.372960 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4cc948e2-327a-4708-a50e-0a6c27e678b4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1683 microversion: 2.1 time: 0.496384 May 10 02:43:30.373596 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2709/5461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:29 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1683 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:43:30.548462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:30.549430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:30.563713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:30.566166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:30.567097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:30.567854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:30.692208 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d3df697-6c5d-4eab-8b92-efdb9ae2677a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action" status: 200 len: 32643 microversion: 2.1 time: 0.148765 May 10 02:43:30.698854 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2753/5462] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:43:30 2022] POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action => generated 32643 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:43:30.892847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:30.894516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:30.913586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:30.915774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:30.918427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:30.921259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:30.996144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8982351ac02f429cb964e6f9b0386930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bed0589f4c4d19a458a8fdcb65a3c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:30.996958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 50015504-b803-4c32-9611-f2c55402843a] flavor_id is None. Assuming migration. {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4142}} May 10 02:43:30.997567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 50015504-b803-4c32-9611-f2c55402843a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 02:43:31.515642 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe417e1c-c7ce-4518-8ff5-3045d84c509f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action" status: 202 len: 0 microversion: 2.1 time: 0.627213 May 10 02:43:31.517147 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2710/5463] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:43:30 2022] POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:43:31.528926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:31.531372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:31.542663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:31.543630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:31.544883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:31.545592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:31.781009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:31.790381 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1183721-ef56-4014-bb51-b87d47704753 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1692 microversion: 2.1 time: 0.268590 May 10 02:43:31.790979 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2754/5464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:31 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1692 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:32.817351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:32.818107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:32.833056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:32.833894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:32.835199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:32.835900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:33.223997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:33.231972 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b6e3b10-820a-4571-9437-5a27cdc78875 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1692 microversion: 2.1 time: 0.426562 May 10 02:43:33.232559 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2711/5465] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:32 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1692 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:34.251030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:34.252318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:34.262900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:34.263422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:34.265246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:34.266122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:34.482160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:34.492044 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-31a64aed-d1e3-41ac-8a24-7d03099b5873 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1692 microversion: 2.1 time: 0.245598 May 10 02:43:34.493067 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2755/5466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:34 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1692 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:35.509837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:35.510478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:35.525670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:35.526136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:35.526954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:35.527458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:35.878303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:35.895232 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dab25f50-727a-48b4-93fb-a20982ba85eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.389207 May 10 02:43:35.914837 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2712/5467] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:35 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:36.922852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:36.924252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:36.932042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:36.932821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:36.933934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:36.934488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:37.248024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:37.270278 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4926b82e-69e8-43f5-8565-8050b514ba3d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.355351 May 10 02:43:37.272057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2756/5468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:36 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:38.290037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:38.291402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:38.298310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:38.298776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:38.307440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:38.307926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:38.662093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:38.672700 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ba71059-6b74-4bc8-a574-ae09b077eff8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.386720 May 10 02:43:38.673323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2713/5469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:38 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:39.690518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:39.691199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:39.709629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:39.710099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:39.710909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:39.715583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:40.031320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:40.044587 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3663cbd-00c9-4965-a537-8f72216658eb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.356589 May 10 02:43:40.047881 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2757/5470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:39 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:41.064334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:41.065236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:41.076166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:41.078150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:41.079335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:41.081120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:41.473423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:41.482907 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5d4ab5ee-1052-4bd5-9c14-f8e1df189b61 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.422565 May 10 02:43:41.483551 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2714/5471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:41 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:42.502704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:42.503362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:42.519808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:42.521164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:42.523455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:42.523925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:42.969010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:42.983966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b30a0cc0-fcfe-41ae-9ee8-962c5922fb8c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.486552 May 10 02:43:42.987535 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2758/5472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:42 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:43:44.004122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:44.004750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:44.025736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:44.026205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:44.027022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:44.027501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:44.458024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:44.466278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-767571da-f94c-4ee8-9080-3179314fed45 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.466006 May 10 02:43:44.479441 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2715/5473] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:43 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:45.489831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:45.491332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:45.498450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:45.501291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:45.502206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:45.503493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:45.863004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:45.890076 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fdeb8622-da51-48e4-8ff2-a1851826d378 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.409926 May 10 02:43:45.890705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2759/5474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:45 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:46.923530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:46.924125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:46.930762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:46.931260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:46.932064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:46.932513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:47.281923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:47.295950 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f801365-b082-4c3d-a112-2ff756ead106 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.392359 May 10 02:43:47.296873 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2716/5475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:46 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:48.313127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:48.313769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:48.324219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:48.328065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:48.329160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:48.333515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:48.701891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:48.711787 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-06aaecb2-3636-4e9b-8576-60de97186dd8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.402539 May 10 02:43:48.717712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2760/5476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:48 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:49.735447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:49.738036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:49.752460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:49.753010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:49.753900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:49.755157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:50.142895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:50.174862 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-73f99c37-4e3c-4cf5-a88e-401df9b52a83 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.437057 May 10 02:43:50.175615 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2717/5477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:49 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:51.193437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:51.194764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:51.204739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:51.205196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:51.205996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:51.206447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:51.518500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:51.527001 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-45ab3b06-c4b9-408d-b684-b7c226368799 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1697 microversion: 2.1 time: 0.338490 May 10 02:43:51.535949 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2761/5478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:51 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1697 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:52.552265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:52.552901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:52.576470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:52.581888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:52.582971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:52.583570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:52.998918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:53.010137 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67acdb88-27a0-4b4e-bb17-455bc30901c2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1696 microversion: 2.1 time: 0.459438 May 10 02:43:53.010884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2718/5479] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:52 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1696 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:43:53.684387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6e745266-7ea7-49b3-b92e-9a946b6de564 req-ee484cae-4e8d-4fe9-bc37-b4ba7ff54aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "name": "network-vif-unplugged", "status": "completed", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:53.708233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6e745266-7ea7-49b3-b92e-9a946b6de564 req-ee484cae-4e8d-4fe9-bc37-b4ba7ff54aea service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:53.708801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6e745266-7ea7-49b3-b92e-9a946b6de564 req-ee484cae-4e8d-4fe9-bc37-b4ba7ff54aea service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:53.734328 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6e745266-7ea7-49b3-b92e-9a946b6de564 req-ee484cae-4e8d-4fe9-bc37-b4ba7ff54aea service nova] Creating event network-vif-unplugged:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h2-841089-2 May 10 02:43:53.761108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-6e745266-7ea7-49b3-b92e-9a946b6de564 req-ee484cae-4e8d-4fe9-bc37-b4ba7ff54aea service nova] Instance 50015504-b803-4c32-9611-f2c55402843a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:43:53.812986 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6e745266-7ea7-49b3-b92e-9a946b6de564 req-ee484cae-4e8d-4fe9-bc37-b4ba7ff54aea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115611 May 10 02:43:53.814107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2762/5480] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:43:54.030504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:54.031698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:54.051568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:54.052330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:54.053312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:54.053961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:55.026506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:55.042210 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-39669c8b-1e8e-4c40-b2c3-cf3308a5c28a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1696 microversion: 2.1 time: 1.018583 May 10 02:43:55.049279 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2719/5481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:54 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1696 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:55.869209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2ceda33f-a0e9-4a7d-acb7-a117f7ea01e7 req-e63db7e0-8a9a-4d61-9573-9d5d30b6180f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:55.885353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2ceda33f-a0e9-4a7d-acb7-a117f7ea01e7 req-e63db7e0-8a9a-4d61-9573-9d5d30b6180f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:55.889761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2ceda33f-a0e9-4a7d-acb7-a117f7ea01e7 req-e63db7e0-8a9a-4d61-9573-9d5d30b6180f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:55.919814 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2ceda33f-a0e9-4a7d-acb7-a117f7ea01e7 req-e63db7e0-8a9a-4d61-9573-9d5d30b6180f service nova] Creating event network-changed:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h2-841089-2 May 10 02:43:55.926088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-2ceda33f-a0e9-4a7d-acb7-a117f7ea01e7 req-e63db7e0-8a9a-4d61-9573-9d5d30b6180f service nova] Instance 50015504-b803-4c32-9611-f2c55402843a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:43:55.953851 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2ceda33f-a0e9-4a7d-acb7-a117f7ea01e7 req-e63db7e0-8a9a-4d61-9573-9d5d30b6180f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090655 May 10 02:43:55.959492 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2763/5482] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:43:56.059326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:56.061302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:56.071897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:56.079966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:56.081194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:56.082583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:56.501146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:56.508699 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ff16303-3c3a-4f76-9fee-637dca594f92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1696 microversion: 2.1 time: 0.453422 May 10 02:43:56.512908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2720/5483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:56 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1696 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:57.530817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:57.532438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:57.553916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:57.554674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:57.555703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:57.556435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:57.816613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:57.830196 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c363c675-732a-4939-9703-bcd7ac9aa7d9 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1694 microversion: 2.1 time: 0.307063 May 10 02:43:57.830824 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2764/5484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:57 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1694 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:58.848894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:58.850129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:58.862176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:58.863593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:58.865857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:58.869608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:59.251724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:59.260733 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b92a68b-5292-43bb-b8cd-3d429c5558d5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1691 microversion: 2.1 time: 0.416394 May 10 02:43:59.264524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2721/5485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:58 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1691 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:43:59.282508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:43:59.283994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:59.291542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:59.292239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:59.293186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:59.294012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:59.367287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0aac088b-87b6-4bde-8ba2-2eef7a6b05ee tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action" status: 204 len: 0 microversion: 2.1 time: 0.090414 May 10 02:43:59.369536 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2765/5486] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:43:59 2022] POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:43:59.379125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:43:59.380133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:43:59.386784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:59.387650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:59.389405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:43:59.390286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:43:59.616021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:43:59.646056 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbd58b9f-ae86-4354-b472-fdc3f65eda87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1691 microversion: 2.1 time: 0.270428 May 10 02:43:59.656695 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2722/5487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:43:59 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:00.678312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:00.680181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:00.693406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:00.695690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:00.697680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:00.698667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:01.071372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:01.082323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02d87473-0c66-4172-be95-1a121191e7c5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1691 microversion: 2.1 time: 0.421568 May 10 02:44:01.093443 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2766/5488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:00 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1691 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:02.099250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:02.100581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:02.112685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:02.113474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:02.116062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:02.117255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:02.522694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:02.549448 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7ae0cf2-99b7-423e-97ca-5e4b85ad60ed tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1683 microversion: 2.1 time: 0.454373 May 10 02:44:02.556908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2723/5489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:02 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1683 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:03.084016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fe95b983-891e-4710-a479-28775676b022 req-e01911a1-43f8-43e4-90be-a09243034241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "name": "network-vif-plugged", "status": "completed", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:03.104797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fe95b983-891e-4710-a479-28775676b022 req-e01911a1-43f8-43e4-90be-a09243034241 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:03.108521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fe95b983-891e-4710-a479-28775676b022 req-e01911a1-43f8-43e4-90be-a09243034241 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:03.142424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fe95b983-891e-4710-a479-28775676b022 req-e01911a1-43f8-43e4-90be-a09243034241 service nova] Creating event network-vif-plugged:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h2-841089-2 May 10 02:44:03.162872 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fe95b983-891e-4710-a479-28775676b022 req-e01911a1-43f8-43e4-90be-a09243034241 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082736 May 10 02:44:03.167767 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2767/5490] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:24.907108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:24.909283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:24.923876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:24.925016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:24.931125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:24.931802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:24.994354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23093874-beb0-4d3b-85ee-f110671b2910 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action" status: 200 len: 24572 microversion: 2.1 time: 0.091582 May 10 02:44:24.996367 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2724/5491] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:44:24 2022] POST /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a/action => generated 24572 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:44:26.076578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:26.077406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:26.088824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:26.091741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:26.093070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:26.093632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:26.167268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:44:26.412134 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3bd8b085-3db4-4a87-b519-90aaf72e7556 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "DELETE /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 204 len: 0 microversion: 2.42 time: 0.669462 May 10 02:44:26.419945 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2768/5492] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:44:25 2022] DELETE /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:44:26.436567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:26.437856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:26.465520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:26.468152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:26.469147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:26.471296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:26.808112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:26.823948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:26.830473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:26.839624 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0b4b5b3-5740-4c19-8de5-78a5626d6f43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2959 microversion: 2.42 time: 0.407696 May 10 02:44:26.840313 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2725/5493] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:26 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2959 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:27.863039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:27.863853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:27.881179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:27.884214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:27.908322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:27.911123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:28.232402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:28.254322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:28.255875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:28.257157 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-595ddbb2-5331-477e-99ab-e71f0ada998c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2959 microversion: 2.42 time: 0.398577 May 10 02:44:28.259907 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2769/5494] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:27 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2959 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:29.279447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:29.280657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:29.291646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:29.306031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:29.311999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:29.312784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:29.599333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:29.614826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:29.618475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:29.620548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-67bf8435-9cae-40e6-b568-0fcf5c583a7d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2959 microversion: 2.42 time: 0.346154 May 10 02:44:29.631649 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2726/5495] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:29 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2959 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:30.646547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:30.647334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:30.662247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:30.664593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:30.670217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:30.672279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:31.165648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:31.183545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:31.185605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:31.190516 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57502f24-504b-40cc-916f-4bbf05ade9ca tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2938 microversion: 2.42 time: 0.547893 May 10 02:44:31.191515 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2770/5496] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:30 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2938 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:31.212303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:31.213495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:31.228247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:31.228861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:31.229797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:31.231574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:31.531701 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8eb96b6f-2fc6-464a-ab1f-d7ba6c49e768 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1834 microversion: 2.1 time: 0.324003 May 10 02:44:31.534398 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2727/5497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:31 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1834 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:32.214724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:32.215474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:32.228957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:32.229430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:32.230235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:32.231293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:32.734974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1184a481-6275-4c0d-bf7d-e3e9e8cab0dc req-3c4311ca-94c3-4991-bb64-cd0dc9a7cd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-deleted", "tag": "524ef9b2-c4b1-4920-9b01-d6a636efe97c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:32.765320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1184a481-6275-4c0d-bf7d-e3e9e8cab0dc req-3c4311ca-94c3-4991-bb64-cd0dc9a7cd54 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:32.765966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1184a481-6275-4c0d-bf7d-e3e9e8cab0dc req-3c4311ca-94c3-4991-bb64-cd0dc9a7cd54 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:32.836000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1184a481-6275-4c0d-bf7d-e3e9e8cab0dc req-3c4311ca-94c3-4991-bb64-cd0dc9a7cd54 service nova] Creating event network-vif-deleted:524ef9b2-c4b1-4920-9b01-d6a636efe97c for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:32.874151 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1184a481-6275-4c0d-bf7d-e3e9e8cab0dc req-3c4311ca-94c3-4991-bb64-cd0dc9a7cd54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.393232 May 10 02:44:32.879464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2728/5498] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:32.954615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:32.974242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:32.975831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:32.987863 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43faee33-709c-4576-8998-ce8aa185406d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2871 microversion: 2.42 time: 0.777828 May 10 02:44:32.988486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2771/5499] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:32 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2871 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:33.281758 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 02:44:33.282386 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 02:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 02:44:34.018061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:34.020977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:34.046051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:34.047736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:34.052619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:34.053315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:34.750735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1a3027d1-0370-4acb-891d-2949f3f2d1bd req-32f392c6-e895-4e3b-bd98-a50d7540cc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-unplugged", "status": "completed", "tag": "915b783c-c028-4503-95c9-c4a588f78d66"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:34.779491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1a3027d1-0370-4acb-891d-2949f3f2d1bd req-32f392c6-e895-4e3b-bd98-a50d7540cc47 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:34.780247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1a3027d1-0370-4acb-891d-2949f3f2d1bd req-32f392c6-e895-4e3b-bd98-a50d7540cc47 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:34.822742 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1a3027d1-0370-4acb-891d-2949f3f2d1bd req-32f392c6-e895-4e3b-bd98-a50d7540cc47 service nova] Creating event network-vif-unplugged:915b783c-c028-4503-95c9-c4a588f78d66 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:34.831778 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1a3027d1-0370-4acb-891d-2949f3f2d1bd req-32f392c6-e895-4e3b-bd98-a50d7540cc47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088927 May 10 02:44:34.839002 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2772/5500] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:44:35.555117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:35.582923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:35.597817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:35.602285 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2b7fad5-4874-4051-bfd1-88a2ac295b40 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2711 microversion: 2.42 time: 1.597515 May 10 02:44:35.603554 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2729/5501] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:34 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2711 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:35.652201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6abe2430-83b4-473c-9467-f438336ba4d5 req-ecd8a469-5f4d-4981-828c-2a103a166522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-deleted", "tag": "03d41542-4a81-4658-b31f-590f0f2ea996"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:35.664442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6abe2430-83b4-473c-9467-f438336ba4d5 req-ecd8a469-5f4d-4981-828c-2a103a166522 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:35.664899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6abe2430-83b4-473c-9467-f438336ba4d5 req-ecd8a469-5f4d-4981-828c-2a103a166522 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:35.712257 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6abe2430-83b4-473c-9467-f438336ba4d5 req-ecd8a469-5f4d-4981-828c-2a103a166522 service nova] Creating event network-vif-deleted:03d41542-4a81-4658-b31f-590f0f2ea996 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:35.733155 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6abe2430-83b4-473c-9467-f438336ba4d5 req-ecd8a469-5f4d-4981-828c-2a103a166522 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094590 May 10 02:44:35.734460 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2773/5502] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:44:36.626420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:36.628038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:36.639885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:36.653229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:36.654448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:36.655154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:36.934902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:36.936657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:36.949378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:36.953146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:36.956257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:36.956967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:37.038935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:44:37.219359 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62529085-b7a4-4666-b670-3f8128085b3e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 204 len: 0 microversion: 2.1 time: 0.291239 May 10 02:44:37.223394 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2774/5503] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:44:36 2022] DELETE /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:44:37.369976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0bb30e7b-2de7-4d90-abd6-630944bed457 req-d2555db8-3bfb-4c32-95a4-be0adef9292f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:37.379453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:37.420723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:37.421784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0bb30e7b-2de7-4d90-abd6-630944bed457 req-d2555db8-3bfb-4c32-95a4-be0adef9292f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:37.423822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0bb30e7b-2de7-4d90-abd6-630944bed457 req-d2555db8-3bfb-4c32-95a4-be0adef9292f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:37.429255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:37.440152 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-325e7dd0-a7a4-452e-98e9-b09cb8b37bdd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2373 microversion: 2.42 time: 0.817570 May 10 02:44:37.442548 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2730/5504] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:36 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2373 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:37.457643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3ba79152-38c6-4213-83d7-1345c5233f88 req-928e2975-f607-4dab-b5b9-06ee5c1195d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-unplugged", "status": "completed", "tag": "8ebe326a-6371-48e0-b2c2-fc7da49b1838"}, {"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-unplugged", "status": "completed", "tag": "b29b86f4-aa60-4bf8-9ce5-f4154354e21b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:37.473303 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0bb30e7b-2de7-4d90-abd6-630944bed457 req-d2555db8-3bfb-4c32-95a4-be0adef9292f service nova] Creating event network-changed:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h2-841089-2 May 10 02:44:37.492815 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0bb30e7b-2de7-4d90-abd6-630944bed457 req-d2555db8-3bfb-4c32-95a4-be0adef9292f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267066 May 10 02:44:37.498428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2775/5505] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:37.512274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3ba79152-38c6-4213-83d7-1345c5233f88 req-928e2975-f607-4dab-b5b9-06ee5c1195d6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:37.513246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3ba79152-38c6-4213-83d7-1345c5233f88 req-928e2975-f607-4dab-b5b9-06ee5c1195d6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:37.527110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:37.532876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:37.550563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:37.551033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:37.560026 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3ba79152-38c6-4213-83d7-1345c5233f88 req-928e2975-f607-4dab-b5b9-06ee5c1195d6 service nova] Creating event network-vif-unplugged:8ebe326a-6371-48e0-b2c2-fc7da49b1838 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:37.560998 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3ba79152-38c6-4213-83d7-1345c5233f88 req-928e2975-f607-4dab-b5b9-06ee5c1195d6 service nova] Creating event network-vif-unplugged:b29b86f4-aa60-4bf8-9ce5-f4154354e21b for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:37.567339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:37.568678 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3ba79152-38c6-4213-83d7-1345c5233f88 req-928e2975-f607-4dab-b5b9-06ee5c1195d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.122421 May 10 02:44:37.569989 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2731/5506] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:37.573788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:37.779851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b85a3e81-649c-4617-9cd4-243cf11b5c1b req-1ceebc7b-6b0f-4e74-9dfd-e043129342ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-deleted", "tag": "8ebe326a-6371-48e0-b2c2-fc7da49b1838"}, {"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-deleted", "tag": "b29b86f4-aa60-4bf8-9ce5-f4154354e21b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:37.806631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b85a3e81-649c-4617-9cd4-243cf11b5c1b req-1ceebc7b-6b0f-4e74-9dfd-e043129342ab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:37.810440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b85a3e81-649c-4617-9cd4-243cf11b5c1b req-1ceebc7b-6b0f-4e74-9dfd-e043129342ab service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:37.903196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b85a3e81-649c-4617-9cd4-243cf11b5c1b req-1ceebc7b-6b0f-4e74-9dfd-e043129342ab service nova] Creating event network-vif-deleted:8ebe326a-6371-48e0-b2c2-fc7da49b1838 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:37.904252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b85a3e81-649c-4617-9cd4-243cf11b5c1b req-1ceebc7b-6b0f-4e74-9dfd-e043129342ab service nova] Creating event network-vif-deleted:b29b86f4-aa60-4bf8-9ce5-f4154354e21b for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:37.928693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b85a3e81-649c-4617-9cd4-243cf11b5c1b req-1ceebc7b-6b0f-4e74-9dfd-e043129342ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.151222 May 10 02:44:37.932875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2732/5507] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:44:38.468102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:38.468829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:38.480188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:38.481480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:38.484039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:38.486872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:38.524174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:38.543724 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65df3842-401c-45ad-9b23-bd2dfc5d23de tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1570 microversion: 2.1 time: 1.037317 May 10 02:44:38.549188 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2776/5508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:37 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1570 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:38.682789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:38.695354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:38.704213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:38.705747 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a77597e-1f39-4718-af04-fbaa42a86450 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 2032 microversion: 2.42 time: 0.242694 May 10 02:44:38.706795 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2733/5509] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:38 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 2032 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:39.566534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:39.568029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:39.577631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:39.582526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:39.589058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:39.590420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:39.725296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:39.725932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:39.742555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:39.743026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:39.743886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:39.744341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:40.078046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:40.101620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:40.112120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:40.113635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-897a962a-b1ae-4f32-b568-b73ea18db6e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.392302 May 10 02:44:40.124656 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2734/5510] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:39 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:40.132806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-481202b2-a9b4-42e0-930c-c45e3e36b665 req-a0115ae2-ef68-4bb9-9ec3-347e6c05d5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68403166-3242-4c19-81c3-0f9143739c04", "name": "network-vif-deleted", "tag": "915b783c-c028-4503-95c9-c4a588f78d66"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:40.154851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-481202b2-a9b4-42e0-930c-c45e3e36b665 req-a0115ae2-ef68-4bb9-9ec3-347e6c05d5af service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:40.165909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-481202b2-a9b4-42e0-930c-c45e3e36b665 req-a0115ae2-ef68-4bb9-9ec3-347e6c05d5af service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:40.188814 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-481202b2-a9b4-42e0-930c-c45e3e36b665 req-a0115ae2-ef68-4bb9-9ec3-347e6c05d5af service nova] Creating event network-vif-deleted:915b783c-c028-4503-95c9-c4a588f78d66 for instance 68403166-3242-4c19-81c3-0f9143739c04 on n-h1-841089-2 May 10 02:44:40.203762 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-481202b2-a9b4-42e0-930c-c45e3e36b665 req-a0115ae2-ef68-4bb9-9ec3-347e6c05d5af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085288 May 10 02:44:40.204594 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2735/5511] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:40.788766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:40.798233 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-47eae710-586a-4942-a0cb-ab700a72b9e4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 200 len: 1570 microversion: 2.1 time: 1.236770 May 10 02:44:40.802611 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2777/5512] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:39 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 1570 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:40.916163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-539e2c81-d36f-4cfd-888d-24adfc5a03e4 req-6e7dbc4c-cf9c-41cb-a1de-a779ba0a0f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50015504-b803-4c32-9611-f2c55402843a", "name": "network-vif-deleted", "tag": "3d363b52-4202-4ef6-ac3c-70df6586a011"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:40.932784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-539e2c81-d36f-4cfd-888d-24adfc5a03e4 req-6e7dbc4c-cf9c-41cb-a1de-a779ba0a0f53 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:40.933252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-539e2c81-d36f-4cfd-888d-24adfc5a03e4 req-6e7dbc4c-cf9c-41cb-a1de-a779ba0a0f53 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:40.977152 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-539e2c81-d36f-4cfd-888d-24adfc5a03e4 req-6e7dbc4c-cf9c-41cb-a1de-a779ba0a0f53 service nova] Creating event network-vif-deleted:3d363b52-4202-4ef6-ac3c-70df6586a011 for instance 50015504-b803-4c32-9611-f2c55402843a on n-h2-841089-2 May 10 02:44:40.988765 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-539e2c81-d36f-4cfd-888d-24adfc5a03e4 req-6e7dbc4c-cf9c-41cb-a1de-a779ba0a0f53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077698 May 10 02:44:40.992455 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2736/5513] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:41.132685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:41.133527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:41.143460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:41.147765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:41.148803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:41.149423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:41.344582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:41.368808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:41.372340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:41.374417 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dcfb067c-0b22-4e10-aefa-9b6879e44611 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.245626 May 10 02:44:41.381146 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2778/5514] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:41 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:41.820709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:41.821615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 50015504-b803-4c32-9611-f2c55402843a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:41.838261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:41.838995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:41.840522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:41.841165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:41.865541 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] HTTP exception thrown: Instance 50015504-b803-4c32-9611-f2c55402843a could not be found. May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Request method failure captured: May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a HTTP/1.1 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedEIRAbNM0Jo3AneNP-OCWGVeg17xFLS7hja29WA5Z-srCxfxYhM0V-F9zjXxD7JodFRVlqz3gruxuxzdD9b1l0fCoDMeosp_Y6eJhaWEg6Nm8GDCmzLNhuhS_J-O-NufXl0KV_ky9h5SPBhDZ84FG_tiZoWlnqhEc7hxkSI4TC449U May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7bcf186f5934745913fb3cb5c09eb57", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 8ac6de721f6a4e678d69f195107843dd May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 50015504-b803-4c32-9611-f2c55402843a could not be found. May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '50015504-b803-4c32-9611-f2c55402843a'} May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50015504-b803-4c32-9611-f2c55402843a could not be found. May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50015504-b803-4c32-9611-f2c55402843a could not be found. May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:44:41.867473 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50015504-b803-4c32-9611-f2c55402843a could not be found. May 10 02:44:41.871645 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:44:41.875094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Returning 404 to user: Instance 50015504-b803-4c32-9611-f2c55402843a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:44:41.876222 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f52effd-8ddf-448f-8e41-af3568606f17 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a" status: 404 len: 111 microversion: 2.1 time: 0.060402 May 10 02:44:41.880497 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2737/5515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:41 2022] GET /compute/v2.1/servers/50015504-b803-4c32-9611-f2c55402843a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:44:42.399685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:42.400326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:42.413365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:42.413832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:42.414638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:42.415103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:43.119853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:43.132886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:43.143548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:43.144807 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6fd12ee5-f331-4dd6-a9b3-bd80e9df3623 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.749471 May 10 02:44:43.149561 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2779/5516] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:42 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:44.169215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:44.169853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:44.186369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:44.191830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:44.192931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:44.193550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:44.321449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:44.331569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:44.336580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:44.339460 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acb309fd-4c1d-4ace-a57a-8567f40b6d43 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.174619 May 10 02:44:44.342822 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2738/5517] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:44 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:45.333350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5dbac799-f422-47c1-87f6-06cdf9e02d5f tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Action: 'create', calling method: .version_select at 0x7f3d35d9f0d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-410752425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNasE8qY8N5A4zddz9m86sAi3cf4oDEwk3nXU7DnYndhsp0TH0pxUOTghvKnWpWtV5ykRZuE0nkd7TXaawTJTTklzgYJiVixFHetjr56KDZ32cQzW3+ZBtoQ9hhV3XNaA=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:45.361295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:45.362683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:45.375704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-5dbac799-f422-47c1-87f6-06cdf9e02d5f tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Getting quotas for project bf6e3ad874a1402398d7b64862fd3abc. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:44:45.377004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:45.384608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:45.386914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:45.387515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:45.394302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-5dbac799-f422-47c1-87f6-06cdf9e02d5f tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Getting quotas for user 6b500579a1724eed9e59173fd4e664ba and project bf6e3ad874a1402398d7b64862fd3abc. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:44:45.438156 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5dbac799-f422-47c1-87f6-06cdf9e02d5f tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.460860 May 10 02:44:45.439496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2780/5518] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:44:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:45.611673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:45.633962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:45.646400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:45.651441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-22cc1714-a763-4fbe-9cd5-10a3f4c4fa9b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.293849 May 10 02:44:45.653316 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2739/5519] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:45 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:46.676034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:46.676828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:46.694632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:46.695565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:46.698759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:46.699403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:46.885721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:46.899504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:46.901421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:46.903911 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-331279f6-77f0-4dc4-8d8e-2a10aa40825f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.235117 May 10 02:44:46.904970 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2781/5520] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:46 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:47.925791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:47.927516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:47.942627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:47.943585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:47.949304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:47.949913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:48.085645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:48.096918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:48.101506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:48.103019 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a597e585-bbf9-42ea-8f9d-f417c2aa2fbe tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.183791 May 10 02:44:48.104184 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2740/5521] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:47 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:48.171338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1037942812", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-410752425", "security_groups": [{"name": "tempest-secgroup-smoke-1842417342"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "79f26f7a-d743-4742-adb4-0167e7c7bdf4"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:48.463240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] validate_networks() for [('79f26f7a-d743-4742-adb4-0167e7c7bdf4', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:44:49.122834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:49.124323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:49.140380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:49.144575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:49.148107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:49.151730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:49.359705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:49.373400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:49.376749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:49.381448 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-55811709-17eb-4d38-b2fa-4e97748f62de tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.262668 May 10 02:44:49.396286 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2741/5522] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:49 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:49.832656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Getting quotas for project bf6e3ad874a1402398d7b64862fd3abc. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:44:49.853755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Getting quotas for user 6b500579a1724eed9e59173fd4e664ba and project bf6e3ad874a1402398d7b64862fd3abc. Resources: dict_keys(['metadata_items']) {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:44:49.905810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:44:49.911595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:44:49.912395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:44:49.914676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:44:49.919247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:44:49.945100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:49.949963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:49.951684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:49.952396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:49.999843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Getting quotas for project bf6e3ad874a1402398d7b64862fd3abc. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:44:50.017799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Getting quotas for user 6b500579a1724eed9e59173fd4e664ba and project bf6e3ad874a1402398d7b64862fd3abc. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:44:50.060269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:44:50.063276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:44:50.169861 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae47ba86-a648-46f7-9ead-5d3b4614b902 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.002201 May 10 02:44:50.173180 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2782/5523] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:44:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:44:50.183087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-987e3abd-817d-458a-bb98-ddacf4bdd0d4 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:50.183701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-987e3abd-817d-458a-bb98-ddacf4bdd0d4 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:50.306878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-987e3abd-817d-458a-bb98-ddacf4bdd0d4 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:50.318819 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-987e3abd-817d-458a-bb98-ddacf4bdd0d4 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1302 microversion: 2.1 time: 0.136349 May 10 02:44:50.323190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2742/5524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:50 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1302 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:50.335392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81d69614-5de7-493a-8423-fcec1551c3e7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '.version_select at 0x7f3d35d7c3a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:50.395520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-81d69614-5de7-493a-8423-fcec1551c3e7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-521456621" status: 202 len: 0 microversion: 2.1 time: 0.064025 May 10 02:44:50.396420 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2783/5525] 10.222.0.52 () {58 vars in 1280 bytes} [Tue May 10 02:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-521456621 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:44:50.417619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:50.418552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:50.434056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:50.437707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d9dd039e-d045-4a6a-a2c9-ea4900ab4829 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: .version_select at 0x7f3d35d11a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1027064232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfnjHiegFvjzOOPHtx/CIRUSDrG6udU09USvxnylSG4mHdBrBmBTi/dtIowcXj5n/Xn3GMGDCezBPgu1F4fg4FEwXpC9DpKdlQUBVaW8vnmdjs3zXitt8Q7oib/bMnt0A=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:50.439544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:50.440800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:50.441453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:50.476428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d9dd039e-d045-4a6a-a2c9-ea4900ab4829 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:44:50.482731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d9dd039e-d045-4a6a-a2c9-ea4900ab4829 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:44:50.579265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:50.588456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d9dd039e-d045-4a6a-a2c9-ea4900ab4829 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.157019 May 10 02:44:50.613330 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2784/5526] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:44:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:50.631364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:50.648135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:50.649765 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b5c86cf-6044-46b5-b44d-52299b2aa9e9 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.237059 May 10 02:44:50.656518 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2743/5527] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:50 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:51.341544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:51.342278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:51.365527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:51.372404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:51.373278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:51.373735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:51.525714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:51.534857 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b554abd0-183b-4de1-9ab1-5b1c7c5834a3 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1306 microversion: 2.1 time: 0.198722 May 10 02:44:51.535473 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2785/5528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:51 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:51.675847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:51.676446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:51.688723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:51.691890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:51.695038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:51.695720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:51.854581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:51.871346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:51.872874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:51.874082 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e76e0b8-77a2-49b1-8481-e879a6c5b21d tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.202845 May 10 02:44:51.874651 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2744/5529] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:51 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:52.554607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:52.555903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:52.577973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:52.578644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:52.579760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:52.582823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:52.737537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:52.774763 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d2e45c3-90a9-49f8-b23d-3d2d2252445d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1360 microversion: 2.1 time: 0.225202 May 10 02:44:52.786565 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2786/5530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:52 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:52.896298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:52.897443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:52.919030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:52.919726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:52.921891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:52.925716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:53.087972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:53.130852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:53.132587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:53.133872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-09a5b77e-91c6-4259-94ec-b541790865ef tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.243404 May 10 02:44:53.134455 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2745/5531] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:52 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:53.794753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:53.796086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:53.813712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:53.815162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:53.816162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:53.816773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:54.155893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:54.158372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:54.179735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:54.180579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:54.181635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:54.182343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:54.205574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:54.217538 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-87ccbb58-53eb-4534-b6bc-45f9864bd198 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.427593 May 10 02:44:54.227721 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2787/5532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:53 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:54.365340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:54.385258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:54.392305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:54.393954 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c384b787-8a67-4f18-bfc9-f75521fda1a6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.243238 May 10 02:44:54.395253 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2746/5533] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:54 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:55.195621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c5f5a698-b675-4b04-b48c-06ed4eeea863 req-c5ea2eef-13a8-43bb-b98a-d1cac2ffee61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4ead59-0efe-456a-9fdd-1972948afb0a", "tag": "66399fb7-29d0-448e-bf25-ebfce7bcbeec"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:44:55.212627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c5f5a698-b675-4b04-b48c-06ed4eeea863 req-c5ea2eef-13a8-43bb-b98a-d1cac2ffee61 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:55.213356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c5f5a698-b675-4b04-b48c-06ed4eeea863 req-c5ea2eef-13a8-43bb-b98a-d1cac2ffee61 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:55.236592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:55.237480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:55.246699 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c5f5a698-b675-4b04-b48c-06ed4eeea863 req-c5ea2eef-13a8-43bb-b98a-d1cac2ffee61 service nova] Creating event network-changed:66399fb7-29d0-448e-bf25-ebfce7bcbeec for instance cc4ead59-0efe-456a-9fdd-1972948afb0a on n-h2-841089-2 May 10 02:44:55.252792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:55.256940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:55.260372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:55.261816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:55.264009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c5f5a698-b675-4b04-b48c-06ed4eeea863 req-c5ea2eef-13a8-43bb-b98a-d1cac2ffee61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072497 May 10 02:44:55.269248 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2788/5534] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:44:55.414511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:55.415262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:55.428736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:55.429458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:55.430419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:55.431029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:55.621199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:55.636840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:55.638685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:55.639986 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a1a5d96-b987-4b82-aa24-db1b14bdb594 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.230070 May 10 02:44:55.651992 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2789/5535] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:55 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:55.899498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:55.908674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e18d7b8d-fd71-40d2-a082-c738c1e7d826 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.678552 May 10 02:44:55.921806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2747/5536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:55 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:44:56.662045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:56.662650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:56.676901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:56.681301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:56.683775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:56.687232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:56.874394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:56.885336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:56.897945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:56.899253 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2a14f60a-9a85-46e7-a950-7f58505c53fb tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.243199 May 10 02:44:56.911185 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2790/5537] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:56 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:56.930902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:56.931473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:56.943401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:56.945948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:56.949792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:56.950454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:57.228198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:57.239393 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e00534f4-9998-46d1-9d56-ba7dd52324c9 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.313918 May 10 02:44:57.270793 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2748/5538] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:56 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:57.924103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:57.924736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:57.944375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:57.944845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:57.945657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:57.946106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:58.129826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:58.140299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:58.141839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:58.143038 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2026378a-eb41-48fc-a526-12de06d97026 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.223373 May 10 02:44:58.153389 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2791/5539] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:57 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:58.256387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:58.257771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:58.267316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:58.268501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:58.269579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:58.270240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:58.567147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:58.577566 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7837f958-673a-46b7-9c37-e56e2d6e2c67 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.324984 May 10 02:44:58.580792 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2749/5540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:58 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:44:59.172435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:59.173194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:59.186966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:59.187976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:59.191079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:59.191774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:59.403295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:59.418099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:59.419979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:59.421572 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-718b997a-ef35-4405-9afc-29ec10f255ec tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.253151 May 10 02:44:59.422657 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2792/5541] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:44:59 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:44:59.597832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:44:59.599408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:44:59.608433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:59.611719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:59.615051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:44:59.615632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:44:59.812453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:44:59.820015 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34818901-e5f2-4942-8550-a12fa47d8de7 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.226004 May 10 02:44:59.820607 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2750/5542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:44:59 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:00.441527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:00.442155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:00.458460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:00.468627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:00.469901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:00.470561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:00.621361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:00.633641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:00.638074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:00.642777 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a38572c-ddb2-45f4-b7c3-0c20b973879e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.203575 May 10 02:45:00.644994 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2793/5543] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:00 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:00.836767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:00.837395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:00.854192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:00.856424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:00.872061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:00.873074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:01.307596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:01.319467 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af9038ca-605f-4a3c-9469-b1a3a27eed3e tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.486575 May 10 02:45:01.338384 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2751/5544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:00 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:01.462132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-be0a358f-4758-4be5-bcde-81209d080eed req-9adc4a44-df59-4e54-a339-33335e69c2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4ead59-0efe-456a-9fdd-1972948afb0a", "name": "network-vif-plugged", "status": "completed", "tag": "66399fb7-29d0-448e-bf25-ebfce7bcbeec"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:01.498499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-be0a358f-4758-4be5-bcde-81209d080eed req-9adc4a44-df59-4e54-a339-33335e69c2aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:01.499455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-be0a358f-4758-4be5-bcde-81209d080eed req-9adc4a44-df59-4e54-a339-33335e69c2aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:01.555580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-be0a358f-4758-4be5-bcde-81209d080eed req-9adc4a44-df59-4e54-a339-33335e69c2aa service nova] Creating event network-vif-plugged:66399fb7-29d0-448e-bf25-ebfce7bcbeec for instance cc4ead59-0efe-456a-9fdd-1972948afb0a on n-h2-841089-2 May 10 02:45:01.585717 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-be0a358f-4758-4be5-bcde-81209d080eed req-9adc4a44-df59-4e54-a339-33335e69c2aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127640 May 10 02:45:01.586640 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2794/5545] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:01.668972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:01.669876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:01.680927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:01.681667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:01.683437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:01.685711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:01.957892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:01.979325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:01.993478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:01.994914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-95f6df3e-969d-451a-b8dc-81651bdae610 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.330530 May 10 02:45:01.996070 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2752/5546] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:01 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:02.013111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1509726182", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "f55ef532-cb57-4f89-b024-8e6b84251300"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1027064232", "security_groups": [{"name": "tempest-secgroup-smoke-751029499"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:02.240064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] validate_networks() for [('f55ef532-cb57-4f89-b024-8e6b84251300', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:45:02.342191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:02.342823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:02.367178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:02.367872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:02.368753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:02.369269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:02.873845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:02.888414 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e836ed1-1a20-4413-a999-e14d5f554259 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1428 microversion: 2.1 time: 0.550071 May 10 02:45:02.894687 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2753/5547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:02 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1428 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:03.015058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:03.015783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:03.062240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:03.062653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:03.063500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:03.063957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:03.453418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:45:03.453873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:45:03.454320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:45:03.454737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:45:03.455577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:45:03.455666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:03.466599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:03.469013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:03.470246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d943c180-375d-453e-8fad-ac56753a52ed tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.460315 May 10 02:45:03.471232 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2754/5548] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:03 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:03.493940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:03.494403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:03.495408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:03.495862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:03.601920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:45:03.618662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:45:03.653909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:45:03.656360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:45:03.765852 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3de4c0ca-b088-4fda-bdb0-b87a83104ceb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.757790 May 10 02:45:03.766694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2795/5549] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:45:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:45:03.782436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2aed4ab5-43d9-44f2-9d27-97e5a8ba41ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:03.783788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2aed4ab5-43d9-44f2-9d27-97e5a8ba41ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:03.914839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:03.915501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:03.926914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:03.932926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:03.935379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2aed4ab5-43d9-44f2-9d27-97e5a8ba41ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:03.936210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:03.936826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:03.944310 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2aed4ab5-43d9-44f2-9d27-97e5a8ba41ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1267 microversion: 2.1 time: 0.166177 May 10 02:45:03.950431 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2755/5550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:03 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:04.156158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:04.167004 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e016c93-3773-4ff3-836c-57f9d8736356 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1606 microversion: 2.1 time: 0.256639 May 10 02:45:04.168302 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2796/5551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:03 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1606 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:04.184855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:04.185210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:04.194868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.195359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.196169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.196625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.490759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:04.492507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:04.507188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:04.508842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.511712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.515913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.518583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f136c3f-42a5-4251-a77e-c98377aa9195 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1606 microversion: 2.1 time: 0.338431 May 10 02:45:04.519347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.522675 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2756/5552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:04 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1606 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:04.540058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:04.540853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:04.552330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.554128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.555107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.559936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.700544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:04.719679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:04.726396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:04.731422 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9ba920b-c255-4160-b7d8-29bc37e4c41c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.244292 May 10 02:45:04.738410 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2797/5553] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:04 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:45:04.964196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:04.965191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:04.973743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.975853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:04.979772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:04.981113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:05.032437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:05.045491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5f84aac3-3dca-4aba-9781-0b242d699412 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1606 microversion: 2.1 time: 0.509683 May 10 02:45:05.046088 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2757/5554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:04 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1606 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:45:05.110239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:05.122531 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa301efd-6184-4965-87ef-8b86c660cd1c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1263 microversion: 2.1 time: 0.158547 May 10 02:45:05.124104 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2798/5555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:04 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:05.753116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:05.753743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:05.783718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:05.784322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:05.785355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:05.787565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:06.047458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:06.057106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:06.073705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:06.080340 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23b51aec-81a7-4a83-a3fb-43e9d7e36d3c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.331989 May 10 02:45:06.084117 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2758/5556] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:05 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:06.140761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:06.142346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:06.164200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:06.165107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:06.169733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:06.172075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:06.721745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:06.730940 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bac8b76d-22c9-4277-8620-941927585a4d tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1325 microversion: 2.1 time: 0.594035 May 10 02:45:06.738226 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2799/5557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:06 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:07.102360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:07.102997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:07.119720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:07.120221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:07.121025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:07.121465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:07.410123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:07.423028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:07.424641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:07.425879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-845dcae3-8248-4f1b-bca4-344c2fc4477c tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.328013 May 10 02:45:07.443464 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2759/5558] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:07 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:07.756532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:07.758005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:07.772798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:07.773267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:07.774059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:07.774505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:08.273977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:08.287157 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1c6f951-a47f-44f5-800a-11abfdbf03be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 0.535023 May 10 02:45:08.289822 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2800/5559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:07 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:08.445993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:08.447447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:08.466688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:08.467829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:08.470170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:08.470827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:08.597388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:08.610329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:08.612443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:08.615390 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d98b74a7-ed37-46e4-8034-ed53e1be168f tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.173768 May 10 02:45:08.616496 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2760/5560] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:08 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:09.309327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:09.310578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:09.324030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:09.327433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:09.330332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:09.332831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:09.634266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:09.635952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:09.659975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:09.667946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:09.672948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:09.673647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:10.044693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:10.058595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:10.065183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:10.066796 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d2596350-ecad-4805-9c2c-87aea51576dd tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.436879 May 10 02:45:10.072637 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2761/5561] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:09 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:45:10.093053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9eed932e-a045-433b-bccc-e4ffc82bf543 req-3e7591a3-c13e-4263-a5ae-e0f4f5665c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:10.108935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9eed932e-a045-433b-bccc-e4ffc82bf543 req-3e7591a3-c13e-4263-a5ae-e0f4f5665c29 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:10.109535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9eed932e-a045-433b-bccc-e4ffc82bf543 req-3e7591a3-c13e-4263-a5ae-e0f4f5665c29 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:10.136932 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9eed932e-a045-433b-bccc-e4ffc82bf543 req-3e7591a3-c13e-4263-a5ae-e0f4f5665c29 service nova] Creating event network-changed:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:45:10.146523 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9eed932e-a045-433b-bccc-e4ffc82bf543 req-3e7591a3-c13e-4263-a5ae-e0f4f5665c29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069873 May 10 02:45:10.150738 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2762/5562] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:10.360061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:10.368991 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2039805c-302b-412d-9027-5924ce592e05 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 1.068474 May 10 02:45:10.373569 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2801/5563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:09 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:10.761230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1b8bedb0-891e-4b04-9ce5-250ee9301358 req-e52211c0-5acd-4c91-81f5-6e7651523d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4ead59-0efe-456a-9fdd-1972948afb0a", "tag": "66399fb7-29d0-448e-bf25-ebfce7bcbeec"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:10.770955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1b8bedb0-891e-4b04-9ce5-250ee9301358 req-e52211c0-5acd-4c91-81f5-6e7651523d01 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:10.771903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1b8bedb0-891e-4b04-9ce5-250ee9301358 req-e52211c0-5acd-4c91-81f5-6e7651523d01 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:10.787031 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1b8bedb0-891e-4b04-9ce5-250ee9301358 req-e52211c0-5acd-4c91-81f5-6e7651523d01 service nova] Creating event network-changed:66399fb7-29d0-448e-bf25-ebfce7bcbeec for instance cc4ead59-0efe-456a-9fdd-1972948afb0a on n-h2-841089-2 May 10 02:45:10.794466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1b8bedb0-891e-4b04-9ce5-250ee9301358 req-e52211c0-5acd-4c91-81f5-6e7651523d01 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039780 May 10 02:45:10.795982 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2763/5564] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:11.098029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:11.098675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:11.115988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:11.118066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:11.120415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:11.121066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:11.319249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:11.337344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:11.339194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:11.344613 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5ea7377-4091-43dc-8403-2bef7e6a21e6 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.256916 May 10 02:45:11.348242 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2802/5565] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:11 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:11.393037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:11.394174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:11.405958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:11.408783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:11.409836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:11.411604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:12.087861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:12.102309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-194923f9-bbd6-4a7b-9220-92de9e3dc6df tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 0.713106 May 10 02:45:12.103170 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2764/5566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:11 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:12.366851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:12.367856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:12.385170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:12.388153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:12.389578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:12.391840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:12.508453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:12.522101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:12.527895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:12.529973 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-60ae1cc5-1841-49bd-8847-b53dcdafd4d0 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.169013 May 10 02:45:12.531116 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2803/5567] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:12 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:13.118715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:13.119472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:13.132943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:13.133536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:13.136453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:13.136999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:13.340680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:13.347930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-27ccc6c4-5a8f-449a-8ed7-e16578212ec3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 0.233297 May 10 02:45:13.357979 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2765/5568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:13 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:13.549788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:13.550549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:13.566494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:13.566494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:13.566494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:13.566494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:13.656469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:13.665706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:13.668749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:13.671384 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-13dde740-bb78-40cf-885d-be375879a888 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.125676 May 10 02:45:13.672445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2804/5569] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:13 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:14.365547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:14.366258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:14.378609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:14.380611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:14.381529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:14.382184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:14.637952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:14.647100 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-34a4ebb5-ad8d-4d99-bc04-5a0134314ab7 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 0.285672 May 10 02:45:14.650215 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2766/5570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:14 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:14.692625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:14.693271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:14.700896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:14.702024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:14.713949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:14.714714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:14.796119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:14.815250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:14.816769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:14.818330 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f682b3d-224a-4224-9bcb-b5c15826c540 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.129464 May 10 02:45:14.818540 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2805/5571] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:14 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:15.668123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:15.669277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:15.676219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:15.676864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:15.677827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:15.678448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:15.830724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:15.836603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:15.837816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:15.839616 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1cb122b9-8c70-4e9a-9c18-9d1a7ddbfaa8 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 0.175658 May 10 02:45:15.840680 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2767/5572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:15 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:15.849086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:15.849816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:15.851983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:15.853736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:15.922525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:15.939178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:15.941147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:15.942414 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3879cfe-e0f0-4e1e-b762-88933dc95078 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.109674 May 10 02:45:15.947201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2806/5573] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:15 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:45:16.443987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f9536f37-dafc-4a15-802b-4ca79c40b39e req-bce07544-d306-4bcb-81b6-796a5be40318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "name": "network-vif-plugged", "status": "completed", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:16.463220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f9536f37-dafc-4a15-802b-4ca79c40b39e req-bce07544-d306-4bcb-81b6-796a5be40318 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:16.464619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f9536f37-dafc-4a15-802b-4ca79c40b39e req-bce07544-d306-4bcb-81b6-796a5be40318 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:16.493430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f9536f37-dafc-4a15-802b-4ca79c40b39e req-bce07544-d306-4bcb-81b6-796a5be40318 service nova] Creating event network-vif-plugged:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:45:16.502790 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f9536f37-dafc-4a15-802b-4ca79c40b39e req-bce07544-d306-4bcb-81b6-796a5be40318 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063637 May 10 02:45:16.508563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2768/5574] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:16.857279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:16.858655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:16.866933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:16.867643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:16.868738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:16.869349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:16.962310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:16.963049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:16.981398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:16.985295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:16.994181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:16.995753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:17.075897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:17.084839 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c014c9e-4de6-44a7-a0d5-863e580e5953 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1392 microversion: 2.1 time: 0.231899 May 10 02:45:17.099617 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2807/5575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:16 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:17.100063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:17.111156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:17.113317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:17.114758 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-be4793cf-731a-45a9-8449-7ee09ff2488b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.156918 May 10 02:45:17.115899 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2769/5576] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:16 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:18.102527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:18.103238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:18.110725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.111837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.122527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.123173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.134035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:18.135775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:18.143327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.143788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.144572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.145011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.304658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:18.315487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:18.317995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:18.320141 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90a2e708-0a7c-40b7-be38-87d34e7d3986 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.190219 May 10 02:45:18.321104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2770/5577] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:18 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:45:18.340381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-485522742", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:18.391468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:18.402982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1d4a4bc8-5339-4002-809a-e0f3be075445 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1565 microversion: 2.1 time: 0.304293 May 10 02:45:18.408088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:45:18.414256 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2808/5578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:18 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1565 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:18.420144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:18.421007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:18.427520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.428239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.429214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.429847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.719485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:18.728114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e7558e97-4405-451f-a2be-ccfef2af4b03 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1565 microversion: 2.1 time: 0.312135 May 10 02:45:18.729540 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2809/5579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:18 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1565 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:45:18.778791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:45:18.779514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:45:18.780221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:45:18.780973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:45:18.781615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:45:18.797313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.798018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.799051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:18.799755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:18.824440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Getting quotas for project 98c6e9d7920f434cbb99b645657ca767. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:45:18.832903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Getting quotas for user dc0e827d0287410f87b0ae323e438f49 and project 98c6e9d7920f434cbb99b645657ca767. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:45:18.850235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:45:18.854698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:45:18.906768 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62d61f60-5786-4ba7-ac4b-924f0783b863 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573350 May 10 02:45:18.908517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2771/5580] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:45:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:45:18.919350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec665e48-4cbe-4108-8148-c92a8e654382 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:18.920358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec665e48-4cbe-4108-8148-c92a8e654382 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:19.014823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec665e48-4cbe-4108-8148-c92a8e654382 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:19.026914 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec665e48-4cbe-4108-8148-c92a8e654382 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1213 microversion: 2.1 time: 0.109785 May 10 02:45:19.028600 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2810/5581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:18 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:19.345789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:19.346492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:19.357242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:19.359738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:19.362941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:19.363585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:19.473842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:19.487055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:19.496235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:19.497475 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b003b921-c78b-41a8-a1da-fb736163a772 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.157447 May 10 02:45:19.499916 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2772/5582] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:19 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:20.046199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:20.046859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:20.058087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:20.064519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:20.066256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:20.066893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:20.327234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:20.339028 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-05f7ce12-1f60-4eb5-a383-6e315bf89fd4 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1265 microversion: 2.1 time: 0.297120 May 10 02:45:20.340817 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2811/5583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:20 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:20.520529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:20.522235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:20.533002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:20.533736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:20.534946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:20.535627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:20.996961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:21.006830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:21.008618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:21.011241 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb7ac051-e762-4ee6-b00e-c490db2bb752 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.495105 May 10 02:45:21.012017 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2773/5584] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:20 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:21.356315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:21.359348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:21.367507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:21.368290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:21.370168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:21.371271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:21.472066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:21.487948 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61e0f5b3-9fb0-427c-8e4d-9256a8e243fd tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1271 microversion: 2.1 time: 0.135478 May 10 02:45:21.491005 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2812/5585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:21 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:21.786412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2a763757-2bcd-4a2f-ac43-9fc0809944ce req-c112b94e-5f01-406a-aab7-3c1d6228d9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:21.790462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:21.792440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:21.809297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:21.810658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:21.811923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:21.812548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2a763757-2bcd-4a2f-ac43-9fc0809944ce req-c112b94e-5f01-406a-aab7-3c1d6228d9a4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:21.813157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2a763757-2bcd-4a2f-ac43-9fc0809944ce req-c112b94e-5f01-406a-aab7-3c1d6228d9a4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:21.813764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:21.864341 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2a763757-2bcd-4a2f-ac43-9fc0809944ce req-c112b94e-5f01-406a-aab7-3c1d6228d9a4 service nova] Creating event network-changed:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:45:21.882305 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2a763757-2bcd-4a2f-ac43-9fc0809944ce req-c112b94e-5f01-406a-aab7-3c1d6228d9a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099672 May 10 02:45:21.883421 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2813/5586] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:22.035022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:22.035825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:22.048913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:22.052275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:22.053698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:22.054464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:22.203001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:22.217221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:22.218818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:22.220176 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-22c26e76-c83a-4c25-86e3-83b954bc6cce tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.190737 May 10 02:45:22.221025 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2814/5587] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:22 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:22.316408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:22.324762 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8592cecf-294c-47b2-b504-0f1db7da002b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1565 microversion: 2.1 time: 0.546365 May 10 02:45:22.337209 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2774/5588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:21 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1565 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:22.510382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:22.511488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:22.530408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:22.530948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:22.532141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:22.533025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:22.794834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:22.803723 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39f9706f-04ac-4334-a45f-816fde0002e0 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.298354 May 10 02:45:22.814922 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2815/5589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:22 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:23.242592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:23.243706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:23.260570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:23.261056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:23.266707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:23.267420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:23.411123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:23.428354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:23.429890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:23.431116 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36bd9f12-859f-4ec1-b1fa-2cf931d3848b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.193933 May 10 02:45:23.442441 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2775/5590] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:23 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:23.822039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:23.823850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:23.837363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:23.839500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:23.840564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:23.842021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:23.905359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9f935a86-4c8e-4f1b-8284-5276b7ce3160 req-b84b7f87-8ec3-4b24-9f38-9fcef6c11851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332d29ce-b23b-45d7-b746-6c49fc6b9e02", "tag": "898e76c7-5da0-4cfc-8ebc-40153dcc306f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:23.921004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9f935a86-4c8e-4f1b-8284-5276b7ce3160 req-b84b7f87-8ec3-4b24-9f38-9fcef6c11851 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:23.921466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9f935a86-4c8e-4f1b-8284-5276b7ce3160 req-b84b7f87-8ec3-4b24-9f38-9fcef6c11851 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:23.936125 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9f935a86-4c8e-4f1b-8284-5276b7ce3160 req-b84b7f87-8ec3-4b24-9f38-9fcef6c11851 service nova] Creating event network-changed:898e76c7-5da0-4cfc-8ebc-40153dcc306f for instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 on n-h2-841089-2 May 10 02:45:23.943571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9f935a86-4c8e-4f1b-8284-5276b7ce3160 req-b84b7f87-8ec3-4b24-9f38-9fcef6c11851 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041420 May 10 02:45:23.944884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2776/5591] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:24.025555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:24.034653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fcb5f99-bc54-45ff-9dcd-318e52a380f6 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.217165 May 10 02:45:24.035492 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2816/5592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:23 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:24.451908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:24.452530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:24.459634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:24.460093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:24.460890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:24.461334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:24.556056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:24.569929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:24.573222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6cc75baab3a4df6a7f69007e79e31e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e613152df54ce2bda1a071df09d6dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:24.574990 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac3ae15a-9b94-4243-b6b0-e61fecfd088e tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 200 len: 1605 microversion: 2.42 time: 0.128759 May 10 02:45:24.575597 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2777/5593] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:24 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 1605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:45:25.053733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:25.055462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:25.064066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:25.064544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:25.066084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:25.066529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:25.270733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:25.280776 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f478303-277d-4c56-9cf7-77953dc33f01 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.232374 May 10 02:45:25.290952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2817/5594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:25 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:25.597435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:25.598111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:25.605743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:25.606206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:25.606984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:25.607464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:25.621813 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] HTTP exception thrown: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Request method failure captured: May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 HTTP/1.1 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiec_qKOdyIMQIP04mEicDuAHshqt7ABRb-LFs58TUQceS1F1qxGf0A3DxLoqKr0MuaMOCgYhMS6MY3EhHkd4OEKNWtGm3B4r0Dgoa2x5qL2w_20HjVPf6ohBSMDgxtjGMWfSOtIlO2PjL_nT_B6yfGSYuB0MnAqfOezA9OhlJHFlDJLU May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.42 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: d2e613152df54ce2bda1a071df09d6dd May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2e613152df54ce2bda1a071df09d6dd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: d2e613152df54ce2bda1a071df09d6dd May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TaggedBootDevicesTest_v242-1967292275-project May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: d6cc75baab3a4df6a7f69007e79e31e9 May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1967292275-project May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '68403166-3242-4c19-81c3-0f9143739c04'} May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:45:25.623517 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Returning 404 to user: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-196ea59c-ebea-4905-9499-286df5281242 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 404 len: 111 microversion: 2.42 time: 0.031670 May 10 02:45:25.631465 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2778/5595] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:25 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 02:45:25.640857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a0311478-c75c-4308-8dc5-ee72547b2f14 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '.version_select at 0x7f3d35d42700>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:25.659096 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a0311478-c75c-4308-8dc5-ee72547b2f14 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1477111006" status: 204 len: 0 microversion: 2.42 time: 0.029012 May 10 02:45:25.659674 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2818/5596] 10.222.0.52 () {60 vars in 1261 bytes} [Tue May 10 02:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1477111006 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:45:26.297940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:26.298588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:26.309494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:26.309979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:26.310760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:26.311227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:26.519961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:26.534710 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee1f87fc-ef34-4c84-a8d3-fc6f8bff46ec tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.240102 May 10 02:45:26.535335 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2779/5597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:26 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:27.564498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:27.567340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:27.581815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:27.582278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:27.583765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:27.584094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:27.787568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:27.807615 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9976a922-d79c-49b6-8a84-175d87065a51 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.258921 May 10 02:45:27.808315 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2819/5598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:27 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:28.825002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:28.826508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:28.833446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:28.833895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:28.834669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:28.835139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:29.045990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:29.046620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:29.054360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:29.054955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:29.056357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:29.057554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:29.066208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:29.073949 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] HTTP exception thrown: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.075932 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd93a50f-5a88-4ff8-8c05-c943490d36f3 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.255405 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Request method failure captured: May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 HTTP/1.1 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec_qKOdyIMQIP04mEicDuAHshqt7ABRb-LFs58TUQceS1F1qxGf0A3DxLoqKr0MuaMOCgYhMS6MY3EhHkd4OEKNWtGm3B4r0Dgoa2x5qL2w_20HjVPf6ohBSMDgxtjGMWfSOtIlO2PjL_nT_B6yfGSYuB0MnAqfOezA9OhlJHFlDJLU May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.42 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: d2e613152df54ce2bda1a071df09d6dd May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2e613152df54ce2bda1a071df09d6dd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: d2e613152df54ce2bda1a071df09d6dd May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TaggedBootDevicesTest_v242-1967292275-project May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: d6cc75baab3a4df6a7f69007e79e31e9 May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1967292275-project May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '68403166-3242-4c19-81c3-0f9143739c04'} May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:45:29.076353 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Returning 404 to user: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:45:29.080969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-35ab0831-87c0-4d79-990a-8d9615493407 tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "DELETE /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 404 len: 111 microversion: 2.42 time: 0.038763 May 10 02:45:29.083566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2820/5599] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:45:29 2022] DELETE /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:45:29.088418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:29.089330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] [instance: 68403166-3242-4c19-81c3-0f9143739c04] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:29.089788 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2780/5600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:28 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:29.096146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:29.096796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:29.098239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:29.098686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:29.113765 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] HTTP exception thrown: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Request method failure captured: May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 HTTP/1.1 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiec_qKOdyIMQIP04mEicDuAHshqt7ABRb-LFs58TUQceS1F1qxGf0A3DxLoqKr0MuaMOCgYhMS6MY3EhHkd4OEKNWtGm3B4r0Dgoa2x5qL2w_20HjVPf6ohBSMDgxtjGMWfSOtIlO2PjL_nT_B6yfGSYuB0MnAqfOezA9OhlJHFlDJLU May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Openstack-Nova-Api-Version: 2.42 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: d2e613152df54ce2bda1a071df09d6dd May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2e613152df54ce2bda1a071df09d6dd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2e613152df54ce2bda1a071df09d6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: d2e613152df54ce2bda1a071df09d6dd May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1967292275 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TaggedBootDevicesTest_v242-1967292275-project May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: d6cc75baab3a4df6a7f69007e79e31e9 May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1967292275-project May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '68403166-3242-4c19-81c3-0f9143739c04'} May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.115378 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] Returning 404 to user: Instance 68403166-3242-4c19-81c3-0f9143739c04 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee410f88-98cd-4ec2-a64e-5086ad124c5b tempest-TaggedBootDevicesTest_v242-1967292275 tempest-TaggedBootDevicesTest_v242-1967292275-project] 10.222.0.52 "GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04" status: 404 len: 111 microversion: 2.42 time: 0.032238 May 10 02:45:29.120428 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2821/5601] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:45:29 2022] GET /compute/v2.1/servers/68403166-3242-4c19-81c3-0f9143739c04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 02:45:29.195781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b52ae469-3d97-44ca-b3f4-e6cce39437b9 req-0c66b1f3-b0f9-4352-b306-794bcb7ec0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332d29ce-b23b-45d7-b746-6c49fc6b9e02", "name": "network-vif-plugged", "status": "completed", "tag": "898e76c7-5da0-4cfc-8ebc-40153dcc306f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:29.213792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b52ae469-3d97-44ca-b3f4-e6cce39437b9 req-0c66b1f3-b0f9-4352-b306-794bcb7ec0db service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:29.214559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b52ae469-3d97-44ca-b3f4-e6cce39437b9 req-0c66b1f3-b0f9-4352-b306-794bcb7ec0db service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:29.232511 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b52ae469-3d97-44ca-b3f4-e6cce39437b9 req-0c66b1f3-b0f9-4352-b306-794bcb7ec0db service nova] Creating event network-vif-plugged:898e76c7-5da0-4cfc-8ebc-40153dcc306f for instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 on n-h2-841089-2 May 10 02:45:29.239867 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b52ae469-3d97-44ca-b3f4-e6cce39437b9 req-0c66b1f3-b0f9-4352-b306-794bcb7ec0db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053326 May 10 02:45:29.241255 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2781/5602] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:30.110956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:30.111788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:30.124174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:30.131103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:30.132286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:30.133181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:30.303603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:30.313706 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f412c41-ed6d-47c1-b1f4-6d0539ae174a tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1313 microversion: 2.1 time: 0.211498 May 10 02:45:30.314705 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2822/5603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:30 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:31.332093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:31.333688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:31.343902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:31.344860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:31.345822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:31.346436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:31.578274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:31.587637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ca0cf7b6-b347-42ab-b443-069a25d8854e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1463 microversion: 2.1 time: 0.260242 May 10 02:45:31.599375 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2782/5604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:31 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1463 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:31.605513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ae5312-128b-4cb6-8a3a-ad1b29d10744", "device": "/dev/sdb"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:31.607418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:31.619606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:31.620069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:31.621069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:31.621673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:32.116132 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e1e96bb-0b56-4597-97b9-bbe01aac2929 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "POST /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514804 May 10 02:45:32.116843 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2823/5605] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:45:31 2022] POST /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:45:41.787957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:41.788477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:41.795244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:41.795794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:41.797019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:41.797663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:41.824571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-515078da-df2e-4644-9b70-8e5065dfec8d tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042220 May 10 02:45:41.825449 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2783/5606] 10.222.0.52 () {58 vars in 1292 bytes} [Tue May 10 02:45:41 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:45:42.807536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:42.808510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:42.815553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:42.816024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:42.816821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:42.817266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:42.875375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-010dda24-9d84-4382-8c99-18e35b9827f5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action" status: 200 len: 24568 microversion: 2.1 time: 0.073813 May 10 02:45:42.876459 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2824/5607] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:45:42 2022] POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:45:49.308331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:49.308989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:49.316025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:49.316423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:49.317203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:49.317646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:49.445261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-07be06a4-c605-41f9-ab42-c588b04ead46 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1834 microversion: 2.1 time: 0.140890 May 10 02:45:49.446088 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2784/5608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:49 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1834 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:49.463324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:49.464086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:49.471722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:49.472201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:49.472976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:49.473426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:49.610193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:49.617654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a654fe82-5ab8-4b05-8808-ded05ea828d0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1683 microversion: 2.1 time: 0.158853 May 10 02:45:49.618311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2825/5609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:49 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:49.717996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:49.718970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:49.725239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:49.725705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:49.726481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:49.726931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:49.779921 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ebbd9cd-1ca8-4788-ae73-739388c75515 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action" status: 200 len: 32637 microversion: 2.1 time: 0.065679 May 10 02:45:49.781678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2785/5610] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:45:49 2022] POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:45:50.020959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:45:50.021551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:50.029313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:50.029777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:50.030584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:50.031034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:50.166313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8982351ac02f429cb964e6f9b0386930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bed0589f4c4d19a458a8fdcb65a3c6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:50.166944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] flavor_id is None. Assuming migration. {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4142}} May 10 02:45:50.167578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 02:45:50.419648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b448bc36-fc9b-4b6e-99ee-ef528bd0d034 tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action" status: 202 len: 0 microversion: 2.1 time: 0.402340 May 10 02:45:50.423706 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2826/5611] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:45:50 2022] POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:45:50.429047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:50.430346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:50.438124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:50.438775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:50.439779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:50.440487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:50.653157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:50.661626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37497f9f-419e-40f8-b4f4-3615e6ce649e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1692 microversion: 2.1 time: 0.236772 May 10 02:45:50.662445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2786/5612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:50 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:45:51.680095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:51.682042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:51.690758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:51.691314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:51.692167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:51.692684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:51.828056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:51.836178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-20718de4-7d42-4b9f-99ef-a8d8d9b5c05e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1692 microversion: 2.1 time: 0.160493 May 10 02:45:51.837002 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2827/5613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:51 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:52.854446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:52.854994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:52.862949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:52.863529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:52.864334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:52.864787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:53.012958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:53.021167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-237b6b04-16b2-4194-a85d-9dab001cbb16 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.171088 May 10 02:45:53.021986 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2787/5614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:52 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:54.039257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:54.039968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:54.050420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:54.054447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:54.055467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:54.056619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:54.308409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:54.316201 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ffa81b8-22f9-4eca-a230-38fad9f1e4cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.281004 May 10 02:45:54.326657 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2828/5615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:54 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:55.333854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:55.335220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:55.351129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:55.352544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:55.354843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:55.356704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:55.716128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:55.725418 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf6b7ec1-c9a8-434d-9130-49ccf00dadb2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.395435 May 10 02:45:55.737190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2788/5616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:55 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:56.743380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:56.744569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:56.753830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:56.759345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:56.763656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:56.764654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:56.969105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:56.978161 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98a5a4d6-5bcf-4d06-80b0-f30b14cdb498 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.238447 May 10 02:45:56.979145 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2829/5617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:56 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:57.997693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:57.998918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:58.006506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:58.006968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:58.007878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:58.008384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:58.202589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:58.216148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-624d0920-79c8-4e47-a3e5-5bae2d8c25c3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.224646 May 10 02:45:58.231454 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2789/5618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:57 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:45:59.234861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:45:59.236273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:45:59.255785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:59.263163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:59.264704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:45:59.265398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:45:59.433960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:45:59.441721 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1548bcfa-e07e-4339-bd45-4fd6a7415ad4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.211224 May 10 02:45:59.442619 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2830/5619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:45:59 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:00.461053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:00.462219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:00.470266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:00.471144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:00.472200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:00.472725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:01.047934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:01.056562 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e788356-0fa8-4c5d-bf15-3444d5f890a1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.602220 May 10 02:46:01.066647 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2790/5620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:00 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:02.078263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:02.078908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:02.096582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:02.097915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:02.104543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:02.105975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:02.425365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:02.446869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-47c3130b-3737-4b80-99e8-9e02d3fbc848 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.370497 May 10 02:46:02.448222 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2831/5621] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:02 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:03.465243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:03.465868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:03.482053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:03.483017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:03.484007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:03.484477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:03.735179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:03.744187 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-390793c6-997a-4641-99ca-ef415e8be054 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.283566 May 10 02:46:03.744943 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2791/5622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:03 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:04.768340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:04.769420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:04.797252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:04.800253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:04.803753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:04.804421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:05.258185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:05.266783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25acd8af-29ce-4bde-bc05-33203a8a1abb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1697 microversion: 2.1 time: 0.508456 May 10 02:46:05.277827 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2832/5623] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:04 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1697 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:05.931106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e3eb3e6c-4411-4b8f-b6d9-5dbd9dae3cb9 req-f30a09c9-96d7-4d7d-ba70-a6b7c79be78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "name": "network-vif-unplugged", "status": "completed", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:05.952342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e3eb3e6c-4411-4b8f-b6d9-5dbd9dae3cb9 req-f30a09c9-96d7-4d7d-ba70-a6b7c79be78f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:05.953076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e3eb3e6c-4411-4b8f-b6d9-5dbd9dae3cb9 req-f30a09c9-96d7-4d7d-ba70-a6b7c79be78f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:05.981889 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e3eb3e6c-4411-4b8f-b6d9-5dbd9dae3cb9 req-f30a09c9-96d7-4d7d-ba70-a6b7c79be78f service nova] Creating event network-vif-unplugged:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h2-841089-2 May 10 02:46:05.989789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-e3eb3e6c-4411-4b8f-b6d9-5dbd9dae3cb9 req-f30a09c9-96d7-4d7d-ba70-a6b7c79be78f service nova] Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:46:06.003234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e3eb3e6c-4411-4b8f-b6d9-5dbd9dae3cb9 req-f30a09c9-96d7-4d7d-ba70-a6b7c79be78f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098131 May 10 02:46:06.004476 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2792/5624] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:06.285653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:06.286399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:06.310630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:06.312112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:06.313259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:06.318809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:06.744480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:06.756873 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a14199b-63b6-43f2-9a79-d3b03fe46d20 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1696 microversion: 2.1 time: 0.476561 May 10 02:46:06.757466 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2833/5625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:06 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1696 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:06.760325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-149696361", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "98dc69e8-39cb-43e2-b219-5caba1ff4b21"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:06.848409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] validate_networks() for [('98dc69e8-39cb-43e2-b219-5caba1ff4b21', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:46:07.681507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:46:07.682059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:46:07.682409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:46:07.682827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:46:07.683275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:46:07.697543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:07.698231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:07.699577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:07.700327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:07.720777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Getting quotas for project 1d031a8c0ecb4a9a816621ed30185eb7. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:46:07.726561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Getting quotas for user 94b3f15fd38f4c25aba3c7a324b112e8 and project 1d031a8c0ecb4a9a816621ed30185eb7. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:46:07.745044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:46:07.747491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:46:07.775393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:07.776590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:07.795110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:07.796539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:07.800085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:07.802250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:07.815937 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d43757d4-5c62-4178-aa84-51c145174c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300967 May 10 02:46:07.822609 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2793/5626] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:46:07.828988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e89df2b-73ad-4fcc-8f46-8fe5f60df2fc tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:07.834804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e89df2b-73ad-4fcc-8f46-8fe5f60df2fc tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:07.968563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e89df2b-73ad-4fcc-8f46-8fe5f60df2fc tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:07.975636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e89df2b-73ad-4fcc-8f46-8fe5f60df2fc tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1217 microversion: 2.1 time: 0.151581 May 10 02:46:07.986304 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2794/5627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:07 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:08.054142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-de098123-cd59-4a87-963e-dc53e5e8d7b3 req-a970c366-f475-4a6f-ac09-754954d61b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:08.066119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:08.068165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-de098123-cd59-4a87-963e-dc53e5e8d7b3 req-a970c366-f475-4a6f-ac09-754954d61b4d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:08.068621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-de098123-cd59-4a87-963e-dc53e5e8d7b3 req-a970c366-f475-4a6f-ac09-754954d61b4d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:08.078284 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b42b61d5-817f-4639-b721-e8ca7c6426c0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1696 microversion: 2.1 time: 0.307960 May 10 02:46:08.098116 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-de098123-cd59-4a87-963e-dc53e5e8d7b3 req-a970c366-f475-4a6f-ac09-754954d61b4d service nova] Creating event network-changed:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h2-841089-2 May 10 02:46:08.098783 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2834/5628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:07 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1696 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:08.108843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-de098123-cd59-4a87-963e-dc53e5e8d7b3 req-a970c366-f475-4a6f-ac09-754954d61b4d service nova] Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:46:08.131389 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-de098123-cd59-4a87-963e-dc53e5e8d7b3 req-a970c366-f475-4a6f-ac09-754954d61b4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080627 May 10 02:46:08.132630 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2795/5629] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:46:08.995460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:08.996386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:09.004552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:09.005515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:09.007039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:09.007557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:09.078567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:09.087650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12141b23-d2a6-48f4-a15e-cc80394e1262 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1269 microversion: 2.1 time: 0.096822 May 10 02:46:09.098283 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2835/5630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:08 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1269 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:09.102022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:09.103280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:09.111342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:09.112007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:09.113211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:09.113389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:09.345332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:09.359454 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cbaa082-cba5-4197-8916-332cdc6bbc52 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1694 microversion: 2.1 time: 0.264901 May 10 02:46:09.360927 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2796/5631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:09 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:10.110049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:10.112465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:10.129640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.131846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.134504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.136471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.266032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:10.277452 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75306503-ef5b-4f47-ba06-e1578acd031b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1275 microversion: 2.1 time: 0.174062 May 10 02:46:10.281884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2836/5632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:10 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:10.377661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:10.378288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:10.389678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.390151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.393675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.394146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.603459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:10.612540 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf73b94b-7e13-428b-9b7e-0a38835de406 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1691 microversion: 2.1 time: 0.238782 May 10 02:46:10.613704 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2797/5633] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:10 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:10.630977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:10.631554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:10.638548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.639268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.640253 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.640906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.766615 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e35b7c1c-3af4-441f-8dd5-af8d58153c77 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action" status: 202 len: 0 microversion: 2.1 time: 0.139157 May 10 02:46:10.771272 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2837/5634] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:46:10 2022] POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:46:10.776504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:10.777208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:10.783694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.784150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:10.784947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:10.785384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:11.039856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:11.047598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-274a2d15-d673-433a-9ae0-bc40618977a3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1690 microversion: 2.1 time: 0.275486 May 10 02:46:11.050972 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2798/5635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:10 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1690 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:11.305102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:11.307162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:11.322853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:11.324284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:11.325117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:11.325582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:11.508624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1622681c-1f31-4a01-a338-cdea82050911 req-f893b62c-f5ad-4281-ae47-4e423b7f3699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dab08e9-670c-4fec-8eef-db17b7768b8a", "tag": "a85e7579-0560-4136-99f1-a671de41529c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:11.537952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1622681c-1f31-4a01-a338-cdea82050911 req-f893b62c-f5ad-4281-ae47-4e423b7f3699 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:11.538674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1622681c-1f31-4a01-a338-cdea82050911 req-f893b62c-f5ad-4281-ae47-4e423b7f3699 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:11.557120 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1622681c-1f31-4a01-a338-cdea82050911 req-f893b62c-f5ad-4281-ae47-4e423b7f3699 service nova] Creating event network-changed:a85e7579-0560-4136-99f1-a671de41529c for instance 1dab08e9-670c-4fec-8eef-db17b7768b8a on n-h1-841089-2 May 10 02:46:11.563971 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1622681c-1f31-4a01-a338-cdea82050911 req-f893b62c-f5ad-4281-ae47-4e423b7f3699 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064690 May 10 02:46:11.565397 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2799/5636] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:11.617113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:11.625457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b29d0660-91ac-49d9-aa5e-c19e36d2851a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1317 microversion: 2.1 time: 0.328051 May 10 02:46:11.638115 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2838/5637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:11 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:12.068554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:12.072613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:12.087506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:12.088371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:12.090274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:12.091597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:12.246535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:12.254107 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da57dc3a-1eba-4dbf-8584-c2c277ab3e92 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1690 microversion: 2.1 time: 0.192408 May 10 02:46:12.254625 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2800/5638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:12 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1690 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:12.645979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:12.646610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:12.654259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:12.654717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:12.655533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:12.655976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:12.784918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:12.792252 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4888395a-926d-4aee-b7f1-bb8f51ebc2c1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1317 microversion: 2.1 time: 0.150167 May 10 02:46:12.792875 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2839/5639] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:12 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:12.838663 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 02:46:12.839243 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 02:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 02:46:13.271192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:13.271832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:13.279523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:13.281153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:13.282195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:13.283158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:13.375296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d56b265d-b1f4-4b37-83e3-8447b7584698 req-40a6ceee-21d6-4609-8692-dd67b5f66300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "name": "network-vif-plugged", "status": "completed", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:13.393506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d56b265d-b1f4-4b37-83e3-8447b7584698 req-40a6ceee-21d6-4609-8692-dd67b5f66300 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:13.399457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d56b265d-b1f4-4b37-83e3-8447b7584698 req-40a6ceee-21d6-4609-8692-dd67b5f66300 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:13.415168 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d56b265d-b1f4-4b37-83e3-8447b7584698 req-40a6ceee-21d6-4609-8692-dd67b5f66300 service nova] Creating event network-vif-plugged:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h2-841089-2 May 10 02:46:13.437678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-d56b265d-b1f4-4b37-83e3-8447b7584698 req-40a6ceee-21d6-4609-8692-dd67b5f66300 service nova] Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:46:13.483433 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d56b265d-b1f4-4b37-83e3-8447b7584698 req-40a6ceee-21d6-4609-8692-dd67b5f66300 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112027 May 10 02:46:13.484060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2840/5640] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:46:13.529031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:13.541074 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4273acf2-c341-4a25-8d9d-5fb99c078289 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1690 microversion: 2.1 time: 0.273718 May 10 02:46:13.541675 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2801/5641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:13 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1690 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:13.810099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:13.811574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:13.819436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:13.819954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:13.820795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:13.821244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:14.437287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:14.437287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-485e98fd-5527-415a-a6a6-6d10acb45beb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1317 microversion: 2.1 time: 0.605800 May 10 02:46:14.437287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2841/5642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:13 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:14.558485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:14.559282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:14.566434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:14.566895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:14.567921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:14.568575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:14.802607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-14e81ae9-f3ec-4b2e-8fb7-0b7886fda882 req-71f19487-93a4-4ea8-bc91-834826b10b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "name": "network-vif-unplugged", "status": "completed", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:14.819362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-14e81ae9-f3ec-4b2e-8fb7-0b7886fda882 req-71f19487-93a4-4ea8-bc91-834826b10b48 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:14.819929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-14e81ae9-f3ec-4b2e-8fb7-0b7886fda882 req-71f19487-93a4-4ea8-bc91-834826b10b48 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:14.825127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:14.834925 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f0e59974-34e4-4d3f-9707-afb554900d84 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1690 microversion: 2.1 time: 0.280254 May 10 02:46:14.836809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2802/5643] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:14 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:14.858498 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-14e81ae9-f3ec-4b2e-8fb7-0b7886fda882 req-71f19487-93a4-4ea8-bc91-834826b10b48 service nova] Creating event network-vif-unplugged:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:46:14.864976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-14e81ae9-f3ec-4b2e-8fb7-0b7886fda882 req-71f19487-93a4-4ea8-bc91-834826b10b48 service nova] Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:46:14.876507 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-14e81ae9-f3ec-4b2e-8fb7-0b7886fda882 req-71f19487-93a4-4ea8-bc91-834826b10b48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077380 May 10 02:46:14.878067 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2842/5644] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:15.432832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:15.433575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:15.441843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:15.442877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:15.445384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:15.446834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:15.713025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:15.731877 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-894fe729-10c2-4097-aa67-cacb6e49ed37 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1317 microversion: 2.1 time: 0.303605 May 10 02:46:15.740192 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2803/5645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:15 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:15.856490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:15.857920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:15.865969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:15.867023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:15.868594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:15.869207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:16.060819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:16.069095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-415c235f-6647-4f3e-827b-453c376c9df4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1690 microversion: 2.1 time: 0.217238 May 10 02:46:16.070552 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2843/5646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:15 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:16.663867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4cc87671-22e4-41e2-950f-410cc8a6c4c2 req-2568452b-bddc-4754-a4a3-42b3a230f775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dab08e9-670c-4fec-8eef-db17b7768b8a", "name": "network-vif-plugged", "status": "completed", "tag": "a85e7579-0560-4136-99f1-a671de41529c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:16.685917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4cc87671-22e4-41e2-950f-410cc8a6c4c2 req-2568452b-bddc-4754-a4a3-42b3a230f775 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:16.689981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4cc87671-22e4-41e2-950f-410cc8a6c4c2 req-2568452b-bddc-4754-a4a3-42b3a230f775 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:16.704965 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4cc87671-22e4-41e2-950f-410cc8a6c4c2 req-2568452b-bddc-4754-a4a3-42b3a230f775 service nova] Creating event network-vif-plugged:a85e7579-0560-4136-99f1-a671de41529c for instance 1dab08e9-670c-4fec-8eef-db17b7768b8a on n-h1-841089-2 May 10 02:46:16.710430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4cc87671-22e4-41e2-950f-410cc8a6c4c2 req-2568452b-bddc-4754-a4a3-42b3a230f775 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054805 May 10 02:46:16.711610 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2804/5647] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:16.749732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:16.750699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:16.757288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:16.760119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:16.761152 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:16.761796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:16.901729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-72f91ac4-5fbd-42eb-9fe2-264e72d1bf46 req-27b74cf4-4cad-4db3-901d-9abf87aa6952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:16.913004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-72f91ac4-5fbd-42eb-9fe2-264e72d1bf46 req-27b74cf4-4cad-4db3-901d-9abf87aa6952 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:16.913470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-72f91ac4-5fbd-42eb-9fe2-264e72d1bf46 req-27b74cf4-4cad-4db3-901d-9abf87aa6952 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:16.916994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:16.926502 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ceec9a00-76c8-4bbe-ad2c-9c7cf9dccda7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1317 microversion: 2.1 time: 0.180648 May 10 02:46:16.930590 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2844/5648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:16 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:16.933798 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-72f91ac4-5fbd-42eb-9fe2-264e72d1bf46 req-27b74cf4-4cad-4db3-901d-9abf87aa6952 service nova] Creating event network-changed:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:46:16.939966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-72f91ac4-5fbd-42eb-9fe2-264e72d1bf46 req-27b74cf4-4cad-4db3-901d-9abf87aa6952 service nova] Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 02:46:16.951774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-72f91ac4-5fbd-42eb-9fe2-264e72d1bf46 req-27b74cf4-4cad-4db3-901d-9abf87aa6952 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055938 May 10 02:46:16.952705 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2805/5649] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:46:17.089701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:17.090725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:17.097393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:17.098219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:17.099305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:17.100090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:17.418550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:17.426333 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9ab70c4c-4456-4dc9-b92b-600e85dd8164 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1690 microversion: 2.1 time: 0.342544 May 10 02:46:17.426939 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2845/5650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:17 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:17.948252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:17.950480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:17.958178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:17.958641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:17.960403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:17.960873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:18.117254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:18.125545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e8dc7d18-50ef-40da-926f-830959ebc83b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1317 microversion: 2.1 time: 0.184616 May 10 02:46:18.126130 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2806/5651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:17 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:18.443529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:18.444172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:18.451436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:18.451913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:18.452715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:18.453169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:18.708592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:18.718396 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52789344-fb50-4cbd-a00c-32a96e0bbae6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1683 microversion: 2.1 time: 0.278715 May 10 02:46:18.720343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2846/5652] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:18 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1683 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:19.143372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:19.144664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:19.151763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.153226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.154188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.154784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.344163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:19.352321 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c21ce55-8d84-4347-a5ee-f4246cdafc0b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1506 microversion: 2.1 time: 0.212916 May 10 02:46:19.352896 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2807/5653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:19 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:19.373076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:19.373708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:19.379921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.380395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.381184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.381639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.536074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:19.544142 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0d309b2-c8b0-4807-aa72-cc3993ca2c0d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1506 microversion: 2.1 time: 0.178268 May 10 02:46:19.548949 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2847/5654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:19 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:19.561627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:19.563262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:19.569614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.570186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.571265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.571741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.655896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:46:19.656442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:46:19.657208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:46:19.657736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:46:19.658399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:46:19.733344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:19.741101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.741820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.743552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.744222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.808256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e8857cb1-411d-4691-9050-d37dc62243c9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "POST /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a/action" status: 202 len: 1108 microversion: 2.1 time: 0.250918 May 10 02:46:19.817977 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2808/5655] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:46:19 2022] POST /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a/action => generated 1108 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 10 02:46:19.833431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:19.833970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:19.842574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.843140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:19.844083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:19.844530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:20.005117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:20.013931 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8677af07-460e-4aa5-9acb-9565449c9556 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.194366 May 10 02:46:20.015142 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2848/5656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:19 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:20.739311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-6fa49849-9e07-4d0a-8d31-45aef8d7ada8 req-2acb6494-6589-469d-b585-da52c350138b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "name": "network-vif-plugged", "status": "completed", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:20.776830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6fa49849-9e07-4d0a-8d31-45aef8d7ada8 req-2acb6494-6589-469d-b585-da52c350138b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:20.777299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6fa49849-9e07-4d0a-8d31-45aef8d7ada8 req-2acb6494-6589-469d-b585-da52c350138b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:20.793342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-6fa49849-9e07-4d0a-8d31-45aef8d7ada8 req-2acb6494-6589-469d-b585-da52c350138b service nova] Creating event network-vif-plugged:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:46:20.800659 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-6fa49849-9e07-4d0a-8d31-45aef8d7ada8 req-2acb6494-6589-469d-b585-da52c350138b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066486 May 10 02:46:20.801373 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2809/5657] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:21.037368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:21.038004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:21.045703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:21.046173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:21.046979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:21.047478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:21.196282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:21.208736 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-70afd017-80ef-4947-b929-608278815cb8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.175949 May 10 02:46:21.219743 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2849/5658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:21 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:22.229312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:22.230203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:22.236979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:22.237653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:22.238934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:22.239470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:22.392702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:22.401583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b0b9862c-d1ab-4a98-acdf-f7e77fbbb14d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.178292 May 10 02:46:22.407728 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2810/5659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:22 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:23.420041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:23.421551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:23.431870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:23.432330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:23.433494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:23.433949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:23.655720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:23.663614 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ca51a34a-8e69-4fd4-b09f-16d99d2ada5e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.248283 May 10 02:46:23.664921 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2850/5660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:23 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:24.682291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:24.682670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:24.689763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:24.690129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:24.690914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:24.691511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:24.933425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:24.942418 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8119e9cc-96ae-4d7c-b17b-67e8e44401d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.265005 May 10 02:46:24.943481 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2811/5661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:24 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:25.960028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:25.961782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:25.969883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:25.970554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:25.971565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:25.972016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:26.128811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:26.137224 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79c749b1-57b2-48e2-be66-0c48192b28fd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.181542 May 10 02:46:26.137896 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2851/5662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:25 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:27.153888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:27.154619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:27.162163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:27.162703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:27.163607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:27.164596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:27.311685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:27.320501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-11f708f7-7441-4136-a76a-494d64e393e1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.170308 May 10 02:46:27.321416 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2812/5663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:27 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:28.338197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:28.339179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:28.346121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:28.346662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:28.347614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:28.348136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:28.515906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:28.525055 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ccc3d126-1104-4780-bece-d4afd7533480 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.191386 May 10 02:46:28.525635 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2852/5664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:28 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:29.542925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:29.544410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:29.551530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:29.552077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:29.552956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:29.553505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:29.696651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:29.706333 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6b43828-cfb1-4a2a-acde-626fee4bf526 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.168018 May 10 02:46:29.707026 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2813/5665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:29 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:30.724197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:30.725102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:30.732511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:30.732984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:30.734071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:30.734277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:30.873886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:30.885397 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5e23e2e-0be0-45d3-bc55-605ffae7c4e2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.165159 May 10 02:46:30.886231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2853/5666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:30 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:31.901867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:31.902688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:31.909560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:31.910096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:31.910955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:31.911498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:32.060777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:32.071160 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a3227887-c292-49bd-9cb9-89e418c683f7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.173162 May 10 02:46:32.072432 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2814/5667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:31 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:33.090598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:33.091268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:33.112773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:33.113504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:33.114462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:33.115112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:33.315603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:33.330312 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc80a5ec-c929-4bf3-b244-de90dd55e44f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.244917 May 10 02:46:33.331440 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2854/5668] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:33 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:34.348679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:34.349304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:34.357019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:34.358247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:34.359300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:34.359947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:34.538243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:34.547371 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-367601d0-eb0e-4966-80ef-b10c770655c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.202896 May 10 02:46:34.549831 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2815/5669] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:34 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:35.566631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:35.568528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:35.576528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:35.576987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:35.577972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:35.578423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:35.721664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:35.729837 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e534d668-1f6a-4b5d-93d7-37d3654d8660 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.168509 May 10 02:46:35.730712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2855/5670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:35 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:36.749110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:36.749903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:36.757691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:36.758397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:36.759266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:36.759724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:36.921654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:36.930330 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a581594c-f7e5-432f-bc87-f7b4b7cc35cd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.185253 May 10 02:46:36.931012 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2816/5671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:36 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:37.948096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:37.948637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:37.955866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:37.956332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:37.957305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:37.957752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:38.091658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:38.099452 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-31091219-9758-42f2-87d0-1bf1c574d5c3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.155952 May 10 02:46:38.108984 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2856/5672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:37 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:39.116927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:39.117610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:39.124533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:39.125372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:39.126762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:39.127614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:39.270890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:39.279033 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4870c96-194e-47de-a3e4-75d29a218257 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.166239 May 10 02:46:39.279636 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2817/5673] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:39 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:39.433380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76e7fd94-e1e4-4c26-a295-ba59daa68912 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Action: 'create', calling method: .version_select at 0x7f3d35cdc0d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-930069327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXOVZtrUUuIwQxFF+gakUJi48sCPk9ygVSLpr2b0kDaD0sTwGspY3PvUZQQayJNtpVM41S+pbkd0QuvNgF1FbWBrTYopoYaBCMQpUYklU7pikBznl+ZthgseWC7RGxqhQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:39.448701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-76e7fd94-e1e4-4c26-a295-ba59daa68912 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Getting quotas for project a3f0dffb67564d109e34015e81fb6515. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:46:39.458508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-76e7fd94-e1e4-4c26-a295-ba59daa68912 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Getting quotas for user 1d1309b3e2f34fd39335f551eb84aad8 and project a3f0dffb67564d109e34015e81fb6515. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:46:39.483223 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76e7fd94-e1e4-4c26-a295-ba59daa68912 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.055084 May 10 02:46:39.484197 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2857/5674] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:46:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:40.297617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:40.298290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:40.305815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:40.306302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:40.307613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:40.308078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:40.466457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:40.475989 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1dfda4ab-b330-4b98-be8b-acb1ca5e5bfb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.182507 May 10 02:46:40.476763 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2818/5675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:40 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:40.870522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1762371105", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4172f978-6ef4-4d4a-bcc4-f651f0d53214", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-930069327", "security_groups": [{"name": "tempest-secgroup-smoke-704159626"}], "networks": [{"uuid": "f1ff2ed1-d5bf-4a1a-9a4f-74ff568c130f"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:40.993878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] validate_networks() for [('f1ff2ed1-d5bf-4a1a-9a4f-74ff568c130f', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:46:41.364363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:46:41.364795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:46:41.365275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:46:41.365691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:46:41.366108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:46:41.375893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:41.376349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:41.377156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:41.377606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:41.394566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Getting quotas for project a3f0dffb67564d109e34015e81fb6515. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:46:41.400378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Getting quotas for user 1d1309b3e2f34fd39335f551eb84aad8 and project a3f0dffb67564d109e34015e81fb6515. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:46:41.458657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:46:41.461402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4172f978-6ef4-4d4a-bcc4-f651f0d53214',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:46:41.493703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:41.494400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:41.501538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:41.501993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:41.502776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:41.503244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:41.614124 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-496ac7ca-f45c-4a07-b6d0-204731e03804 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748744 May 10 02:46:41.615828 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2858/5676] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:46:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:46:41.633165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ee9d5ab-ec8c-47fb-a6aa-5f4928e58f14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:41.634059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ee9d5ab-ec8c-47fb-a6aa-5f4928e58f14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:41.684537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:41.693473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d23097b0-e5a3-4972-af13-9c19cabe59f0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.203439 May 10 02:46:41.694552 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2819/5677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:41 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:41.701828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5ee9d5ab-ec8c-47fb-a6aa-5f4928e58f14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:41.708864 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ee9d5ab-ec8c-47fb-a6aa-5f4928e58f14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1098 microversion: 2.1 time: 0.084246 May 10 02:46:41.709653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2859/5678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:41 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1098 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:42.713681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:42.714867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:42.725060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:42.725995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:42.726232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:42.726886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:42.728448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:42.729158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:42.735532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:42.736298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:42.737586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:42.738264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:42.843849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:42.860376 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddd145a7-ffa8-4aa8-bc28-cbe4891eae8e tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1214 microversion: 2.1 time: 0.137032 May 10 02:46:42.872485 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2860/5679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:42 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:43.009644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:43.019522 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbfe95ff-c2a2-49a6-a0fc-f0652591405b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.312813 May 10 02:46:43.020802 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2820/5680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:42 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:43.877662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:43.878843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:43.886718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:43.887213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:43.888186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:43.888792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:44.044282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:44.046574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:44.063003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:44.072860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:44.074234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:44.074890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:44.092835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:44.102118 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80c05124-65b1-4ae0-8d39-510fad7f51bf tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.228262 May 10 02:46:44.104087 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2861/5681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:43 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:44.332642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:44.347535 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3fad0da4-35cc-42b1-b807-cdad25437c05 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.313481 May 10 02:46:44.349099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2821/5682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:44 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:44.514452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6af6cfcf-8540-444d-9c1c-5b63274d08b1 req-b9860338-6c32-49b7-acca-c0f07d1cf79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:44.542047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6af6cfcf-8540-444d-9c1c-5b63274d08b1 req-b9860338-6c32-49b7-acca-c0f07d1cf79c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:44.542760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6af6cfcf-8540-444d-9c1c-5b63274d08b1 req-b9860338-6c32-49b7-acca-c0f07d1cf79c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:44.564655 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6af6cfcf-8540-444d-9c1c-5b63274d08b1 req-b9860338-6c32-49b7-acca-c0f07d1cf79c service nova] Creating event network-changed:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:46:44.589286 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6af6cfcf-8540-444d-9c1c-5b63274d08b1 req-b9860338-6c32-49b7-acca-c0f07d1cf79c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078745 May 10 02:46:44.589902 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2862/5683] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:44.959839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:44.960892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:44.969411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:44.970581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:44.971471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:44.971936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:45.062295 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-14097a1b-0aa7-41ac-9287-30e3ff415fa5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action" status: 200 len: 63033 microversion: 2.1 time: 0.107147 May 10 02:46:45.073068 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2822/5684] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:46:44 2022] POST /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77/action => generated 63033 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:46:45.121376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:45.123492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:45.134186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:45.135015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:45.136066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:45.137191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:45.366223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:45.367222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:45.378463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:45.379175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:45.380125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:45.380760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:45.412854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:45.423212 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-889cad62-7111-498f-aec1-d74389faf07d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.307048 May 10 02:46:45.432939 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2863/5685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:45 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:45.633577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:45.641658 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acd4e342-5ad4-4004-a9bd-5e59de8d65ad tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1513 microversion: 2.1 time: 0.279638 May 10 02:46:45.642233 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2823/5686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:45 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:46.440554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:46.441180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:46.448386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:46.449037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:46.449809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:46.450489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:46.611960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:46.621992 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2944204d-f5e0-4cbf-85cc-ee401285cf14 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.183607 May 10 02:46:46.629526 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2864/5687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:46 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:46.660554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:46.661945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:46.669392 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:46.670261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:46.671086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:46.671701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:46.811199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:46.819406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9bbcd46e-e9bd-476c-b699-fce132d564ce tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.163415 May 10 02:46:46.820708 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2824/5688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:46 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:47.647015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:47.648454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:47.656914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:47.657745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:47.658606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:47.659142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:47.810204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:47.819129 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f1c77602-5cbf-4e00-8112-6e97eab11201 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.176917 May 10 02:46:47.820605 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2865/5689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:47 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:47.838144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:47.838533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:47.846095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:47.846684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:47.847539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:47.848082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:48.000978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:48.008379 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-add4c869-addb-4cd4-83a5-3bdff582f3d8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.174805 May 10 02:46:48.017785 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2825/5690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:47 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:48.837076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:48.837701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:48.845929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:48.846384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:48.847188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:48.847633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:49.028625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:49.030718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:49.041836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:49.042692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:49.044190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:49.044890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:49.236050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:49.246173 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4b0c1d1-f036-44eb-9329-697fd3a5046e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.225101 May 10 02:46:49.248355 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2826/5691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:49 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:49.292531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:49.300427 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac10f89c-04a2-4549-93b7-41ecaae93a6b tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.467821 May 10 02:46:49.301222 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2866/5692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:48 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:50.264546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:50.265176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:50.274473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:50.275563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:50.276529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:50.277188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:50.318064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:50.318696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:50.333963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:50.334433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:50.335813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:50.336265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:50.863281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:50.873749 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d97d57e0-ca6e-4c1c-9d47-66e2cf63deb6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.613059 May 10 02:46:50.874704 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2827/5693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:50 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:50.894310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:50.903441 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f75bbf32-463b-48e1-bab1-777a7797154f tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.589355 May 10 02:46:50.904505 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2867/5694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:50 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:51.245313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:51.245942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:51.252288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:51.253027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:51.253821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:51.254263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:51.408866 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f3ca6a60-48af-47c0-888c-4dd1e46be1ab tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1834 microversion: 2.1 time: 0.167761 May 10 02:46:51.420418 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2828/5695] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:51 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1834 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:51.891097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:51.892945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:51.902448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:51.908193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:51.909362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:51.909964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:51.920130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:51.920753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:51.928411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:51.928977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:51.932200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:51.932667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:52.128656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:52.149488 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ecb8b5b-b56e-40fa-bdc7-12e8fb8c2865 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.257979 May 10 02:46:52.153235 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2868/5696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:51 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:52.223644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:52.234234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-345d6271-d11f-4aaa-be79-d7d71224d943 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.317753 May 10 02:46:52.235217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2829/5697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:51 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:52.493062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:52.493888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:52.495843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d3d2cacd-eb56-40b9-ac59-5033f021d070 req-7c7eeadf-8e9c-49df-9475-bfc64cd2aa63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:52.500870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:52.501586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:52.502605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:52.503342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:52.518376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d3d2cacd-eb56-40b9-ac59-5033f021d070 req-7c7eeadf-8e9c-49df-9475-bfc64cd2aa63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:52.518875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d3d2cacd-eb56-40b9-ac59-5033f021d070 req-7c7eeadf-8e9c-49df-9475-bfc64cd2aa63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:52.535686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:46:52.546597 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d3d2cacd-eb56-40b9-ac59-5033f021d070 req-7c7eeadf-8e9c-49df-9475-bfc64cd2aa63 service nova] Creating event network-changed:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:46:52.556721 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d3d2cacd-eb56-40b9-ac59-5033f021d070 req-7c7eeadf-8e9c-49df-9475-bfc64cd2aa63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064314 May 10 02:46:52.560579 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2830/5698] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:52.642995 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fed6e64-4e9d-4fd1-9b1b-e95a45c72970 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 204 len: 0 microversion: 2.1 time: 0.152890 May 10 02:46:52.643666 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2869/5699] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:46:52 2022] DELETE /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:46:52.654976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:52.657589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:52.664170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:52.664631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:52.665479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:52.666072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:52.847700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:52.855586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d57870b-bda0-4ff7-8aad-0e12cf73b398 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1689 microversion: 2.1 time: 0.205945 May 10 02:46:52.856978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2831/5700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:52 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:53.110136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-09f57b7e-3dd0-4b5c-bfb5-02e4c015d610 req-9dbda53f-1de1-40e9-8fd5-338c8ff9c910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dab08e9-670c-4fec-8eef-db17b7768b8a", "name": "network-vif-plugged", "status": "completed", "tag": "a85e7579-0560-4136-99f1-a671de41529c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:53.128898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-09f57b7e-3dd0-4b5c-bfb5-02e4c015d610 req-9dbda53f-1de1-40e9-8fd5-338c8ff9c910 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.140118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-09f57b7e-3dd0-4b5c-bfb5-02e4c015d610 req-9dbda53f-1de1-40e9-8fd5-338c8ff9c910 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:53.155617 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-09f57b7e-3dd0-4b5c-bfb5-02e4c015d610 req-9dbda53f-1de1-40e9-8fd5-338c8ff9c910 service nova] Creating event network-vif-plugged:a85e7579-0560-4136-99f1-a671de41529c for instance 1dab08e9-670c-4fec-8eef-db17b7768b8a on n-h1-841089-2 May 10 02:46:53.169585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:53.171168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:53.179753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-09f57b7e-3dd0-4b5c-bfb5-02e4c015d610 req-9dbda53f-1de1-40e9-8fd5-338c8ff9c910 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072415 May 10 02:46:53.182330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.182825 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2870/5701] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:53.183561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:53.184617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.185277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:53.252284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:53.253011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:53.266173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.266720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:53.267567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.268027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:53.421244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:53.429395 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-291ea7f6-1456-4c11-bf5e-686695ce4003 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.266284 May 10 02:46:53.430520 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2832/5702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:53 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:53.455570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:53.464707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0ec70e45-777f-44b5-88b4-bcc85b34a51a tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1281 microversion: 2.1 time: 0.216542 May 10 02:46:53.474491 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2871/5703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:53 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:53.878083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:53.880281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:53.897519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.897948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:53.898772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:53.899262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:54.161643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:54.177663 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b475b8c-1b84-4c97-9489-8817593a7b87 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1689 microversion: 2.1 time: 0.305829 May 10 02:46:54.180016 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2833/5704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:53 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1689 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:54.446309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:54.446941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:54.453807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:54.454273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:54.455081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:54.455542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:54.482075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:54.482822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:54.489972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:54.490473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:54.492989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:54.493449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:54.655465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:54.673262 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b123d117-16db-4443-a5a5-2dca57a2a407 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1519 microversion: 2.1 time: 0.231134 May 10 02:46:54.676052 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2872/5705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:54 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:54.693654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-553d8226-b715-4565-8bc2-04442c319c67 req-69df7317-93d0-4fa8-993e-dc5bb199a636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b7056e-3ada-46d2-bdb6-a2b801d75a77", "name": "network-vif-deleted", "tag": "204fa1d5-0c9e-46ff-9dac-3b472b611345"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:54.706302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-553d8226-b715-4565-8bc2-04442c319c67 req-69df7317-93d0-4fa8-993e-dc5bb199a636 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:54.707153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-553d8226-b715-4565-8bc2-04442c319c67 req-69df7317-93d0-4fa8-993e-dc5bb199a636 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:54.722095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-553d8226-b715-4565-8bc2-04442c319c67 req-69df7317-93d0-4fa8-993e-dc5bb199a636 service nova] Creating event network-vif-deleted:204fa1d5-0c9e-46ff-9dac-3b472b611345 for instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 on n-h1-841089-2 May 10 02:46:54.728418 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-553d8226-b715-4565-8bc2-04442c319c67 req-69df7317-93d0-4fa8-993e-dc5bb199a636 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050013 May 10 02:46:54.729616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2873/5706] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:54.748480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:54.757439 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-696b5252-03d3-42e5-8599-6a981640999d tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.279234 May 10 02:46:54.768710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2834/5707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:54 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:55.197617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:55.198364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:55.210769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.211364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.212243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.212765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.248479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.249134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.249592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lazy-loading 'fault' on Instance uuid 75b7056e-3ada-46d2-bdb6-a2b801d75a77 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:46:55.301942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:55.311511 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5966bec8-be57-421a-8973-e6b469b644a6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 200 len: 1509 microversion: 2.1 time: 0.119690 May 10 02:46:55.312445 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2874/5708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:55 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 1509 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:55.691927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:55.692551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:55.699819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.700280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.701055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.701498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.779124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:55.780108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:55.787182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.787673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.789198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.789647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.842795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:55.851090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7cf27e2b-4968-4eba-b4e6-00fbdd4c1844 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1504 microversion: 2.1 time: 0.162529 May 10 02:46:55.851880 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2835/5709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:55 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:55.867752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:55.868338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:55.876288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.876853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.877744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:55.878187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:55.993286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:56.000800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec8d1c20-0b24-4b62-8903-0cfd96b480aa tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.227264 May 10 02:46:56.001589 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2875/5710] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:55 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:56.053472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:56.060990 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89e5cc20-98d2-4348-89ea-ce63b0adb67a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 200 len: 1504 microversion: 2.1 time: 0.197203 May 10 02:46:56.061571 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2836/5711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:55 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:46:56.076821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:56.077360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:56.083464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:56.083935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:56.085248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:56.085701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:56.112265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:46:56.187839 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-371afcfe-6a72-456f-8ab6-88cb00a36de9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 204 len: 0 microversion: 2.1 time: 0.114537 May 10 02:46:56.188516 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2876/5712] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:46:56 2022] DELETE /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:46:56.246138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1593678966", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "98dc69e8-39cb-43e2-b219-5caba1ff4b21"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:56.297324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] validate_networks() for [('98dc69e8-39cb-43e2-b219-5caba1ff4b21', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:46:56.330340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:56.331098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 75b7056e-3ada-46d2-bdb6-a2b801d75a77] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:56.338921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:56.339577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:56.341210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:56.341902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:56.356818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] HTTP exception thrown: Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 could not be found. May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Request method failure captured: May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 HTTP/1.1 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedEIRAbNM0Jo3AneNP-OCWGVeg17xFLS7hja29WA5Z-srCxfxYhM0V-F9zjXxD7JodFRVlqz3gruxuxzdD9b1l0fCoDMeosp_Y6eJhaWEg6Nm8GDCmzLNhuhS_J-O-NufXl0KV_ky9h5SPBhDZ84FG_tiZoWlnqhEc7hxkSI4TC449U May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7bcf186f5934745913fb3cb5c09eb57", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 8ac6de721f6a4e678d69f195107843dd May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 could not be found. May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '75b7056e-3ada-46d2-bdb6-a2b801d75a77'} May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 could not be found. May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 could not be found. May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:46:56.358668 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 could not be found. May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Returning 404 to user: Instance 75b7056e-3ada-46d2-bdb6-a2b801d75a77 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd0b5b7f-0f51-47e0-8108-9cde2194aeb5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77" status: 404 len: 111 microversion: 2.1 time: 0.034271 May 10 02:46:56.362592 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2877/5713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:56 2022] GET /compute/v2.1/servers/75b7056e-3ada-46d2-bdb6-a2b801d75a77 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:46:56.682903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:46:56.683380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:46:56.683862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:46:56.684276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:46:56.684693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:46:56.693810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:56.694962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:56.695737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:56.696185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:56.716312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Getting quotas for project 1d031a8c0ecb4a9a816621ed30185eb7. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:46:56.721562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Getting quotas for user 94b3f15fd38f4c25aba3c7a324b112e8 and project 1d031a8c0ecb4a9a816621ed30185eb7. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:46:56.733898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:46:56.736209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:46:56.824630 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aec52dab-7794-4678-afbd-349d08e28eb2 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582496 May 10 02:46:56.825636 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2837/5714] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:46:56.835700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2be48c5c-d3ed-4c82-9a7e-ada39fbb956e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:56.837063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2be48c5c-d3ed-4c82-9a7e-ada39fbb956e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:56.916844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2be48c5c-d3ed-4c82-9a7e-ada39fbb956e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:56.927168 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2be48c5c-d3ed-4c82-9a7e-ada39fbb956e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1218 microversion: 2.1 time: 0.095669 May 10 02:46:56.939850 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2878/5715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:56 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:57.017020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:57.019763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:57.028089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:57.028830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:57.029832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:57.030479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:57.209534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:57.220176 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71e7f77e-a454-4ead-b0c7-ecf8bfdb0bef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.206622 May 10 02:46:57.221287 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2838/5716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:57 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:57.948930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:57.950394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:57.961571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:57.963216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:57.964838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:57.965744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:58.059657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:58.067473 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94dd87a1-77d9-4054-bd42-71660139bc63 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1288 microversion: 2.1 time: 0.124883 May 10 02:46:58.068048 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2879/5717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:57 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:58.238122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:58.239718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:58.249574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:58.250463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:58.251814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:58.252275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:58.395543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:58.403538 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92d1045f-5db8-43fb-a93f-c9571a9cedb2 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.169425 May 10 02:46:58.404263 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2839/5718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:58 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:58.884269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ce1dc8af-1e35-448e-b1ed-57064a890e37 req-5b463dc3-0399-4825-84d5-10df401e4c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dab08e9-670c-4fec-8eef-db17b7768b8a", "name": "network-vif-deleted", "tag": "a85e7579-0560-4136-99f1-a671de41529c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:46:58.896836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ce1dc8af-1e35-448e-b1ed-57064a890e37 req-5b463dc3-0399-4825-84d5-10df401e4c93 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:58.898184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ce1dc8af-1e35-448e-b1ed-57064a890e37 req-5b463dc3-0399-4825-84d5-10df401e4c93 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:58.914917 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ce1dc8af-1e35-448e-b1ed-57064a890e37 req-5b463dc3-0399-4825-84d5-10df401e4c93 service nova] Creating event network-vif-deleted:a85e7579-0560-4136-99f1-a671de41529c for instance 1dab08e9-670c-4fec-8eef-db17b7768b8a on n-h1-841089-2 May 10 02:46:58.921332 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ce1dc8af-1e35-448e-b1ed-57064a890e37 req-5b463dc3-0399-4825-84d5-10df401e4c93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041543 May 10 02:46:58.923427 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2880/5719] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:46:59.087424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:59.088390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:59.096626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:59.097452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:59.099639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:59.100360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:59.179796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:59.202523 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e345ed75-5e06-460f-b8c9-605ea00b0d75 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1276 microversion: 2.1 time: 0.121017 May 10 02:46:59.204155 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2840/5720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:59 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:46:59.423241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:46:59.424801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:46:59.434390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:59.435047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:59.436026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:46:59.436635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:46:59.781210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:46:59.789845 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19b40116-6eb7-41bd-9789-d1e95ba9dc74 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.371881 May 10 02:46:59.803097 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2881/5721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:46:59 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:00.223170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:00.224412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:00.242602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:00.244883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:00.246784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:00.248325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:00.582753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:00.595209 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9b55984e-0ac5-4e2a-b3f6-afe9c3e3ff4d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.378055 May 10 02:47:00.596437 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2841/5722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:00 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:00.809918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:00.810548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:00.818269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:00.820219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:00.821244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:00.822094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:00.965680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-30f8a27c-b0d6-46b5-8df0-1395c1c6559f req-827c62bf-08fa-4d55-b1f3-a6094d0501f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545b4aab-eb66-4d7b-bbbb-ce095216ef43", "tag": "e8091eae-482c-45fe-aeee-07515496a63b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:00.976359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-30f8a27c-b0d6-46b5-8df0-1395c1c6559f req-827c62bf-08fa-4d55-b1f3-a6094d0501f5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:00.977073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-30f8a27c-b0d6-46b5-8df0-1395c1c6559f req-827c62bf-08fa-4d55-b1f3-a6094d0501f5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:00.990150 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-30f8a27c-b0d6-46b5-8df0-1395c1c6559f req-827c62bf-08fa-4d55-b1f3-a6094d0501f5 service nova] Creating event network-changed:e8091eae-482c-45fe-aeee-07515496a63b for instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 on n-h1-841089-2 May 10 02:47:00.996805 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-30f8a27c-b0d6-46b5-8df0-1395c1c6559f req-827c62bf-08fa-4d55-b1f3-a6094d0501f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034784 May 10 02:47:01.001623 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2842/5723] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:47:01.108646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:01.121328 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e468c1d0-5344-4dc1-a4b2-7e3f3cc62405 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.315356 May 10 02:47:01.122817 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2882/5724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:00 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:01.422409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2db58748-86f5-4660-aea5-c422a7733520 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '.version_select at 0x7f3d36dac790>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:01.463793 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2db58748-86f5-4660-aea5-c422a7733520 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1027064232" status: 202 len: 0 microversion: 2.1 time: 0.045492 May 10 02:47:01.465149 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2843/5725] 10.222.0.52 () {58 vars in 1283 bytes} [Tue May 10 02:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1027064232 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:47:01.492230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41c3fd27-6055-4b81-a21a-40ccd98edf6e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: .version_select at 0x7f3d35ce8430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1530564644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/bVpKoqPBWFBWSbKP01T4aktNcQVWBJHu4c39kSyClpmYBgsjCn2MP21aBcLhoZP1HN0Ep3BhrwAFyMHgtMOadFUm0MPUQntXDKpXg4xqwDoXS6oN+2JljBogMxUDi6A=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:01.509334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-41c3fd27-6055-4b81-a21a-40ccd98edf6e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:47:01.514717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-41c3fd27-6055-4b81-a21a-40ccd98edf6e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:47:01.543003 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41c3fd27-6055-4b81-a21a-40ccd98edf6e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055042 May 10 02:47:01.543885 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2883/5726] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:47:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:01.620121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:01.621138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:01.638463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:01.642326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:01.643832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:01.645919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:01.935622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:01.951400 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a9028804-0b9e-4a6f-b072-5d525c49dde8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.342156 May 10 02:47:01.964247 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2844/5727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:01 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:02.144336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:02.145578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:02.156519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:02.157639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:02.158809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:02.159469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:02.345571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:02.359523 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e3b9e783-6f7c-432d-917c-e5b2b1edfe85 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.223120 May 10 02:47:02.366664 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2884/5728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:02 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:02.968800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:02.969418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:02.978926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:02.983845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:02.989649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:02.990107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:03.220002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:03.229616 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71339758-4a23-4fdd-86fe-6d7b2a457aa9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.264605 May 10 02:47:03.238876 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2845/5729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:02 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:03.386964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:03.388926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:03.402851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:03.403680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:03.405831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:03.406821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:03.672227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:03.683980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-67d91542-0dbb-4f76-88ba-67a907d48d70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.305627 May 10 02:47:03.685923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2885/5730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:03 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:03.760254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ff2e1b61-6a42-4f88-8e78-7801ab9f41d8 req-b5ae0cec-f86f-417c-806a-533ec4723713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "name": "network-vif-plugged", "status": "completed", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:03.778401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff2e1b61-6a42-4f88-8e78-7801ab9f41d8 req-b5ae0cec-f86f-417c-806a-533ec4723713 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:03.779027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ff2e1b61-6a42-4f88-8e78-7801ab9f41d8 req-b5ae0cec-f86f-417c-806a-533ec4723713 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:03.806070 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ff2e1b61-6a42-4f88-8e78-7801ab9f41d8 req-b5ae0cec-f86f-417c-806a-533ec4723713 service nova] Creating event network-vif-plugged:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:47:03.820203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ff2e1b61-6a42-4f88-8e78-7801ab9f41d8 req-b5ae0cec-f86f-417c-806a-533ec4723713 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065101 May 10 02:47:03.820837 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2846/5731] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:04.249019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:04.249983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:04.257436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:04.258159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:04.259382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:04.260065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:04.424902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:04.436951 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b65bf37b-d54c-46ae-9b00-ba81824f9715 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.194497 May 10 02:47:04.447471 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2886/5732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:04 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:04.703925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:04.705460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:04.713551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:04.714221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:04.715270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:04.715789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:04.871544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:04.883794 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c62ef85-d3f1-4720-b4a6-a43b0bed13c6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1269 microversion: 2.1 time: 0.184046 May 10 02:47:04.894766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2847/5733] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:04 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:05.453759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:05.459663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:05.468387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:05.469061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:05.470864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:05.471636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:05.763682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:05.772288 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-885c242e-5447-42fc-a10a-22be0e432395 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.322313 May 10 02:47:05.772882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2887/5734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:05 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:05.900858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:05.902978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:05.911899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:05.914387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:05.915835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:05.916479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:06.086140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:06.094525 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b2d1857-2568-4460-b858-8c423e326bff tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1458 microversion: 2.1 time: 0.197750 May 10 02:47:06.111716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:06.112500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:06.117571 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2848/5735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:05 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1458 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:06.119299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:06.119773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:06.120853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:06.121011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:06.306331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:06.314184 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ccf46bec-4d80-4679-b13d-b9bde631df70 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1458 microversion: 2.1 time: 0.206285 May 10 02:47:06.325402 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2888/5736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:06 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1458 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:06.790132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:06.791339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:06.802978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:06.804880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:06.809206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:06.809951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:07.072734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:07.084754 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5318b818-5e85-456e-908c-5ea6e7aadba5 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.297825 May 10 02:47:07.091265 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2849/5737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:06 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:07.264037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-525d934b-de25-404c-89b2-898ccba06ad3 req-397768c4-4eaa-4482-b579-eb275fe9f7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545b4aab-eb66-4d7b-bbbb-ce095216ef43", "name": "network-vif-plugged", "status": "completed", "tag": "e8091eae-482c-45fe-aeee-07515496a63b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:07.282584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-525d934b-de25-404c-89b2-898ccba06ad3 req-397768c4-4eaa-4482-b579-eb275fe9f7b5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:07.289329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-525d934b-de25-404c-89b2-898ccba06ad3 req-397768c4-4eaa-4482-b579-eb275fe9f7b5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:07.323820 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-525d934b-de25-404c-89b2-898ccba06ad3 req-397768c4-4eaa-4482-b579-eb275fe9f7b5 service nova] Creating event network-vif-plugged:e8091eae-482c-45fe-aeee-07515496a63b for instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 on n-h1-841089-2 May 10 02:47:07.336961 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-525d934b-de25-404c-89b2-898ccba06ad3 req-397768c4-4eaa-4482-b579-eb275fe9f7b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077463 May 10 02:47:07.337923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2889/5738] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:08.108259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:08.109021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:08.117988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:08.126925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:08.128013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:08.128588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:08.726115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:08.735630 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-779c2810-1081-41e9-a0b0-5c99ae2a9527 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1318 microversion: 2.1 time: 0.631472 May 10 02:47:08.736234 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2850/5739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:08 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:09.754456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:09.756819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:09.777396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:09.780824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:09.782655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:09.787876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:10.232850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:10.255539 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f307733f-2e3b-4183-bf9a-79243637f0b8 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1507 microversion: 2.1 time: 0.503081 May 10 02:47:10.263841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-874087757", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "7dfdd1bd-3456-480c-925c-46fa2cc49799"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1530564644", "security_groups": [{"name": "tempest-secgroup-smoke-884822519"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:10.283655 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2890/5740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:09 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:10.294325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:10.294975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:10.321231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:10.321876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:10.322567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:10.322945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:10.704178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] validate_networks() for [('7dfdd1bd-3456-480c-925c-46fa2cc49799', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:47:10.982579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:10.998002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4cb66ae0-9703-4e08-9ca8-075cbe471234 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1507 microversion: 2.1 time: 0.708441 May 10 02:47:10.999348 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2891/5741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:10 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1507 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:11.024916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f1eb9d43-3bf7-4f24-8e12-8917058d6034 req-55178694-cc31-43a2-9c7c-d10d4d3c6a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:11.049619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f1eb9d43-3bf7-4f24-8e12-8917058d6034 req-55178694-cc31-43a2-9c7c-d10d4d3c6a6a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:11.050089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f1eb9d43-3bf7-4f24-8e12-8917058d6034 req-55178694-cc31-43a2-9c7c-d10d4d3c6a6a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:11.093427 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f1eb9d43-3bf7-4f24-8e12-8917058d6034 req-55178694-cc31-43a2-9c7c-d10d4d3c6a6a service nova] Creating event network-changed:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:47:11.100929 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f1eb9d43-3bf7-4f24-8e12-8917058d6034 req-55178694-cc31-43a2-9c7c-d10d4d3c6a6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097095 May 10 02:47:11.106370 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2892/5742] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:11.136473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:11.142017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:11.179880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:11.180366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:11.181254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:11.181655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:11.460581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d4a9d2f-f2fd-4789-84bd-6262f848b8d0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "PUT /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1079 microversion: 2.1 time: 0.352894 May 10 02:47:11.471541 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2893/5743] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:47:11 2022] PUT /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1079 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:11.502888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:11.505600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:11.523478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:11.527006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:11.528092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:11.529887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:12.370111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:47:12.370831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:47:12.371441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:47:12.372010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:47:12.372518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:47:12.408652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:12.413196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:12.418141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:12.418745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:12.435691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:12.445624 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bb0b7423-44d1-4a21-ac24-fd6e6b34dc40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1505 microversion: 2.1 time: 0.963425 May 10 02:47:12.454689 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2894/5744] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:11 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1505 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:12.469650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:12.471442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:12.494662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:12.497180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:12.498758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:12.499404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:12.503561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:47:12.522140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:47:12.559661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:47:12.562191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:47:12.653254 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3e5d81b5-af30-45a8-a203-fe038c714fb6 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.393836 May 10 02:47:12.657743 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2851/5745] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:47:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:47:12.669241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-253dcd32-c099-4a9f-b9ee-e6e13056a560 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:12.677871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-253dcd32-c099-4a9f-b9ee-e6e13056a560 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:12.824771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-253dcd32-c099-4a9f-b9ee-e6e13056a560 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:12.825079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:12.833989 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dd94b884-777d-4439-b4d8-b3f0549d2d22 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1505 microversion: 2.1 time: 0.368468 May 10 02:47:12.841184 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2895/5746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:12 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:12.856840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:12.860251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-253dcd32-c099-4a9f-b9ee-e6e13056a560 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1266 microversion: 2.1 time: 0.194843 May 10 02:47:12.860687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:12.860888 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2852/5747] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:12 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:12.919184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:12.923146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:12.930057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:12.935647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:13.098090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:47:13.098594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:47:13.099205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:47:13.100595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:47:13.101211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:47:13.268684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:13.279633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:13.280913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:13.282660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:13.283331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:13.336607 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1dc99d34-9182-425c-a922-db7b5181e9a3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "POST /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43/action" status: 202 len: 1111 microversion: 2.1 time: 0.483604 May 10 02:47:13.338120 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2896/5748] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:47:12 2022] POST /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43/action => generated 1111 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 10 02:47:13.357340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:13.358213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:13.370804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:13.372158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:13.373214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:13.373833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:13.686952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:13.696107 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2a85320-c337-457f-8f05-3154d5f5f269 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.344205 May 10 02:47:13.711730 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2853/5749] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:13 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:13.889716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:13.891258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:13.909034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:13.911821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:13.913616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:13.919109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:14.000965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-31cf95f1-6452-44d0-b347-aaeb3044a613 req-ed52d6a1-459a-4265-828f-294682ffbbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:14.013611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-31cf95f1-6452-44d0-b347-aaeb3044a613 req-ed52d6a1-459a-4265-828f-294682ffbbdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:14.015338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-31cf95f1-6452-44d0-b347-aaeb3044a613 req-ed52d6a1-459a-4265-828f-294682ffbbdd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:14.045603 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-31cf95f1-6452-44d0-b347-aaeb3044a613 req-ed52d6a1-459a-4265-828f-294682ffbbdd service nova] Creating event network-changed:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:47:14.050500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:14.070627 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-31cf95f1-6452-44d0-b347-aaeb3044a613 req-ed52d6a1-459a-4265-828f-294682ffbbdd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078837 May 10 02:47:14.071918 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-85f35dba-2556-4c67-8560-0534e2abf311 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1262 microversion: 2.1 time: 0.184548 May 10 02:47:14.073116 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2897/5750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:13 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1262 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:14.075584 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2854/5751] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:47:14.716251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:14.717147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:14.730675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:14.733769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:14.734632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:14.735100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:14.984596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:14.986705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:15.006722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:15.009468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:15.013045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:15.015683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:15.025929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:15.035027 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7dd6d1c-09d9-4efa-8252-ce92ea3cc25e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.324925 May 10 02:47:15.053995 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2898/5752] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:14 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:15.094967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:15.095700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:15.109782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:15.120578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:15.124403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:15.125129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:15.139964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lazy-loading 'services' on Instance uuid 332d29ce-b23b-45d7-b746-6c49fc6b9e02 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:47:15.252098 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-511aece2-73a1-406b-8b72-4f1f34ebd16c tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02/os-volume_attachments/f4ae5312-128b-4cb6-8a3a-ad1b29d10744" status: 202 len: 0 microversion: 2.1 time: 0.274791 May 10 02:47:15.252732 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2855/5753] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:47:14 2022] DELETE /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02/os-volume_attachments/f4ae5312-128b-4cb6-8a3a-ad1b29d10744 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:47:15.267177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:15.307887 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-03a0fa10-daa8-4c95-8722-a7b5aa9192dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1324 microversion: 2.1 time: 0.210992 May 10 02:47:15.309293 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2899/5754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:15 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1324 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:16.055282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:16.056660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:16.069203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:16.070311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:16.071463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:16.072386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:16.336988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:16.340243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:16.348697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:16.363922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:16.368406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:16.371900 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e85fedb4-bffd-42c5-a959-cb1c9d0c45c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.317232 May 10 02:47:16.372435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:16.373292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:16.385856 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2856/5755] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:16 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:16.461538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a8ec563c-f152-49ec-988c-008f3330badb req-b1752d6e-289e-4465-9e43-55775635f441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:16.498068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a8ec563c-f152-49ec-988c-008f3330badb req-b1752d6e-289e-4465-9e43-55775635f441 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:16.498750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a8ec563c-f152-49ec-988c-008f3330badb req-b1752d6e-289e-4465-9e43-55775635f441 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:16.547296 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a8ec563c-f152-49ec-988c-008f3330badb req-b1752d6e-289e-4465-9e43-55775635f441 service nova] Creating event network-changed:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:47:16.558929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a8ec563c-f152-49ec-988c-008f3330badb req-b1752d6e-289e-4465-9e43-55775635f441 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100911 May 10 02:47:16.561293 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2857/5756] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:16.618563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:16.635076 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a470fee-01e5-4c27-91bf-37e3989452a2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.312122 May 10 02:47:16.645774 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2900/5757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:16 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:17.396990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:17.399988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:17.420360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:17.421320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:17.424151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:17.424869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:17.653819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:17.654596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:17.671341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:17.676318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:17.677660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:17.678137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:17.754641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:17.763182 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b153d470-bdea-4443-815c-b8532cc3e909 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.376347 May 10 02:47:17.773179 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2858/5758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:17 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:17.893735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:17.905019 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e252f5a9-acf5-4d1f-9ff3-e7db4a92ad8f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.255731 May 10 02:47:17.911503 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2901/5759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:17 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:18.743170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-81f03075-3a0b-4c2b-b856-253fb2708fac req-23f98986-1b75-4dff-a519-bf4420f58c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:18.752123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-81f03075-3a0b-4c2b-b856-253fb2708fac req-23f98986-1b75-4dff-a519-bf4420f58c1d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:18.752580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-81f03075-3a0b-4c2b-b856-253fb2708fac req-23f98986-1b75-4dff-a519-bf4420f58c1d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:18.763277 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-81f03075-3a0b-4c2b-b856-253fb2708fac req-23f98986-1b75-4dff-a519-bf4420f58c1d service nova] Creating event network-changed:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h1-841089-2 May 10 02:47:18.768062 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-81f03075-3a0b-4c2b-b856-253fb2708fac req-23f98986-1b75-4dff-a519-bf4420f58c1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029307 May 10 02:47:18.768646 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2859/5760] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:18.790228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:18.790954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:18.797860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:18.798392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:18.799270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:18.799785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:18.931827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:18.941460 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62e2e067-201a-4d65-9646-d5e78f228c84 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.155680 May 10 02:47:18.951761 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2902/5761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:18 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:18.988237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:18.989044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:18.995893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:18.996907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:18.997950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:18.998489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:19.141108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:19.149409 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c69bfc0-5d31-4095-943e-765286f37ead tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.225395 May 10 02:47:19.150424 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2860/5762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:18 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:19.958982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:19.959622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:19.966692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:19.967270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:19.968067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:19.968522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:20.097885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:20.105308 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a028ca61-2499-4bd0-a26c-398191ed471d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.150301 May 10 02:47:20.105888 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2903/5763] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:19 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:20.167859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:20.168489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:20.175496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:20.176050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:20.176926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:20.177384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:20.319892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:20.330168 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ad291b75-9fc1-45ce-a2e9-d7f5cce7e98a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.163914 May 10 02:47:20.330168 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2861/5764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:20 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:21.122237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:21.123003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:21.130118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:21.131214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:21.132033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:21.132485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:21.286011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:21.300436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0e7f032-ba3d-4b5b-ab3a-b75ebde90082 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.182011 May 10 02:47:21.301139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2904/5765] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:21 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:21.344345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:21.345487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:21.351496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:21.352205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:21.353190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:21.354101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:21.499247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:21.506702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90ec0a2c-5604-4595-be26-0b410eca779b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.166590 May 10 02:47:21.507673 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2862/5766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:21 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:22.321542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:22.322129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:22.329122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:22.329588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:22.330403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:22.330850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:22.465090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:22.472459 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9fb69d0b-722e-405f-b88d-70565ccde758 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.155591 May 10 02:47:22.473265 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2905/5767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:22 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:22.522601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:22.523291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:22.530082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:22.530542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:22.531331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:22.531770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:22.665318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:22.672914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-515b027a-64fd-49c4-8f7c-bed36229c845 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.154171 May 10 02:47:22.673641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2863/5768] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:22 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:23.103357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2d063e4f-bca8-4f42-8843-40479cc5221d req-fb0956e4-be92-475e-924d-89c3aed3c7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "name": "network-vif-plugged", "status": "completed", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:23.111658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2d063e4f-bca8-4f42-8843-40479cc5221d req-fb0956e4-be92-475e-924d-89c3aed3c7ef service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:23.112108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2d063e4f-bca8-4f42-8843-40479cc5221d req-fb0956e4-be92-475e-924d-89c3aed3c7ef service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:23.122961 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2d063e4f-bca8-4f42-8843-40479cc5221d req-fb0956e4-be92-475e-924d-89c3aed3c7ef service nova] Creating event network-vif-plugged:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h1-841089-2 May 10 02:47:23.128629 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2d063e4f-bca8-4f42-8843-40479cc5221d req-fb0956e4-be92-475e-924d-89c3aed3c7ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112910 May 10 02:47:23.129227 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2906/5769] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:47:23.489774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:23.490433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:23.496707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:23.497160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:23.498062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:23.498513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:23.639153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:23.647040 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c544957-086d-4bb2-ab1c-850c140aa98d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.161167 May 10 02:47:23.647653 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2864/5770] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:23 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:23.692067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:23.692902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:23.702273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:23.702731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:23.703672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:23.704221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:23.850997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:23.859391 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-da39d153-4b44-4195-b835-54771101a2e1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1391 microversion: 2.1 time: 0.172880 May 10 02:47:23.860197 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2907/5771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:23 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:24.665567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:24.666325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:24.674216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:24.674682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:24.675508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:24.675962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:24.807809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:24.815479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-619c5ead-9123-4164-b281-713860e449c6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.155243 May 10 02:47:24.816350 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2865/5772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:24 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:24.876411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:24.876984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:24.884956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:24.885484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:24.886307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:24.886787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:25.029703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:25.037676 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dda4aa1f-5408-45eb-8c58-312cb6f67d5b tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1563 microversion: 2.1 time: 0.165268 May 10 02:47:25.038435 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2908/5773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:24 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:25.054795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:25.055637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:25.062098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:25.062563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:25.063386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:25.063837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:25.197723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:25.205112 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-175535f3-b78c-4d3e-8ef5-c7bc29e33c55 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1563 microversion: 2.1 time: 0.155104 May 10 02:47:25.215739 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2866/5774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:25 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:25.832585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:25.833215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:25.839675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:25.840142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:25.840923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:25.841370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:25.978488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:25.988114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f0693099-95ac-4c19-bd25-85e799e2fefa tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.159387 May 10 02:47:25.988952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2909/5775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:25 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:26.019037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:26.019617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:26.027079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.027566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.028416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.028861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.061939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:47:26.148174 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a2d2637-496f-4772-a112-8112bb5c7c3b tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "DELETE /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 204 len: 0 microversion: 2.1 time: 0.132951 May 10 02:47:26.148932 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2867/5776] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:47:26 2022] DELETE /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:47:26.158040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:26.158691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:26.165183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.165655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.166448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.166905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.314042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:26.322208 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79ac5783-ebe2-4938-bb02-609ba9983bd2 tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1469 microversion: 2.1 time: 0.168507 May 10 02:47:26.322802 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2910/5777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:26 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:26.925402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:26.926309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:26.926592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-80c19f49-7c47-4f1f-9f2b-51cb7e6a5fb0 req-4c7fd677-6361-4f04-8a6e-47ba1a68d022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:26.934062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.934531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.935357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.935798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.938055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-80c19f49-7c47-4f1f-9f2b-51cb7e6a5fb0 req-4c7fd677-6361-4f04-8a6e-47ba1a68d022 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:26.938970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-80c19f49-7c47-4f1f-9f2b-51cb7e6a5fb0 req-4c7fd677-6361-4f04-8a6e-47ba1a68d022 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:26.951479 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-80c19f49-7c47-4f1f-9f2b-51cb7e6a5fb0 req-4c7fd677-6361-4f04-8a6e-47ba1a68d022 service nova] Creating event network-changed:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h1-841089-2 May 10 02:47:26.956893 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-80c19f49-7c47-4f1f-9f2b-51cb7e6a5fb0 req-4c7fd677-6361-4f04-8a6e-47ba1a68d022 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034485 May 10 02:47:26.957916 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2911/5778] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:27.009554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:27.012936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:27.024783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:27.025647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:27.026573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:27.027481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:27.127498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:27.135878 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-30323e79-a21e-410e-93a8-3acb6fa37c2c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1563 microversion: 2.1 time: 0.215321 May 10 02:47:27.148046 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2868/5779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:26 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1563 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:27.253506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:27.261641 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02f9dc0b-a311-4471-b096-6bf9d3747426 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.259375 May 10 02:47:27.262681 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2912/5780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:27 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:27.340472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:27.341095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:27.348214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:27.348670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:27.352427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:27.353125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:27.831337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc0e827d0287410f87b0ae323e438f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c6e9d7920f434cbb99b645657ca767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:27.842041 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ba8f137-7014-4494-be68-5ee1b0fa125e tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 200 len: 1469 microversion: 2.1 time: 0.505432 May 10 02:47:27.843106 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2869/5781] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:27 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 1469 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:28.282170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:28.303488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:28.324492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:28.326770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:28.329756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:28.330223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:28.357864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d657e814-4398-4044-ae08-c420c0152d0c req-d98d6fff-ad74-47df-bfa0-3086914870f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332d29ce-b23b-45d7-b746-6c49fc6b9e02", "name": "network-vif-deleted", "tag": "898e76c7-5da0-4cfc-8ebc-40153dcc306f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:28.368233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d657e814-4398-4044-ae08-c420c0152d0c req-d98d6fff-ad74-47df-bfa0-3086914870f2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:28.368694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d657e814-4398-4044-ae08-c420c0152d0c req-d98d6fff-ad74-47df-bfa0-3086914870f2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:28.384513 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d657e814-4398-4044-ae08-c420c0152d0c req-d98d6fff-ad74-47df-bfa0-3086914870f2 service nova] Creating event network-vif-deleted:898e76c7-5da0-4cfc-8ebc-40153dcc306f for instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 on n-h2-841089-2 May 10 02:47:28.389421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d657e814-4398-4044-ae08-c420c0152d0c req-d98d6fff-ad74-47df-bfa0-3086914870f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 May 10 02:47:28.390420 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2870/5782] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:47:28.496151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:28.504610 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0787e532-648c-4c75-bf49-c2a387b8447e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.228390 May 10 02:47:28.505374 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2913/5783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:28 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:28.860914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:28.861630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] [instance: 332d29ce-b23b-45d7-b746-6c49fc6b9e02] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:28.869143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:28.869989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:28.870905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:28.871479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:28.884882 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] HTTP exception thrown: Instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 could not be found. May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Request method failure captured: May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 HTTP/1.1 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedG70gZ4zKb-_qoLF53hPHB8N4sdLxm8h1SWU4g20530arMZ_tnwPwZQkdx9AtvLj9PBSzNP1zUcZGxixCCDge1I1ponjcRPDvr-9LAe4hA9ACZKJeghcp2jrduXCJ9rdm2v_1aS8qEmefysP3w53QP9xHI-AzQ6hGuM8nUhoIuCoaU May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 98c6e9d7920f434cbb99b645657ca767 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesBackupsTest-802112032 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_98c6e9d7920f434cbb99b645657ca767", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98c6e9d7920f434cbb99b645657ca767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/98c6e9d7920f434cbb99b645657ca767"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98c6e9d7920f434cbb99b645657ca767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesBackupsTest-802112032 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 98c6e9d7920f434cbb99b645657ca767 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesBackupsTest-802112032 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesBackupsTest-802112032-project May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: dc0e827d0287410f87b0ae323e438f49 May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesBackupsTest-802112032-project May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 could not be found. May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '332d29ce-b23b-45d7-b746-6c49fc6b9e02'} May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 could not be found. May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 could not be found. May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:47:28.886617 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 could not be found. May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] Returning 404 to user: Instance 332d29ce-b23b-45d7-b746-6c49fc6b9e02 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74477735-c1d7-4ff6-bb68-35f1f38325ae tempest-VolumesBackupsTest-802112032 tempest-VolumesBackupsTest-802112032-project] 10.222.0.52 "GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02" status: 404 len: 111 microversion: 2.1 time: 0.031476 May 10 02:47:28.891059 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2871/5784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:28 2022] GET /compute/v2.1/servers/332d29ce-b23b-45d7-b746-6c49fc6b9e02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:47:29.523165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:29.523799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:29.530605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:29.531168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:29.532308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:29.532744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:29.676383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:29.684744 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddbdd7f9-1f4b-49ab-a6eb-9b9d7097ce62 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.166208 May 10 02:47:29.685329 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2914/5785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:29 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:30.704219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:30.705282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:30.714977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:30.715453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:30.716317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:30.716758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:30.860202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:30.868545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9dd3ebb0-1eed-4db3-8b80-fb1b9d57ed7d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.169293 May 10 02:47:30.869122 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2872/5786] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:30 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:31.885527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:31.886406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:31.894298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:31.894637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:31.895483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:31.896473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:32.037737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:32.046004 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4be3c95c-b21d-493f-a62e-7a79705f00e6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.164681 May 10 02:47:32.046641 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2915/5787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:31 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:33.064042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:33.065228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:33.072435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:33.073067 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:33.073965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:33.074526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:33.283434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:33.291778 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac37f13e-0f79-426d-bcb7-6b4c7198123a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.231604 May 10 02:47:33.292373 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2873/5788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:33 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:34.309315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:34.309945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:34.317447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:34.318490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:34.319241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:34.319992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:34.465252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:34.474462 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9593e59d-3ee9-449f-85fb-1f4cb4fd87cb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.168457 May 10 02:47:34.475886 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2916/5789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:34 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:35.493475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:35.494912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:35.503192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:35.503852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:35.504836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:35.505595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:35.671437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:35.681473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-135d8242-a286-4970-bdb6-d5580cc52d4f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.192735 May 10 02:47:35.682259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2874/5790] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:35 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:36.699119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:36.699782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:36.708630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:36.709117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:36.710321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:36.710751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:36.865828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:36.874201 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-adac29ab-8b81-4182-bc50-80fa0ed8d111 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.179461 May 10 02:47:36.875044 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2917/5791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:36 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:37.892124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:37.892792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:37.900574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:37.901118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:37.902536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:37.903551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:38.039046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:38.046424 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a73e92ba-80e3-4927-89db-f6472447e849 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.158381 May 10 02:47:38.048756 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2875/5792] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:37 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:39.064133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:39.065003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:39.072894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:39.073364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:39.074157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:39.074634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:39.220367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:39.228452 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-419e0980-cdd7-4db2-b948-51d3ebe7886f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.168204 May 10 02:47:39.229296 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2918/5793] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:39 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:40.246247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:40.246866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:40.254089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:40.254551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:40.255444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:40.256557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:40.396029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:40.403820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d1c4685-b10e-41f8-8010-6468b2a2bfe0 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1516 microversion: 2.1 time: 0.161598 May 10 02:47:40.404397 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2876/5794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:40 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:41.420980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:41.421607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:41.428751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:41.429234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:41.430023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:41.430474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:41.575471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:41.583525 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10ee0e11-c72d-433c-9e94-cfff743c4d7f tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1522 microversion: 2.1 time: 0.166531 May 10 02:47:41.584361 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2919/5795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:41 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:42.600990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:42.601846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:42.608995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:42.609662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:42.610460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:42.610917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:42.749625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:42.757717 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2be0a1d-ec7d-47d8-ac84-8b39b7af6b6d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1522 microversion: 2.1 time: 0.160785 May 10 02:47:42.758301 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2877/5796] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:42 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:43.775814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:43.776472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:43.784199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:43.784664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:43.785464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:43.785915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:43.920279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:43.928208 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18064372-d00a-427b-89be-aac6707c8ba9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1522 microversion: 2.1 time: 0.156878 May 10 02:47:43.928797 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2920/5797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:43 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:44.945730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:44.946267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:44.953213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:44.953664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:44.954430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:44.954871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:45.103862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:45.112310 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b6dede0d-961e-4731-9287-aba7755c3fcd tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1522 microversion: 2.1 time: 0.170770 May 10 02:47:45.121371 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2878/5798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:44 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:45.186980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ff2e5569-8646-4d59-ad2b-1851b683e432 req-a275f1d7-e71f-4557-a232-a0767e332428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545b4aab-eb66-4d7b-bbbb-ce095216ef43", "name": "network-vif-plugged", "status": "completed", "tag": "e8091eae-482c-45fe-aeee-07515496a63b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:45.199516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ff2e5569-8646-4d59-ad2b-1851b683e432 req-a275f1d7-e71f-4557-a232-a0767e332428 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:45.200127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ff2e5569-8646-4d59-ad2b-1851b683e432 req-a275f1d7-e71f-4557-a232-a0767e332428 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:45.217714 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ff2e5569-8646-4d59-ad2b-1851b683e432 req-a275f1d7-e71f-4557-a232-a0767e332428 service nova] Creating event network-vif-plugged:e8091eae-482c-45fe-aeee-07515496a63b for instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 on n-h1-841089-2 May 10 02:47:45.223235 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ff2e5569-8646-4d59-ad2b-1851b683e432 req-a275f1d7-e71f-4557-a232-a0767e332428 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042200 May 10 02:47:45.225989 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2921/5799] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:46.132140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:46.132685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:46.141646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.142107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.142906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.143525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.323919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:46.333277 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd5ce76b-a982-4c9f-99db-c48b9ffb4778 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1522 microversion: 2.1 time: 0.207111 May 10 02:47:46.333918 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2879/5800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:46 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:46.441404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:46.447299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-eba64c18-958c-4abe-87c4-5c7d9991bdc4 req-6c39b997-c7f6-4148-93d4-75c39c160480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:46.451294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:46.459636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.460110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.460920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.461376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.469446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-eba64c18-958c-4abe-87c4-5c7d9991bdc4 req-6c39b997-c7f6-4148-93d4-75c39c160480 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.469966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-eba64c18-958c-4abe-87c4-5c7d9991bdc4 req-6c39b997-c7f6-4148-93d4-75c39c160480 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.482239 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-eba64c18-958c-4abe-87c4-5c7d9991bdc4 req-6c39b997-c7f6-4148-93d4-75c39c160480 service nova] Creating event network-changed:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:47:46.487760 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-eba64c18-958c-4abe-87c4-5c7d9991bdc4 req-6c39b997-c7f6-4148-93d4-75c39c160480 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044113 May 10 02:47:46.488744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2880/5801] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:46.505070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:47:46.617588 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a04f0478-efa8-4da1-8ffc-622a555087e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 204 len: 0 microversion: 2.1 time: 0.179998 May 10 02:47:46.630812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:46.634967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:46.637326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2922/5802] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:47:46 2022] DELETE /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:47:46.648004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.648998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.650504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:46.653950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:46.822178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:46.830144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-303fbc3c-1596-4632-8359-851f95518207 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1582 microversion: 2.1 time: 0.206246 May 10 02:47:46.837396 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2881/5803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:46 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1582 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:47.351409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:47.352295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:47.360722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.361266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.362076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.362536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.526936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:47.536026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9108b20c-d0ea-4510-8aca-944ce1077d2d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1507 microversion: 2.1 time: 0.189276 May 10 02:47:47.537787 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2923/5804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:47 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:47.556235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:47.557119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:47.565091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.566070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.567157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.567968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.744762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:47.754037 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8251276d-54c5-4d8f-bc6d-fae79bd50b1b tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 200 len: 1507 microversion: 2.1 time: 0.202899 May 10 02:47:47.754719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2882/5805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:47 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:47.772475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:47.772991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:47.779466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.780008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.780983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.781476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.809831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:47:47.850075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:47.851389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:47.858790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.859688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.860790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:47.861454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:47.925148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42d2463e-b80d-4f1b-a1b1-3b5e0b39f80a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 204 len: 0 microversion: 2.1 time: 0.156425 May 10 02:47:47.926050 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2924/5806] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:47:47 2022] DELETE /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:47:47.993236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-744447389", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "98dc69e8-39cb-43e2-b219-5caba1ff4b21"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:48.049651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:48.060052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] validate_networks() for [('98dc69e8-39cb-43e2-b219-5caba1ff4b21', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:47:48.060374 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-335855c1-1e15-4b48-bd83-0ba1e19cf025 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1582 microversion: 2.1 time: 0.213997 May 10 02:47:48.060964 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2883/5807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:47 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1582 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:48.714500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:47:48.715176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:47:48.715746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:47:48.716275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:47:48.716817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:47:48.726267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:48.726830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:48.727776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:48.728309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:48.745701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Getting quotas for project 1d031a8c0ecb4a9a816621ed30185eb7. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:47:48.751595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Getting quotas for user 94b3f15fd38f4c25aba3c7a324b112e8 and project 1d031a8c0ecb4a9a816621ed30185eb7. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:47:48.767003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:47:48.769497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:47:48.817285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-34b480fa-b63a-4c5c-8efe-5a4ef91c014d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829594 May 10 02:47:48.819099 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2925/5808] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:47:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:47:48.828485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c602b9ca-9446-4a0a-95db-23d8909349ac tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:48.829662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c602b9ca-9446-4a0a-95db-23d8909349ac tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:48.929972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c602b9ca-9446-4a0a-95db-23d8909349ac tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:48.937629 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c602b9ca-9446-4a0a-95db-23d8909349ac tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1217 microversion: 2.1 time: 0.112860 May 10 02:47:48.948627 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2884/5809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:48 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:49.050104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e26f4daf-819d-4411-b002-e7f79d0c3e37 req-3b758e33-f9e1-496d-ae71-0f4a4bf4e7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8213f8-d599-45a5-82f2-10a12532758b", "name": "network-vif-deleted", "tag": "77b4733d-252f-44cc-a658-f88a1ed7f6e5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:49.072388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e26f4daf-819d-4411-b002-e7f79d0c3e37 req-3b758e33-f9e1-496d-ae71-0f4a4bf4e7f6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:49.078082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:49.078721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:49.087193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e26f4daf-819d-4411-b002-e7f79d0c3e37 req-3b758e33-f9e1-496d-ae71-0f4a4bf4e7f6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:49.094843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:49.095343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:49.097920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:49.100616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:49.113255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e26f4daf-819d-4411-b002-e7f79d0c3e37 req-3b758e33-f9e1-496d-ae71-0f4a4bf4e7f6 service nova] Creating event network-vif-deleted:77b4733d-252f-44cc-a658-f88a1ed7f6e5 for instance 4b8213f8-d599-45a5-82f2-10a12532758b on n-h2-841089-2 May 10 02:47:49.120269 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e26f4daf-819d-4411-b002-e7f79d0c3e37 req-3b758e33-f9e1-496d-ae71-0f4a4bf4e7f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079982 May 10 02:47:49.121080 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2926/5810] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:49.196793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:49.205947 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28c084d1-1c82-4a52-8f95-c1b5901438ca tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.132289 May 10 02:47:49.207215 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2885/5811] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:49 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:49.957239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:49.957967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:49.966000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:49.966728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:49.967763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:49.968628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:49.982132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0b5a5f34-a0b0-493b-98b7-5454d3c3c373 req-d137fb72-247e-4f17-975f-3282ed90f858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545b4aab-eb66-4d7b-bbbb-ce095216ef43", "name": "network-vif-deleted", "tag": "e8091eae-482c-45fe-aeee-07515496a63b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:50.014014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0b5a5f34-a0b0-493b-98b7-5454d3c3c373 req-d137fb72-247e-4f17-975f-3282ed90f858 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:50.014793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0b5a5f34-a0b0-493b-98b7-5454d3c3c373 req-d137fb72-247e-4f17-975f-3282ed90f858 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:50.042577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:50.049707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0b5a5f34-a0b0-493b-98b7-5454d3c3c373 req-d137fb72-247e-4f17-975f-3282ed90f858 service nova] Creating event network-vif-deleted:e8091eae-482c-45fe-aeee-07515496a63b for instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 on n-h1-841089-2 May 10 02:47:50.052240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7878ee2-349f-41e0-9ebe-70b9b9277406 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1269 microversion: 2.1 time: 0.100152 May 10 02:47:50.054093 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2927/5812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:49 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:50.065656 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0b5a5f34-a0b0-493b-98b7-5454d3c3c373 req-d137fb72-247e-4f17-975f-3282ed90f858 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093263 May 10 02:47:50.067448 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2886/5813] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:50.223613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:50.224856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:50.235692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:50.236585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:50.241879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:50.242596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:50.410261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:50.431660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:50.432999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:50.436930 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d71b2974-aa7a-4482-a04c-204463309d23 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.203764 May 10 02:47:50.438711 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2928/5814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:50 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:50.444416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:50.445291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:50.446916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:50.447749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:50.516507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e1371421-74dd-46a4-b760-bf22c73a25dc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action" status: 200 len: 24571 microversion: 2.1 time: 0.089701 May 10 02:47:50.517177 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2887/5815] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:47:50 2022] POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:47:51.076383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:51.078460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:51.110045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:51.111256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:51.112774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:51.114243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:51.382601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:51.392773 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-921b84c3-0ec3-4d76-b238-beb4ef9d8ce9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.323841 May 10 02:47:51.406326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2929/5816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:51 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:51.463274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:51.464884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:51.483373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:51.484507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:51.486007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:51.487614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:51.775445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:51.784997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bba0a995-041c-4c55-a651-66a1ff79cd42 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.332401 May 10 02:47:51.786731 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2888/5817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:51 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:52.296556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2711027d-9232-444a-81e2-e213e319c96a req-924c5643-add2-4114-a8b3-1acaa5fa6de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9954010-5d4d-4212-9c51-c5af402d9179", "tag": "df8731ff-81e9-4fd5-a9e7-3afddcf3bff2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:52.309644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2711027d-9232-444a-81e2-e213e319c96a req-924c5643-add2-4114-a8b3-1acaa5fa6de3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:52.311287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2711027d-9232-444a-81e2-e213e319c96a req-924c5643-add2-4114-a8b3-1acaa5fa6de3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:52.350188 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2711027d-9232-444a-81e2-e213e319c96a req-924c5643-add2-4114-a8b3-1acaa5fa6de3 service nova] Creating event network-changed:df8731ff-81e9-4fd5-a9e7-3afddcf3bff2 for instance a9954010-5d4d-4212-9c51-c5af402d9179 on n-h2-841089-2 May 10 02:47:52.355821 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2711027d-9232-444a-81e2-e213e319c96a req-924c5643-add2-4114-a8b3-1acaa5fa6de3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063877 May 10 02:47:52.357586 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2930/5818] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:52.412241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:52.412954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:52.420111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:52.420648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:52.421506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:52.422022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:52.681784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:52.700015 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7b784f91-de93-4eca-bb7b-4338b46591d3 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.288381 May 10 02:47:52.713936 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2889/5819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:52 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:52.804757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:52.805484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:52.814347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:52.817386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:52.819750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:52.821627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:52.908440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:52.918560 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c0f4b56-9ae2-4345-b3e6-6586455a2e61 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.119246 May 10 02:47:52.919245 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2931/5820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:52 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:53.719153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:53.719909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:53.728153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:53.728861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:53.729758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:53.730450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:53.874708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:53.883929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ca79ca1c-e161-4fdc-977a-0646eda58ad9 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.169345 May 10 02:47:53.885369 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2890/5821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:53 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:53.937363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:53.939025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:53.946961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:53.947748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:53.949128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:53.949941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:54.039647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:54.048011 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28ab96f8-3918-4512-a150-999e277a23e6 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.115047 May 10 02:47:54.055334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2932/5822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:53 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:54.902404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:54.903139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:54.912355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:54.912900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:54.913772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:54.914479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:55.067051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:55.068451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:55.082719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:55.086830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:55.087869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:55.088902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:55.089559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:55.092057 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20d82f0c-5619-4c4a-90b1-85befab9027a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.194022 May 10 02:47:55.101314 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2891/5823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:54 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:55.170442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:55.179553 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-abf1716a-b864-42bc-8bae-f6c088f33666 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.116575 May 10 02:47:55.180258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2933/5824] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:55 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:56.109311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:56.109920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:56.117443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:56.117911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:56.118694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:56.119250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:56.197281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:56.198611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:56.205801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:56.206545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:56.207584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:56.208041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:56.312382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:56.322441 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b149c9fc-d978-4a62-bf29-d6b23f3013ef tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.129512 May 10 02:47:56.333011 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2934/5825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:56 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:56.343680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:56.353608 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1190b75-9020-4064-a846-e982599b063a tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.248300 May 10 02:47:56.363388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2892/5826] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:56 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:56.919322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:56.919873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:56.926131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:56.926615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:56.928044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:56.928493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.061896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:57.069626 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f06d1126-e4c3-4161-acd0-558c18f3dafb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1682 microversion: 2.1 time: 0.154389 May 10 02:47:57.070202 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2935/5827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:56 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:57.166440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:57.167414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:57.174273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.174708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.175522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.175974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.231241 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08e61573-3915-44b2-852a-d39f72b2c0af tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action" status: 200 len: 32641 microversion: 2.1 time: 0.068533 May 10 02:47:57.237651 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2893/5828] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:47:57 2022] POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action => generated 32641 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:47:57.340643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:57.341311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:57.348289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.348753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.350179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.350631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.371749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:57.372435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:57.379863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.380354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.381133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.381577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.415259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:57.423972 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-834da4a4-e6b4-40c9-a36f-0a194f8d04c0 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.087279 May 10 02:47:57.424937 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2936/5829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:57 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:57.523301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:57.530823 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-88447d85-3833-4afe-9b0d-263938de3aa1 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.163317 May 10 02:47:57.531445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2894/5830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:57 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:57.559455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:57.560087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:57.566624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.566952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.568012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.568466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.699120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-434f53d7-91a4-4043-92ad-4872efbf55bd tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1833 microversion: 2.1 time: 0.269059 May 10 02:47:57.699704 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2937/5831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:57 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1833 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:47:57.717245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:57.718088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:57.724737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.725268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.726132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.726645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.752186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lazy-loading 'flavor' on Instance uuid 08e13165-74e4-4be0-ae55-356aaa8a836f {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:47:57.765057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Going to try to live migrate instance to another host {{(pid=118717) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 10 02:47:57.890599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-cfdcb470-6591-4ad1-8cd8-c5a1ff4ec8e2 req-9bb9fac1-a59d-45d6-b9b1-aaf114861778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9954010-5d4d-4212-9c51-c5af402d9179", "name": "network-vif-plugged", "status": "completed", "tag": "df8731ff-81e9-4fd5-a9e7-3afddcf3bff2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:47:57.908067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cfdcb470-6591-4ad1-8cd8-c5a1ff4ec8e2 req-9bb9fac1-a59d-45d6-b9b1-aaf114861778 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:57.908067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cfdcb470-6591-4ad1-8cd8-c5a1ff4ec8e2 req-9bb9fac1-a59d-45d6-b9b1-aaf114861778 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:57.934925 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-cfdcb470-6591-4ad1-8cd8-c5a1ff4ec8e2 req-9bb9fac1-a59d-45d6-b9b1-aaf114861778 service nova] Creating event network-vif-plugged:df8731ff-81e9-4fd5-a9e7-3afddcf3bff2 for instance a9954010-5d4d-4212-9c51-c5af402d9179 on n-h2-841089-2 May 10 02:47:57.942324 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-cfdcb470-6591-4ad1-8cd8-c5a1ff4ec8e2 req-9bb9fac1-a59d-45d6-b9b1-aaf114861778 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057468 May 10 02:47:57.943952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2938/5832] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:47:58.442559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:58.444009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:58.450760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:58.451613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:58.452345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:58.452798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:58.527050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1309b3e2f34fd39335f551eb84aad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f0dffb67564d109e34015e81fb6515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:58.535956 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b1fcde9-9501-47d4-aedc-ed4e97cab3fd tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 200 len: 1229 microversion: 2.1 time: 0.098373 May 10 02:47:58.537106 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2939/5833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:58 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:58.550073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:58.550788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:58.558889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:58.559471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:58.560283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:58.560742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:58.699776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:58.708402 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53529626-db30-437d-b995-7e1e6ac2abe7 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1317 microversion: 2.1 time: 0.161294 May 10 02:47:58.709312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2940/5834] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:58 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:47:59.554274 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:59.555848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] [instance: 4b8213f8-d599-45a5-82f2-10a12532758b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:59.562484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:59.562944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:59.563797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:59.564249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:59.579354 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] HTTP exception thrown: Instance 4b8213f8-d599-45a5-82f2-10a12532758b could not be found. May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Request method failure captured: May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b HTTP/1.1 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedFDzdiebs3HIc5U_J5BBkwomQOjsBJ6wPa3uyj46XhmaP8Ka1JkCiWNJt2qTT3vs-yF750-RRLSp7Jv_ZserTlHMxP8zVcemshIrVjJuCtX6idsHuYzxXVWWjZPhFqzBFUpdggFIY853oiPwBOa8_jzYqa5g-hJLxK4FZe1NVumOeI May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a3f0dffb67564d109e34015e81fb6515 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBackupRestore-102528986 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a3f0dffb67564d109e34015e81fb6515", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3f0dffb67564d109e34015e81fb6515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a3f0dffb67564d109e34015e81fb6515"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3f0dffb67564d109e34015e81fb6515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBackupRestore-102528986 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a3f0dffb67564d109e34015e81fb6515 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBackupRestore-102528986 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBackupRestore-102528986-project May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1d1309b3e2f34fd39335f551eb84aad8 May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBackupRestore-102528986-project May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4b8213f8-d599-45a5-82f2-10a12532758b could not be found. May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4b8213f8-d599-45a5-82f2-10a12532758b'} May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8213f8-d599-45a5-82f2-10a12532758b could not be found. May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8213f8-d599-45a5-82f2-10a12532758b could not be found. May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:47:59.581140 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8213f8-d599-45a5-82f2-10a12532758b could not be found. May 10 02:47:59.585961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:47:59.587193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Returning 404 to user: Instance 4b8213f8-d599-45a5-82f2-10a12532758b could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:47:59.588225 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a7fbec8-0d01-4e6f-920d-9ea3cff50d19 tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b" status: 404 len: 111 microversion: 2.1 time: 0.038732 May 10 02:47:59.588794 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2941/5835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:59 2022] GET /compute/v2.1/servers/4b8213f8-d599-45a5-82f2-10a12532758b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:47:59.725515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:47:59.726283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:47:59.732459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:59.732933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:59.733849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:47:59.734306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:47:59.983537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:47:59.998060 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b382376e-609d-4f9e-80a2-46283cb8951d tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action" status: 202 len: 0 microversion: 2.1 time: 2.285442 May 10 02:47:59.999095 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2895/5836] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:47:57 2022] POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action => generated 0 bytes in 2287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:48:00.004947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d229158a-fee1-45b2-ae4c-56cd75cef1ed tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] Calling method '.version_select at 0x7f3d37007b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:00.011924 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa28e4fc-81c2-4502-8576-8a997716ac72 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1507 microversion: 2.1 time: 0.289395 May 10 02:48:00.026999 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2942/5837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:47:59 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:00.030775 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d229158a-fee1-45b2-ae4c-56cd75cef1ed tempest-TestVolumeBackupRestore-102528986 tempest-TestVolumeBackupRestore-102528986-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-930069327" status: 202 len: 0 microversion: 2.1 time: 0.030396 May 10 02:48:00.032272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:00.032903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:00.037702 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2896/5838] 10.222.0.52 () {58 vars in 1265 bytes} [Tue May 10 02:47:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-930069327 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:48:00.043143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:00.044765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:00.052717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.053701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.054368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.055372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.055985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.056328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.057787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.058340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.507356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:00.517663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:00.527336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b8bb9eb-4df8-48c9-be5e-ee39ae019713 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.499041 May 10 02:48:00.528104 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c50f094c-5476-476a-8932-e599db5f886d tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1507 microversion: 2.1 time: 0.489072 May 10 02:48:00.539125 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2943/5839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:00 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:00.542028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2897/5840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:00 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:00.549509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:00.550721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:00.557736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.558271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.561565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.562682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.659536 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-804956c4-0b89-44bb-a5d1-61b6def937d6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "PUT /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1079 microversion: 2.1 time: 0.114944 May 10 02:48:00.660687 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2944/5841] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:48:00 2022] PUT /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1079 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:00.674276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:00.674901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:00.681792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.682450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.683930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.684644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.905871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:00.914809 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5cda5836-75ef-44f4-b9d8-419d6bb37a02 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1505 microversion: 2.1 time: 0.244393 May 10 02:48:00.915627 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2898/5842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:00 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:00.931336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:00.931973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:00.938383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.938856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:00.939741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:00.940124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.129646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:01.139014 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-24dcffd4-424f-4983-8792-88dca2670838 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1505 microversion: 2.1 time: 0.211725 May 10 02:48:01.139740 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2945/5843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:00 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:01.157704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:01.159512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:01.167577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.168399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.170098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.171680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.251096 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3385d48f-0e4b-44e2-94ac-dabdd6316012 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "PUT /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1081 microversion: 2.1 time: 0.097374 May 10 02:48:01.252060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2899/5844] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 02:48:01 2022] PUT /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1081 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:01.268279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:01.268893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:01.279432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.280210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.281489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.282701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.546828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:01.547517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:01.556475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.557134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.559953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.561198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.628996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:01.640469 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1d87adab-084b-4eb9-9f71-b565e189790e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1507 microversion: 2.1 time: 0.376123 May 10 02:48:01.641688 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2946/5845] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:01 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:01.663992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:01.664602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:01.671223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.672189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.673514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:01.674368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:01.843504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:01.862665 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da596902-66ed-46ca-8d6b-75b193dd197a tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.320441 May 10 02:48:01.864793 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2900/5846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:01 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:01.997383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-55b73d74-9c5c-45db-8a59-dc27159e8088 req-89e839e2-c5d4-4449-ac72-92d0c93d13d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "name": "network-vif-unplugged", "status": "completed", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:02.013403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:02.016908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-55b73d74-9c5c-45db-8a59-dc27159e8088 req-89e839e2-c5d4-4449-ac72-92d0c93d13d5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.018109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-55b73d74-9c5c-45db-8a59-dc27159e8088 req-89e839e2-c5d4-4449-ac72-92d0c93d13d5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.030830 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1d7b22a-c89c-4ccf-b89c-de53e4f1900e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1507 microversion: 2.1 time: 0.373773 May 10 02:48:02.033243 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2947/5847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:01 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:02.044391 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-55b73d74-9c5c-45db-8a59-dc27159e8088 req-89e839e2-c5d4-4449-ac72-92d0c93d13d5 service nova] Creating event network-vif-unplugged:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h1-841089-2 May 10 02:48:02.053259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:02.054657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:02.056847 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-55b73d74-9c5c-45db-8a59-dc27159e8088 req-89e839e2-c5d4-4449-ac72-92d0c93d13d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063282 May 10 02:48:02.061461 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2901/5848] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:02.067204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.085753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.092250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.092824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.142699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:48:02.337330 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b73c2251-d90b-41dd-8b62-1781221aae40 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 204 len: 0 microversion: 2.1 time: 0.289746 May 10 02:48:02.338670 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2948/5849] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:48:02 2022] DELETE /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:48:02.351945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:02.353355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:02.372202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.372972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.373985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.376112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.447313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:48:02.529987 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Instance is already in deleting state, ignoring this request May 10 02:48:02.532482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-26c5779e-6594-44d1-9f58-739ae848d757 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 204 len: 0 microversion: 2.1 time: 0.183986 May 10 02:48:02.533086 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2902/5850] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:48:02 2022] DELETE /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:48:02.542401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:02.543538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:02.563136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.563997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.568404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.570730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.895058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:02.899677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:02.922776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.923435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.924527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:02.932987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:02.938088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:02.953224 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d727a6b3-44d8-4bef-9218-10fd674919ea tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1513 microversion: 2.1 time: 0.415318 May 10 02:48:02.964022 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2949/5851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:02 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:03.252181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:03.261556 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f8f8a397-0305-483b-add9-e58cb3bdfd91 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.376352 May 10 02:48:03.263575 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2903/5852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:02 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:03.970316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:03.970941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:03.984685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:03.985258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:03.986338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:03.990362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:04.280330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:04.280956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:04.298691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:04.299183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:04.300015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:04.300438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:04.801539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b3f15fd38f4c25aba3c7a324b112e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d031a8c0ecb4a9a816621ed30185eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:04.809807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:04.813051 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbab0d0e-3831-4b26-88ca-7ce08f0e8195 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 200 len: 1513 microversion: 2.1 time: 0.846548 May 10 02:48:04.813964 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2950/5853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:03 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 1513 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:04.818793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9771cb0e-744d-4190-b323-ea3c0c091b51 req-29b03259-4306-4746-b5aa-66b590be0ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:04.825844 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-64ee9c8a-6a91-4a2f-a66f-cc737c9179dd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.549074 May 10 02:48:04.827351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9771cb0e-744d-4190-b323-ea3c0c091b51 req-29b03259-4306-4746-b5aa-66b590be0ad5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:04.827999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9771cb0e-744d-4190-b323-ea3c0c091b51 req-29b03259-4306-4746-b5aa-66b590be0ad5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:04.838074 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2904/5854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:04 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:04.840641 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9771cb0e-744d-4190-b323-ea3c0c091b51 req-29b03259-4306-4746-b5aa-66b590be0ad5 service nova] Creating event network-changed:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h1-841089-2 May 10 02:48:04.846307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9771cb0e-744d-4190-b323-ea3c0c091b51 req-29b03259-4306-4746-b5aa-66b590be0ad5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030836 May 10 02:48:04.847271 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2951/5855] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:05.829785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:05.830413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: a9954010-5d4d-4212-9c51-c5af402d9179] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:05.837581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.838261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.839401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.840346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.845726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:05.847396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:05.854651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.855285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.855615 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] HTTP exception thrown: Instance a9954010-5d4d-4212-9c51-c5af402d9179 could not be found. May 10 02:48:05.856279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.856891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Request method failure captured: May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 HTTP/1.1 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedHu6AzSSbpRMGXd3inGSkV7sETq1A4N3ZLlROceA_wFgMLMXOWToc4l60f5iUNGX4-gyMe0U-nCPtRPOqtrSAkDvCp1Ty10PGGRHyGR7V9UTRuAvJ4Oet-fFASgZ2YqKunZUqKvy12xzSOEyesKIXyMow4gjeLtq7rgk8MyAAOKdgY May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d031a8c0ecb4a9a816621ed30185eb7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 94b3f15fd38f4c25aba3c7a324b112e8 May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance a9954010-5d4d-4212-9c51-c5af402d9179 could not be found. May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'a9954010-5d4d-4212-9c51-c5af402d9179'} May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9954010-5d4d-4212-9c51-c5af402d9179 could not be found. May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9954010-5d4d-4212-9c51-c5af402d9179 could not be found. May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.857308 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9954010-5d4d-4212-9c51-c5af402d9179 could not be found. May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Returning 404 to user: Instance a9954010-5d4d-4212-9c51-c5af402d9179 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:05.862191 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-69c7e38b-ce60-488c-9aad-e4efe502aca6 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179" status: 404 len: 111 microversion: 2.1 time: 0.032906 May 10 02:48:05.862908 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2905/5856] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:05 2022] GET /compute/v2.1/servers/a9954010-5d4d-4212-9c51-c5af402d9179 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:48:05.869115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:05.869625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:05.876232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.876699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.878130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.879090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.895170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] HTTP exception thrown: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Request method failure captured: May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 HTTP/1.1 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedHu6AzSSbpRMGXd3inGSkV7sETq1A4N3ZLlROceA_wFgMLMXOWToc4l60f5iUNGX4-gyMe0U-nCPtRPOqtrSAkDvCp1Ty10PGGRHyGR7V9UTRuAvJ4Oet-fFASgZ2YqKunZUqKvy12xzSOEyesKIXyMow4gjeLtq7rgk8MyAAOKdgY May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d031a8c0ecb4a9a816621ed30185eb7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 94b3f15fd38f4c25aba3c7a324b112e8 May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '545b4aab-eb66-4d7b-bbbb-ce095216ef43'} May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:05.896980 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.901660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Returning 404 to user: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:05.902637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b446a464-d27d-42f4-ab7e-f3cdb2ead5fb tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 404 len: 111 microversion: 2.1 time: 0.036617 May 10 02:48:05.903409 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2906/5857] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:48:05 2022] DELETE /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:48:05.912208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:05.912827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 545b4aab-eb66-4d7b-bbbb-ce095216ef43] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:05.919003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.919484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.920259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.920698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.935311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] HTTP exception thrown: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Request method failure captured: May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 HTTP/1.1 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedHu6AzSSbpRMGXd3inGSkV7sETq1A4N3ZLlROceA_wFgMLMXOWToc4l60f5iUNGX4-gyMe0U-nCPtRPOqtrSAkDvCp1Ty10PGGRHyGR7V9UTRuAvJ4Oet-fFASgZ2YqKunZUqKvy12xzSOEyesKIXyMow4gjeLtq7rgk8MyAAOKdgY May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d031a8c0ecb4a9a816621ed30185eb7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 94b3f15fd38f4c25aba3c7a324b112e8 May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '545b4aab-eb66-4d7b-bbbb-ce095216ef43'} May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.936889 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Returning 404 to user: Instance 545b4aab-eb66-4d7b-bbbb-ce095216ef43 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f14a7327-c984-4dec-af1e-f15ecd218d2e tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43" status: 404 len: 111 microversion: 2.1 time: 0.030389 May 10 02:48:05.941710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2907/5858] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:05 2022] GET /compute/v2.1/servers/545b4aab-eb66-4d7b-bbbb-ce095216ef43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:48:05.946876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:05.947478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:05.953380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.953912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.954914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.955448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.969538 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] HTTP exception thrown: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Request method failure captured: May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a HTTP/1.1 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedHu6AzSSbpRMGXd3inGSkV7sETq1A4N3ZLlROceA_wFgMLMXOWToc4l60f5iUNGX4-gyMe0U-nCPtRPOqtrSAkDvCp1Ty10PGGRHyGR7V9UTRuAvJ4Oet-fFASgZ2YqKunZUqKvy12xzSOEyesKIXyMow4gjeLtq7rgk8MyAAOKdgY May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d031a8c0ecb4a9a816621ed30185eb7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 94b3f15fd38f4c25aba3c7a324b112e8 May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1dab08e9-670c-4fec-8eef-db17b7768b8a'} May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:05.971433 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Returning 404 to user: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-22fb264a-d2ad-4d50-85da-7df7b9758e64 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 404 len: 111 microversion: 2.1 time: 0.031202 May 10 02:48:05.979643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2908/5859] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:48:05 2022] DELETE /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:48:05.984727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:05.985431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] [instance: 1dab08e9-670c-4fec-8eef-db17b7768b8a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:05.992268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.992796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:05.993635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:05.994147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:06.008866 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] HTTP exception thrown: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Request method failure captured: May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a HTTP/1.1 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedHu6AzSSbpRMGXd3inGSkV7sETq1A4N3ZLlROceA_wFgMLMXOWToc4l60f5iUNGX4-gyMe0U-nCPtRPOqtrSAkDvCp1Ty10PGGRHyGR7V9UTRuAvJ4Oet-fFASgZ2YqKunZUqKvy12xzSOEyesKIXyMow4gjeLtq7rgk8MyAAOKdgY May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d031a8c0ecb4a9a816621ed30185eb7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d031a8c0ecb4a9a816621ed30185eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 1d031a8c0ecb4a9a816621ed30185eb7 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1584077265 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 94b3f15fd38f4c25aba3c7a324b112e8 May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1584077265-project May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1dab08e9-670c-4fec-8eef-db17b7768b8a'} May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:06.010435 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] Returning 404 to user: Instance 1dab08e9-670c-4fec-8eef-db17b7768b8a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc80eef3-0ec0-4d83-ab50-4b0d8b9eade4 tempest-ServerDiskConfigTestJSON-1584077265 tempest-ServerDiskConfigTestJSON-1584077265-project] 10.222.0.52 "GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a" status: 404 len: 111 microversion: 2.1 time: 0.030936 May 10 02:48:06.017832 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2909/5860] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:05 2022] GET /compute/v2.1/servers/1dab08e9-670c-4fec-8eef-db17b7768b8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:48:06.026083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:06.035829 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4f6868d-cd37-48ab-8501-f3766a229716 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.194746 May 10 02:48:06.037594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2952/5861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:05 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:06.873295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-21cea0a5-0bfa-40f9-b95e-e6b741518f4f req-33347265-03fe-4fc3-ab3e-b9a97797aad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9954010-5d4d-4212-9c51-c5af402d9179", "name": "network-vif-deleted", "tag": "df8731ff-81e9-4fd5-a9e7-3afddcf3bff2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:06.882064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21cea0a5-0bfa-40f9-b95e-e6b741518f4f req-33347265-03fe-4fc3-ab3e-b9a97797aad9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:06.882512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21cea0a5-0bfa-40f9-b95e-e6b741518f4f req-33347265-03fe-4fc3-ab3e-b9a97797aad9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:06.894076 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-21cea0a5-0bfa-40f9-b95e-e6b741518f4f req-33347265-03fe-4fc3-ab3e-b9a97797aad9 service nova] Creating event network-vif-deleted:df8731ff-81e9-4fd5-a9e7-3afddcf3bff2 for instance a9954010-5d4d-4212-9c51-c5af402d9179 on n-h2-841089-2 May 10 02:48:06.899038 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-21cea0a5-0bfa-40f9-b95e-e6b741518f4f req-33347265-03fe-4fc3-ab3e-b9a97797aad9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029441 May 10 02:48:06.899659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2910/5862] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:07.055564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:07.056593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:07.063777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:07.064561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:07.071295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:07.072064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:07.231842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:07.241182 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28ad2e61-d9f0-4e1c-94e5-1396192bf9bf tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.189637 May 10 02:48:07.243161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2953/5863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:07 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:07.745358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-573155952", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": "none"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:07.801331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:48:07.802543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:48:07.803456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:48:07.804166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:48:07.805066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:48:07.814738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:07.815234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:07.816054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:07.816500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:07.834866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Getting quotas for project dd22bf53bf1245a08337e0f7af839dc6. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:48:07.840142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Getting quotas for user 55413e9720c14437942f42240ece5967 and project dd22bf53bf1245a08337e0f7af839dc6. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:48:07.856662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:48:07.859174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:48:07.915178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75f56574-1ddf-4743-b76a-2a7f72769aee tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.286428 May 10 02:48:07.917016 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2911/5864] 10.222.0.52 () {62 vars in 1187 bytes} [Tue May 10 02:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 02:48:07.928425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c596112-8209-4775-aaaf-b0e55571c72d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:07.929299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c596112-8209-4775-aaaf-b0e55571c72d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:07.999154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c596112-8209-4775-aaaf-b0e55571c72d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:08.008047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c596112-8209-4775-aaaf-b0e55571c72d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:08.009578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c596112-8209-4775-aaaf-b0e55571c72d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:08.010742 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c596112-8209-4775-aaaf-b0e55571c72d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1277 microversion: 2.57 time: 0.087490 May 10 02:48:08.011352 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2954/5865] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:07 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:48:08.259176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:08.260265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:08.271056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:08.271795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:08.272792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:08.273414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:08.445686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:08.453791 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d17d8c7-dfb8-4e18-b00a-e0a27d5eb912 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.199911 May 10 02:48:08.454376 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2912/5866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:08 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:08.820508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-445b829f-bd53-408b-904a-57f51db07fd4 req-eee233e7-6b53-4d31-a924-1c4b996c574c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "name": "network-vif-unplugged", "status": "completed", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:08.831421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-445b829f-bd53-408b-904a-57f51db07fd4 req-eee233e7-6b53-4d31-a924-1c4b996c574c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:08.832102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-445b829f-bd53-408b-904a-57f51db07fd4 req-eee233e7-6b53-4d31-a924-1c4b996c574c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:08.845304 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-445b829f-bd53-408b-904a-57f51db07fd4 req-eee233e7-6b53-4d31-a924-1c4b996c574c service nova] Creating event network-vif-unplugged:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h1-841089-2 May 10 02:48:08.851300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-445b829f-bd53-408b-904a-57f51db07fd4 req-eee233e7-6b53-4d31-a924-1c4b996c574c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034544 May 10 02:48:08.852139 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2955/5867] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:09.030903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:09.032465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:09.042735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:09.046515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:09.053302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:09.054003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:09.238574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:09.251799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:09.258867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:09.261032 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0bf7c897-8cc9-4af7-9c64-67e7b4575b3e tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1329 microversion: 2.57 time: 0.235397 May 10 02:48:09.269974 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2913/5868] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:09 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1329 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:09.471817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:09.472543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:09.486073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:09.486073 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:09.486827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:09.487317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:09.696461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:09.704823 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f11e49dc-77cd-4540-bd49-891f8e57ba5f tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.237674 May 10 02:48:09.706003 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2956/5869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:09 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:10.291721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:10.293060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:10.301276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:10.302475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:10.303401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:10.303953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:10.394283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:10.408719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:10.410269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:10.411978 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6599d3f5-87e4-4818-8c7d-6234329100a4 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1335 microversion: 2.57 time: 0.126074 May 10 02:48:10.423124 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2914/5870] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:10 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:10.722125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:10.722934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:10.734532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:10.741562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:10.742798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:10.743531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:10.918280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:10.929192 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c61a8e2-ff81-4167-b53e-35a2265f5c64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.210801 May 10 02:48:10.930397 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2957/5871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:10 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:11.431520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:11.432739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:11.440367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:11.441024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:11.441978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:11.443138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:11.539440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:11.549296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:11.553325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:11.557297 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b1ec4ab4-f2e4-423f-a126-44787b9cc3ab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1335 microversion: 2.57 time: 0.129836 May 10 02:48:11.572281 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2915/5872] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:11 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1335 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:11.946802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:11.948964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:11.974554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:11.977468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:11.978749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:11.980938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.334666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:12.342621 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ec5fab6e-cfed-4cb8-8559-2f4ca7c8d173 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1692 microversion: 2.1 time: 0.400525 May 10 02:48:12.352374 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2958/5873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:11 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1692 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:12.580465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:12.581095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:12.588209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.588886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.589842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.590455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.673340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:12.682330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:12.684119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:12.685487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e1fca37-6f5c-4fbe-9f15-81a086de6040 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1356 microversion: 2.57 time: 0.109307 May 10 02:48:12.704214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:12.706054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:12.708907 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2916/5874] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:12 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:12.719157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.719873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.721769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.723028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.826859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:48:12.827739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:48:12.828389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:48:12.828970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:48:12.829697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:48:12.909413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:12.916457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.916911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.917708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.918157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.958557 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e6a7ea59-f3ac-4108-bae7-010f9341003f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "POST /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb/action" status: 202 len: 1137 microversion: 2.57 time: 0.258425 May 10 02:48:12.959628 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2959/5875] 10.222.0.52 () {62 vars in 1319 bytes} [Tue May 10 02:48:12 2022] POST /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb/action => generated 1137 bytes in 260 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 10 02:48:12.977661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:12.978602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:12.985165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.985845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:12.986835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:12.987492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:13.107419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:13.116457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:13.137369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:13.153679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-063faa3a-eec3-4fb0-82cc-6aac60a2cce9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.180916 May 10 02:48:13.157649 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2917/5876] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:12 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:13.359795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:13.360462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:13.369816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:13.370540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:13.371716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:13.372328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:13.529737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:13.537730 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33580a8f-1444-482a-9fcf-3b49e5d96793 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1682 microversion: 2.1 time: 0.181866 May 10 02:48:13.539121 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2960/5877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:13 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:13.554270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:13.554909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:13.564955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:13.565410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:13.566209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:13.566647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:13.765788 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e665f403-1dea-4931-a782-476f6299a45f tempest-TestNetworkAdvancedServerOps-1852230222 tempest-TestNetworkAdvancedServerOps-1852230222-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1833 microversion: 2.1 time: 0.215036 May 10 02:48:13.766761 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2918/5878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:13 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1833 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:13.782626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:13.783386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:13.798984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:13.799830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:13.800880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:13.802048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:14.005646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:14.013835 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d60a354-d0d2-47a4-a35e-7b688dcf36aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1682 microversion: 2.1 time: 0.235580 May 10 02:48:14.014420 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2961/5879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:13 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:14.173167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:14.173786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:14.180862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:14.181334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:14.182108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:14.182551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:14.246307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:14.254176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:14.255762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:14.256947 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-91b12d52-3451-498a-ba95-c7a9ede4e755 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.087762 May 10 02:48:14.257510 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2919/5880] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:14 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:15.277377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:15.278781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:15.288172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:15.289361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:15.290827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:15.291707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:15.396997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:15.409213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:15.411739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:15.415316 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-135d54ae-0eb4-4e0f-8c33-3c4e9a061dd6 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.142250 May 10 02:48:15.422856 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2962/5881] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:15 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:16.116100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:16.118090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:16.127640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:16.128332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:16.129297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:16.130554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:16.187879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c10cc7d-ea40-48bc-894a-320dad410794 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action" status: 200 len: 38514 microversion: 2.1 time: 0.075824 May 10 02:48:16.190397 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2920/5882] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:48:16 2022] POST /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f/action => generated 38514 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:48:16.443998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:16.445285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:16.454576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:16.455759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:16.457166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:16.457941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:16.537270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:16.549112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:16.551100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:16.553210 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8699d76a-c8a4-4cee-8746-424fd5557549 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.114719 May 10 02:48:16.554490 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2963/5883] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:16 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:17.574373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:17.576401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:17.588363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:17.588583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:17.589596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:17.590250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:17.700141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:17.724790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:17.731470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:17.735307 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-393c4e5a-4ea4-4391-a2ad-d44b0a058ce1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.166474 May 10 02:48:17.740747 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2921/5884] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:17 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:18.252866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:18.253688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:18.254536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-09949bb8-ae22-4f6b-908a-64ace1bd63f9 req-da3cd31a-fcb5-46ea-b821-85bd8b7b618c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:18.266960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-09949bb8-ae22-4f6b-908a-64ace1bd63f9 req-da3cd31a-fcb5-46ea-b821-85bd8b7b618c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.267219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.267728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.269465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-09949bb8-ae22-4f6b-908a-64ace1bd63f9 req-da3cd31a-fcb5-46ea-b821-85bd8b7b618c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.272597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.273083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.299339 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-09949bb8-ae22-4f6b-908a-64ace1bd63f9 req-da3cd31a-fcb5-46ea-b821-85bd8b7b618c service nova] Creating event network-changed:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h2-841089-2 May 10 02:48:18.312557 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-09949bb8-ae22-4f6b-908a-64ace1bd63f9 req-da3cd31a-fcb5-46ea-b821-85bd8b7b618c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059528 May 10 02:48:18.313702 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2922/5885] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:18.326023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:48:18.448170 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a13b6d51-078b-4b55-9e38-4288e16b2da0 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 204 len: 0 microversion: 2.1 time: 0.201636 May 10 02:48:18.448817 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2964/5886] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:48:18 2022] DELETE /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:48:18.470216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:18.470775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:18.514148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.515550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.516874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.517483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.760995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:18.761713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:18.770472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.773251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.776351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:18.779442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:18.981555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:18.996136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:18.998640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:19.000456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f9e9ad8-8003-4104-b09c-cbfd6ab472b3 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.243782 May 10 02:48:19.001617 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2965/5887] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:18 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:19.316062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:19.326690 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f75d6ae3-d632-4f7f-a5f4-e2657bbe9acb tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1688 microversion: 2.1 time: 0.866042 May 10 02:48:19.338674 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2923/5888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:18 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1688 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:20.028575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:20.030586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:20.040746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:20.042726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:20.044210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:20.046842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:20.150561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:20.167409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:20.169361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:20.170553 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1e81d13-6458-4873-8faa-96eaeb32df51 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.153087 May 10 02:48:20.171147 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2966/5889] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:20 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:20.315885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bf9750e4-53c7-473f-898b-32a96a296a73 req-ac70e8ba-c101-45e9-bf1b-53e9c7c330ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e13165-74e4-4be0-ae55-356aaa8a836f", "name": "network-vif-deleted", "tag": "ca7a0c1f-8c62-4c24-988f-4af93d7d4722"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:20.346875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:20.348640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:20.350556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bf9750e4-53c7-473f-898b-32a96a296a73 req-ac70e8ba-c101-45e9-bf1b-53e9c7c330ba service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:20.353638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bf9750e4-53c7-473f-898b-32a96a296a73 req-ac70e8ba-c101-45e9-bf1b-53e9c7c330ba service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:20.356201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:20.356673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:20.357894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:20.358593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:20.374964 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bf9750e4-53c7-473f-898b-32a96a296a73 req-ac70e8ba-c101-45e9-bf1b-53e9c7c330ba service nova] Creating event network-vif-deleted:ca7a0c1f-8c62-4c24-988f-4af93d7d4722 for instance 08e13165-74e4-4be0-ae55-356aaa8a836f on n-h2-841089-2 May 10 02:48:20.383824 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bf9750e4-53c7-473f-898b-32a96a296a73 req-ac70e8ba-c101-45e9-bf1b-53e9c7c330ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071733 May 10 02:48:20.384978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2924/5890] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:48:20.442990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:20.451239 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10d6b884-6906-4b48-961d-a5e74e1f59cd tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 200 len: 1351 microversion: 2.1 time: 0.110032 May 10 02:48:20.451566 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2967/5891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:20 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:21.190738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:21.193171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:21.204409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:21.205208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:21.206202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:21.206837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:21.307849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:21.316941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:21.319157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:21.320725 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a27e45b9-ff14-47e8-aa7b-e72f6e348f0d tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.134888 May 10 02:48:21.321475 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2925/5892] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:21 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:21.468473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:21.469222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 08e13165-74e4-4be0-ae55-356aaa8a836f] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:21.476355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:21.476926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:21.483043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:21.483821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:21.500685 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] HTTP exception thrown: Instance 08e13165-74e4-4be0-ae55-356aaa8a836f could not be found. May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Request method failure captured: May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f HTTP/1.1 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedEIRAbNM0Jo3AneNP-OCWGVeg17xFLS7hja29WA5Z-srCxfxYhM0V-F9zjXxD7JodFRVlqz3gruxuxzdD9b1l0fCoDMeosp_Y6eJhaWEg6Nm8GDCmzLNhuhS_J-O-NufXl0KV_ky9h5SPBhDZ84FG_tiZoWlnqhEc7hxkSI4TC449U May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7bcf186f5934745913fb3cb5c09eb57", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 8ac6de721f6a4e678d69f195107843dd May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 08e13165-74e4-4be0-ae55-356aaa8a836f could not be found. May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '08e13165-74e4-4be0-ae55-356aaa8a836f'} May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e13165-74e4-4be0-ae55-356aaa8a836f could not be found. May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e13165-74e4-4be0-ae55-356aaa8a836f could not be found. May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:48:21.502535 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e13165-74e4-4be0-ae55-356aaa8a836f could not be found. May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Returning 404 to user: Instance 08e13165-74e4-4be0-ae55-356aaa8a836f could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a59289bc-7ea0-4a07-bbe4-d1af0e8ca67c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f" status: 404 len: 111 microversion: 2.1 time: 0.039670 May 10 02:48:21.507870 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2968/5893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:21 2022] GET /compute/v2.1/servers/08e13165-74e4-4be0-ae55-356aaa8a836f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:48:22.339833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:22.340453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:22.347298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:22.349492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:22.350386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:22.350776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:22.451299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:22.464374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:22.466124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:22.468638 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-509468f7-107f-4b55-b733-a28eebea6579 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.132793 May 10 02:48:22.470177 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2926/5894] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:22 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:48:23.489527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:23.490814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:23.508823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:23.509723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:23.512338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:23.514014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:23.682559 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:23.693107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:23.698148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:23.704775 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-914336a9-6e29-43d6-8e85-ce909b686a13 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.219198 May 10 02:48:23.705868 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2969/5895] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:23 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:24.726962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:24.727883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:24.735584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:24.736285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:24.737469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:24.738092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:24.840930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:24.849129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:24.853470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:24.857987 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20ce22d6-d4b9-4b00-af65-53bfa2729e10 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.135917 May 10 02:48:24.870428 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2927/5896] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:24 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:25.878817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:25.880057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:25.890451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:25.891903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:25.894531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:25.895050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:25.996317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:26.005773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:26.007762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:26.009196 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2287033-fd9d-4986-a3d3-bc8aaa366cab tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.134910 May 10 02:48:26.010380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2970/5897] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:25 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:26.232438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7a48705f-db1c-4006-82ff-8a799cbec0d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '.version_select at 0x7f3d36dac3a0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:26.260909 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7a48705f-db1c-4006-82ff-8a799cbec0d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1530564644" status: 202 len: 0 microversion: 2.1 time: 0.035042 May 10 02:48:26.261423 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2928/5898] 10.222.0.52 () {58 vars in 1283 bytes} [Tue May 10 02:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1530564644 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:48:26.293792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83d17d88-6593-4249-9bee-a62bab069932 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: .version_select at 0x7f3d364a9280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-206253750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmiJSEX767tMMDHZGrpn8XGAbodlrlM/Y7yQg45IiYu/uapUJ1HkQNdtTmBLI5+DYNpjQIeP4zP8rniM3opWQ7UYSHZ2lvi/RXutfM6gQOt5oky3+OHCgT0PScRp79wuw=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:26.318640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-83d17d88-6593-4249-9bee-a62bab069932 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:48:26.324607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-83d17d88-6593-4249-9bee-a62bab069932 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:48:26.352672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-83d17d88-6593-4249-9bee-a62bab069932 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.063136 May 10 02:48:26.353281 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2971/5899] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:48:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:48:27.034673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:27.035377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:27.046523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:27.046995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:27.047812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:27.050207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:27.149585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:27.168366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:27.170224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:27.171497 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6fa07d6-02b6-421c-ba16-c5f826c4e65a tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.141924 May 10 02:48:27.172371 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2929/5900] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:27 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:28.191888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:28.193049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:28.204288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:28.206292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:28.207250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:28.213208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:28.359436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:28.370487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:28.372543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:28.374058 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-163ef28b-0148-482d-82a5-56ea23383457 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.187423 May 10 02:48:28.375201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2972/5901] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:28 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:29.397875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:29.399171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:29.411586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:29.412310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:29.413715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:29.416030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:29.575750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:29.590913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:29.594272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:29.598644 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4991f857-6cce-4b0e-8eb6-83eec1f667c1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.209347 May 10 02:48:29.599719 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2930/5902] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:29 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:30.620794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:30.623317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:30.646417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:30.647606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:30.652317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:30.656957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:30.801587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:30.809836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:30.817553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:30.819160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-397acb41-1688-4173-9241-13e3857cb360 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.205512 May 10 02:48:30.822540 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2973/5903] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:30 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:31.842971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:31.844621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:31.869443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:31.869907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:31.870722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:31.871197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:32.125697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:32.134064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:32.137877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:32.141294 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24136add-d71a-487e-875c-6ec692dede7c tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.303673 May 10 02:48:32.144029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2931/5904] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:31 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:33.163373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:33.164683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:33.175061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:33.178785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:33.179851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:33.181889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:33.337816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:33.353031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:33.358887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:33.360457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5446a46-073a-4c6c-808a-dc3ab2e425de tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.202247 May 10 02:48:33.361917 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2974/5905] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:33 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:34.379937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:34.380569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:34.400521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:34.400997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:34.401807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:34.402261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:34.653025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:34.667564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:34.669246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:34.671482 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-205d33e2-26e8-4bc0-9df3-3127faa0311f tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.295299 May 10 02:48:34.674415 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2932/5906] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:34 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:35.685300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1111702764", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "b701ed70-af81-4546-a6d8-8fe3caf2def2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-206253750", "security_groups": [{"name": "tempest-secgroup-smoke-2068011674"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:35.693501 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:35.694140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:35.709325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:35.709987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:35.710949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:35.711633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:35.904834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:35.917514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:35.919170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:35.927670 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ccf5097-98ef-4dc8-bfed-7f5ca71d9db1 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.238681 May 10 02:48:35.929080 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2933/5907] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:35 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:48:35.937061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] validate_networks() for [('b701ed70-af81-4546-a6d8-8fe3caf2def2', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:48:36.744281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:48:36.744847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:48:36.745499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:48:36.745764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:48:36.746198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:48:36.780302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:36.781108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:36.782240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:36.783058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:36.852578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:48:36.862926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Getting quotas for user 8ac6de721f6a4e678d69f195107843dd and project c7bcf186f5934745913fb3cb5c09eb57. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:48:36.917173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:48:36.919839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:48:36.947409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:36.948834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:36.966515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:36.967367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:36.970498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:36.971262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:37.038635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc95cb0b-87ff-4069-a1dc-9a2bfe164dfa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.357566 May 10 02:48:37.039555 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2975/5908] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:48:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:48:37.049641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7dd98e4b-fe1a-4e4c-97dd-08546c08d036 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:37.076818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7dd98e4b-fe1a-4e4c-97dd-08546c08d036 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:37.126954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:37.144330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:37.146882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:37.148366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3172003b-cc5f-4358-a44c-49b8b135879b tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.206081 May 10 02:48:37.149192 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2934/5909] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:36 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 02:48:37.225122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7dd98e4b-fe1a-4e4c-97dd-08546c08d036 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:37.250091 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7dd98e4b-fe1a-4e4c-97dd-08546c08d036 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1266 microversion: 2.1 time: 0.203299 May 10 02:48:37.256283 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2976/5910] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:37 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:38.171007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:38.172335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:38.186905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:38.188237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:38.190613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:38.192172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:38.270825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:38.272224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:38.283541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:38.289369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:38.290908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:38.291579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:38.354000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:38.378070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:38.385359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:38.386638 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-119654e2-36f9-465f-9bd0-cdcfcd16e695 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.222755 May 10 02:48:38.390899 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2935/5911] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:38 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:38.417936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:38.427790 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-19565e92-d6a5-4916-93df-20b5ce3961be tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1318 microversion: 2.1 time: 0.161337 May 10 02:48:38.428376 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2977/5912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:38 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:39.407445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:39.408720 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:39.416105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:39.416922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:39.417877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:39.418487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:39.445865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:39.447353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:39.461069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:39.463284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:39.468761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:39.469463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:39.547521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:39.557374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:39.563611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:39.577429 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c162087-eaf5-4271-9330-76794882c189 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1365 microversion: 2.57 time: 0.172108 May 10 02:48:39.578450 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2936/5913] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:39 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:39.653168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:39.668583 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-edaa8648-e02d-46c5-abc1-867601615347 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1324 microversion: 2.1 time: 0.227038 May 10 02:48:39.680734 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2978/5914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:39 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:40.598887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:40.599548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:40.617020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:40.618013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:40.618991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:40.619660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:40.687013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:40.688321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:40.696262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:40.707052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:40.708268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:40.708940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:40.762744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:40.771297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:40.778539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:40.778539 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-314717f8-8637-484f-9e2e-ebb03f07bfdc tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1371 microversion: 2.57 time: 0.179819 May 10 02:48:40.782748 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2937/5915] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:40 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:41.014665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:41.023758 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f887e9ee-df88-400b-8730-13c31087ab30 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.340550 May 10 02:48:41.024352 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2979/5916] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:40 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:41.802997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:41.803666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:41.816202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:41.816924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:41.817915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:41.823099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:41.955568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:41.971672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:41.974544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:41.976051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf6d494f-feb1-4304-9b3b-24c77458fe59 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1371 microversion: 2.57 time: 0.178159 May 10 02:48:41.977165 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2938/5917] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:41 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:42.040855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:42.042084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:42.055748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:42.056529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:42.057575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:42.059859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:42.340786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:42.352263 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac419d01-c51a-439b-be30-edcd6d327f4e tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.315451 May 10 02:48:42.353009 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2980/5918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:42 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:42.995407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:42.996186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:43.010833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.012778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.013695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.015555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.164874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9cd70443-f3b3-493e-8e69-52f36b511054 req-849a5a92-e4d3-4c04-a556-781e4c080f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:43.215783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9cd70443-f3b3-493e-8e69-52f36b511054 req-849a5a92-e4d3-4c04-a556-781e4c080f56 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.216263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9cd70443-f3b3-493e-8e69-52f36b511054 req-849a5a92-e4d3-4c04-a556-781e4c080f56 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.234387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.247750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.248339 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9cd70443-f3b3-493e-8e69-52f36b511054 req-849a5a92-e4d3-4c04-a556-781e4c080f56 service nova] Creating event network-changed:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:48:43.250723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.260235 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6618f0e8-3702-4655-bf23-b5ac0d9e5ca9 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1356 microversion: 2.57 time: 0.268986 May 10 02:48:43.261829 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2939/5919] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:42 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:43.264276 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9cd70443-f3b3-493e-8e69-52f36b511054 req-849a5a92-e4d3-4c04-a556-781e4c080f56 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108733 May 10 02:48:43.265368 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2981/5920] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:48:43.287686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:43.288302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:43.310586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.314557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.315539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.316097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.371089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:43.371805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:43.377440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:48:43.381360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.382068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.384197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.384953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.583872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-198a7a5b-b6af-467c-beb9-0d29da14b513 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 204 len: 0 microversion: 2.57 time: 0.299859 May 10 02:48:43.586698 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2940/5921] 10.222.0.52 () {60 vars in 1279 bytes} [Tue May 10 02:48:43 2022] DELETE /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 02:48:43.602678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:43.603623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:43.616362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.616829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.617809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:43.618060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:43.654852 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.668627 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e894da45-f3ed-46e3-8de2-23bddb4a2c78 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.299743 May 10 02:48:43.679342 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2982/5922] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:43 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:43.789398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.801943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.803495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:43.811208 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0fed2ba-8fbe-41b9-9732-039d6053c211 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1362 microversion: 2.57 time: 0.220184 May 10 02:48:43.822538 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2941/5923] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:43 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:44.685897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:44.686741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:44.694116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:44.694702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:44.695817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:44.698116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:44.833319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:44.834243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:44.847810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:44.853288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:44.855117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:44.856013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:44.984633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:44.997281 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ef2b43e-ef84-45dd-a3fa-41f1bce25224 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.315183 May 10 02:48:44.997885 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2983/5924] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:44 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:45.008976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:45.017995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:45.020339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55413e9720c14437942f42240ece5967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd22bf53bf1245a08337e0f7af839dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:45.021818 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0ae74da-2705-42d9-9158-1dc0cde6a566 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 200 len: 1362 microversion: 2.57 time: 0.195895 May 10 02:48:45.022992 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2942/5925] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:44 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 02:48:46.014780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:46.015453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:46.026140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:46.027845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:46.029646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:46.031744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:46.046191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:46.046809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] [instance: d9e8a8f7-8731-4561-83d3-3b78928fbbbb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:46.065315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:46.065820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:46.067825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:46.069428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:46.122015 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] HTTP exception thrown: Instance d9e8a8f7-8731-4561-83d3-3b78928fbbbb could not be found. May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Request method failure captured: May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb HTTP/1.1 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedJn7DHctmq_Pvw9OqafD3YrYE8YMsQVi5pxPMQdjjN5E8mEqHfx4uu-aNKFaV8qYLJlZNT3x2gOwR6XZboXnfcWn15vGsqSvPLrk_ddRViZ80yF4MPIAztbP-0YHIrdaKtttOxlWsjS62WXrDG04TeMoTHeUPEjUhfGVQfXYYcQEkE May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Openstack-Nova-Api-Version: 2.57 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: dd22bf53bf1245a08337e0f7af839dc6 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerShowV257Test-355468403 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd22bf53bf1245a08337e0f7af839dc6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd22bf53bf1245a08337e0f7af839dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd22bf53bf1245a08337e0f7af839dc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd22bf53bf1245a08337e0f7af839dc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerShowV257Test-355468403 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: dd22bf53bf1245a08337e0f7af839dc6 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerShowV257Test-355468403 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerShowV257Test-355468403-project May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 55413e9720c14437942f42240ece5967 May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerShowV257Test-355468403-project May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d9e8a8f7-8731-4561-83d3-3b78928fbbbb could not be found. May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd9e8a8f7-8731-4561-83d3-3b78928fbbbb'} May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e8a8f7-8731-4561-83d3-3b78928fbbbb could not be found. May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e8a8f7-8731-4561-83d3-3b78928fbbbb could not be found. May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:48:46.123850 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e8a8f7-8731-4561-83d3-3b78928fbbbb could not be found. May 10 02:48:46.128934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:48:46.135979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] Returning 404 to user: Instance d9e8a8f7-8731-4561-83d3-3b78928fbbbb could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:48:46.137174 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-22fefb38-9df5-4a69-8ffd-6cc10a4fd393 tempest-ServerShowV257Test-355468403 tempest-ServerShowV257Test-355468403-project] 10.222.0.52 "GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb" status: 404 len: 111 microversion: 2.57 time: 0.097110 May 10 02:48:46.140362 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2943/5926] 10.222.0.52 () {60 vars in 1276 bytes} [Tue May 10 02:48:46 2022] GET /compute/v2.1/servers/d9e8a8f7-8731-4561-83d3-3b78928fbbbb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 02:48:46.407305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:46.422490 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2f56fff2-f194-42bb-bf7f-a5723d0c26d3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.411577 May 10 02:48:46.427486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2984/5927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:46 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:47.441445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:47.442083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:47.458477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:47.462731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:47.463653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:47.464111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:47.683214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:47.699361 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a641bb9-f39e-48d4-8430-7c4b1725fb00 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.262339 May 10 02:48:47.700706 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2944/5928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:47 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:48.396189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-787757903", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b5319ee6-6a27-4c8d-88aa-430347120f5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:48.488650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:48:48.721412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:48.724495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:48.732416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:48.733710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:48.734687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:48.735391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:49.024915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:49.040723 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.320210 May 10 02:48:49.052926 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2945/5929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:48 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:49.098254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:48:49.098892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:48:49.099683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:48:49.100264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:48:49.101731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:48:49.133899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:49.134381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:49.135295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:49.135693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:49.177959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:48:49.202913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:48:49.298126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:48:49.300725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5319ee6-6a27-4c8d-88aa-430347120f5f',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:48:49.344929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:49.346180 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbce4a86-9bcf-4818-889f-059ae540b2fe tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001534 May 10 02:48:49.347967 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2946/5930] 10.222.0.52 () {56 vars in 885 bytes} [Tue May 10 02:48:49 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) May 10 02:48:49.505836 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a13e3e9b-0ec5-4966-b18e-7fffd36ca9de tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113591 May 10 02:48:49.511209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2985/5931] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:48:49.518506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c131cba-0dee-44ef-ae9b-8382bf0fbd57 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:49.519552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c131cba-0dee-44ef-ae9b-8382bf0fbd57 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:49.631276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c131cba-0dee-44ef-ae9b-8382bf0fbd57 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:49.642925 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c131cba-0dee-44ef-ae9b-8382bf0fbd57 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1056 microversion: 2.1 time: 0.129084 May 10 02:48:49.646722 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2947/5932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:49 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1056 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:49.925522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1cd6ca98-d5d9-4221-873f-33ec187258d0 req-b770c071-2ff7-463e-b462-17761c29b377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "name": "network-vif-plugged", "status": "completed", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:49.937376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1cd6ca98-d5d9-4221-873f-33ec187258d0 req-b770c071-2ff7-463e-b462-17761c29b377 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:49.938175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1cd6ca98-d5d9-4221-873f-33ec187258d0 req-b770c071-2ff7-463e-b462-17761c29b377 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:49.954285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1cd6ca98-d5d9-4221-873f-33ec187258d0 req-b770c071-2ff7-463e-b462-17761c29b377 service nova] Creating event network-vif-plugged:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:48:49.960897 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1cd6ca98-d5d9-4221-873f-33ec187258d0 req-b770c071-2ff7-463e-b462-17761c29b377 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040583 May 10 02:48:49.962262 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2986/5933] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:48:50.058912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:50.059724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:50.078703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:50.079677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:50.083533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:50.085425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:50.511597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:50.536077 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9113b9c0-eadb-4cc3-b8e1-3dc47a5471c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1392 microversion: 2.1 time: 0.482101 May 10 02:48:50.536678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2948/5934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:50 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1392 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:50.664834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:50.665688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:50.672622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:50.673207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:50.674263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:50.674956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:50.751902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:50.761606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1975f241-27b0-4ae6-bc9a-79da5df4a2ba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1154 microversion: 2.1 time: 0.102062 May 10 02:48:50.762518 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2987/5935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:50 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1154 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:51.553856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:51.554777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:51.569008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:51.569481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:51.570290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:51.570736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:51.779519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:51.780691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:51.795090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:51.797883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:51.798892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:51.799581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:52.042137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:52.052910 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b875cef0-700f-42e7-8ea8-7b7939a86701 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1564 microversion: 2.1 time: 0.503567 May 10 02:48:52.053819 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2949/5936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:51 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1564 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:52.073905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:52.074925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:52.086399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:52.086860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:52.087687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:52.088132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:52.140603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:52.151939 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cdcce935-a96d-4d71-8b5c-256cbb44ef4a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.376503 May 10 02:48:52.158037 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2988/5937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:51 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:52.301004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-86b053c0-cb2e-4ab6-a4d0-e6f964fb1d6e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Action: 'create', calling method: .version_select at 0x7f3d364a9550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-793077483"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:52.343349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:52.356968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d96973c6-dfb2-40b4-bff4-c88a337f62c1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1564 microversion: 2.1 time: 0.287464 May 10 02:48:52.357562 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2950/5938] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:52 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1564 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:52.850347 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-86b053c0-cb2e-4ab6-a4d0-e6f964fb1d6e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.690892 May 10 02:48:52.851726 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2989/5939] 10.222.0.52 () {60 vars in 1154 bytes} [Tue May 10 02:48:52 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 693 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 02:48:52.862972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cf572be-2ce9-4179-90f0-c8d2e69a5348 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d37796d30>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:52.961561 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cf572be-2ce9-4179-90f0-c8d2e69a5348 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 344 microversion: 2.1 time: 0.102520 May 10 02:48:52.962330 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2951/5940] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:48:52 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:53.154046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d22f0425-f3a4-431d-8138-cc84b87eec42 req-f1a14d02-a060-4792-8dbf-1e2939bdc84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e3ad29c-a4d0-46c0-9646-42c7fea2325a", "tag": "5975e047-19f1-4ab9-830c-66ac1c6239b0"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:53.176831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:53.177520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:53.201828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d22f0425-f3a4-431d-8138-cc84b87eec42 req-f1a14d02-a060-4792-8dbf-1e2939bdc84f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:53.202472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d22f0425-f3a4-431d-8138-cc84b87eec42 req-f1a14d02-a060-4792-8dbf-1e2939bdc84f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:53.203111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:53.203576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:53.204372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:53.204815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:53.225147 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d22f0425-f3a4-431d-8138-cc84b87eec42 req-f1a14d02-a060-4792-8dbf-1e2939bdc84f service nova] Creating event network-changed:5975e047-19f1-4ab9-830c-66ac1c6239b0 for instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a on n-h2-841089-2 May 10 02:48:53.257963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d22f0425-f3a4-431d-8138-cc84b87eec42 req-f1a14d02-a060-4792-8dbf-1e2939bdc84f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104889 May 10 02:48:53.262613 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2990/5941] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:53.887429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:53.899535 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e83e5a34-2fd8-494f-81ed-85ed6665c340 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.728511 May 10 02:48:53.905816 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2952/5942] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:53 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:48:53.974402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ea3cc70-cf28-40cc-b2a8-ffe754e5fdca tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d363288b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:54.087300 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ea3cc70-cf28-40cc-b2a8-ffe754e5fdca tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 344 microversion: 2.1 time: 0.117032 May 10 02:48:54.088554 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2991/5943] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:48:53 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:54.920172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:54.921582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:54.932556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:54.933284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:54.934256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:54.935001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:55.101043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6ede3e8-90c2-46d2-b139-168ba3efac88 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d36e8ac10>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:55.193041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:55.206216 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7c83c69-6761-4b0d-ab66-6bae157088f5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.292083 May 10 02:48:55.217045 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2953/5944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:54 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:55.264391 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6ede3e8-90c2-46d2-b139-168ba3efac88 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 345 microversion: 2.1 time: 0.168112 May 10 02:48:55.264996 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2992/5945] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:48:55 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:48:55.277785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee63c91c-d061-4bf9-b33d-b45808d5ee3f tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Action: 'create', calling method: .version_select at 0x7f3d3703e280>, body: {"snapshot": {"volume_id": "91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2069586468"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:55.293587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:55.294582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:55.304759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:55.305567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:55.306989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:55.308524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:55.540354 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee63c91c-d061-4bf9-b33d-b45808d5ee3f tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.266778 May 10 02:48:55.540960 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2954/5946] 10.222.0.52 () {60 vars in 1161 bytes} [Tue May 10 02:48:55 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:55.549628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:55.561258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-01049d82-d3d9-4c1d-8494-222f2423b55a req-e40f179e-02fd-416a-9515-406b8e443290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:48:55.565414 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cd4224e-f4db-49f5-8a0e-11734e04ed50 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1564 microversion: 2.1 time: 0.278177 May 10 02:48:55.566407 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2993/5947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:55 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1564 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:55.575183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bc72cd87-3317-48a7-b3f6-c68709493f99 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d364caaf0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:55.577825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-01049d82-d3d9-4c1d-8494-222f2423b55a req-e40f179e-02fd-416a-9515-406b8e443290 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:55.579350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-01049d82-d3d9-4c1d-8494-222f2423b55a req-e40f179e-02fd-416a-9515-406b8e443290 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:55.600850 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-01049d82-d3d9-4c1d-8494-222f2423b55a req-e40f179e-02fd-416a-9515-406b8e443290 service nova] Creating event network-changed:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:48:55.607218 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-01049d82-d3d9-4c1d-8494-222f2423b55a req-e40f179e-02fd-416a-9515-406b8e443290 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054784 May 10 02:48:55.608439 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2955/5948] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:55.672586 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bc72cd87-3317-48a7-b3f6-c68709493f99 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.103348 May 10 02:48:55.673447 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2994/5949] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:48:55 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:55.684765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a4b2764-8ba6-4152-bfd5-fa7a3d708ea1 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d37867c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:55.741376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a4b2764-8ba6-4152-bfd5-fa7a3d708ea1 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.061105 May 10 02:48:55.742259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2956/5950] 10.222.0.52 () {58 vars in 1139 bytes} [Tue May 10 02:48:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:55.754082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93e65735-968c-46f3-9979-05adeef8144b tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d363a51f0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:55.810832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-93e65735-968c-46f3-9979-05adeef8144b tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.062154 May 10 02:48:55.814935 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2995/5951] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:48:55 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:56.224861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:56.225768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:56.246466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:56.247089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:56.248041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:56.248601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:56.562345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:56.572157 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af42cef3-9011-4709-993d-398c70a5c059 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.352315 May 10 02:48:56.573022 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2957/5952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:56 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:56.824172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2547287-4f69-4cd4-9f15-546e2a7cac1b tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d364a9e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:56.882582 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2547287-4f69-4cd4-9f15-546e2a7cac1b tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.063974 May 10 02:48:56.883544 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2996/5953] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:48:56 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:57.592075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:57.593652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:57.603183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:57.604109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:57.605193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:57.605829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:57.763411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:57.772483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0339b0fe-69ce-4c90-952c-c3f910a1b90b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.186501 May 10 02:48:57.773604 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2958/5954] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:57 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:57.901194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4c20f03-142d-4bed-9244-5f281bf1f8b5 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d363a51f0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:57.990425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4c20f03-142d-4bed-9244-5f281bf1f8b5 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.098303 May 10 02:48:57.991404 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2997/5955] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:48:57 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:58.790418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:58.791746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:58.798697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:58.799185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:58.800726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:58.801170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:58.932801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:48:58.941561 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08ad9a7d-ad1a-4379-b143-0f3c0718cd6d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.155174 May 10 02:48:58.942524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2959/5956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:58 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:48:59.003452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e07c1a6-ca15-4f75-a71a-78c940ba540c tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d3653ca60>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:59.046185 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e07c1a6-ca15-4f75-a71a-78c940ba540c tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 288 microversion: 2.1 time: 0.047742 May 10 02:48:59.046893 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2998/5957] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:48:58 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 288 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:59.057619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ae62736-add3-4f8d-aa77-cf7aeff99a18 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d374fa940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:59.139804 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ae62736-add3-4f8d-aa77-cf7aeff99a18 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 202 len: 0 microversion: 2.1 time: 0.086366 May 10 02:48:59.140885 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2960/5958] 10.222.0.52 () {58 vars in 1253 bytes} [Tue May 10 02:48:59 2022] DELETE /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:48:59.151050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98d51070-e275-4868-8228-dceeca7ff79f tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d371d23a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:59.188680 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98d51070-e275-4868-8228-dceeca7ff79f tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.042803 May 10 02:48:59.189269 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 2999/5959] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:48:59 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:48:59.960271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:48:59.961740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:48:59.972434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:59.973159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:48:59.974234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:48:59.975143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:00.144429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:00.164872 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-96371070-8af8-4696-9817-0fdffb990391 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.210599 May 10 02:49:00.165482 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2961/5960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:48:59 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:00.203475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d27c5c14-1028-483d-b301-5b07bfe825e4 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d3653c1f0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:00.238819 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d27c5c14-1028-483d-b301-5b07bfe825e4 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.040649 May 10 02:49:00.244502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3000/5961] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:49:00 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:01.181879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:01.183127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:01.190979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:01.191666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:01.192605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:01.193225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:01.253532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c0abefc-581e-4f32-a631-2f47692159b1 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d3645ed30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:01.291247 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c0abefc-581e-4f32-a631-2f47692159b1 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 200 len: 287 microversion: 2.1 time: 0.043343 May 10 02:49:01.296466 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3001/5962] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:49:01 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:49:01.381900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:01.395520 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-942b1951-1475-4081-87ec-5b6469be389d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.217378 May 10 02:49:01.396388 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2962/5963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:01 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:02.305223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9725a7f8-282f-4a78-b74b-c00434d9ce28 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d3653c9d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:02.337996 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9725a7f8-282f-4a78-b74b-c00434d9ce28 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] HTTP exception thrown: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9725a7f8-282f-4a78-b74b-c00434d9ce28 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Request method failure captured: May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec HTTP/1.1 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKTF0fNyP90_GcF0qRuigB9r7YpK4aw2qD9BW5f9fho-np_q_JGI-niERrYtaU2_MVYeEjg7WthLJOIjBzbJNA6xrV6-iu1aUpFXwtYyda2aJoMf887HQKT_zrVbUUXkkGASg98dY9J9OkLbgZcenIB-xDF51N0w00-bl1KtYaj5zw May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0dfbb9a0ecc49d096e56d83b889ec95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2b5fa478474e41f38e38302cfbe97ef2 May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: exception: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '138ab03d-969a-4ddd-bf64-ddb1d21393ec'} May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. (HTTP 404) (Request-ID: req-4f9e7075-69c0-4f49-be0c-d4965659eab8) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:49:02.356904 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. May 10 02:49:02.361035 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:02.367426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9725a7f8-282f-4a78-b74b-c00434d9ce28 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Returning 404 to user: Snapshot 138ab03d-969a-4ddd-bf64-ddb1d21393ec could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:02.368525 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9725a7f8-282f-4a78-b74b-c00434d9ce28 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec" status: 404 len: 111 microversion: 2.1 time: 0.069120 May 10 02:49:02.378324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e228d7ba-b9cd-4687-a760-de8cc68aa3a4 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d374fa4c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:02.384897 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3002/5964] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:49:02 2022] GET /compute/v2.1/os-snapshots/138ab03d-969a-4ddd-bf64-ddb1d21393ec => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:02.414329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:02.415307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:02.426304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:02.428545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:02.430638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:02.431334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:02.496023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e228d7ba-b9cd-4687-a760-de8cc68aa3a4 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 202 len: 0 microversion: 2.1 time: 0.122223 May 10 02:49:02.497457 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2963/5965] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:49:02 2022] DELETE /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:49:02.506043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0e8fc39-2453-48f7-b15d-59cdc421c962 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d36061160>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:02.605096 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0e8fc39-2453-48f7-b15d-59cdc421c962 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 344 microversion: 2.1 time: 0.102915 May 10 02:49:02.605698 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2964/5966] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:49:02 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:49:02.727493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:02.736118 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1b8c24e2-f6bf-4c9a-aeb0-6c3341e5f9ec tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.326664 May 10 02:49:02.746494 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3003/5967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:02 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:03.618205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e324cb96-6162-442e-9e50-4398a355611f tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d36542b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:03.745278 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e324cb96-6162-442e-9e50-4398a355611f tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 344 microversion: 2.1 time: 0.131125 May 10 02:49:03.752767 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2965/5968] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:49:03 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:03.766156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:03.766795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:03.802121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:03.803126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:03.804135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:03.804766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:04.050727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:04.059322 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a6035d67-521c-4103-aaa3-7fecbf187ecd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1214 microversion: 2.1 time: 0.305517 May 10 02:49:04.076335 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3004/5969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:03 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1214 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:04.757810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5007f01-6a8d-4af7-b0e5-e454335e6e7b tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d37e8d1f0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:04.818951 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5007f01-6a8d-4af7-b0e5-e454335e6e7b tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 344 microversion: 2.1 time: 0.064845 May 10 02:49:04.819566 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2966/5970] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:49:04 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:05.084493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:05.086192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:05.093078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:05.093547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:05.094349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:05.094801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:05.253228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:05.263354 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-859480c6-7fcc-43d5-a1e6-467146a718c5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.182693 May 10 02:49:05.273612 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3005/5971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:05 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:05.832834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5099ff18-86e1-4904-8af3-62e6bd610094 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d36542940>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:05.886473 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5099ff18-86e1-4904-8af3-62e6bd610094 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 200 len: 344 microversion: 2.1 time: 0.057955 May 10 02:49:05.887035 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2967/5972] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:49:05 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:06.281847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:06.282484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:06.291217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:06.291679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:06.292484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:06.292929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:06.440491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:06.448160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-562cb162-f68f-48f0-b6d7-0ef50a221efe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.170652 May 10 02:49:06.448755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3006/5973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:06 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:06.899669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62212a44-3a6a-48d6-8ee2-73d40f02cb0e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d370d3ee0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:06.928233 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-62212a44-3a6a-48d6-8ee2-73d40f02cb0e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] HTTP exception thrown: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62212a44-3a6a-48d6-8ee2-73d40f02cb0e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Request method failure captured: May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 HTTP/1.1 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKTF0fNyP90_GcF0qRuigB9r7YpK4aw2qD9BW5f9fho-np_q_JGI-niERrYtaU2_MVYeEjg7WthLJOIjBzbJNA6xrV6-iu1aUpFXwtYyda2aJoMf887HQKT_zrVbUUXkkGASg98dY9J9OkLbgZcenIB-xDF51N0w00-bl1KtYaj5zw May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0dfbb9a0ecc49d096e56d83b889ec95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2b5fa478474e41f38e38302cfbe97ef2 May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: exception: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44'} May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. (HTTP 404) (Request-ID: req-e837b873-46b2-4161-879f-f2679bef385d) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:49:06.930359 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62212a44-3a6a-48d6-8ee2-73d40f02cb0e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Returning 404 to user: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62212a44-3a6a-48d6-8ee2-73d40f02cb0e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 404 len: 109 microversion: 2.1 time: 0.037337 May 10 02:49:06.939384 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2968/5974] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:49:06 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:06.947843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-518fdde2-7148-4837-97d7-4f87bc3d8b77 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d36f06ca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:06.977669 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-518fdde2-7148-4837-97d7-4f87bc3d8b77 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] HTTP exception thrown: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-518fdde2-7148-4837-97d7-4f87bc3d8b77 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Request method failure captured: May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 HTTP/1.1 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKTF0fNyP90_GcF0qRuigB9r7YpK4aw2qD9BW5f9fho-np_q_JGI-niERrYtaU2_MVYeEjg7WthLJOIjBzbJNA6xrV6-iu1aUpFXwtYyda2aJoMf887HQKT_zrVbUUXkkGASg98dY9J9OkLbgZcenIB-xDF51N0w00-bl1KtYaj5zw May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0dfbb9a0ecc49d096e56d83b889ec95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2b5fa478474e41f38e38302cfbe97ef2 May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: method: May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: exception: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44'} May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. (HTTP 404) (Request-ID: req-0e8d0734-4dc5-4597-8303-bdb07af7175a) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:49:06.979975 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-518fdde2-7148-4837-97d7-4f87bc3d8b77 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Returning 404 to user: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-518fdde2-7148-4837-97d7-4f87bc3d8b77 tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 404 len: 109 microversion: 2.1 time: 0.038226 May 10 02:49:06.989818 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3007/5975] 10.222.0.52 () {58 vars in 1247 bytes} [Tue May 10 02:49:06 2022] DELETE /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:07.000178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2558428-cd38-43b0-89a5-0be790f1092e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Calling method '.version_select at 0x7f3d365514c0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:07.036931 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b2558428-cd38-43b0-89a5-0be790f1092e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] HTTP exception thrown: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2558428-cd38-43b0-89a5-0be790f1092e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Request method failure captured: May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 HTTP/1.1 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKTF0fNyP90_GcF0qRuigB9r7YpK4aw2qD9BW5f9fho-np_q_JGI-niERrYtaU2_MVYeEjg7WthLJOIjBzbJNA6xrV6-iu1aUpFXwtYyda2aJoMf887HQKT_zrVbUUXkkGASg98dY9J9OkLbgZcenIB-xDF51N0w00-bl1KtYaj5zw May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0dfbb9a0ecc49d096e56d83b889ec95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0dfbb9a0ecc49d096e56d83b889ec95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: a0dfbb9a0ecc49d096e56d83b889ec95 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2057755903 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2b5fa478474e41f38e38302cfbe97ef2 May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2057755903-project May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: method: May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: exception: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44'} May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. (HTTP 404) (Request-ID: req-14a7f3aa-0243-493e-8772-7d7626824ce2) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 02:49:07.039739 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2558428-cd38-43b0-89a5-0be790f1092e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] Returning 404 to user: Volume 91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:07.044860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2558428-cd38-43b0-89a5-0be790f1092e tempest-VolumesSnapshotsTestJSON-2057755903 tempest-VolumesSnapshotsTestJSON-2057755903-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44" status: 404 len: 109 microversion: 2.1 time: 0.052392 May 10 02:49:07.051778 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2969/5976] 10.222.0.52 () {58 vars in 1244 bytes} [Tue May 10 02:49:06 2022] GET /compute/v2.1/os-volumes/91a9b7ae-50a3-4779-a3b8-7a9b4cbf4f44 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:07.467255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:07.468622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:07.480859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:07.481663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:07.482683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:07.483336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:07.637812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:07.647478 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5eca646-c352-496f-bbba-b939d12b6868 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.185191 May 10 02:49:07.649057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3008/5977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:07 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:08.670167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:08.671659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:08.684648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:08.685546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:08.686779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:08.687528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:08.869233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:08.877985 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c75c813e-370f-4cf7-85a1-488a96da51be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.213830 May 10 02:49:08.878932 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2970/5978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:08 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:09.895186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:09.896150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:09.903685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:09.904223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:09.905084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:09.905607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:10.044717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:10.053666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5306022a-ad52-4394-9526-4b1df92b0e70 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.162469 May 10 02:49:10.054305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3009/5979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:09 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:11.070610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:11.071288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:11.078463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:11.078922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:11.079748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:11.080201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:11.217491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:11.226151 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-14c017df-f659-497e-be44-b350c7467411 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.159454 May 10 02:49:11.231126 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2971/5980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:11 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:12.243933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:12.245140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:12.252320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:12.252984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:12.253952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:12.254571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:12.422738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:12.430060 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d9c75b8-0931-4f0a-b46d-1bcedde35909 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.190319 May 10 02:49:12.430633 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3010/5981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:12 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:13.447709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:13.448487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:13.456297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:13.456751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:13.457524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:13.457965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:13.609197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:13.617081 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0a80dbc-46e3-4fdf-a75d-8b98ca1bd876 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.174738 May 10 02:49:13.617662 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2972/5982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:13 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:14.291101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3fa39062-eef2-44ad-9e21-9baaa6b3f440 req-8d59ef0f-eac3-46ee-a9a4-b68eb8eb5532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e3ad29c-a4d0-46c0-9646-42c7fea2325a", "name": "network-vif-plugged", "status": "completed", "tag": "5975e047-19f1-4ab9-830c-66ac1c6239b0"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:14.303654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3fa39062-eef2-44ad-9e21-9baaa6b3f440 req-8d59ef0f-eac3-46ee-a9a4-b68eb8eb5532 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:14.304894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3fa39062-eef2-44ad-9e21-9baaa6b3f440 req-8d59ef0f-eac3-46ee-a9a4-b68eb8eb5532 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:14.320444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3fa39062-eef2-44ad-9e21-9baaa6b3f440 req-8d59ef0f-eac3-46ee-a9a4-b68eb8eb5532 service nova] Creating event network-vif-plugged:5975e047-19f1-4ab9-830c-66ac1c6239b0 for instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a on n-h2-841089-2 May 10 02:49:14.325727 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3fa39062-eef2-44ad-9e21-9baaa6b3f440 req-8d59ef0f-eac3-46ee-a9a4-b68eb8eb5532 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038143 May 10 02:49:14.331160 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3011/5983] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:14.637031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:14.638337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:14.647571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:14.648328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:14.650161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:14.650686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:14.802028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:14.810027 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-25e0ce49-b073-413f-ba30-19c62f72c63f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1202 microversion: 2.1 time: 0.177497 May 10 02:49:14.810693 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2973/5984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:14 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:15.829599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:15.830338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:15.836949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:15.837407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:15.838183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:15.838658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:15.998710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:16.006720 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa075ecc-864e-41d4-94f5-5ebdf8f513dd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1389 microversion: 2.1 time: 0.182948 May 10 02:49:16.016125 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3012/5985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:15 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1389 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:16.023145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:16.023781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:16.035733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.036644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.037450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.037903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.134436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:16.135410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:16.141834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.144183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.145259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.146117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.194146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:16.203444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1951d45-efc5-404e-8164-4e1e3d43e0d1 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4/action" status: 200 len: 24575 microversion: 2.1 time: 0.072433 May 10 02:49:16.204502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3013/5986] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:49:16 2022] POST /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4/action => generated 24575 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 02:49:16.205088 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e99cd9da-c637-4305-87ee-61032c9908b5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1389 microversion: 2.1 time: 0.185513 May 10 02:49:16.206517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2974/5987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:16 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1389 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:16.223915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:16.224566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:16.231817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.232271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.233092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.233509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.401723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:16.410544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28523cf5-1fd2-453e-a77a-b00e7ed93178 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1389 microversion: 2.1 time: 0.190899 May 10 02:49:16.411538 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3014/5988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:16 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1389 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:16.428742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:16.429256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:16.435257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.435843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.436623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.437248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.462753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:49:16.569260 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c14ded5-08d6-49ec-8e56-d6ba29c34b67 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 204 len: 0 microversion: 2.1 time: 0.145097 May 10 02:49:16.573222 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2975/5989] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:49:16 2022] DELETE /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:49:16.584487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:16.585373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:16.591579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.592043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.592851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:16.593589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:16.737633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:16.746957 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8495f150-e375-43b7-94f4-acd96d9332ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1395 microversion: 2.1 time: 0.168161 May 10 02:49:16.751113 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3015/5990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:16 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1395 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:49:17.765992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:17.767467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:17.775012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:17.775591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:17.776579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:17.777119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:17.927200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:17.934586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db60643b-bc66-44c2-937c-4cd829f22b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1395 microversion: 2.1 time: 0.173687 May 10 02:49:17.935202 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2976/5991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:17 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1395 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:18.735601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0b1225a9-b394-4dfa-a518-500232b60b87 req-a0385a5c-070b-4330-8140-a9c30b5ef71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e3ad29c-a4d0-46c0-9646-42c7fea2325a", "name": "network-vif-deleted", "tag": "5975e047-19f1-4ab9-830c-66ac1c6239b0"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:18.749307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0b1225a9-b394-4dfa-a518-500232b60b87 req-a0385a5c-070b-4330-8140-a9c30b5ef71a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:18.749914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0b1225a9-b394-4dfa-a518-500232b60b87 req-a0385a5c-070b-4330-8140-a9c30b5ef71a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:18.763921 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0b1225a9-b394-4dfa-a518-500232b60b87 req-a0385a5c-070b-4330-8140-a9c30b5ef71a service nova] Creating event network-vif-deleted:5975e047-19f1-4ab9-830c-66ac1c6239b0 for instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a on n-h2-841089-2 May 10 02:49:18.770923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0b1225a9-b394-4dfa-a518-500232b60b87 req-a0385a5c-070b-4330-8140-a9c30b5ef71a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040972 May 10 02:49:18.772444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3016/5992] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:18.953965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:18.954594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:18.967298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:18.967764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:18.968728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:18.969204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:19.040814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:19.064158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e783dc91-2dbb-4500-8e89-6785e4d47744 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.100844 May 10 02:49:19.068250 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2977/5993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:18 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:20.087478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:20.088718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:20.096900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:20.097641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:20.099414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:20.099867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:20.211682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:20.223136 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e213bc0-1150-4698-ae76-32603b80aea3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.144474 May 10 02:49:20.233802 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3017/5994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:20 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:21.248260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:21.256176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:21.263750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:21.264662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:21.265861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:21.266511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:21.360126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:21.370236 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b610c406-1445-4cf3-87fb-2f9ff7baf42c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.131771 May 10 02:49:21.371037 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2978/5995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:21 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:22.390965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:22.393072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:22.403605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:22.404358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:22.407100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:22.407828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:22.482583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:22.491410 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c9b3d5d8-ad9f-426b-b676-e51a9e3dfdd6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.106555 May 10 02:49:22.492450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3018/5996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:22 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:22.685452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "193324a5-9e6a-4320-a184-bbef949b550f"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:22.689504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:22.699617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:22.700461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:22.701654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:22.702306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:22.808461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:49:22.808893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:49:22.809626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:49:22.810052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:49:22.810479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:49:22.901222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:22.936253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:22.936724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:22.937534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:22.940911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:23.006038 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-37c40ad9-ee33-4feb-bee2-f9f253bb0766 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4/action" status: 202 len: 1138 microversion: 2.1 time: 0.323531 May 10 02:49:23.007542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2979/5997] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:49:22 2022] POST /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4/action => generated 1138 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 10 02:49:23.021665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:23.022298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:23.028407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:23.029153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:23.030161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:23.030815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:23.191110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:23.199194 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2cf90f50-6562-47f0-9252-6601ce967cd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.181418 May 10 02:49:23.200348 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3019/5998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:23 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:23.512028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:23.513049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:23.520721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:23.521478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:23.522484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:23.523230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:23.617499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:23.634508 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-419ae5e5-4064-4eb5-b5cd-c3d2cbe65bd9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.127619 May 10 02:49:23.646830 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2980/5999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:23 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:24.217461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:24.218084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:24.225757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:24.226227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:24.227013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:24.227493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:24.391052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:24.399869 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32f0fca9-fdd5-4c6e-9bef-841c122982aa tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.186276 May 10 02:49:24.400455 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3020/6000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:24 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:24.665273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:24.667223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:24.682716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:24.683587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:24.684636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:24.685318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:24.765104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:24.773544 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-08f623ac-8832-43b9-93d3-e60741675c72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.113543 May 10 02:49:24.774724 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2981/6001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:24 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:25.418260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:25.418910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:25.426699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:25.427190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:25.428011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:25.428455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:25.585016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:25.596512 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3330fd47-1f2f-4b37-8af7-e30d1f81d3d4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.182247 May 10 02:49:25.597518 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3021/6002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:25 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:25.790328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:25.791639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:25.798343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:25.798861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:25.799673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:25.800121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:25.865549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:25.873859 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-33ed602e-cb8a-4aba-ae7c-bceaf5feb290 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.087328 May 10 02:49:25.874659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2982/6003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:25 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:26.615399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:26.616038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:26.622835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:26.629178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:26.629827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:26.630284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:26.774029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:26.785650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9675768b-36ad-4f11-a76e-d26ab4a5dbd4 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.175002 May 10 02:49:26.786994 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3022/6004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:26 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:26.891445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:26.892335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:26.900181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:26.900831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:26.902017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:26.902664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:26.974120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:26.982413 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d237d02-6897-4646-8e2e-bb0d645eb5b6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.095159 May 10 02:49:26.982994 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2983/6005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:26 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:27.804333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:27.805065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:27.812339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:27.812802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:27.813585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:27.814028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:27.951174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:27.960457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b9e496c-db2f-4f6a-94c4-891bb12ea028 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.160499 May 10 02:49:27.961065 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3023/6006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:27 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:27.999898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:28.000719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:28.008312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:28.008925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:28.009840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:28.010412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:28.078070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:28.086750 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c1f677ce-b5b8-4a93-aed2-64b86b2cec36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 200 len: 1187 microversion: 2.1 time: 0.090827 May 10 02:49:28.087560 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2984/6007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:27 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:28.977775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:28.978397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:28.985488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:28.986140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:28.987040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:28.987666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:29.104078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:29.105236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5e3ad29c-a4d0-46c0-9646-42c7fea2325a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:29.124727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:29.125493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:29.126520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:29.127197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:29.149184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:29.158832 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c5b7d2b-0f45-4eac-a056-f80fe43266f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.184316 May 10 02:49:29.159491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a could not be found. May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a HTTP/1.1 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a could not be found. May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5e3ad29c-a4d0-46c0-9646-42c7fea2325a'} May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a could not be found. May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a could not be found. May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:29.161206 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a could not be found. May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance 5e3ad29c-a4d0-46c0-9646-42c7fea2325a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-360585d0-bf6a-4bab-b043-dee0c38bb765 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a" status: 404 len: 111 microversion: 2.1 time: 0.062569 May 10 02:49:29.169438 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2985/6008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:29 2022] GET /compute/v2.1/servers/5e3ad29c-a4d0-46c0-9646-42c7fea2325a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 02:49:29.170165 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3024/6009] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:28 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:30.185024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:30.186549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:30.193996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:30.194461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:30.195507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:30.196403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:30.358252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:30.368686 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90293efb-4153-4096-b5a1-904513cc497c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.187659 May 10 02:49:30.389224 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2986/6010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:30 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:49:31.397394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:31.398021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:31.411504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:31.412230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:31.413128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:31.413609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:31.591598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:31.599859 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f9c4bc4a-1c17-433a-9c94-980c7348bcd5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.206446 May 10 02:49:31.600582 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3025/6011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:31 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:32.616956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:32.617598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:32.625075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:32.625846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:32.627397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:32.628061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:32.776396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:32.785459 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0d5f41d6-5877-458d-a8c2-690d57939c89 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.172411 May 10 02:49:32.786394 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2987/6012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:32 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:33.803580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:33.804776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:33.812634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:33.813251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:33.814241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:33.814819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:34.031793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:34.041024 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c1de89b1-a898-4478-8116-a4f00b5f6f29 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1692 microversion: 2.1 time: 0.241479 May 10 02:49:34.042052 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3026/6013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:33 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1692 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:49:35.058282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:35.058954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:35.066930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:35.066930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:35.066930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:35.067385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:35.235929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:35.245484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e787f309-9d92-422b-be81-17de932546ce tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1698 microversion: 2.1 time: 0.191437 May 10 02:49:35.255440 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2988/6014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:35 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:36.269701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:36.273089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:36.284521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:36.285328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:36.286942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:36.287673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:36.478400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:36.489021 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-537b6389-eb4a-433d-b5d9-d27a4b6e16a5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1698 microversion: 2.1 time: 0.227776 May 10 02:49:36.490419 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3027/6015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:36 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1698 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:37.508408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:37.509695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:37.519485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:37.523768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:37.524608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:37.525058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:37.820545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:37.838105 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9befb36-494d-48c3-9e5c-e4688ee7c7f2 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1683 microversion: 2.1 time: 0.330991 May 10 02:49:37.839997 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2989/6016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:37 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1683 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:37.858217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1e5fae56-aa1f-4f7d-b88c-e01e881d77c1 req-4852c551-804b-4666-9b5c-accb977ed9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "name": "network-vif-unplugged", "status": "completed", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:37.899219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1e5fae56-aa1f-4f7d-b88c-e01e881d77c1 req-4852c551-804b-4666-9b5c-accb977ed9e9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:37.900135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1e5fae56-aa1f-4f7d-b88c-e01e881d77c1 req-4852c551-804b-4666-9b5c-accb977ed9e9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:37.946173 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1e5fae56-aa1f-4f7d-b88c-e01e881d77c1 req-4852c551-804b-4666-9b5c-accb977ed9e9 service nova] Creating event network-vif-unplugged:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:49:37.957826 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1e5fae56-aa1f-4f7d-b88c-e01e881d77c1 req-4852c551-804b-4666-9b5c-accb977ed9e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108640 May 10 02:49:37.960037 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3028/6017] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:39.985582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-81f31017-74bf-43d4-becd-09c84ae300ba req-14b37981-9165-4d15-a17a-42cd930f80c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "name": "network-vif-plugged", "status": "completed", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:40.002098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-81f31017-74bf-43d4-becd-09c84ae300ba req-14b37981-9165-4d15-a17a-42cd930f80c9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:40.002838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-81f31017-74bf-43d4-becd-09c84ae300ba req-14b37981-9165-4d15-a17a-42cd930f80c9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:40.016568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-81f31017-74bf-43d4-becd-09c84ae300ba req-14b37981-9165-4d15-a17a-42cd930f80c9 service nova] Creating event network-vif-plugged:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:49:40.034260 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-81f31017-74bf-43d4-becd-09c84ae300ba req-14b37981-9165-4d15-a17a-42cd930f80c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052736 May 10 02:49:40.040112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2990/6018] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:46.381256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:46.381857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:46.393453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:46.394251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:46.404454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:46.405071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:46.453099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:49:46.599594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9794b930-9cdf-4256-8d1d-35c5f82d2236 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 204 len: 0 microversion: 2.1 time: 0.510617 May 10 02:49:46.603105 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3029/6019] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:49:46 2022] DELETE /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:49:46.610168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:46.611626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:46.622386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:46.623656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:46.624731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:46.625483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:47.252826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:47.270120 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02c610b6-ceb5-4dfe-bc6a-42257a864196 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1731 microversion: 2.1 time: 0.664893 May 10 02:49:47.270766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2991/6020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:46 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1731 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:48.288365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:48.290365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:48.297390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:48.298254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:48.299335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:48.299869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:48.761929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:48.775010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-407281f2-9853-4605-89da-56d103333980 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1731 microversion: 2.1 time: 0.490730 May 10 02:49:48.785444 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3030/6021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:48 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1731 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:49:49.793083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:49.793717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:49.807933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:49.808386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:49.809189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:49.810950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:50.029901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b500579a1724eed9e59173fd4e664ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6e3ad874a1402398d7b64862fd3abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:49:50.061101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f4f2c801-a9d0-493c-b275-580dbb997ce5 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 200 len: 1663 microversion: 2.1 time: 0.270523 May 10 02:49:50.061744 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2992/6022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:49 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:49:50.298982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-05a66b13-0075-428a-becc-7967e9518b41 req-76ce052d-8773-4e87-acf6-56e6a3b7c049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4ead59-0efe-456a-9fdd-1972948afb0a", "name": "network-vif-deleted", "tag": "66399fb7-29d0-448e-bf25-ebfce7bcbeec"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:49:50.319461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-05a66b13-0075-428a-becc-7967e9518b41 req-76ce052d-8773-4e87-acf6-56e6a3b7c049 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:50.320818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-05a66b13-0075-428a-becc-7967e9518b41 req-76ce052d-8773-4e87-acf6-56e6a3b7c049 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:50.367907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-05a66b13-0075-428a-becc-7967e9518b41 req-76ce052d-8773-4e87-acf6-56e6a3b7c049 service nova] Creating event network-vif-deleted:66399fb7-29d0-448e-bf25-ebfce7bcbeec for instance cc4ead59-0efe-456a-9fdd-1972948afb0a on n-h2-841089-2 May 10 02:49:50.385907 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-05a66b13-0075-428a-becc-7967e9518b41 req-76ce052d-8773-4e87-acf6-56e6a3b7c049 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240579 May 10 02:49:50.388121 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3031/6023] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:49:51.080261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:51.081705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:51.095244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:51.096493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:51.098624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:51.099573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:51.132593 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] HTTP exception thrown: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Request method failure captured: May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a HTTP/1.1 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedGMe8mxZyifeRSBInBXzVP9wnevW03jRXLYuSQdOW_WVRk3BOVoK7Tzg3oXfpd1y_Dz8pTWVOekfceBUMuBLUFImmfRo5JTdOHijl1QilqkAeFeyAt6TJt5Vh4FoZoiGYlUOwsf8h_p6-pLLvNc6J80G4H1aLV7hd4QjzCjwKnMxz8 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: bf6e3ad874a1402398d7b64862fd3abc May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestServerBasicOps-2117851279 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf6e3ad874a1402398d7b64862fd3abc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestServerBasicOps-2117851279 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: bf6e3ad874a1402398d7b64862fd3abc May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestServerBasicOps-2117851279 May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestServerBasicOps-2117851279-project May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 6b500579a1724eed9e59173fd4e664ba May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestServerBasicOps-2117851279-project May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'cc4ead59-0efe-456a-9fdd-1972948afb0a'} May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:51.136601 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:51.141174 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:51.147185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Returning 404 to user: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:51.149735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9da86896-5dc9-4e78-93a5-996cae190af1 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 404 len: 111 microversion: 2.1 time: 0.073592 May 10 02:49:51.156584 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2993/6024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:51 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:52.133712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:52.135174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:52.162678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:52.164865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:52.166977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:52.167786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:52.199825 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] HTTP exception thrown: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Request method failure captured: May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a HTTP/1.1 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedGMe8mxZyifeRSBInBXzVP9wnevW03jRXLYuSQdOW_WVRk3BOVoK7Tzg3oXfpd1y_Dz8pTWVOekfceBUMuBLUFImmfRo5JTdOHijl1QilqkAeFeyAt6TJt5Vh4FoZoiGYlUOwsf8h_p6-pLLvNc6J80G4H1aLV7hd4QjzCjwKnMxz8 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: bf6e3ad874a1402398d7b64862fd3abc May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestServerBasicOps-2117851279 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf6e3ad874a1402398d7b64862fd3abc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestServerBasicOps-2117851279 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: bf6e3ad874a1402398d7b64862fd3abc May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestServerBasicOps-2117851279 May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestServerBasicOps-2117851279-project May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 6b500579a1724eed9e59173fd4e664ba May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestServerBasicOps-2117851279-project May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'cc4ead59-0efe-456a-9fdd-1972948afb0a'} May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:52.209570 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:49:52.215540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Returning 404 to user: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:52.217923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eac84749-7038-4775-9a5f-710f027dc20c tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 404 len: 111 microversion: 2.1 time: 0.090231 May 10 02:49:52.221299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3032/6025] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:49:52 2022] DELETE /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:52.229345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:52.229975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] [instance: cc4ead59-0efe-456a-9fdd-1972948afb0a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:49:52.243233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:52.243698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:52.244496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:49:52.244945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:49:52.260568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] HTTP exception thrown: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Request method failure captured: May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a HTTP/1.1 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedGMe8mxZyifeRSBInBXzVP9wnevW03jRXLYuSQdOW_WVRk3BOVoK7Tzg3oXfpd1y_Dz8pTWVOekfceBUMuBLUFImmfRo5JTdOHijl1QilqkAeFeyAt6TJt5Vh4FoZoiGYlUOwsf8h_p6-pLLvNc6J80G4H1aLV7hd4QjzCjwKnMxz8 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: bf6e3ad874a1402398d7b64862fd3abc May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestServerBasicOps-2117851279 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf6e3ad874a1402398d7b64862fd3abc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6e3ad874a1402398d7b64862fd3abc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestServerBasicOps-2117851279 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: bf6e3ad874a1402398d7b64862fd3abc May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestServerBasicOps-2117851279 May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestServerBasicOps-2117851279-project May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 6b500579a1724eed9e59173fd4e664ba May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestServerBasicOps-2117851279-project May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'cc4ead59-0efe-456a-9fdd-1972948afb0a'} May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:49:52.262654 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. May 10 02:49:52.267533 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:49:52.268302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Returning 404 to user: Instance cc4ead59-0efe-456a-9fdd-1972948afb0a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:49:52.269879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56cd7903-96bb-4e0e-983e-80083023ca96 tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a" status: 404 len: 111 microversion: 2.1 time: 0.044461 May 10 02:49:52.274751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2994/6026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:49:52 2022] GET /compute/v2.1/servers/cc4ead59-0efe-456a-9fdd-1972948afb0a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:49:52.595080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84a0b770-c1c8-4f9b-b758-3cfba2dbcd1b tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] Calling method '.version_select at 0x7f3d3645bca0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:49:52.652773 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-84a0b770-c1c8-4f9b-b758-3cfba2dbcd1b tempest-TestServerBasicOps-2117851279 tempest-TestServerBasicOps-2117851279-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-410752425" status: 202 len: 0 microversion: 2.1 time: 0.061395 May 10 02:49:52.659320 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3033/6027] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-410752425 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:50:02.193959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:02.204877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:02.216551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:02.217043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:02.225979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:02.226811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:02.310136 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2fc9d01e-a7f0-42a0-97c4-a1c10117c108 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "POST /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4/action" status: 200 len: 24573 microversion: 2.1 time: 0.120109 May 10 02:50:02.316995 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2995/6028] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:50:02 2022] POST /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4/action => generated 24573 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:50:09.985469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:09.986156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:10.005820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:10.031656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:10.036663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:10.038399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:10.122461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:50:10.310099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f4d823c1-4f48-4de8-9803-a63d4e880876 req-a894a863-5e70-4be8-9ba7-fb01229a6e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:10.329528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f4d823c1-4f48-4de8-9803-a63d4e880876 req-a894a863-5e70-4be8-9ba7-fb01229a6e7c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:10.330086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f4d823c1-4f48-4de8-9803-a63d4e880876 req-a894a863-5e70-4be8-9ba7-fb01229a6e7c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:10.343619 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4515b2db-aa48-4ffc-bac1-5d6f3807617c tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 204 len: 0 microversion: 2.1 time: 0.406294 May 10 02:50:10.347623 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3034/6029] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:50:09 2022] DELETE /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:50:10.357375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f4d823c1-4f48-4de8-9803-a63d4e880876 req-a894a863-5e70-4be8-9ba7-fb01229a6e7c service nova] Creating event network-changed:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:50:10.359027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:10.359818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:10.372276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:10.373095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:10.374174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:10.374804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:10.379685 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f4d823c1-4f48-4de8-9803-a63d4e880876 req-a894a863-5e70-4be8-9ba7-fb01229a6e7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405660 May 10 02:50:10.380402 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2996/6030] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:50:10.621703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:10.632871 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a9d557c5-974e-4c0d-bdb8-29462cf95ca5 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1689 microversion: 2.1 time: 0.283580 May 10 02:50:10.633859 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3035/6031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:10 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1689 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:11.594659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-37470606", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "938a568b-5142-4273-8dd2-2310363654d5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:11.656365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:11.657123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:11.664356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:11.664815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:11.665605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:11.666055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:11.731118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:50:12.065058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac6de721f6a4e678d69f195107843dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bcf186f5934745913fb3cb5c09eb57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:12.073500 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-802ed593-6d57-49e3-8eeb-d26a5b3146f3 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 200 len: 1689 microversion: 2.1 time: 0.422435 May 10 02:50:12.074914 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3036/6032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:11 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 1689 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:12.571419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5e510eec-f027-4f88-add0-3c49f3eccc65 req-1411e512-0b30-474e-ada7-937b5bc41a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b676d3-40d2-4a20-b75a-c421eb2bebf4", "name": "network-vif-deleted", "tag": "462dc9f1-598d-4131-a20a-85e00391ac63"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:12.583489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5e510eec-f027-4f88-add0-3c49f3eccc65 req-1411e512-0b30-474e-ada7-937b5bc41a6f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:12.585311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5e510eec-f027-4f88-add0-3c49f3eccc65 req-1411e512-0b30-474e-ada7-937b5bc41a6f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:12.608613 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5e510eec-f027-4f88-add0-3c49f3eccc65 req-1411e512-0b30-474e-ada7-937b5bc41a6f service nova] Creating event network-vif-deleted:462dc9f1-598d-4131-a20a-85e00391ac63 for instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 on n-h1-841089-2 May 10 02:50:12.613917 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5e510eec-f027-4f88-add0-3c49f3eccc65 req-1411e512-0b30-474e-ada7-937b5bc41a6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047112 May 10 02:50:12.615136 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3037/6033] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:50:12.736073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:50:12.736660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:50:12.737823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:50:12.738446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:50:12.739044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:50:12.749840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:12.751041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:12.751896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:12.752340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:12.772939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:50:12.783823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:50:12.798390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:50:12.800751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='938a568b-5142-4273-8dd2-2310363654d5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:50:12.881615 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a92d96b-88bf-4589-af9f-694fadae6a2f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291865 May 10 02:50:12.881615 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2997/6034] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:50:12.902028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8625e256-5718-412f-ab19-de58896aa1a2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:12.902943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8625e256-5718-412f-ab19-de58896aa1a2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:13.092905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:13.094237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] [instance: 26b676d3-40d2-4a20-b75a-c421eb2bebf4] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:13.098764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8625e256-5718-412f-ab19-de58896aa1a2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:13.107630 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8625e256-5718-412f-ab19-de58896aa1a2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1055 microversion: 2.1 time: 0.210196 May 10 02:50:13.107769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:13.108913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:13.109439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3038/6035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:12 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1055 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:13.121074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:13.122871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:13.145404 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] HTTP exception thrown: Instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 could not be found. May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Request method failure captured: May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 HTTP/1.1 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedEIRAbNM0Jo3AneNP-OCWGVeg17xFLS7hja29WA5Z-srCxfxYhM0V-F9zjXxD7JodFRVlqz3gruxuxzdD9b1l0fCoDMeosp_Y6eJhaWEg6Nm8GDCmzLNhuhS_J-O-NufXl0KV_ky9h5SPBhDZ84FG_tiZoWlnqhEc7hxkSI4TC449U May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7bcf186f5934745913fb3cb5c09eb57", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7bcf186f5934745913fb3cb5c09eb57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: c7bcf186f5934745913fb3cb5c09eb57 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1774862807 May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 8ac6de721f6a4e678d69f195107843dd May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1774862807-project May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 could not be found. May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '26b676d3-40d2-4a20-b75a-c421eb2bebf4'} May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 could not be found. May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 could not be found. May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:50:13.148590 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 could not be found. May 10 02:50:13.153218 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:50:13.162329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Returning 404 to user: Instance 26b676d3-40d2-4a20-b75a-c421eb2bebf4 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:50:13.163507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e321741-2d3f-4039-b698-2ca8baa589bc tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4" status: 404 len: 111 microversion: 2.1 time: 0.075969 May 10 02:50:13.182417 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2998/6036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:13 2022] GET /compute/v2.1/servers/26b676d3-40d2-4a20-b75a-c421eb2bebf4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:50:14.126266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:14.127891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:14.136511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:14.137293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:14.138565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:14.139379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:14.277403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:14.288949 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e96ab7c5-035f-4ce4-b216-8bd222b944c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1107 microversion: 2.1 time: 0.164336 May 10 02:50:14.289825 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3039/6037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:14 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1107 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:15.314192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:15.315607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:15.325598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:15.326397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:15.331450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:15.333053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:15.487572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:15.511799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-36063036-7183-4e93-b61f-28fdaa0fb73a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1125 microversion: 2.1 time: 0.203830 May 10 02:50:15.525025 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 2999/6038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:15 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1125 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:16.533588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:16.534823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:16.553555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:16.557568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:16.558819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:16.559823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:17.224802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:17.236858 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2c5ad2e-5230-4760-8c1f-92cc9fa964c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.707497 May 10 02:50:17.245896 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3040/6039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:16 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:18.096527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-84776d88-ad6a-40a2-abd6-4f39ee1c32c9 req-05551bf0-e86d-4415-b610-2caba04ebb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4b73b8-12f9-4757-8eb4-d9859a895aa7", "tag": "1c1c35f6-fee6-47a2-8b49-4ef6e33eb522"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:18.109951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-84776d88-ad6a-40a2-abd6-4f39ee1c32c9 req-05551bf0-e86d-4415-b610-2caba04ebb1d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:18.115998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-84776d88-ad6a-40a2-abd6-4f39ee1c32c9 req-05551bf0-e86d-4415-b610-2caba04ebb1d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:18.151929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-84776d88-ad6a-40a2-abd6-4f39ee1c32c9 req-05551bf0-e86d-4415-b610-2caba04ebb1d service nova] Creating event network-changed:1c1c35f6-fee6-47a2-8b49-4ef6e33eb522 for instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 on n-h2-841089-2 May 10 02:50:18.157779 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-84776d88-ad6a-40a2-abd6-4f39ee1c32c9 req-05551bf0-e86d-4415-b610-2caba04ebb1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065153 May 10 02:50:18.158951 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3000/6040] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:50:18.253473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:18.254033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:18.269134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:18.269750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:18.270574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:18.271027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:18.693255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dad61ba6-470b-4125-9379-37390b203f64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] Calling method '.version_select at 0x7f3d37007c10>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:18.745384 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dad61ba6-470b-4125-9379-37390b203f64 tempest-TestNetworkAdvancedServerOps-1774862807 tempest-TestNetworkAdvancedServerOps-1774862807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-206253750" status: 202 len: 0 microversion: 2.1 time: 0.058280 May 10 02:50:18.746121 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3001/6041] 10.222.0.52 () {58 vars in 1280 bytes} [Tue May 10 02:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-206253750 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:50:18.808873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:18.816882 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d5055ba-a800-4ab9-a665-1854e0f076f3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.567432 May 10 02:50:18.817484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3041/6042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:18 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:50:19.834292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:19.834956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:19.861950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:19.866570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:19.867741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:19.870092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:20.558082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:20.567025 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eede373e-2ab7-4510-8a63-19cc0ea04811 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.736669 May 10 02:50:20.570341 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3002/6043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:19 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:21.584520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:21.585465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:21.599635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:21.600112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:21.600933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:21.601404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:21.926400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:21.936727 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-062c178b-2fc8-4610-96b5-d7ef107d1adc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.356543 May 10 02:50:21.937849 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3042/6044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:21 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:22.956277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:22.957333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:23.006710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:23.011246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:23.014867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:23.017554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:23.434098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:23.441881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40d2868e-4752-4da1-b785-c69486bd6430 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.491975 May 10 02:50:23.445405 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3003/6045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:22 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:24.464201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:24.465633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:24.496136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:24.500114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:24.502128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:24.505815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:24.868723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:24.877350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5aa40146-e5bb-4783-93bd-a5d9e8699553 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.419095 May 10 02:50:24.888353 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3043/6046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:24 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:25.901328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:25.902956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:25.920697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:25.922349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:25.926134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:25.930433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:26.495740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:26.513812 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf3a2759-f69b-4b3a-bfee-583693af81d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.616953 May 10 02:50:26.516143 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3004/6047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:25 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:27.533831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:27.535228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:27.556627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:27.565245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:27.572526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:27.573795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:28.035996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:28.043639 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c9e2cc3-47ef-406a-a37e-efd2636b166c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.514314 May 10 02:50:28.047890 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3044/6048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:27 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:29.073232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:29.075859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:29.088348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:29.090665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:29.091946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:29.095539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:29.621910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:29.678012 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d14ed25a-8c77-45b7-bdce-bcc05e2f08a5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.610667 May 10 02:50:29.683139 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3005/6049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:29 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:30.721660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:30.723245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:30.737784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:30.739376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:30.742078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:30.742788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:31.096986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:31.107877 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a73f5844-9d74-4cea-8259-a2494b0bac36 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.393409 May 10 02:50:31.116816 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3045/6050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:30 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:32.133419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:32.134056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:32.145532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:32.145999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:32.146810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:32.153843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:32.560264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:32.569741 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6194ad2-9686-4338-8d9f-4894bac31901 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.440328 May 10 02:50:32.570898 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3006/6051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:32 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:32.640153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddca969c-02d4-41b1-b233-b4632e8ac414 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'create', calling method: .version_select at 0x7f3d362b9af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1569021065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLbHSb3ZJWQQFPvBQ5249ngXJ1TuMXtGvgqAx7nGHJFNRQpMU4BH2u3fmrt3Kole61+fUoy48njofMSQWUlbnB6L85H+X6IiUD1coH0ZEH6Uj8LwFYqU/4BP+4YFYORFw=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:32.668163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ddca969c-02d4-41b1-b233-b4632e8ac414 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:50:32.676057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ddca969c-02d4-41b1-b233-b4632e8ac414 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for user 04db90acbad8446bbdb8b1d4834048ec and project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:50:32.710580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddca969c-02d4-41b1-b233-b4632e8ac414 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.075480 May 10 02:50:32.713829 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3046/6052] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:50:32 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:50:33.587540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:33.588118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:33.605361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:33.611461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:33.613988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:33.616040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:33.914108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:33.926173 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-338106f6-ab95-4641-b567-f3da0e44fad3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.343197 May 10 02:50:33.937650 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3007/6053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:33 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:34.862866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-675988186", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "4bc7d64d-4e57-4e43-8313-4d0774ad7104"}], "key_name": "tempest-TestNetworkBasicOps-1569021065", "security_groups": [{"name": "tempest-secgroup-smoke-1930193975"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:34.952564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:34.953903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:34.962986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:34.963790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:34.975169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:34.976062 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:35.011259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] validate_networks() for [('4bc7d64d-4e57-4e43-8313-4d0774ad7104', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:50:35.285216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:35.297392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-382c003f-f0cd-407c-bdb6-eb69ca1b0167 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.356087 May 10 02:50:35.298690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3008/6054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:34 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:35.688162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:50:35.688608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:50:35.689457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:50:35.690048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:50:35.690653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:50:35.702552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:35.703679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:35.704849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:35.705582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:35.731921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:50:35.738965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for user 04db90acbad8446bbdb8b1d4834048ec and project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:50:35.766263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:50:35.769314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:50:35.846261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cbc21abb-9774-4f9e-97b2-a91562e47b39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.989832 May 10 02:50:35.852007 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3047/6055] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:50:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:50:35.857253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5db96fff-4789-4a86-8f69-29e927525e27 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:35.857967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5db96fff-4789-4a86-8f69-29e927525e27 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:35.964604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5db96fff-4789-4a86-8f69-29e927525e27 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:35.982430 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5db96fff-4789-4a86-8f69-29e927525e27 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1248 microversion: 2.1 time: 0.129235 May 10 02:50:35.984430 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3009/6056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:35 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1248 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:36.317480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:36.325322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:36.334985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:36.336587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:36.339493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:36.340036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:36.579525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:36.592546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-949507f4-fefe-4340-a2e0-6966ae03d6d0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.281771 May 10 02:50:36.593800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3048/6057] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:36 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:37.002003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:37.004216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:37.029521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:37.031847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:37.032672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:37.033122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:37.110022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:37.118170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0c0eea9-674a-4e78-9c66-0ec29dfb5012 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1300 microversion: 2.1 time: 0.121229 May 10 02:50:37.132887 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3010/6058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:36 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1300 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:37.616124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:37.616661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:37.625898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:37.626720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:37.627949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:37.628587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:37.946719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:37.955805 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c22ab29-c0e7-4f2e-af58-c7d290726b1e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.349086 May 10 02:50:37.957023 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3049/6059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:37 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:38.140545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:38.141817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:38.148870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:38.149540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:38.150500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:38.151142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:38.228235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:38.237415 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab24c99c-c93d-4b53-95ef-fca091ae4d1d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1306 microversion: 2.1 time: 0.101467 May 10 02:50:38.238820 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3011/6060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:38 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:38.976007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:38.977569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:38.995316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:38.996371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:39.017417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:39.018851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:39.257562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:39.258382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:39.270320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:39.275241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:39.276638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:39.279319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:39.398048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:39.406140 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0143a0f0-d552-4a15-8e16-634159ba970b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.435124 May 10 02:50:39.419972 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3050/6061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:38 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:39.474138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d22fa4e5-44f6-43ca-b72c-b714573c02f2 req-22c7ce2e-8351-4f39-9e4a-0897cc31bb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed336a10-9f3f-4825-818d-28fd9652249e", "tag": "92e25cdd-6673-4b4f-9f03-0733254b7470"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:39.492545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d22fa4e5-44f6-43ca-b72c-b714573c02f2 req-22c7ce2e-8351-4f39-9e4a-0897cc31bb13 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:39.493264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d22fa4e5-44f6-43ca-b72c-b714573c02f2 req-22c7ce2e-8351-4f39-9e4a-0897cc31bb13 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:39.511204 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d22fa4e5-44f6-43ca-b72c-b714573c02f2 req-22c7ce2e-8351-4f39-9e4a-0897cc31bb13 service nova] Creating event network-changed:92e25cdd-6673-4b4f-9f03-0733254b7470 for instance ed336a10-9f3f-4825-818d-28fd9652249e on n-h1-841089-2 May 10 02:50:39.526249 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d22fa4e5-44f6-43ca-b72c-b714573c02f2 req-22c7ce2e-8351-4f39-9e4a-0897cc31bb13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053436 May 10 02:50:39.535926 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3051/6062] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:50:39.572710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:39.588809 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b40d92be-0765-4253-a51e-f712af5e37a8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.336107 May 10 02:50:39.594020 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3012/6063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:39 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:40.437917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:40.438638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:40.444918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:40.445728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:40.446749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:40.447451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:40.611288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:40.612564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:40.626510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:40.628357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:40.629537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:40.630215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:40.724531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:40.737112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2673fd6-c85d-4b82-9b89-aed5203fd16f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.304229 May 10 02:50:40.739450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3052/6064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:40 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:40.886104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:40.896684 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a89aeb74-6e05-4fba-9e9f-35bc88a9b871 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.291224 May 10 02:50:40.897615 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3013/6065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:40 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:50:41.755949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:41.756582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:41.766626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:41.766862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:41.768378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:41.768874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:41.919177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:41.919947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:41.956915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:41.957118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:41.957893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:41.958344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:42.012520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:42.021314 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d28b5af7-594f-42ba-874e-ec7dce6bd7f9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.269803 May 10 02:50:42.026426 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3053/6066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:41 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:42.326440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:42.345819 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c1b6c9c-efba-4de9-8fe2-bba62c6ee612 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.431741 May 10 02:50:42.346427 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3014/6067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:41 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:43.039104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:43.039959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:43.051657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:43.054335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:43.056728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:43.057672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:43.293436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:43.307902 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-36839718-b487-4198-a98f-8b937722e4fe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.273703 May 10 02:50:43.309284 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3054/6068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:43 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:43.367354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:43.367921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:43.381295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:43.381765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:43.382942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:43.383423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:43.597037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:43.606094 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b5ba5da1-f7ea-4b59-a1c0-85a1903c5312 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.245682 May 10 02:50:43.607105 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3015/6069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:43 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:44.326118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:44.327505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:44.340077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:44.340539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:44.341338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:44.345682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:44.624262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:44.627443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:44.648740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:44.648876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:44.648996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:44.649767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:44.654602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:44.661239 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b1f0cdc8-b78a-4c08-9ff6-4281d3bf7963 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.339549 May 10 02:50:44.667048 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3055/6070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:44 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:44.879835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:44.890964 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4c24e45-db25-4f79-908b-c5608ed3b5d4 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.271189 May 10 02:50:44.891974 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3016/6071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:44 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:50:45.681054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:45.682277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:45.689924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:45.690615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:45.691794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:45.692439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:45.910448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:45.911055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:45.924460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:45.924992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:45.927435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:45.929773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:45.950615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:45.959084 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38e85554-60d7-4a40-9019-a5a0ccc7853b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1167 microversion: 2.1 time: 0.281812 May 10 02:50:45.959693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3056/6072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:45 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1167 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:46.163731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-bb567369-55f8-4fd1-9a2f-3be6eb7cd200 req-82f60f8e-fa35-43d5-9709-662dbe5ec2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed336a10-9f3f-4825-818d-28fd9652249e", "name": "network-vif-plugged", "status": "completed", "tag": "92e25cdd-6673-4b4f-9f03-0733254b7470"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:46.191119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bb567369-55f8-4fd1-9a2f-3be6eb7cd200 req-82f60f8e-fa35-43d5-9709-662dbe5ec2e0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:46.191580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-bb567369-55f8-4fd1-9a2f-3be6eb7cd200 req-82f60f8e-fa35-43d5-9709-662dbe5ec2e0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:46.211252 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-bb567369-55f8-4fd1-9a2f-3be6eb7cd200 req-82f60f8e-fa35-43d5-9709-662dbe5ec2e0 service nova] Creating event network-vif-plugged:92e25cdd-6673-4b4f-9f03-0733254b7470 for instance ed336a10-9f3f-4825-818d-28fd9652249e on n-h1-841089-2 May 10 02:50:46.231202 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-bb567369-55f8-4fd1-9a2f-3be6eb7cd200 req-82f60f8e-fa35-43d5-9709-662dbe5ec2e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070937 May 10 02:50:46.232120 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3057/6073] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:50:46.351935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:46.366784 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b241f116-99e8-401d-9482-175fb8a552cd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.461496 May 10 02:50:46.368317 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3017/6074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:45 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:46.979965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:46.994436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:47.015562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:47.016909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:47.018624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:47.019846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:47.232629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:47.249411 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42cb4318-76d7-464c-85e7-ed14fe84fd3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1213 microversion: 2.1 time: 0.273973 May 10 02:50:47.251816 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3058/6075] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:46 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1213 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:47.384642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:47.385599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:47.397245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:47.397690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:47.398390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:47.398874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:47.642716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:47.651293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0cb2428a-636c-4c51-b041-10fc7e492d9a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1374 microversion: 2.1 time: 0.270584 May 10 02:50:47.651810 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3018/6076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:47 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:48.265955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:48.267162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:48.274969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:48.275634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:48.276619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:48.277234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:48.502640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:48.512864 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f5be816-0e2d-49ca-879a-2e752e2e079c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.250758 May 10 02:50:48.523631 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3059/6077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:48 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:48.669039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:48.670326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:48.677774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:48.678526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:48.679592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:48.680248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:48.848202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:48.860475 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b18a0474-1d9a-4502-95ad-b15de0219f0c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1546 microversion: 2.1 time: 0.195554 May 10 02:50:48.861662 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3019/6078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:48 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:48.879002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:48.880338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:48.887954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:48.888677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:48.890186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:48.890801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:49.047419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:49.056866 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0068b466-426e-4b51-8e43-810b512e6107 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1546 microversion: 2.1 time: 0.182506 May 10 02:50:49.057756 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3060/6079] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:48 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:49.532278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:49.533788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:49.541646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:49.542491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:49.543646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:49.544302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:49.943077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:49.958996 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cd0b70af-a2c0-43e5-8965-c1a4008a205c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.432604 May 10 02:50:49.960241 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3020/6080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:49 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:50.976123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:50.977333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:50.988389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:50.991545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:50.997612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:51.003773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:51.360669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:51.370646 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01f3e21d-6e13-4f60-a6a5-cc371017629c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.398449 May 10 02:50:51.371866 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3061/6081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:50 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:52.021213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-788f3c95-3f8b-49a4-8fa7-1133c1595928 req-a5420989-7e0a-4653-86f1-ded51b1bf20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed336a10-9f3f-4825-818d-28fd9652249e", "tag": "92e25cdd-6673-4b4f-9f03-0733254b7470"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:52.039860 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-788f3c95-3f8b-49a4-8fa7-1133c1595928 req-a5420989-7e0a-4653-86f1-ded51b1bf20b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:52.040725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-788f3c95-3f8b-49a4-8fa7-1133c1595928 req-a5420989-7e0a-4653-86f1-ded51b1bf20b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:52.062387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-788f3c95-3f8b-49a4-8fa7-1133c1595928 req-a5420989-7e0a-4653-86f1-ded51b1bf20b service nova] Creating event network-changed:92e25cdd-6673-4b4f-9f03-0733254b7470 for instance ed336a10-9f3f-4825-818d-28fd9652249e on n-h1-841089-2 May 10 02:50:52.079237 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-788f3c95-3f8b-49a4-8fa7-1133c1595928 req-a5420989-7e0a-4653-86f1-ded51b1bf20b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063239 May 10 02:50:52.082394 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3021/6082] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:50:52.388355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:52.389043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:52.403971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:52.404736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:52.405988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:52.406800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:52.647697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:52.656184 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6368c900-b005-4631-937f-d55f34f71fb7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.272295 May 10 02:50:52.657075 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3062/6083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:52 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:53.673800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:53.674587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:53.684913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:53.686724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:53.690874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:53.691403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:53.850095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:53.860160 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f45e24da-1aae-4ba6-98d3-ce2fb32d0bbf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.190598 May 10 02:50:53.861191 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3022/6084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:53 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:54.877376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:54.878125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:54.886886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:54.887484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:54.888563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:54.889965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:55.076691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:55.085844 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d18778a-f0c3-4a95-b533-58588e29405f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.212334 May 10 02:50:55.086451 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3063/6085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:54 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:56.103369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:56.104635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:56.113078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:56.113895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:56.114895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:56.115364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:56.353585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:56.358835 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bde107d4-60ee-41ce-9712-ec2ad71a00a9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.259233 May 10 02:50:56.359819 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3023/6086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:56 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:56.888296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b823a354-82de-4627-ab0a-16039b60a95d req-3807191d-c2a8-4356-87ab-c470e6084b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b73b8-12f9-4757-8eb4-d9859a895aa7", "name": "network-vif-plugged", "status": "completed", "tag": "1c1c35f6-fee6-47a2-8b49-4ef6e33eb522"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:50:56.899136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b823a354-82de-4627-ab0a-16039b60a95d req-3807191d-c2a8-4356-87ab-c470e6084b4c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:56.899825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b823a354-82de-4627-ab0a-16039b60a95d req-3807191d-c2a8-4356-87ab-c470e6084b4c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:56.923177 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b823a354-82de-4627-ab0a-16039b60a95d req-3807191d-c2a8-4356-87ab-c470e6084b4c service nova] Creating event network-vif-plugged:1c1c35f6-fee6-47a2-8b49-4ef6e33eb522 for instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 on n-h2-841089-2 May 10 02:50:56.933067 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b823a354-82de-4627-ab0a-16039b60a95d req-3807191d-c2a8-4356-87ab-c470e6084b4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048330 May 10 02:50:56.935865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3064/6087] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:50:57.375252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:57.376517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:57.385577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:57.386235 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:57.387247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:57.387864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:57.603851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:57.614242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac3dcd9c-4fb7-441a-b763-de341331e9f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1201 microversion: 2.1 time: 0.242729 May 10 02:50:57.624171 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3024/6088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:57 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1201 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:58.637611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:58.638273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:58.651566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:58.652148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:58.653018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:58.653566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:58.820147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:58.829105 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f220d583-12d0-458f-ae50-199320ad67ff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1388 microversion: 2.1 time: 0.201872 May 10 02:50:58.830662 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3065/6089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:58 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1388 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:58.852050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:58.852812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:58.859553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:58.860018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:58.866671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:58.867215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.080699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:59.094230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d651e43e-019d-48d0-8217-dd8271081b83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1388 microversion: 2.1 time: 0.252818 May 10 02:50:59.095586 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3025/6090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:58 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1388 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:59.116657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:59.117617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:59.124610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:59.126056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.127055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:59.127707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.433419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:59.442926 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2c5d1e6-74b4-474e-a69f-4bc0d8a769cf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1388 microversion: 2.1 time: 0.336058 May 10 02:50:59.450151 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3066/6091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:59 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1388 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:50:59.548622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:59.549411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:59.566130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:59.569172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.570016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:59.570469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.612410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:50:59.742865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0edced7f-668d-49f8-8c74-b1c14bc12fe7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 204 len: 0 microversion: 2.1 time: 0.199484 May 10 02:50:59.745151 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3026/6092] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:50:59 2022] DELETE /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:50:59.753612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:50:59.754259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:50:59.762858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:59.763623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.764670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:50:59.766103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:50:59.959846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:50:59.967846 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-95a43e28-1834-459a-b333-7234a74d07d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1394 microversion: 2.1 time: 0.219527 May 10 02:50:59.977694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3067/6093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:50:59 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1394 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:51:00.987022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:00.987918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:00.994915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:00.995748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:00.996759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:00.997277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:01.137509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:01.145481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5e75277-d2b9-4af5-b08a-a964429d7dff tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1394 microversion: 2.1 time: 0.164035 May 10 02:51:01.146055 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3027/6094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:00 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1394 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:02.165250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:02.166723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:02.175645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:02.176496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:02.177865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:02.180770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:02.559995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-21624197-68b5-4b9d-9f9b-cef7d6327497 req-a4665a0f-aefb-4a69-9c8c-497f46dd75aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b73b8-12f9-4757-8eb4-d9859a895aa7", "name": "network-vif-deleted", "tag": "1c1c35f6-fee6-47a2-8b49-4ef6e33eb522"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:51:02.601921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:02.617724 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79b45b00-7295-4ac3-9c27-6f0f58a6ec72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1394 microversion: 2.1 time: 0.458716 May 10 02:51:02.619517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21624197-68b5-4b9d-9f9b-cef7d6327497 req-a4665a0f-aefb-4a69-9c8c-497f46dd75aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:02.619973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-21624197-68b5-4b9d-9f9b-cef7d6327497 req-a4665a0f-aefb-4a69-9c8c-497f46dd75aa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:02.620617 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3068/6095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:02 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1394 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:02.660299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-21624197-68b5-4b9d-9f9b-cef7d6327497 req-a4665a0f-aefb-4a69-9c8c-497f46dd75aa service nova] Creating event network-vif-deleted:1c1c35f6-fee6-47a2-8b49-4ef6e33eb522 for instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 on n-h2-841089-2 May 10 02:51:02.667501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-21624197-68b5-4b9d-9f9b-cef7d6327497 req-a4665a0f-aefb-4a69-9c8c-497f46dd75aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113362 May 10 02:51:02.681641 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3028/6096] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:51:03.649630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:03.651524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:03.666435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:03.669131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:03.671798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:03.672443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:03.796387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:03.813483 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-53728321-fd3a-4d28-a18a-f94da0710d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.178355 May 10 02:51:03.822375 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3069/6097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:03 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:04.836950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:04.840927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:04.869969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:04.870429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:04.881332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:04.885691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:05.007306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:05.019901 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d1d7ffee-0994-4267-a59e-2442a7dc32be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.191618 May 10 02:51:05.044176 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3029/6098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:04 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:06.045206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:06.046061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:06.057176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:06.057850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:06.058803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:06.062335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:06.169005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:06.186991 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c82128ce-8dd9-4f3f-8dc1-eaa09473c366 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.145995 May 10 02:51:06.189937 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3070/6099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:06 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:07.206029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:07.207553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:07.220113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:07.224658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:07.225475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:07.226056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:07.345051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:07.354900 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dcc3e837-e63d-4845-a5ee-285082848bf9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.152866 May 10 02:51:07.366583 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3030/6100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:07 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:08.372917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:08.373632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:08.409256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:08.409914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:08.416813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:08.417746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:08.532882 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:08.561220 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-75051583-0880-4b0c-bb8f-6a58bbeb853d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.192272 May 10 02:51:08.562627 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3071/6101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:08 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:09.580077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:09.580950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:09.599865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:09.599865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:09.604009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:09.604832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:09.776452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:09.790223 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9309738f-a4b1-4c13-95d8-12ad28dbb6a1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.216325 May 10 02:51:09.795536 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3031/6102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:09 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:10.813168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:10.814450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:10.829867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:10.830541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:10.831548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:10.832170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:10.917679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:10.931261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94a41d7c-a201-46d3-85f3-06c659e8df85 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.123734 May 10 02:51:10.932131 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3072/6103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:10 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:11.948243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:11.948814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:11.959705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:11.960579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:11.962348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:11.964363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:12.085363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:12.097149 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-16a031a8-a796-4856-8d08-c522205aa004 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.152854 May 10 02:51:12.107602 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3032/6104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:11 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:12.439764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:51:12.441171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:12.457773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:12.458358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:12.462450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:12.464270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:12.547240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb7c9dc7-d129-43b4-8dd3-828016f37134 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e/action" status: 200 len: 24567 microversion: 2.1 time: 0.113825 May 10 02:51:12.549143 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3073/6105] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:51:12 2022] POST /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e/action => generated 24567 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:51:13.118391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:13.119623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:13.136286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:13.136742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:13.137530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:13.137970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:13.259240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:13.274874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b61824fe-231b-408b-8496-6134d453dbfe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.163351 May 10 02:51:13.285770 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3033/6106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:13 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:14.293258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:14.294139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:14.309215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:14.309682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:14.311054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:14.311526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:14.820721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:14.836662 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-67491a32-cf2b-4887-ba38-e4d24f55396f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1186 microversion: 2.1 time: 0.544672 May 10 02:51:14.837651 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3074/6107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:14 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1186 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:15.856555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:15.859684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:15.879647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:15.880113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:15.884271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:15.885054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:16.008684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:16.009009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:16.009716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lazy-loading 'fault' on Instance uuid 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:51:16.118979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:16.130336 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-741b1b22-2c04-4f09-a4b1-983735d87d77 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 200 len: 1191 microversion: 2.1 time: 0.279887 May 10 02:51:16.134717 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3034/6108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:15 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 1191 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:17.152191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:17.152831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:17.161266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:17.162045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:17.163100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:17.163761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:17.188383 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 HTTP/1.1 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '5a4b73b8-12f9-4757-8eb4-d9859a895aa7'} May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:51:17.190335 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:17.195891 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:17.199526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:51:17.200480 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b410576-c475-4afd-973f-34bc5ff18a7a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 404 len: 111 microversion: 2.1 time: 0.052414 May 10 02:51:17.201102 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3075/6109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:17 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:51:22.633490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:22.634011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:22.650270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:22.664871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:22.665968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:22.666582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:22.696577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 HTTP/1.1 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '5a4b73b8-12f9-4757-8eb4-d9859a895aa7'} May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:51:22.698598 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.703679 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:51:22.708680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:51:22.716933 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3738a744-99f4-4654-9e5b-a8623b8bd3d7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 404 len: 111 microversion: 2.1 time: 0.089741 May 10 02:51:22.718146 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3035/6110] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:51:22 2022] DELETE /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:51:22.726847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:22.727908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 5a4b73b8-12f9-4757-8eb4-d9859a895aa7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:22.746837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:22.747562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:22.751746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:22.753122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:22.799034 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 HTTP/1.1 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '5a4b73b8-12f9-4757-8eb4-d9859a895aa7'} May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:51:22.800714 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. May 10 02:51:22.807231 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:51:22.810330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance 5a4b73b8-12f9-4757-8eb4-d9859a895aa7 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:51:22.810330 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f378b06c-df50-4dad-8459-fc5c27257dbd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7" status: 404 len: 111 microversion: 2.1 time: 0.086281 May 10 02:51:22.811387 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3076/6111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:22 2022] GET /compute/v2.1/servers/5a4b73b8-12f9-4757-8eb4-d9859a895aa7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:51:25.659894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a8a1457-182d-4ecb-8f49-ff6302f51c69 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'create', calling method: .version_select at 0x7f3d35e97430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-418080888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGGzJypaZdKcfyV/LdoCpsdo/kVNeuw7ZWdKEM4FCZijOI6IQ5S63NimOPRIlgKg/my86l7vXrQTYsXd6GSu5bAamXOB/156JS92OVh2jHFKilm8HdzHwrONJ/aBBomDw=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:51:25.725170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2a8a1457-182d-4ecb-8f49-ff6302f51c69 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:51:25.742104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2a8a1457-182d-4ecb-8f49-ff6302f51c69 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for user 04db90acbad8446bbdb8b1d4834048ec and project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:51:25.792536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a8a1457-182d-4ecb-8f49-ff6302f51c69 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.143271 May 10 02:51:25.796329 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3036/6112] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:51:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:51:27.855808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1317307388", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "3782cee7-bd6f-4bb3-aff1-e15ba4d6b745"}], "key_name": "tempest-TestNetworkBasicOps-418080888", "security_groups": [{"name": "tempest-secgroup-smoke-1684728059"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:51:28.275473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] validate_networks() for [('3782cee7-bd6f-4bb3-aff1-e15ba4d6b745', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:51:29.133969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:51:29.135037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:51:29.135990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:51:29.136658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:51:29.137296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:51:29.167987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:29.169464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:29.172905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:29.174218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:29.229259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:51:29.273150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for user 04db90acbad8446bbdb8b1d4834048ec and project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:51:29.293316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:51:29.296584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:51:29.401794 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e3fc2f5-a620-446a-8917-6cd83bac6415 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.552006 May 10 02:51:29.403289 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3077/6113] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:51:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:51:29.415137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d2e2b957-9192-47ea-a307-283f0f94fe4d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:29.417483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d2e2b957-9192-47ea-a307-283f0f94fe4d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:29.809285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d2e2b957-9192-47ea-a307-283f0f94fe4d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:29.821057 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d2e2b957-9192-47ea-a307-283f0f94fe4d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1248 microversion: 2.1 time: 0.410224 May 10 02:51:29.821668 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3037/6114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:29 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1248 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:30.838747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:30.840090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:30.854621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:30.855337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:30.856290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:30.857472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:31.145772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:31.155568 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-48ea2e95-2616-49a4-82d6-9fa57b7b12da tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1300 microversion: 2.1 time: 0.321348 May 10 02:51:31.156800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3078/6115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:30 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1300 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:32.185593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:32.186713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:32.198982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:32.211911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:32.213159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:32.213821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:32.361788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:32.371315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b5369a58-1141-4db3-a2b8-d3ac811f2cc0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1306 microversion: 2.1 time: 0.202567 May 10 02:51:32.376149 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3038/6116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:32 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:33.392832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:33.394200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:33.413104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:33.413810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:33.415622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:33.416804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:33.897298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:33.907243 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a9109729-4cc2-4c2f-8027-f6e35bbfd633 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 0.518704 May 10 02:51:33.922811 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3079/6117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:33 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:34.868471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1a5ed19c-c6a1-4a22-ab41-72ead3f1646c req-5e184c10-aa5d-4086-81c7-7c945c0c96ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a4ac84-046f-4385-ae38-37800276ae64", "tag": "982a7d01-ebb6-477e-8a14-2ed5da5f32c5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:51:34.906200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1a5ed19c-c6a1-4a22-ab41-72ead3f1646c req-5e184c10-aa5d-4086-81c7-7c945c0c96ff service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:34.906652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1a5ed19c-c6a1-4a22-ab41-72ead3f1646c req-5e184c10-aa5d-4086-81c7-7c945c0c96ff service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:34.929938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:34.931412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:34.943493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:34.959943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:34.960897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:34.963183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:34.963742 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1a5ed19c-c6a1-4a22-ab41-72ead3f1646c req-5e184c10-aa5d-4086-81c7-7c945c0c96ff service nova] Creating event network-changed:982a7d01-ebb6-477e-8a14-2ed5da5f32c5 for instance 21a4ac84-046f-4385-ae38-37800276ae64 on n-h2-841089-2 May 10 02:51:34.974576 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1a5ed19c-c6a1-4a22-ab41-72ead3f1646c req-5e184c10-aa5d-4086-81c7-7c945c0c96ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110309 May 10 02:51:34.975238 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3039/6118] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:51:36.082602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:36.094901 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a90fe92-944f-4741-bc75-1a90356a77d3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 1.169489 May 10 02:51:36.097987 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3080/6119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:34 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:51:37.112379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:37.113187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:37.160142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:37.160623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:37.161500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:37.162018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:37.415980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:37.427318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-63f3b79f-753e-4ee6-9cfb-ec925f3d5e07 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 0.318713 May 10 02:51:37.429287 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3040/6120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:37 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:38.445433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:38.446632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:38.460038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:38.462384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:38.464014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:38.466211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:38.753278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:38.769786 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a5586a0-da93-4da8-ba22-75c5c5c9b49a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 0.329394 May 10 02:51:38.770492 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3081/6121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:38 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:39.812732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:39.817100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:39.836540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:39.836998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:39.837797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:39.838244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:40.287987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:40.296865 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-659a6379-74e9-4927-863f-16be9daee5a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 0.507300 May 10 02:51:40.297755 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3041/6122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:39 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:41.207208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e3335d90-cd79-4827-8c06-93c62d9e2625 req-a4d83218-aebb-4d79-aa12-3727f6b4418d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a4ac84-046f-4385-ae38-37800276ae64", "name": "network-vif-plugged", "status": "completed", "tag": "982a7d01-ebb6-477e-8a14-2ed5da5f32c5"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:51:41.222214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e3335d90-cd79-4827-8c06-93c62d9e2625 req-a4d83218-aebb-4d79-aa12-3727f6b4418d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:41.222669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e3335d90-cd79-4827-8c06-93c62d9e2625 req-a4d83218-aebb-4d79-aa12-3727f6b4418d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:41.235498 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e3335d90-cd79-4827-8c06-93c62d9e2625 req-a4d83218-aebb-4d79-aa12-3727f6b4418d service nova] Creating event network-vif-plugged:982a7d01-ebb6-477e-8a14-2ed5da5f32c5 for instance 21a4ac84-046f-4385-ae38-37800276ae64 on n-h2-841089-2 May 10 02:51:41.245206 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e3335d90-cd79-4827-8c06-93c62d9e2625 req-a4d83218-aebb-4d79-aa12-3727f6b4418d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040698 May 10 02:51:41.246236 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3082/6123] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:51:41.323455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:41.326052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:41.345169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:41.351626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:41.354607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:41.356156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:41.787951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:41.799307 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a257cef-73a9-47f8-ad81-4d31686987e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 0.485665 May 10 02:51:41.800133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3042/6124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:41 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:42.817229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:42.817920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:42.832403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:42.840983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:42.842072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:42.844770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:43.083268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:43.100443 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6399444a-b05c-493d-96b5-72b2fa4e53c8 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1374 microversion: 2.1 time: 0.287823 May 10 02:51:43.108614 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3083/6125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:42 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1374 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:44.117938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:44.119179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:44.127932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:44.136822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:44.137900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:44.138481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:44.353947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:44.363725 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afd45d33-27ed-4f97-83fa-ffcda2121ed0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1546 microversion: 2.1 time: 0.249701 May 10 02:51:44.364588 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3043/6126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:44 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1546 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:51:44.384580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:51:44.385209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:51:44.397086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:44.398065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:44.399333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:51:44.400290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:51:44.576787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:51:44.589638 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2db21a7-74f8-45e1-b113-3b5346d566b2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1546 microversion: 2.1 time: 0.208873 May 10 02:51:44.591234 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3084/6127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:51:44 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:05.438331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1879050261", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7e4ccef1-23ab-401d-905b-15d478713458", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:05.555529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:52:06.331831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:52:06.332608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:52:06.333307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:52:06.334535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:52:06.335337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:52:06.347986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:06.348762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:06.349771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:06.350578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:06.374525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:52:06.383363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:52:06.466160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:52:06.468441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e4ccef1-23ab-401d-905b-15d478713458',volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:52:06.642490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5dd3c747-1f05-4574-bb26-db029aee4bbe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209096 May 10 02:52:06.645502 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3044/6128] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:52:06.673801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16ddd2ce-3613-4c75-9dde-dc987f0a001e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:06.675602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16ddd2ce-3613-4c75-9dde-dc987f0a001e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:06.775182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-16ddd2ce-3613-4c75-9dde-dc987f0a001e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:06.782995 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16ddd2ce-3613-4c75-9dde-dc987f0a001e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1071 microversion: 2.1 time: 0.130404 May 10 02:52:06.784973 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3085/6129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:06 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1071 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:07.809846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:07.811343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:07.825240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:07.826875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:07.827783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:07.835977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:07.935431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:07.962163 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb2a09e0-256f-4e1d-9938-d657c00003a0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1177 microversion: 2.1 time: 0.144817 May 10 02:52:07.963536 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3045/6130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:07 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1177 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:08.979820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:08.981319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:08.995856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:08.996445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:08.997320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:08.997838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:09.139079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:09.146714 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b359dc76-c680-4691-bd36-dceb90e7e13b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1187 microversion: 2.1 time: 0.170813 May 10 02:52:09.155786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3086/6131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:08 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1187 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:10.172517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:10.173142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:10.181764 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:10.182417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:10.183648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:10.184279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:10.912772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:10.923905 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-be3282e9-50e4-43e6-ba65-ae6683ee81c4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.752441 May 10 02:52:10.925724 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3046/6132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:10 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:11.782710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a6cf2256-a07c-458f-91a6-dabd4f2067a3 req-16432e60-267f-4061-b016-d886ad8d12a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d663ab29-b4bb-466e-81ca-06e17922f37d", "tag": "25a3ee34-afb4-46f1-b9a3-b797a3ff8446"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:11.811139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a6cf2256-a07c-458f-91a6-dabd4f2067a3 req-16432e60-267f-4061-b016-d886ad8d12a7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:11.811614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a6cf2256-a07c-458f-91a6-dabd4f2067a3 req-16432e60-267f-4061-b016-d886ad8d12a7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:11.838855 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a6cf2256-a07c-458f-91a6-dabd4f2067a3 req-16432e60-267f-4061-b016-d886ad8d12a7 service nova] Creating event network-changed:25a3ee34-afb4-46f1-b9a3-b797a3ff8446 for instance d663ab29-b4bb-466e-81ca-06e17922f37d on n-h1-841089-2 May 10 02:52:11.857795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a6cf2256-a07c-458f-91a6-dabd4f2067a3 req-16432e60-267f-4061-b016-d886ad8d12a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080892 May 10 02:52:11.858732 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3087/6133] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:52:11.942442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:11.943814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:11.953454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:11.955899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:11.960821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:11.961477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:12.191712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:12.204349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3fd8fbb8-fe68-4eaa-b324-2a9ae7ec3b87 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.266539 May 10 02:52:12.207337 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3047/6134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:11 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:13.230709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:13.231603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:13.253703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:13.254203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:13.255191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:13.255770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:13.386810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:13.387357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:13.407607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:13.409119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:13.412038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:13.412654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:13.478553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:52:13.609829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:13.642732 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0c3d069-bee8-4508-9425-1a54d5135c00 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.396668 May 10 02:52:13.649615 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3088/6135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:13 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:13.684176 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c4d83e4-2681-43d7-8a62-2ddaaef11be2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 204 len: 0 microversion: 2.1 time: 0.301406 May 10 02:52:13.685233 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3048/6136] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:52:13 2022] DELETE /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 02:52:13.694166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:13.695150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:13.702744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:13.703519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:13.704475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:13.705086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:13.963565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:13.973026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e2dffb61-74a6-4061-8ac4-baaae3ad9286 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1552 microversion: 2.1 time: 0.283421 May 10 02:52:13.985429 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3089/6137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:13 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1552 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:14.667557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:14.668281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:14.860833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:14.860833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:14.860833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:14.860833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:14.993368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:14.994126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:15.008574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:15.009126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:15.011985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:15.013336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:15.274780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:15.284952 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d473b8a0-444e-42a0-89c9-7f3cc40d1eb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.622891 May 10 02:52:15.299519 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3049/6138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:14 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:15.438427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:15.449913 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-922dcae2-ab4a-4143-8994-668201990002 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1552 microversion: 2.1 time: 0.462175 May 10 02:52:15.461673 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3090/6139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:14 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1552 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:52:16.230585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1155e655-5a5f-492a-b509-5b00f889db85 req-0965feed-ea61-470e-a277-34e152dcd7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a4ac84-046f-4385-ae38-37800276ae64", "name": "network-vif-deleted", "tag": "982a7d01-ebb6-477e-8a14-2ed5da5f32c5"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:16.241645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1155e655-5a5f-492a-b509-5b00f889db85 req-0965feed-ea61-470e-a277-34e152dcd7a6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:16.242396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1155e655-5a5f-492a-b509-5b00f889db85 req-0965feed-ea61-470e-a277-34e152dcd7a6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:16.255972 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1155e655-5a5f-492a-b509-5b00f889db85 req-0965feed-ea61-470e-a277-34e152dcd7a6 service nova] Creating event network-vif-deleted:982a7d01-ebb6-477e-8a14-2ed5da5f32c5 for instance 21a4ac84-046f-4385-ae38-37800276ae64 on n-h2-841089-2 May 10 02:52:16.264189 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1155e655-5a5f-492a-b509-5b00f889db85 req-0965feed-ea61-470e-a277-34e152dcd7a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040886 May 10 02:52:16.270238 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3050/6140] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:52:16.303473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:16.304108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:16.313781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:16.314498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:16.315690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:16.316808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:16.471528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:16.472191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:16.489816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:16.490279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:16.497519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:16.497977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:16.540291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:16.555114 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52c878c3-325f-42e6-bf3c-5040fd898066 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.256520 May 10 02:52:16.568797 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3091/6141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:16 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:16.587618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:16.588258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:16.589564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lazy-loading 'fault' on Instance uuid 21a4ac84-046f-4385-ae38-37800276ae64 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:52:16.719779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:16.730597 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6cd6d62-75a9-4b4e-bb5b-97936d9b0f79 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 200 len: 1338 microversion: 2.1 time: 0.264980 May 10 02:52:16.741976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3051/6142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:16 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 1338 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:17.578436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:17.579143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:17.589586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:17.590066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:17.591189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:17.591866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:17.753274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:17.753837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: 21a4ac84-046f-4385-ae38-37800276ae64] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:17.767824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:17.768362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:17.778260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:17.781261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:17.835405 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] HTTP exception thrown: Instance 21a4ac84-046f-4385-ae38-37800276ae64 could not be found. May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Request method failure captured: May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 HTTP/1.1 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedLtUtM8oSZbvvN7Hr57cpyZGSqhfmP_6xyydP_MG7hHYA4oJYWO18M3--zWMVruaVA01xnGBC3rkZJkMt_MHSrjMlx48Yh2-9LGMqjrMV13800BKgzyGNt7Ay0IgsWLGAmWi3DBB18Pw8hv_fmw-0-MtAClKywH4x_WFTF8qWb-cV4 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 28d7b9e6477f48d3a9fb6ae490046647 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkBasicOps-827621217 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28d7b9e6477f48d3a9fb6ae490046647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkBasicOps-827621217 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 28d7b9e6477f48d3a9fb6ae490046647 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkBasicOps-827621217 May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkBasicOps-827621217-project May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 04db90acbad8446bbdb8b1d4834048ec May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkBasicOps-827621217-project May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 21a4ac84-046f-4385-ae38-37800276ae64 could not be found. May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '21a4ac84-046f-4385-ae38-37800276ae64'} May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a4ac84-046f-4385-ae38-37800276ae64 could not be found. May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a4ac84-046f-4385-ae38-37800276ae64 could not be found. May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:52:17.842934 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a4ac84-046f-4385-ae38-37800276ae64 could not be found. May 10 02:52:17.847280 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:17.849188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Returning 404 to user: Instance 21a4ac84-046f-4385-ae38-37800276ae64 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:52:17.850440 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-70356904-0ae7-4465-9436-873a2dd3f8c9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64" status: 404 len: 111 microversion: 2.1 time: 0.102666 May 10 02:52:17.851567 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3052/6143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:17 2022] GET /compute/v2.1/servers/21a4ac84-046f-4385-ae38-37800276ae64 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:52:18.018131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:18.028774 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d0af729-99a4-4b3b-8412-e90d74f52330 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.457082 May 10 02:52:18.029386 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3092/6144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:17 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:18.160550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a668ea01-683c-421a-8c35-0137b3f68b76 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '.version_select at 0x7f3d370079d0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:18.195493 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a668ea01-683c-421a-8c35-0137b3f68b76 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-418080888" status: 202 len: 0 microversion: 2.1 time: 0.038857 May 10 02:52:18.196552 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3053/6145] 10.222.0.52 () {58 vars in 1253 bytes} [Tue May 10 02:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-418080888 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:52:19.048448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:19.049759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:19.062264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:19.062817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:19.063739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:19.064277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:19.470322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:19.482109 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c813dbf-7e5b-4989-b600-f025cfaa6750 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.438528 May 10 02:52:19.493175 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3093/6146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:19 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:20.499556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:20.500810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:20.513353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:20.514220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:20.515224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:20.520163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:20.961342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:20.977680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0de120e6-eae0-4d4e-93a9-314ad49660ae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.482164 May 10 02:52:20.978316 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3054/6147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:20 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:21.996827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:21.997490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:22.008007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.008472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:22.009590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.009700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:22.395695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:22.414612 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4109a19e-225c-4982-8ed5-8979b2692d7f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.412394 May 10 02:52:22.416220 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3094/6148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:21 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:22.460454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:22.462287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:22.463987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-76e43778-0c87-47c2-978a-baa6fc001c7a req-4429523c-b2b8-4dd5-8c42-8f46cbbc8dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed336a10-9f3f-4825-818d-28fd9652249e", "tag": "92e25cdd-6673-4b4f-9f03-0733254b7470"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:22.478883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-76e43778-0c87-47c2-978a-baa6fc001c7a req-4429523c-b2b8-4dd5-8c42-8f46cbbc8dbe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.479210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-76e43778-0c87-47c2-978a-baa6fc001c7a req-4429523c-b2b8-4dd5-8c42-8f46cbbc8dbe service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:22.481538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.484040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:22.485996 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.486592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:22.501868 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-76e43778-0c87-47c2-978a-baa6fc001c7a req-4429523c-b2b8-4dd5-8c42-8f46cbbc8dbe service nova] Creating event network-changed:92e25cdd-6673-4b4f-9f03-0733254b7470 for instance ed336a10-9f3f-4825-818d-28fd9652249e on n-h1-841089-2 May 10 02:52:22.509773 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-76e43778-0c87-47c2-978a-baa6fc001c7a req-4429523c-b2b8-4dd5-8c42-8f46cbbc8dbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049474 May 10 02:52:22.511510 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3095/6149] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:52:22.565605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:52:22.812973 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc3cee96-7adb-4d25-abdb-2b4ffc563d3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 204 len: 0 microversion: 2.1 time: 0.361862 May 10 02:52:22.814406 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3055/6150] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:52:22 2022] DELETE /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:52:22.824227 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:22.825231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:22.837789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.838505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:22.848281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:22.851121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:23.206513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:23.220484 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c7a0c85-ade8-4d84-b618-8551e22c1965 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1671 microversion: 2.1 time: 0.400666 May 10 02:52:23.223770 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3096/6151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:22 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1671 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:23.443414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:23.444402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:23.452803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:23.453370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:23.454059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:23.455048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:23.767790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:23.775776 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f894e450-0324-4917-b713-e538547ccdfb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.338817 May 10 02:52:23.815407 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3056/6152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:23 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:24.239380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:24.239895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:24.254950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:24.255676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:24.256873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:24.257646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:24.761044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:24.785795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-071cc1aa-40ab-406d-9752-3c4e43d56b1f tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1671 microversion: 2.1 time: 0.550942 May 10 02:52:24.787265 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3097/6153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:24 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1671 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:24.815896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:24.816518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:24.831660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:24.833961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:24.835409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:24.853133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:25.244723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:25.253778 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d211ce0d-0bef-4efc-9ead-009e2b31872c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1229 microversion: 2.1 time: 0.441860 May 10 02:52:25.254376 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3057/6154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:24 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1229 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:25.691504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-896fb94f-1db0-4565-bd41-70a76aa49019 req-a16d7165-ad60-4a79-a142-d5db54de5fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed336a10-9f3f-4825-818d-28fd9652249e", "name": "network-vif-deleted", "tag": "92e25cdd-6673-4b4f-9f03-0733254b7470"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:25.753346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-896fb94f-1db0-4565-bd41-70a76aa49019 req-a16d7165-ad60-4a79-a142-d5db54de5fd7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:25.754135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-896fb94f-1db0-4565-bd41-70a76aa49019 req-a16d7165-ad60-4a79-a142-d5db54de5fd7 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:25.785306 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-896fb94f-1db0-4565-bd41-70a76aa49019 req-a16d7165-ad60-4a79-a142-d5db54de5fd7 service nova] Creating event network-vif-deleted:92e25cdd-6673-4b4f-9f03-0733254b7470 for instance ed336a10-9f3f-4825-818d-28fd9652249e on n-h1-841089-2 May 10 02:52:25.795375 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-896fb94f-1db0-4565-bd41-70a76aa49019 req-a16d7165-ad60-4a79-a142-d5db54de5fd7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108753 May 10 02:52:25.798923 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3098/6155] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:52:25.804327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:25.804980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:25.813747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:25.814770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:25.815920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:25.816989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:25.866306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:25.866517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:25.866956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lazy-loading 'fault' on Instance uuid ed336a10-9f3f-4825-818d-28fd9652249e {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:52:25.943199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:25.951857 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e92e0dd-f143-4830-ac4e-75d235ed1119 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 200 len: 1489 microversion: 2.1 time: 0.151568 May 10 02:52:25.961634 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3058/6156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:25 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 1489 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:26.279961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:26.281534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:26.291334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:26.293111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:26.303546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:26.309076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:26.488558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:26.496893 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f16f9dc5-a99b-4495-acdf-080eb5154b42 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.229293 May 10 02:52:26.507489 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3099/6157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:26 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:26.969506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:26.970206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ed336a10-9f3f-4825-818d-28fd9652249e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:26.978132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:26.978913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:26.980339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:26.981048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:26.999132 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] HTTP exception thrown: Instance ed336a10-9f3f-4825-818d-28fd9652249e could not be found. May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Request method failure captured: May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e HTTP/1.1 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedLtUtM8oSZbvvN7Hr57cpyZGSqhfmP_6xyydP_MG7hHYA4oJYWO18M3--zWMVruaVA01xnGBC3rkZJkMt_MHSrjMlx48Yh2-9LGMqjrMV13800BKgzyGNt7Ay0IgsWLGAmWi3DBB18Pw8hv_fmw-0-MtAClKywH4x_WFTF8qWb-cV4 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 28d7b9e6477f48d3a9fb6ae490046647 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkBasicOps-827621217 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28d7b9e6477f48d3a9fb6ae490046647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkBasicOps-827621217 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 28d7b9e6477f48d3a9fb6ae490046647 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkBasicOps-827621217 May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkBasicOps-827621217-project May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 04db90acbad8446bbdb8b1d4834048ec May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkBasicOps-827621217-project May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance ed336a10-9f3f-4825-818d-28fd9652249e could not be found. May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ed336a10-9f3f-4825-818d-28fd9652249e'} May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed336a10-9f3f-4825-818d-28fd9652249e could not be found. May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed336a10-9f3f-4825-818d-28fd9652249e could not be found. May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:52:27.001297 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed336a10-9f3f-4825-818d-28fd9652249e could not be found. May 10 02:52:27.005600 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:52:27.007857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Returning 404 to user: Instance ed336a10-9f3f-4825-818d-28fd9652249e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:52:27.009741 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8d17991-9c06-434f-9cee-7747e92ecb38 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e" status: 404 len: 111 microversion: 2.1 time: 0.043766 May 10 02:52:27.009741 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3059/6158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:26 2022] GET /compute/v2.1/servers/ed336a10-9f3f-4825-818d-28fd9652249e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:52:27.300153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2568f5e-2f09-4849-abb3-e6faa8dff36d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '.version_select at 0x7f3d3729f5e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:27.343053 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2568f5e-2f09-4849-abb3-e6faa8dff36d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1569021065" status: 202 len: 0 microversion: 2.1 time: 0.046664 May 10 02:52:27.343661 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3100/6159] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 02:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1569021065 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:52:27.517944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:27.520893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:27.528081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:27.533025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:27.534415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:27.536147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:27.854114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:27.863319 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-95a46676-1ff3-4ca3-89a2-c2c9cf8e0203 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.349458 May 10 02:52:27.863937 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3060/6160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:27 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:28.881936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:28.883305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:28.891655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:28.892467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:28.893452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:28.894082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:29.461240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:29.474564 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8cb58952-bf37-4bc4-836f-3517b50d18ca tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.596743 May 10 02:52:29.476569 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3101/6161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:28 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:30.492887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:30.494204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:30.515380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:30.515855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:30.518846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:30.519391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:30.782452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:30.790831 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d9350a7d-6854-4e83-a089-be0249251ec1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.301954 May 10 02:52:30.794696 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3061/6162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:30 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:31.823483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:31.824993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:31.831986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:31.832453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:31.833266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:31.833716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:32.147680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:32.156429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-10dfe36c-fe39-4ac1-86c5-5462dad47e18 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.340976 May 10 02:52:32.159593 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3102/6163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:31 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:33.177761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:33.178343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:33.185524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:33.185977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:33.186945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:33.187605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:33.403708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:33.418118 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-11d42efe-af63-439d-b401-d0cf45ffd804 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.244176 May 10 02:52:33.419295 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3062/6164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:33 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:34.436319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:34.437098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:34.449622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:34.451278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:34.452331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:34.452995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:34.692609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0fa758ee-3e41-49de-a1e0-1d1dec9e1b1c req-f3137e4f-13b4-44fc-94f8-5a80f9c5f62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d663ab29-b4bb-466e-81ca-06e17922f37d", "name": "network-vif-plugged", "status": "completed", "tag": "25a3ee34-afb4-46f1-b9a3-b797a3ff8446"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:34.716509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0fa758ee-3e41-49de-a1e0-1d1dec9e1b1c req-f3137e4f-13b4-44fc-94f8-5a80f9c5f62f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:34.716935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0fa758ee-3e41-49de-a1e0-1d1dec9e1b1c req-f3137e4f-13b4-44fc-94f8-5a80f9c5f62f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:34.728815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:34.737944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0fa758ee-3e41-49de-a1e0-1d1dec9e1b1c req-f3137e4f-13b4-44fc-94f8-5a80f9c5f62f service nova] Creating event network-vif-plugged:25a3ee34-afb4-46f1-b9a3-b797a3ff8446 for instance d663ab29-b4bb-466e-81ca-06e17922f37d on n-h1-841089-2 May 10 02:52:34.741410 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2664b217-735f-4978-b24e-1f0e967b85ed tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.310476 May 10 02:52:34.742032 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3103/6165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:34 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:34.747860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0fa758ee-3e41-49de-a1e0-1d1dec9e1b1c req-f3137e4f-13b4-44fc-94f8-5a80f9c5f62f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262793 May 10 02:52:34.749402 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3063/6166] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:52:35.759289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:35.759939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:35.767491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:35.779928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:35.780991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:35.781532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:36.082821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:36.092414 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78910ff8-84d5-4659-a41c-80f55a71600c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1217 microversion: 2.1 time: 0.337078 May 10 02:52:36.093028 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3104/6167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:35 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1217 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:37.110453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:37.111330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:37.126597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:37.127249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:37.128115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:37.128560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:37.388521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:37.418417 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb87ae1c-b601-497b-bb87-91577c05deab tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1403 microversion: 2.1 time: 0.313074 May 10 02:52:37.419131 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3064/6168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:37 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1403 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:37.434913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:37.436314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:37.455384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:37.455890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:37.456705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:37.457158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:37.812440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:37.825613 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad6b0378-bc25-48a8-9bd0-8d6a2f1cd4e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1403 microversion: 2.1 time: 0.394648 May 10 02:52:37.840652 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3105/6169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:37 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1403 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:37.844339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-349314424"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:37.846210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:37.856262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:37.856729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:37.860018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:37.860659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:38.064961 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Attempting to quiesce instance before volume snapshot. May 10 02:52:38.146913 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 10 02:52:38.282298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Creating snapshot from volume 7e4ccef1-23ab-401d-905b-15d478713458. {{(pid=118717) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 10 02:52:40.311683 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ade9ebc1-81f8-46d2-8eb6-e99d8f9e2c41 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d/action" status: 202 len: 0 microversion: 2.1 time: 2.471361 May 10 02:52:40.315347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3065/6170] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:52:37 2022] POST /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d/action => generated 0 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 10 02:52:40.388913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-869331f8-5936-485b-9034-b9209fe66419 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'create', calling method: .version_select at 0x7f3d372375e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-11254807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLko5PGvDSRDv2M2j1lFjmaBeiFPQAORmUKPO73MGYmqqvhL+lO4PZizwM6anj9kWUArO0VsUIkQ0Jh/O5wpxd+AmPr1pRVeTCMtoDVpxMmHgTNfZpXNyi9KuHyAozlduQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:40.420549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-869331f8-5936-485b-9034-b9209fe66419 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:52:40.432680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-869331f8-5936-485b-9034-b9209fe66419 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for user 04db90acbad8446bbdb8b1d4834048ec and project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:52:40.489260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-869331f8-5936-485b-9034-b9209fe66419 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.105125 May 10 02:52:40.495572 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3106/6171] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:52:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:52:42.914202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1892550040", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "205121d8-8743-47f2-ae0c-adf2896027f4"}], "key_name": "tempest-TestNetworkBasicOps-11254807", "security_groups": [{"name": "tempest-secgroup-smoke-43791376"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:43.141157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] validate_networks() for [('205121d8-8743-47f2-ae0c-adf2896027f4', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:52:43.736523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:52:43.736969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:52:43.737460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:52:43.738663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:52:43.739134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:52:43.758855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:43.759371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:43.760224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:43.770892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:43.811493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:52:43.823631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Getting quotas for user 04db90acbad8446bbdb8b1d4834048ec and project 28d7b9e6477f48d3a9fb6ae490046647. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:52:43.840115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:52:43.844702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:52:43.868665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1144458947", "imageRef": "7286039a-ba27-40e8-ae6e-e10ac7564c6d", "flavorRef": "452", "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:43.911447 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fdf195e2-296b-4651-8314-2cdcc79af9fe tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.004689 May 10 02:52:43.912580 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3066/6172] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:52:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:52:43.925134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc0b7ab5-446e-43a8-b947-ac749ce684fd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:43.926460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc0b7ab5-446e-43a8-b947-ac749ce684fd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:43.962859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:52:44.019426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc0b7ab5-446e-43a8-b947-ac749ce684fd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:44.028062 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc0b7ab5-446e-43a8-b947-ac749ce684fd tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1247 microversion: 2.1 time: 0.106898 May 10 02:52:44.047451 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3067/6173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:43 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1247 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:44.602942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:52:44.603219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:52:44.603605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:52:44.604124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:52:44.604658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:52:44.620568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:44.621716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:44.623446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:44.624355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:44.652723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:52:44.660012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:52:44.674808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:52:44.679427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='785720be-3a81-4352-ae2c-7804a8e14e14',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:52:44.804030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b74ff888-278d-40f7-bfdc-b328b2d93557 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939384 May 10 02:52:44.805177 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3107/6174] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 02:52:44.815769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed0019f7-a613-4129-8290-da1e0f68f36c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:44.816642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ed0019f7-a613-4129-8290-da1e0f68f36c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:44.909880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed0019f7-a613-4129-8290-da1e0f68f36c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:44.926376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed0019f7-a613-4129-8290-da1e0f68f36c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1230 microversion: 2.1 time: 0.112736 May 10 02:52:44.936964 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3068/6175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:44 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:45.045702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:45.046338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:45.053567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:45.054182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:45.054990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:45.055472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:45.128836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:45.136571 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1598837-343c-479a-ae0b-a5579868829e tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1299 microversion: 2.1 time: 0.095448 May 10 02:52:45.137343 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3108/6176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:45 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:45.944373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:45.945276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:45.955431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:45.956270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:45.958035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:45.959648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:46.104613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:46.114223 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ca7401de-c689-4146-a029-a0b4dbd0b063 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1282 microversion: 2.1 time: 0.173798 May 10 02:52:46.117074 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3069/6177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:45 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:46.154966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:46.155611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:46.174351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:46.175032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:46.175925 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:46.176379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:46.357808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:46.368359 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a757afb1-24ae-4aba-b3b3-971d6c85e58b tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1305 microversion: 2.1 time: 0.218268 May 10 02:52:46.370165 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3109/6178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:46 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1305 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:47.139892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:47.140602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:47.158016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:47.158673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:47.160465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:47.161302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:47.389668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:47.390973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:47.400058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:47.401451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:47.402434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:47.403154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:47.716805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:47.725352 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5b3eaed6-1cea-4d7f-9d75-2f13d5c0eae9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1300 microversion: 2.1 time: 0.591146 May 10 02:52:47.735099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3070/6179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:47 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1300 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:48.073176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:48.094647 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1474422-d268-452c-94d2-078677c54b99 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.709582 May 10 02:52:48.095420 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3110/6180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:47 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:48.742353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:48.744313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:48.786093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:48.788040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:48.788962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:48.789883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:49.112470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:49.113932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:49.125871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:49.126702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:49.134520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:49.135836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:49.315473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:49.328800 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa70fffd-ed95-43c8-8c4a-12a4db84a3a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.586466 May 10 02:52:49.329660 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3071/6181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:48 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:49.472671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:49.485580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51770af3-0331-4221-b1c2-f8f9737773a2 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.377024 May 10 02:52:49.491015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3111/6182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:49 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:52:49.664885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f13964ca-3f66-44f5-8c59-6693249ab7a5 req-78a2d8d0-cff3-4b19-a5a2-169a5cc31476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae", "tag": "0d7fa467-31e9-4379-ace3-d36127a89429"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:49.685631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f13964ca-3f66-44f5-8c59-6693249ab7a5 req-78a2d8d0-cff3-4b19-a5a2-169a5cc31476 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:49.686102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f13964ca-3f66-44f5-8c59-6693249ab7a5 req-78a2d8d0-cff3-4b19-a5a2-169a5cc31476 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:49.767310 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f13964ca-3f66-44f5-8c59-6693249ab7a5 req-78a2d8d0-cff3-4b19-a5a2-169a5cc31476 service nova] Creating event network-changed:0d7fa467-31e9-4379-ace3-d36127a89429 for instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae on n-h2-841089-2 May 10 02:52:49.774441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f13964ca-3f66-44f5-8c59-6693249ab7a5 req-78a2d8d0-cff3-4b19-a5a2-169a5cc31476 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113436 May 10 02:52:49.779036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3072/6183] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:52:50.353921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:50.354631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:50.373144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:50.377694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:50.381199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:50.381679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:50.512946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:50.513747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:50.523595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:50.524064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:50.524862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:50.525886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:50.980467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:50.990952 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-444a4102-c8c4-4c8c-87cc-e40a3a8b2ea9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.647676 May 10 02:52:50.991575 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3112/6184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:50 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:51.042318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:51.049991 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f31f4f46-11fd-4ea7-8f23-91b714b83f3a tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.546157 May 10 02:52:51.051101 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3073/6185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:50 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:52:51.847612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6eaa6883-9aea-4b8d-97cc-aad8826bc79a req-9a03ed4d-75b6-49ec-8ca9-7a9d8904df2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e44792-3eff-45a2-ae63-d6a5e8de1e22", "tag": "5ce85edc-fde3-4987-8296-62a0f6fb0c3b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:51.858660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6eaa6883-9aea-4b8d-97cc-aad8826bc79a req-9a03ed4d-75b6-49ec-8ca9-7a9d8904df2d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:51.860137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6eaa6883-9aea-4b8d-97cc-aad8826bc79a req-9a03ed4d-75b6-49ec-8ca9-7a9d8904df2d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:51.872340 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6eaa6883-9aea-4b8d-97cc-aad8826bc79a req-9a03ed4d-75b6-49ec-8ca9-7a9d8904df2d service nova] Creating event network-changed:5ce85edc-fde3-4987-8296-62a0f6fb0c3b for instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 on n-h2-841089-2 May 10 02:52:51.877834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6eaa6883-9aea-4b8d-97cc-aad8826bc79a req-9a03ed4d-75b6-49ec-8ca9-7a9d8904df2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 May 10 02:52:51.883231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3113/6186] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:52:52.008681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:52.010043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:52.025053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:52.028478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:52.034313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:52.034885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:52.068105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:52.068823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:52.089820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:52.090279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:52.091249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:52.091527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:52.573722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:52.585633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8329dbb4-1bb1-450b-b751-9023af687d16 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.578215 May 10 02:52:52.596439 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3074/6187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:52 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:52.700741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:52.709279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c3b534c-09f8-4064-90be-41552bc8a4bc tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.645356 May 10 02:52:52.712329 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3114/6188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:52 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:52:53.603306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:53.604269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:53.620837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:53.622443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:53.625597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:53.626137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:53.729465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:53.730380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:53.742712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:53.747533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:53.749460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:53.750355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:54.348636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:54.360150 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5c53adb-3844-418a-8c5e-291abddfd966 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.761162 May 10 02:52:54.372523 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3075/6189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:53 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:54.511374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:54.521528 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a9d5c574-b3e9-45b3-a279-ebadde0e6dd5 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.796686 May 10 02:52:54.526096 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3115/6190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:53 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:52:55.379811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:55.381521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:55.412116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:55.412817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:55.413493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:55.414002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:55.540131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:55.540921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:55.568225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:55.568694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:55.577356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:55.577966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:55.910300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:55.938158 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afb9e570-41fa-4cb0-91e3-a639e2aebbb0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.555247 May 10 02:52:55.948797 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3076/6191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:55 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:56.010069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:56.022076 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f552d7f-86e3-447a-8de9-99f48935fa45 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.485610 May 10 02:52:56.023329 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3116/6192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:55 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:56.968673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:56.973221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:57.001786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:57.004901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:57.010314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:57.012476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:57.055829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:57.059038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:57.075515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:57.076723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:57.078367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:57.079548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:57.332535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:57.343732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5d7ed0a-c45d-441c-9bd0-ed97eb3f2cf6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.390716 May 10 02:52:57.347585 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3077/6193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:56 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:57.370619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:57.381722 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4ad1c102-6a68-4711-9c96-5a4dd8acc889 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.330708 May 10 02:52:57.382557 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3117/6194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:57 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:57.534485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-cd4019e3-aeb2-4bf1-975f-eb84c162fa58 req-388e30ed-d106-407a-8f3c-3b55d92a24c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae", "name": "network-vif-plugged", "status": "completed", "tag": "0d7fa467-31e9-4379-ace3-d36127a89429"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:52:57.559740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cd4019e3-aeb2-4bf1-975f-eb84c162fa58 req-388e30ed-d106-407a-8f3c-3b55d92a24c0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:57.563627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cd4019e3-aeb2-4bf1-975f-eb84c162fa58 req-388e30ed-d106-407a-8f3c-3b55d92a24c0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:57.581232 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-cd4019e3-aeb2-4bf1-975f-eb84c162fa58 req-388e30ed-d106-407a-8f3c-3b55d92a24c0 service nova] Creating event network-vif-plugged:0d7fa467-31e9-4379-ace3-d36127a89429 for instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae on n-h2-841089-2 May 10 02:52:57.597622 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-cd4019e3-aeb2-4bf1-975f-eb84c162fa58 req-388e30ed-d106-407a-8f3c-3b55d92a24c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071753 May 10 02:52:57.607049 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3078/6195] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:52:58.377508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:58.378312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:58.389872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:58.390558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:58.391633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:58.392085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:58.401928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:58.403640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:58.424930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:58.426189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:58.429881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:58.432674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:58.720435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:58.734864 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3fc605b1-b848-4478-8278-9405749942ad tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.362019 May 10 02:52:58.736098 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3118/6196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:58 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:58.781879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:52:58.792147 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-560832a6-82c1-4fb1-97c3-79ea01397960 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1371 microversion: 2.1 time: 0.395451 May 10 02:52:58.793461 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3079/6197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:58 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:52:59.754096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:59.755853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:59.767496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:59.768391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:59.769494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:59.770164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:59.818199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:52:59.823814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:52:59.841337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:59.842240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:52:59.843469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:52:59.844287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:00.054924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:00.065413 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0741ccb3-4a29-4c19-8e23-1bdfeb26759f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.316144 May 10 02:53:00.075079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:00.075886 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3119/6198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:59 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:00.091706 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f3483bb2-1ee0-4295-8215-cbcd80b351e9 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1543 microversion: 2.1 time: 0.278250 May 10 02:53:00.092306 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3080/6199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:52:59 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1543 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:00.109111 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:00.110048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:00.116421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:00.117080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:00.118010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:00.119354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:00.282900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:00.293954 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3eef0329-c00e-430a-9067-4d5cddef8e39 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1543 microversion: 2.1 time: 0.188634 May 10 02:53:00.311420 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3120/6200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:00 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1543 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:01.082230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:01.082989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:01.097339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:01.097822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:01.098710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:01.099196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:01.383610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:01.392394 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8508d165-b718-41a5-bb2f-e76c856a3922 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.314343 May 10 02:53:01.393302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3081/6201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:01 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:02.416986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:02.417605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:02.435545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:02.438919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:02.440126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:02.440792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:02.769256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:02.780934 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b07703dd-e8ba-432c-85c9-84091585bb23 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.368862 May 10 02:53:02.782482 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3121/6202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:02 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:03.174573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2c8e5b57-b988-47be-bef0-7759871f7a02 req-dc64f301-4159-4a2a-9087-657c7742d7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae", "tag": "0d7fa467-31e9-4379-ace3-d36127a89429"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:03.205753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2c8e5b57-b988-47be-bef0-7759871f7a02 req-dc64f301-4159-4a2a-9087-657c7742d7df service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:03.206195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2c8e5b57-b988-47be-bef0-7759871f7a02 req-dc64f301-4159-4a2a-9087-657c7742d7df service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:03.219246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2c8e5b57-b988-47be-bef0-7759871f7a02 req-dc64f301-4159-4a2a-9087-657c7742d7df service nova] Creating event network-changed:0d7fa467-31e9-4379-ace3-d36127a89429 for instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae on n-h2-841089-2 May 10 02:53:03.239043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2c8e5b57-b988-47be-bef0-7759871f7a02 req-dc64f301-4159-4a2a-9087-657c7742d7df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068008 May 10 02:53:03.240001 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3082/6203] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:53:03.798110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:03.798854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:03.809786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:03.815561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:03.816609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:03.818851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:04.381483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:04.399313 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f570e3b1-e601-4760-8e24-feb881bd2d22 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.599030 May 10 02:53:04.400764 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3122/6204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:03 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:05.419014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:05.420413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:05.437259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:05.438065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:05.439430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:05.440056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:05.735402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:05.743939 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a9aafbae-b658-46c7-84db-5a28542cab0d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.329550 May 10 02:53:05.758556 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3083/6205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:05 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:06.770232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:06.773229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:06.784197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:06.784857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:06.786435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:06.787388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:06.974672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:06.983362 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-677c038b-1350-40c2-8bc0-d72f6a0f016a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.217785 May 10 02:53:06.993443 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3123/6206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:06 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:08.000881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:08.001637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:08.008201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:08.008676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:08.010034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:08.010493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:08.146317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:08.154548 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9d3cca6-f841-4f67-abd5-c87c6f383796 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.157482 May 10 02:53:08.155155 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3084/6207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:07 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:09.171937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:09.173408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:09.181037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:09.181541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:09.182482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:09.184598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:09.371756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:09.379424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cf6066b2-a206-4cde-b93f-fdd8b85af513 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.211756 May 10 02:53:09.380332 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3124/6208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:09 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:10.397146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:10.397774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:10.405168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:10.405640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:10.406452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:10.406881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:10.557780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:10.565934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9bfd71f-7cb4-484d-9173-3a4caeda73a3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.172781 May 10 02:53:10.566519 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3085/6209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:10 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:11.583521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:11.584830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:11.592065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:11.593066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:11.593849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:11.594512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:11.746911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:11.760865 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5089afd7-eff1-4b73-85e6-904ec3248454 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.181296 May 10 02:53:11.761813 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3125/6210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:11 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:12.779786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:12.780427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:12.788313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:12.788795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:12.789602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:12.790063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:12.941831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:12.951947 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-578f41f2-cb8f-4562-9161-6eae1c5ab380 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.177285 May 10 02:53:12.952757 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3086/6211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:12 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:13.971924 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:13.972814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:13.980729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:13.981421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:13.982230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:13.982781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:14.149203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:14.159874 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9efc77a0-ae9f-4cf7-bfed-1a7c67d2ffee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.192429 May 10 02:53:14.169884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3126/6212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:13 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:15.177733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:15.178986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:15.188096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:15.188530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:15.189618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:15.190138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:15.384756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:15.395663 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-701839cc-0fb5-4744-8fa7-872012800bd7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.222121 May 10 02:53:15.400041 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3087/6213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:15 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:16.415620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:16.416709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:16.423639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:16.424089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:16.424887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:16.425328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:16.601099 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:16.613331 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a79b151b-d5c9-49d9-bcfa-346931566b3d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1342 microversion: 2.1 time: 0.203289 May 10 02:53:16.629361 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3127/6214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:16 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:17.638597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:17.640055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:17.652303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:17.653309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:17.654513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:17.654981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:17.925048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:17.936272 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-110258a4-47c1-492e-bf44-5676f2fa856f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1388 microversion: 2.1 time: 0.302360 May 10 02:53:17.936876 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3088/6215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:17 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1388 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:18.953267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:18.953891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:18.961523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:18.962873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:18.963858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:18.964468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:19.125588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:19.135596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6e009d78-4c5d-4e15-85e8-64bfe254bdc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.185285 May 10 02:53:19.137038 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3128/6216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:18 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:20.154888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:20.155520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:20.162399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:20.162947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:20.163839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:20.164374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:20.307234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:20.315127 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fc20dc7b-3b69-4475-9c3f-d4300a1e2649 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.165610 May 10 02:53:20.315725 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3089/6217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:20 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:21.332076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:21.332700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:21.340430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:21.340742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:21.341797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:21.342485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:21.475700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:21.483373 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7341751-584f-4030-8d5d-ba024213be54 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.155113 May 10 02:53:21.484236 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3129/6218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:21 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:22.501088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:22.501894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:22.510348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:22.510820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:22.511773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:22.512271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:22.660010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:22.667869 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9856a91a-d172-4006-8c10-2424e68315bd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.171158 May 10 02:53:22.668466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3090/6219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:22 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:23.686150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:23.686787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:23.693876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:23.694397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:23.695337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:23.695861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:23.841858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:23.851626 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-15be2e4c-abd7-44b9-b3c1-50cec8bd2ccf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.169761 May 10 02:53:23.853027 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3130/6220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:23 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:24.871225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:24.871951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:24.881632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:24.882105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:24.883050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:24.883737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:25.071616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:25.081682 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8aea55f-d678-42ca-9f10-73a13d4ba96b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.215376 May 10 02:53:25.082571 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3091/6221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:24 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:25.826859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:25.828632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:25.847286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:25.848850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:25.849977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:25.850652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:25.910583 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-83a95ab9-81b5-4c25-8686-4acaac6e8ace tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae/action" status: 200 len: 24568 microversion: 2.1 time: 0.089052 May 10 02:53:25.911925 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3131/6222] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:53:25 2022] POST /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae/action => generated 24568 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:53:26.100759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:26.101589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:26.118284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:26.119576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:26.120766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:26.121399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:26.288017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:26.298760 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8babdba0-2f32-4820-80c4-0088b356bf39 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.201925 May 10 02:53:26.299830 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3092/6223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:26 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:27.318146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:27.319469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:27.344021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:27.344734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:27.345797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:27.346403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:27.513675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:27.522851 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bbc1ff5-87ef-44d2-b62d-a15efcecd70a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.209019 May 10 02:53:27.532258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3132/6224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:27 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:28.540896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:28.541737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:28.548952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:28.549484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:28.550431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:28.550894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:28.694161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:28.702590 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d26ed6f4-e907-47cc-a34d-4562e1b77dd1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.166541 May 10 02:53:28.704807 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3093/6225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:28 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:29.397773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7c902a31-e986-48e9-8ef6-f46adb49c760 req-88eb241d-b2f8-483b-b07e-3b1d470c5f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e44792-3eff-45a2-ae63-d6a5e8de1e22", "name": "network-vif-plugged", "status": "completed", "tag": "5ce85edc-fde3-4987-8296-62a0f6fb0c3b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:29.410601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7c902a31-e986-48e9-8ef6-f46adb49c760 req-88eb241d-b2f8-483b-b07e-3b1d470c5f32 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:29.410896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7c902a31-e986-48e9-8ef6-f46adb49c760 req-88eb241d-b2f8-483b-b07e-3b1d470c5f32 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:29.424481 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7c902a31-e986-48e9-8ef6-f46adb49c760 req-88eb241d-b2f8-483b-b07e-3b1d470c5f32 service nova] Creating event network-vif-plugged:5ce85edc-fde3-4987-8296-62a0f6fb0c3b for instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 on n-h2-841089-2 May 10 02:53:29.430494 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7c902a31-e986-48e9-8ef6-f46adb49c760 req-88eb241d-b2f8-483b-b07e-3b1d470c5f32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039906 May 10 02:53:29.431816 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3133/6226] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:53:29.719138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:29.720178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:29.727394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:29.727978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:29.728878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:29.729444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:29.866347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:29.875275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00f3acfd-3da2-4152-9b25-69ce7a671224 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1376 microversion: 2.1 time: 0.160012 May 10 02:53:29.876203 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3094/6227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:29 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:30.896631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:30.897701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:30.908201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:30.908938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:30.910028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:30.910684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:31.084250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:31.093342 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6964c103-3966-4d80-83c7-871a2b3e351a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1562 microversion: 2.1 time: 0.203651 May 10 02:53:31.094507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3134/6228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:30 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1562 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:31.110208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:31.111897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:31.121288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:31.122090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:31.123173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:31.124502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:31.295429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:31.304074 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bceeffe1-a170-44b4-ba24-4ea3de8beebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1562 microversion: 2.1 time: 0.197714 May 10 02:53:31.305010 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3095/6229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:31 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1562 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:31.386798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:31.387511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:31.393756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:31.394385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:31.395607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:31.396328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:31.429636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:53:31.538119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f6c3055e-e65c-48cc-91fc-751257e38147 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 204 len: 0 microversion: 2.1 time: 0.155366 May 10 02:53:31.543164 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3135/6230] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:53:31 2022] DELETE /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:53:31.548267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:31.548901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:31.562279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:31.562753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:31.563597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:31.564206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:32.192038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:32.206441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f75640c-a19e-45c7-9665-a34e3fb8f858 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1568 microversion: 2.1 time: 0.661903 May 10 02:53:32.208276 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3096/6231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:31 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1568 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:33.229313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:33.229313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:33.237304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:33.237755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:33.238782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:33.239285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:33.535749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:33.543979 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2985286-0f69-46ca-a9c4-9935095cc7d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1568 microversion: 2.1 time: 0.320865 May 10 02:53:33.544800 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3136/6232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:33 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:33.830712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-829526ca-15b8-494f-a282-00807c59a018 req-bb9fd707-fa9e-47f2-96d2-a006ba3f0840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e44792-3eff-45a2-ae63-d6a5e8de1e22", "name": "network-vif-deleted", "tag": "5ce85edc-fde3-4987-8296-62a0f6fb0c3b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:33.846544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-829526ca-15b8-494f-a282-00807c59a018 req-bb9fd707-fa9e-47f2-96d2-a006ba3f0840 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:33.847386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-829526ca-15b8-494f-a282-00807c59a018 req-bb9fd707-fa9e-47f2-96d2-a006ba3f0840 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:33.859861 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-829526ca-15b8-494f-a282-00807c59a018 req-bb9fd707-fa9e-47f2-96d2-a006ba3f0840 service nova] Creating event network-vif-deleted:5ce85edc-fde3-4987-8296-62a0f6fb0c3b for instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 on n-h2-841089-2 May 10 02:53:33.865277 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-829526ca-15b8-494f-a282-00807c59a018 req-bb9fd707-fa9e-47f2-96d2-a006ba3f0840 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038636 May 10 02:53:33.866496 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3097/6233] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:53:34.561649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:34.562207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:34.569292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:34.569762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:34.570553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:34.571014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:34.636979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:34.646993 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa0b6026-ff28-4dfd-842b-c55c108734e9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.089297 May 10 02:53:34.647547 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3137/6234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:34 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:35.671060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:35.672031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:35.682549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:35.683150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:35.685130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:35.685805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:35.774947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:35.783674 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29d2b4ca-3e8d-4075-81eb-3a2a6df0fa1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.122372 May 10 02:53:35.784270 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3098/6235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:35 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:36.801699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:36.802449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:36.813752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:36.814470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:36.816092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:36.816736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:36.924557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:36.937336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cdf0e711-c609-401a-a11b-ddddf65d4034 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.140842 May 10 02:53:36.938196 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3138/6236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:36 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:37.100123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:37.101073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:37.113934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:37.114652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:37.120491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:37.121255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:37.223558 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9609eb7a-80ed-4bdc-a2e2-0ef679cc767d tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "POST /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae/action" status: 200 len: 32644 microversion: 2.1 time: 0.119035 May 10 02:53:37.224629 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3099/6237] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:53:37 2022] POST /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae/action => generated 32644 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 02:53:37.957382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:37.959523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:37.986219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:37.989466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:37.991464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:37.994616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:38.110097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:38.118648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8dfda068-40f7-4fcd-ac6f-044ad4279dc8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.166133 May 10 02:53:38.119937 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3139/6238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:37 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:39.021998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:39.022599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:39.024573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-291914e7-4474-403e-b220-f5788d5b0dc9 req-491bd851-cf4c-4484-8091-76598b2135c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae", "tag": "0d7fa467-31e9-4379-ace3-d36127a89429"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:39.036473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-291914e7-4474-403e-b220-f5788d5b0dc9 req-491bd851-cf4c-4484-8091-76598b2135c5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.037156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-291914e7-4474-403e-b220-f5788d5b0dc9 req-491bd851-cf4c-4484-8091-76598b2135c5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.042363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.042838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.043673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.044129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.050715 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-291914e7-4474-403e-b220-f5788d5b0dc9 req-491bd851-cf4c-4484-8091-76598b2135c5 service nova] Creating event network-changed:0d7fa467-31e9-4379-ace3-d36127a89429 for instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae on n-h2-841089-2 May 10 02:53:39.057429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-291914e7-4474-403e-b220-f5788d5b0dc9 req-491bd851-cf4c-4484-8091-76598b2135c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036882 May 10 02:53:39.058772 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3140/6239] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:53:39.083908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:53:39.137084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:39.140394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:39.151228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.157410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.158530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.159347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.246476 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-278b0959-4a0b-4c19-99f1-9285fd6099d0 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 204 len: 0 microversion: 2.1 time: 0.228726 May 10 02:53:39.248503 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3100/6240] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:53:39 2022] DELETE /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:53:39.263403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:39.265382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:39.282914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.286266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.287200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:39.287667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:39.364800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:39.373959 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c0e2e4b-7521-4211-896e-a9822c57502d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.241827 May 10 02:53:39.377667 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3141/6241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:39 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:39.484566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:39.493493 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db3dc6e2-03dc-4ffa-8909-e598442d1be3 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1667 microversion: 2.1 time: 0.239860 May 10 02:53:39.495000 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3101/6242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:39 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1667 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:40.393787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:40.394417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:40.401779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:40.402481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:40.403448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:40.404402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:40.518508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:40.519754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:40.528975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:40.531689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:40.532755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:40.534474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:40.542726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:40.551701 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-77c2d566-5641-449b-9905-3c9743d63de2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.161852 May 10 02:53:40.554524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3142/6243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:40 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:40.759821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:40.767568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1de1b746-5a88-4589-8a13-d4bf2e2622e1 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1667 microversion: 2.1 time: 0.259616 May 10 02:53:40.768825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3102/6244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:40 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1667 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:53:41.580858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:41.582185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:41.621489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:41.622000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:41.622828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:41.629052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:41.729500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:41.745273 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a856056-684a-4d52-9644-bc1a77d91ee7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.177193 May 10 02:53:41.745889 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3143/6245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:41 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:41.795199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:41.796081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:41.808915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:41.809643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:41.810785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:41.812789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:41.942232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04db90acbad8446bbdb8b1d4834048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d7b9e6477f48d3a9fb6ae490046647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:41.953407 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2850723-409a-430f-83f2-079b22d92624 tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 200 len: 1483 microversion: 2.1 time: 0.165774 May 10 02:53:41.954775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3103/6246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:41 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 1483 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:41.971619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f3da7e8b-7351-4e5b-b3b6-f6d0ddd795bd req-152eb379-34a2-4662-827f-7a885d2fe4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae", "name": "network-vif-deleted", "tag": "0d7fa467-31e9-4379-ace3-d36127a89429"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:41.981775 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f3da7e8b-7351-4e5b-b3b6-f6d0ddd795bd req-152eb379-34a2-4662-827f-7a885d2fe4c8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:41.984002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f3da7e8b-7351-4e5b-b3b6-f6d0ddd795bd req-152eb379-34a2-4662-827f-7a885d2fe4c8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:41.998363 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f3da7e8b-7351-4e5b-b3b6-f6d0ddd795bd req-152eb379-34a2-4662-827f-7a885d2fe4c8 service nova] Creating event network-vif-deleted:0d7fa467-31e9-4379-ace3-d36127a89429 for instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae on n-h2-841089-2 May 10 02:53:42.006337 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f3da7e8b-7351-4e5b-b3b6-f6d0ddd795bd req-152eb379-34a2-4662-827f-7a885d2fe4c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038337 May 10 02:53:42.016649 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3144/6247] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:53:42.761951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:42.762589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:42.782581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:42.783087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:42.784063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:42.784335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:42.868959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:42.877651 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec2ec688-2635-4f6c-82fe-b193529acb6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.119688 May 10 02:53:42.878233 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3104/6248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:42 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:42.973546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:42.974853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] [instance: ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:43.000676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:43.001316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:43.002464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:43.003086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:43.030464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] HTTP exception thrown: Instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae could not be found. May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Request method failure captured: May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae HTTP/1.1 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedLtUtM8oSZbvvN7Hr57cpyZGSqhfmP_6xyydP_MG7hHYA4oJYWO18M3--zWMVruaVA01xnGBC3rkZJkMt_MHSrjMlx48Yh2-9LGMqjrMV13800BKgzyGNt7Ay0IgsWLGAmWi3DBB18Pw8hv_fmw-0-MtAClKywH4x_WFTF8qWb-cV4 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 28d7b9e6477f48d3a9fb6ae490046647 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestNetworkBasicOps-827621217 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28d7b9e6477f48d3a9fb6ae490046647", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28d7b9e6477f48d3a9fb6ae490046647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestNetworkBasicOps-827621217 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 28d7b9e6477f48d3a9fb6ae490046647 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestNetworkBasicOps-827621217 May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestNetworkBasicOps-827621217-project May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 04db90acbad8446bbdb8b1d4834048ec May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestNetworkBasicOps-827621217-project May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae could not be found. May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae'} May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae could not be found. May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae could not be found. May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:53:43.034350 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae could not be found. May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Returning 404 to user: Instance ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:53:43.038720 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d3b9b1b-ceb2-4ad8-83ce-17fe56cbfcbb tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae" status: 404 len: 111 microversion: 2.1 time: 0.067903 May 10 02:53:43.051427 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3145/6249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:42 2022] GET /compute/v2.1/servers/ac2989dd-4c60-4a19-a8fa-168ac6d7e1ae => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:53:43.239896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da724599-4f32-4a6b-98ed-91449a79098c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] Calling method '.version_select at 0x7f3d35e17b80>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:43.264151 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da724599-4f32-4a6b-98ed-91449a79098c tempest-TestNetworkBasicOps-827621217 tempest-TestNetworkBasicOps-827621217-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-11254807" status: 202 len: 0 microversion: 2.1 time: 0.028882 May 10 02:53:43.265215 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3105/6250] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 02:53:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-11254807 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:53:43.893979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:43.894842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:43.902615 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:43.903351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:43.904313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:43.904937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:44.385359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:44.406239 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eeba226c-b652-45e4-ad3b-05d248c260e0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.516070 May 10 02:53:44.406755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3146/6251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:43 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:45.425729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:45.426282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:45.451718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:45.452096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:45.453056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:45.453525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:45.581193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:45.589172 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ce19b62-d7e0-4222-906e-75efe17870a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 200 len: 1361 microversion: 2.1 time: 0.168454 May 10 02:53:45.593042 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3106/6252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:45 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:46.611279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:46.612400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:46.648490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:46.657238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:46.659932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:46.663339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:46.700006 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 HTTP/1.1 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f4e44792-3eff-45a2-ae63-d6a5e8de1e22'} May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:53:46.702232 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:53:46.705901 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5b0b4dfb-f6a5-40e9-addb-81fea906a387 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 404 len: 111 microversion: 2.1 time: 0.099229 May 10 02:53:46.742099 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3147/6253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:46 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:53:55.427232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:55.427750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:55.435149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:55.435606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:55.436399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:55.436850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:55.465703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:53:55.560490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3baeef42-ec84-44a0-9d5e-5f936cf93185 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 204 len: 0 microversion: 2.1 time: 0.136704 May 10 02:53:55.564728 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3107/6254] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:53:55 2022] DELETE /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:53:55.573120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:55.573750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:55.580537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:55.581193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:55.582139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:55.582592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:55.740987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:55.749258 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cbe3c82-d1a9-4c4a-8e60-6ca07adbeb1a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1409 microversion: 2.1 time: 0.180191 May 10 02:53:55.749842 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3148/6255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:55 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:56.767535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:56.768461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:56.775422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:56.776069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:56.777066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:56.777667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:56.931785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:56.939604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adf44898-8607-43ed-8a01-f289426946c1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1409 microversion: 2.1 time: 0.176455 May 10 02:53:56.943172 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3108/6256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:56 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:57.526689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-feb62a37-129e-48a9-99c0-8c33c54dbf70 req-34530486-ec32-42c9-8d29-f0ec7004d7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d663ab29-b4bb-466e-81ca-06e17922f37d", "name": "network-vif-deleted", "tag": "25a3ee34-afb4-46f1-b9a3-b797a3ff8446"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:53:57.548708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-feb62a37-129e-48a9-99c0-8c33c54dbf70 req-34530486-ec32-42c9-8d29-f0ec7004d7f5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:57.550943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-feb62a37-129e-48a9-99c0-8c33c54dbf70 req-34530486-ec32-42c9-8d29-f0ec7004d7f5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:57.567249 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-feb62a37-129e-48a9-99c0-8c33c54dbf70 req-34530486-ec32-42c9-8d29-f0ec7004d7f5 service nova] Creating event network-vif-deleted:25a3ee34-afb4-46f1-b9a3-b797a3ff8446 for instance d663ab29-b4bb-466e-81ca-06e17922f37d on n-h1-841089-2 May 10 02:53:57.573505 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-feb62a37-129e-48a9-99c0-8c33c54dbf70 req-34530486-ec32-42c9-8d29-f0ec7004d7f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051163 May 10 02:53:57.574475 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3149/6257] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:53:57.957447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:57.958834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:57.969963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:57.973989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:57.975133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:57.975806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:58.070969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:58.079397 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9eed9c21-bdc3-4661-8051-36fce394e0fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.126173 May 10 02:53:58.090048 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3109/6258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:57 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:53:59.097679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:53:59.098411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:53:59.105552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:59.106022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:59.106929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:53:59.107555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:53:59.182493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:53:59.192132 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-96180d73-217b-422b-b4f1-45f68ed0de6e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.098773 May 10 02:53:59.193027 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3150/6259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:53:59 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:00.209256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:00.209903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:00.226554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:00.227030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:00.227958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:00.228596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:00.306034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:00.314818 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e20ef7d-899a-4eee-b153-54d64705d96f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.109184 May 10 02:54:00.324656 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3110/6260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:00 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:01.332091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:01.333663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:01.346000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:01.349836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:01.352631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:01.354252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:01.448050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:01.457503 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cfd614b-12a3-474e-aabd-e26786d60b81 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.129206 May 10 02:54:01.458490 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3151/6261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:01 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:02.474460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:02.476116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:02.483704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:02.507942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:02.516888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:02.517671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:02.648279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:02.656715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1d1ca14a-bbc9-433b-8ab8-f927b3d65fa0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.185831 May 10 02:54:02.657305 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3111/6262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:02 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:03.673351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:03.673992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:03.683318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:03.684024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:03.684996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:03.685600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:03.755780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:03.766247 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b929dc3b-cdf5-4eaf-b81a-c90c4aebfaa1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.096814 May 10 02:54:03.768661 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3152/6263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:03 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:04.785548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:04.789935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:04.802419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:04.803186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:04.804167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:04.804633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:04.882056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:04.891084 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-370244d9-52fb-4347-bf39-9aaddc263a38 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.109603 May 10 02:54:04.893796 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3112/6264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:04 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:05.910115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:05.910737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:05.933739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:05.934217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:05.935019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:05.935523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:06.016523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:06.024698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9abc0e68-8ae9-405c-a51f-ffd207ed5245 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.118953 May 10 02:54:06.025903 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3153/6265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:05 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:07.042962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:07.044175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:07.051589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:07.052666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:07.053662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:07.054309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:07.121790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:07.129683 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b144119-6b6a-412b-9937-84557f9e385d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1202 microversion: 2.1 time: 0.091697 May 10 02:54:07.140899 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3113/6266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:07 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:08.148206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:08.148749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:08.155766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:08.156566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:08.157870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:08.158541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:08.192927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:08.193754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:08.194480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lazy-loading 'fault' on Instance uuid d663ab29-b4bb-466e-81ca-06e17922f37d {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:54:08.241280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:08.249567 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9cc30fd6-123c-49d1-ba78-702bb7fc3c73 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 200 len: 1207 microversion: 2.1 time: 0.105387 May 10 02:54:08.250483 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3154/6267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:08 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 1207 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:09.267519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:09.268340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:09.279881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:09.280434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:09.281563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:09.282393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:09.298098 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d HTTP/1.1 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd663ab29-b4bb-466e-81ca-06e17922f37d'} May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:09.299858 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:54:09.303559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c336bcc-356f-4e43-b1ed-f37880feeb9c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 404 len: 111 microversion: 2.1 time: 0.038240 May 10 02:54:09.305158 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3114/6268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:09 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:54:13.661334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:13.662519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:13.670148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:13.670811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:13.671811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:13.672418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:13.691861 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 HTTP/1.1 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f4e44792-3eff-45a2-ae63-d6a5e8de1e22'} May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:54:13.694048 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.698147 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:13.700701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:54:13.702323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1c5d024-b336-40a7-a89f-fb6630644578 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 404 len: 111 microversion: 2.1 time: 0.045292 May 10 02:54:13.706846 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3155/6269] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:54:13 2022] DELETE /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:54:13.711976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:13.713911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: f4e44792-3eff-45a2-ae63-d6a5e8de1e22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:13.725427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:13.735861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:13.737190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:13.737897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 HTTP/1.1 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f4e44792-3eff-45a2-ae63-d6a5e8de1e22'} May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:54:13.757070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance f4e44792-3eff-45a2-ae63-d6a5e8de1e22 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4fadba9e-5815-4349-a28f-b1c3a7efc2e3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22" status: 404 len: 111 microversion: 2.1 time: 0.047475 May 10 02:54:13.761293 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3115/6270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:13 2022] GET /compute/v2.1/servers/f4e44792-3eff-45a2-ae63-d6a5e8de1e22 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:54:14.575943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:14.576794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:14.588649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:14.589603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:14.590396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:14.592195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:14.625341 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d HTTP/1.1 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd663ab29-b4bb-466e-81ca-06e17922f37d'} May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:54:14.627515 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:54:14.631211 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5af0d451-b9dc-4cff-8045-4258cb8ba3c0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 404 len: 111 microversion: 2.1 time: 0.059046 May 10 02:54:14.638662 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3156/6271] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:54:14 2022] DELETE /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:54:14.643551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:14.644192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: d663ab29-b4bb-466e-81ca-06e17922f37d] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:14.655695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:14.656274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:14.657548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:14.658265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:14.672774 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d HTTP/1.1 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd663ab29-b4bb-466e-81ca-06e17922f37d'} May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:54:14.674743 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. May 10 02:54:14.678142 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:54:14.679817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance d663ab29-b4bb-466e-81ca-06e17922f37d could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:54:14.681023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d5633cd8-5cf4-4dbe-a2ad-ea5ee89e00be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d" status: 404 len: 111 microversion: 2.1 time: 0.041354 May 10 02:54:14.685791 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3116/6272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:14 2022] GET /compute/v2.1/servers/d663ab29-b4bb-466e-81ca-06e17922f37d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:54:14.802220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6992f6b8-3ab8-47ff-9818-07f240b4f48c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: .version_select at 0x7f3d37237f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1101334833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr7MA3JPg5Ped+4T+oFDAbAP6TGP0T6inAcNM3KYBwIwjgHg/6B0oW3qBIYcGMD4Oroxc57gmAP7hIwBqLnOjor7IDKEcaHH1lPd8vkO0I+YqE6j2jEm5shkvNbMEpovg=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:54:14.828982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-6992f6b8-3ab8-47ff-9818-07f240b4f48c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:54:14.836200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-6992f6b8-3ab8-47ff-9818-07f240b4f48c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:54:14.884939 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6992f6b8-3ab8-47ff-9818-07f240b4f48c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.103192 May 10 02:54:14.886065 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3157/6273] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 02:54:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:54:40.767157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1099209141", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101334833", "security_groups": [{"name": "tempest-secgroup-smoke-1192332852"}], "block_device_mapping_v2": [{"uuid": "5da12d0e-b7d0-4f09-9f27-1a9811f73442", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:54:40.889328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:54:41.298119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:54:41.298584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:54:41.299098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:54:41.299533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:54:41.299969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:54:41.310822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:41.311588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:41.312583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:41.313438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:41.332642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:54:41.338668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:54:41.408087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:54:41.410509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5da12d0e-b7d0-4f09-9f27-1a9811f73442',volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:54:41.560385 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fb015c80-92d2-4b8f-a138-d68adb1edf68 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797769 May 10 02:54:41.561449 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3117/6274] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:54:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:54:41.572854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5af956e-664c-4b24-97bc-3a0db0d6eb8d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:41.574044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d5af956e-664c-4b24-97bc-3a0db0d6eb8d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:41.639310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d5af956e-664c-4b24-97bc-3a0db0d6eb8d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:41.650154 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5af956e-664c-4b24-97bc-3a0db0d6eb8d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1095 microversion: 2.1 time: 0.081752 May 10 02:54:41.651505 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3158/6275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:41 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:54:42.668084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:42.670438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:42.679106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:42.679896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:42.680956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:42.681638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:42.756823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:42.765044 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ad15976-c191-474d-aadb-cf815b8a41d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1193 microversion: 2.1 time: 0.101366 May 10 02:54:42.776661 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3118/6276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:42 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:54:43.786552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:43.787584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:43.802792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:43.803596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:43.804591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:43.805396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:44.095914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:44.105731 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5818f46f-fb2f-4102-bd0e-6e00bbe380aa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.324849 May 10 02:54:44.106980 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3159/6277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:43 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:44.988304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-82b66aee-ff21-4489-b23e-ee15fc6b8de6 req-75fe8061-a0bb-4fc3-9af2-b4153a96a3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec95f481-bbb5-43b9-a2f5-13afb5bb1282", "tag": "ca166859-49ac-4bef-869b-624e56003a68"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:54:45.023312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-82b66aee-ff21-4489-b23e-ee15fc6b8de6 req-75fe8061-a0bb-4fc3-9af2-b4153a96a3a8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:45.024269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-82b66aee-ff21-4489-b23e-ee15fc6b8de6 req-75fe8061-a0bb-4fc3-9af2-b4153a96a3a8 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:45.069093 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-82b66aee-ff21-4489-b23e-ee15fc6b8de6 req-75fe8061-a0bb-4fc3-9af2-b4153a96a3a8 service nova] Creating event network-changed:ca166859-49ac-4bef-869b-624e56003a68 for instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 on n-h2-841089-2 May 10 02:54:45.075297 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-82b66aee-ff21-4489-b23e-ee15fc6b8de6 req-75fe8061-a0bb-4fc3-9af2-b4153a96a3a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096425 May 10 02:54:45.079412 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3119/6278] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:54:45.123024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:45.123758 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:45.138888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:45.139608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:45.140421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:45.140949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:45.884430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:45.895932 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-546571e6-c9bb-4e6d-bfb5-b9c8ca9b8e72 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.776633 May 10 02:54:45.897010 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3160/6279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:45 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:46.914048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:46.915508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:46.923894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:46.924713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:46.925768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:46.926439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:47.126616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:47.137251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f72df1b-1f64-4e5d-9b5c-46e97f319f83 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.227484 May 10 02:54:47.138775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3120/6280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:46 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:48.154939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:48.155886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:48.170285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:48.171343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:48.173999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:48.174915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:48.372892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:48.384376 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78668e1f-6a09-4d0f-8f7b-a135225b80cb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.234441 May 10 02:54:48.395573 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3161/6281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:48 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:49.401944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:49.403226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:49.413747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:49.414480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:49.421159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:49.421835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:49.675256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:49.692186 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1f6bfa62-cfc5-4d87-9fad-efa5ea64dfa4 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.293056 May 10 02:54:49.693202 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3121/6282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:49 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:54:50.709703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:50.710921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:50.720792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:50.721321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:50.722051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:50.722502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:50.946427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:50.964198 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c2e1a40-c985-4764-841a-0b677daca6fa tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.253224 May 10 02:54:50.965693 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3162/6283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:50 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:51.982486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:51.983753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:51.991903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:51.993013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:51.994592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:51.995362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:52.176259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:52.185760 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9071ad1f-3b9c-4991-90c2-30b574927192 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.207940 May 10 02:54:52.187243 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3122/6284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:51 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:53.202028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:53.203371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:53.210669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:53.211433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:53.212458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:53.213133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:53.368351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:53.377385 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b95013fe-b58d-4a6c-aa35-4ab70157a7e1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.179347 May 10 02:54:53.378287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3163/6285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:53 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:54.396464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:54.397901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:54.407248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:54.408202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:54.409935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:54.410397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:54.553729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:54.561651 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b799bfb9-ccf3-40ed-9223-644705f33990 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1279 microversion: 2.1 time: 0.171315 May 10 02:54:54.562227 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3123/6286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:54 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:55.578422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:55.579271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:55.586890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:55.587482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:55.588293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:55.588867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:55.766204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:55.783631 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-65dd6d8a-9f7a-47cb-8997-e39c56334a28 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.209449 May 10 02:54:55.785120 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3164/6287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:55 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:56.801865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:56.802495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:56.809294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:56.809761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:56.810545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:56.810998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:56.943323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:56.951377 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b0ca415-be6e-4cf2-bdf4-3c6828eb0175 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.153540 May 10 02:54:56.951953 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3124/6288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:56 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:57.969169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:57.969927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:57.977023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:57.977673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:57.978661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:57.979131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:58.138357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:58.146600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6aa3d4b9-db69-47d3-bdd9-a02c2eeb88fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.182039 May 10 02:54:58.151104 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3165/6289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:57 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:54:59.164110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:54:59.164924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:54:59.172194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:59.172667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:59.173478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:54:59.173940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:54:59.311616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:54:59.319059 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7687c5d-1ba9-416e-9849-cdf8e1132d60 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.159271 May 10 02:54:59.319670 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3125/6290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:54:59 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:00.339025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:00.340210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:00.347793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:00.348404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:00.349204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:00.349825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:00.499418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:00.507606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21fdd5b4-5ede-4290-a81b-007f11191038 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.172774 May 10 02:55:00.508351 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3166/6291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:00 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:01.526489 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:01.528882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:01.537737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:01.538643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:01.540124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:01.540788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:01.713903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:01.722574 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a08156e-4e9a-4601-a26c-ad5c9e37e3e8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.201094 May 10 02:55:01.723748 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3126/6292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:01 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:02.739979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:02.740962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:02.749491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:02.750080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:02.751267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:02.751791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:02.928055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:02.937328 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fb5754d-33e2-4022-ac6e-e874cdcb43fc tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.201327 May 10 02:55:02.938037 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3167/6293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:02 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:03.954443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:03.955250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:03.963359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:03.964075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:03.965653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:03.966336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:04.115356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:04.123892 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-17a24cc8-5503-4a38-9800-465dae25e288 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.173481 May 10 02:55:04.124546 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3127/6294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:03 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:05.141320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:05.141865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:05.148692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:05.149161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:05.149950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:05.150404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:05.295492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:05.303702 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3add7fa1-75bb-49bc-a896-0f8ad29a948f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.166314 May 10 02:55:05.304534 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3168/6295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:05 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:05.940589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-dc8d2e37-8fe2-45f5-a620-c94ac894e1b9 req-b988c444-9604-4de4-bc6a-4d24dce32d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec95f481-bbb5-43b9-a2f5-13afb5bb1282", "name": "network-vif-plugged", "status": "completed", "tag": "ca166859-49ac-4bef-869b-624e56003a68"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:05.957741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-dc8d2e37-8fe2-45f5-a620-c94ac894e1b9 req-b988c444-9604-4de4-bc6a-4d24dce32d2a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:05.958194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-dc8d2e37-8fe2-45f5-a620-c94ac894e1b9 req-b988c444-9604-4de4-bc6a-4d24dce32d2a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:05.978011 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-dc8d2e37-8fe2-45f5-a620-c94ac894e1b9 req-b988c444-9604-4de4-bc6a-4d24dce32d2a service nova] Creating event network-vif-plugged:ca166859-49ac-4bef-869b-624e56003a68 for instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 on n-h2-841089-2 May 10 02:55:05.991117 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-dc8d2e37-8fe2-45f5-a620-c94ac894e1b9 req-b988c444-9604-4de4-bc6a-4d24dce32d2a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054033 May 10 02:55:05.992085 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3128/6296] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:55:06.321174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:06.322050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:06.329375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:06.329937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:06.330825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:06.331377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:06.469978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:06.477552 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c829edb1-3c80-4fbb-b2ee-36f35d1758ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1267 microversion: 2.1 time: 0.160419 May 10 02:55:06.478140 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3169/6297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:06 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:07.496329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:07.497685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:07.523020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:07.527357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:07.528848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:07.529651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:07.736480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:07.746431 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56bda273-486d-4fb5-8a42-971f73c59719 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1453 microversion: 2.1 time: 0.254870 May 10 02:55:07.746949 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3129/6298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:07 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1453 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:07.763727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:07.764980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:07.773091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:07.773750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:07.774689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:07.775324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:07.934583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:07.943536 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7c9d613-5da2-4d55-9603-18d173ee730a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1453 microversion: 2.1 time: 0.184999 May 10 02:55:07.944660 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3170/6299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:07 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:10.138656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ee9e3386-0701-4a25-9613-64dd11d133df req-fefe7c15-dff7-4721-9df4-9c6c1a9bd280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec95f481-bbb5-43b9-a2f5-13afb5bb1282", "tag": "ca166859-49ac-4bef-869b-624e56003a68"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:10.150763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ee9e3386-0701-4a25-9613-64dd11d133df req-fefe7c15-dff7-4721-9df4-9c6c1a9bd280 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:10.151284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ee9e3386-0701-4a25-9613-64dd11d133df req-fefe7c15-dff7-4721-9df4-9c6c1a9bd280 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:10.164115 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ee9e3386-0701-4a25-9613-64dd11d133df req-fefe7c15-dff7-4721-9df4-9c6c1a9bd280 service nova] Creating event network-changed:ca166859-49ac-4bef-869b-624e56003a68 for instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 on n-h2-841089-2 May 10 02:55:10.169902 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ee9e3386-0701-4a25-9613-64dd11d133df req-fefe7c15-dff7-4721-9df4-9c6c1a9bd280 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218535 May 10 02:55:10.170813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3130/6300] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:55:19.214575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-29429118", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "2c9e58d8-8e5c-48d5-a2d2-3c93e7dbed9b"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:19.274031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] validate_networks() for [('2c9e58d8-8e5c-48d5-a2d2-3c93e7dbed9b', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:55:19.967994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:55:19.968428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:55:19.968910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:55:19.969327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:55:19.969773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:55:19.979244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:19.979704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:19.980554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:19.981011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:20.004189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Getting quotas for project 5d8c361aa5cf492c8ba64c5186904d92. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:55:20.009468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Getting quotas for user 050bc5f8f5df4c8d8df7a9ad2eaa0c2c and project 5d8c361aa5cf492c8ba64c5186904d92. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:55:20.023674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:55:20.025938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:55:20.079623 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0a7593df-7ae3-4822-b646-72164768346b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986399 May 10 02:55:20.080539 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3171/6301] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:55:20.091652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ad3c8d93-1e05-4ca6-ad09-a8f21c499684 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:20.092376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ad3c8d93-1e05-4ca6-ad09-a8f21c499684 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:20.150468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ad3c8d93-1e05-4ca6-ad09-a8f21c499684 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:20.157193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ad3c8d93-1e05-4ca6-ad09-a8f21c499684 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1213 microversion: 2.1 time: 0.070669 May 10 02:55:20.161953 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3131/6302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:20 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:21.175676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:21.176874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:21.196881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:21.197619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:21.198587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:21.199222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:21.270300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:21.282684 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-479d21d2-e5f3-4f71-ac1c-3762bcdf7528 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1271 microversion: 2.1 time: 0.110773 May 10 02:55:21.284017 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3172/6303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:21 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:22.301511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:22.302141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:22.309799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:22.310298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:22.311109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:22.311751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:22.479835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:22.492470 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29d7848c-7618-4b64-90ea-0c9080402e56 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1313 microversion: 2.1 time: 0.194580 May 10 02:55:22.493341 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3132/6304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:22 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:22.609107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5c608632-4ed4-4ba1-8079-db6da64fbe5a req-705998c0-8f5e-450a-a908-18ee1285339e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1", "tag": "9d28323f-f27b-4cda-ba4c-bc1d67ac974b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:22.621727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5c608632-4ed4-4ba1-8079-db6da64fbe5a req-705998c0-8f5e-450a-a908-18ee1285339e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:22.622784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5c608632-4ed4-4ba1-8079-db6da64fbe5a req-705998c0-8f5e-450a-a908-18ee1285339e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:22.656881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5c608632-4ed4-4ba1-8079-db6da64fbe5a req-705998c0-8f5e-450a-a908-18ee1285339e service nova] Creating event network-changed:9d28323f-f27b-4cda-ba4c-bc1d67ac974b for instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 on n-h1-841089-2 May 10 02:55:22.662510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5c608632-4ed4-4ba1-8079-db6da64fbe5a req-705998c0-8f5e-450a-a908-18ee1285339e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158080 May 10 02:55:22.664011 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3173/6305] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:55:23.509499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:23.510308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:23.517520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:23.517991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:23.518794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:23.519277 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:23.663788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:23.672138 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29487395-1892-4734-8737-7511102db77e tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1313 microversion: 2.1 time: 0.166550 May 10 02:55:23.672809 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3133/6306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:23 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:24.689843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:24.690704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:24.698501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:24.699049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:24.699858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:24.700330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:24.838283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:24.849057 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb207ebc-b3d6-43bf-8d9c-38d8dc6de935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1313 microversion: 2.1 time: 0.162769 May 10 02:55:24.849057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3174/6307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:24 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:25.867149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:25.867886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:25.880169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:25.880971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:25.881912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:25.882701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:26.050811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:26.059087 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0505553-1186-4119-8aaf-fd0471edacbe tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1313 microversion: 2.1 time: 0.197119 May 10 02:55:26.059677 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3134/6308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:25 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:27.079013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:27.079724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:27.089194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:27.089595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:27.090838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:27.091346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:27.278272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:27.289333 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1090fb4b-fae4-4ceb-a4e8-a02b484fa935 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1313 microversion: 2.1 time: 0.214958 May 10 02:55:27.290345 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3175/6309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:27 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:27.375927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-67f93e69-fb74-4bf4-87fd-193b492b47d1 req-f845aef4-945c-4078-9db7-893956930b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1", "name": "network-vif-plugged", "status": "completed", "tag": "9d28323f-f27b-4cda-ba4c-bc1d67ac974b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:27.386322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-67f93e69-fb74-4bf4-87fd-193b492b47d1 req-f845aef4-945c-4078-9db7-893956930b22 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:27.386734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-67f93e69-fb74-4bf4-87fd-193b492b47d1 req-f845aef4-945c-4078-9db7-893956930b22 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:27.399205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-67f93e69-fb74-4bf4-87fd-193b492b47d1 req-f845aef4-945c-4078-9db7-893956930b22 service nova] Creating event network-vif-plugged:9d28323f-f27b-4cda-ba4c-bc1d67ac974b for instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 on n-h1-841089-2 May 10 02:55:27.405145 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-67f93e69-fb74-4bf4-87fd-193b492b47d1 req-f845aef4-945c-4078-9db7-893956930b22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 May 10 02:55:27.406833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3135/6310] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:55:28.307042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:28.307691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:28.315036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:28.315519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:28.316293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:28.316742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:28.448841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:28.462419 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8de9c8df-9cbd-4361-ae77-2a5f7e126090 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1313 microversion: 2.1 time: 0.159285 May 10 02:55:28.463009 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3176/6311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:28 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:29.480575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:29.481289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:29.487627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.488099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.488888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.489346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.619938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:29.629734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02df8ac5-53f4-4d0c-b9f5-fdb13a1d6df2 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1499 microversion: 2.1 time: 0.153991 May 10 02:55:29.630745 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3136/6312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:29 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:29.647521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:29.648114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:29.654928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.655424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.656217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.656665 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.791098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:29.798500 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7774319a-f921-4c61-b14b-a8dc4ee0cfba tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1499 microversion: 2.1 time: 0.155218 May 10 02:55:29.799101 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3177/6313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:29 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:29.815178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:29.815742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:29.821805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.822282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.823086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.823631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.846171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lazy-loading 'flavor' on Instance uuid e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:55:29.912264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fa3ececd-3144-4b7c-a989-fb223c7ef1ea tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action" status: 202 len: 0 microversion: 2.1 time: 0.100531 May 10 02:55:29.912840 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3137/6314] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:55:29 2022] POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:55:29.925330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:29.926064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:29.932295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.932759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:29.933553 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:29.933999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:30.065675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:30.073203 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28b48551-e770-4e25-8463-40991eace82d tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1507 microversion: 2.1 time: 0.156060 May 10 02:55:30.073826 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3178/6315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:29 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:31.092724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:31.093482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:31.099806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:31.100283 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:31.101077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:31.101536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:31.239832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:31.247639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f676f7f7-a0a8-46f6-98cb-ec31e89a464a tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1490 microversion: 2.1 time: 0.160739 May 10 02:55:31.248218 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3138/6316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:31 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1490 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:31.264788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:31.265402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:31.272399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:31.273021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:31.273868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:31.274378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:31.342846 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0da68a8-7f2d-4146-a3f1-ad6e497ea987 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action" status: 202 len: 0 microversion: 2.1 time: 0.081727 May 10 02:55:31.343490 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3179/6317] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:55:31 2022] POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 02:55:31.352816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:31.353514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:31.363352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:31.364109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:31.365023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:31.365584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:31.527642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:31.536695 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1492cf49-5128-4919-9d16-e221245b6e08 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1496 microversion: 2.1 time: 0.188642 May 10 02:55:31.537277 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3139/6318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:31 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1496 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:32.555479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:32.556326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:32.566135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:32.566731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:32.568236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:32.568702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:32.767720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:32.776149 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88e8299b-bef7-4c13-9ce5-4c316eb3b989 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1499 microversion: 2.1 time: 0.225586 May 10 02:55:32.776761 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3180/6319] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:32 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1499 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:55:32.794215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:32.794962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:32.802374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:32.802845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:32.803685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:32.804144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:32.832977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lazy-loading 'flavor' on Instance uuid e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:55:32.909984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c08a699-8894-47ee-9bcc-9289db653421 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action" status: 202 len: 0 microversion: 2.1 time: 0.119698 May 10 02:55:32.910697 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3140/6320] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:55:32 2022] POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:55:32.918899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:32.920324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:32.926302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:32.926767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:32.927761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:32.928218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:33.065811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:33.073366 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eed77754-16ff-4db3-b833-8e03f0c738e8 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1507 microversion: 2.1 time: 0.158334 May 10 02:55:33.073954 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3181/6321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:32 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:34.092002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:34.092652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:34.099023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:34.099529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:34.100318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:34.100784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:34.234407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:34.244358 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c6ecd9a-e76b-4b34-a392-273a6e3ac547 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1490 microversion: 2.1 time: 0.157141 May 10 02:55:34.245376 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3141/6322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:34 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1490 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:34.268223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:34.269052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:34.276182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:34.276743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:34.278142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:34.278674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:34.349049 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-908ddf13-1f71-4c87-81e6-2ca338e12dcc tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action" status: 202 len: 0 microversion: 2.1 time: 0.087296 May 10 02:55:34.353306 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3182/6323] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 02:55:34 2022] POST /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:55:34.358398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:34.359040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:34.365474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:34.365898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:34.366700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:34.367201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:34.508171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:34.517012 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4f5db3c-a313-474d-83f9-a209caf8aeb0 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1496 microversion: 2.1 time: 0.162947 May 10 02:55:34.517788 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3142/6324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:34 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:55:35.535658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:35.536383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:35.543297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:35.543956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:35.544845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:35.545321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:35.700358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:35.708108 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad684bb8-cc66-454b-a237-2b96418e9a20 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1496 microversion: 2.1 time: 0.178121 May 10 02:55:35.708694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3183/6325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:35 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1496 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:36.726267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:36.727031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:36.735029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:36.735596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:36.736476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:36.736931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:36.885632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:36.893243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3056a5ce-f42f-411f-bbeb-ce56b59a9802 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1499 microversion: 2.1 time: 0.170981 May 10 02:55:36.893765 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3143/6326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:36 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:36.913532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:36.914484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:36.922059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:36.922527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:36.923397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:36.923841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:36.953578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:55:37.029560 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-965cb4ea-1a16-4dd8-9493-e0196882b8ae tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 204 len: 0 microversion: 2.1 time: 0.122000 May 10 02:55:37.031241 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3184/6327] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:55:36 2022] DELETE /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:55:37.039529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:37.040158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:37.047463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:37.047982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:37.048843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:37.049323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:37.196563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:37.204951 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85d6decb-e18a-4239-a247-ba72560d5729 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1505 microversion: 2.1 time: 0.169800 May 10 02:55:37.205587 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3144/6328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:37 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:38.223784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:38.224612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:38.233909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:38.234418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:38.235337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:38.235793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:38.380266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:38.389119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f96c9c79-ce98-4cbd-a012-c1e5ce5c8ccb tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1505 microversion: 2.1 time: 0.170333 May 10 02:55:38.389759 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3185/6329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:38 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:39.289751 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f1d6ede7-ccc6-4fd3-a200-3aada18e71e1 req-4d490d1b-9357-4c29-92aa-91e7ae984332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1", "name": "network-vif-deleted", "tag": "9d28323f-f27b-4cda-ba4c-bc1d67ac974b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:55:39.301322 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f1d6ede7-ccc6-4fd3-a200-3aada18e71e1 req-4d490d1b-9357-4c29-92aa-91e7ae984332 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:39.301779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f1d6ede7-ccc6-4fd3-a200-3aada18e71e1 req-4d490d1b-9357-4c29-92aa-91e7ae984332 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:39.323799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f1d6ede7-ccc6-4fd3-a200-3aada18e71e1 req-4d490d1b-9357-4c29-92aa-91e7ae984332 service nova] Creating event network-vif-deleted:9d28323f-f27b-4cda-ba4c-bc1d67ac974b for instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 on n-h1-841089-2 May 10 02:55:39.330543 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f1d6ede7-ccc6-4fd3-a200-3aada18e71e1 req-4d490d1b-9357-4c29-92aa-91e7ae984332 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045887 May 10 02:55:39.331759 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3145/6330] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 02:55:39.406942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:39.407889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:39.415434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:39.416090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:39.417062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:39.417670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:39.451534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:39.452477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:39.452946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lazy-loading 'fault' on Instance uuid e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:55:39.502982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050bc5f8f5df4c8d8df7a9ad2eaa0c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8c361aa5cf492c8ba64c5186904d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:55:39.512954 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d284c5e2-18bd-41ee-8093-fa4ac6b7176b tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 200 len: 1303 microversion: 2.1 time: 0.110485 May 10 02:55:39.513865 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3186/6331] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:39 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:55:40.531759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:55:40.532790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] [instance: e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:55:40.542142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:40.543040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:40.543899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:55:40.544431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:55:40.559687 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] HTTP exception thrown: Instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 could not be found. May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Request method failure captured: May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 HTTP/1.1 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedQVCn14vezNcO2Yo6zHhak549ff-JP3dCxN7JSny3S5Q0h1HUHKflbFt5JJ835_yAkvUAJ0AZVG7M8gyK_1Pn4JvIkKkKj6lyILkJzsyk1XB0bz3xn4Uq8yyF-qMbbA-l9cSbgyLwNeuQFhqA8dfqmXyGCKRnrdyJs4GFKl9veO2Yc May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 5d8c361aa5cf492c8ba64c5186904d92 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestServerAdvancedOps-1400986605 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5d8c361aa5cf492c8ba64c5186904d92", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d8c361aa5cf492c8ba64c5186904d92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5d8c361aa5cf492c8ba64c5186904d92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5d8c361aa5cf492c8ba64c5186904d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestServerAdvancedOps-1400986605 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 5d8c361aa5cf492c8ba64c5186904d92 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestServerAdvancedOps-1400986605 May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestServerAdvancedOps-1400986605-project May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 050bc5f8f5df4c8d8df7a9ad2eaa0c2c May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestServerAdvancedOps-1400986605-project May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 could not be found. May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1'} May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 could not be found. May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 could not be found. May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:55:40.561914 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 could not be found. May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] Returning 404 to user: Instance e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-875b64ec-d9f8-496c-9d36-bd5d8ad5ce27 tempest-TestServerAdvancedOps-1400986605 tempest-TestServerAdvancedOps-1400986605-project] 10.222.0.52 "GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1" status: 404 len: 111 microversion: 2.1 time: 0.036521 May 10 02:55:40.566050 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3146/6332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:55:40 2022] GET /compute/v2.1/servers/e3ee2aef-7910-4c68-ad33-80bdd2b9f7b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:56:35.385054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1733874719", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "3acfa81d-f370-4007-929c-998537e9fa6f"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:56:35.597017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] validate_networks() for [('3acfa81d-f370-4007-929c-998537e9fa6f', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:56:36.048909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:56:36.049349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:56:36.049838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:56:36.050262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:56:36.050733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:56:36.059557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:36.060018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:36.060867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:36.061316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:36.079052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Getting quotas for project bf829d11fdba4e38a1a249a0510425ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:56:36.085242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Getting quotas for user 4dff33500c704120aa7fe97cf4a7239d and project bf829d11fdba4e38a1a249a0510425ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:56:36.099529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:56:36.101765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:56:36.149098 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cbbb1576-431d-4a71-8111-9dc780622ed7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768225 May 10 02:56:36.149779 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3187/6333] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:56:36.161398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-97038f4e-c2a7-4027-a868-16b21762264d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:36.162821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-97038f4e-c2a7-4027-a868-16b21762264d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:36.286096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-97038f4e-c2a7-4027-a868-16b21762264d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:36.295836 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-97038f4e-c2a7-4027-a868-16b21762264d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1219 microversion: 2.1 time: 0.139173 May 10 02:56:36.296622 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3147/6334] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:36 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:56:37.314015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:37.314648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:37.321838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:37.322302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:37.323747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:37.323747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:37.395380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:37.402664 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-43b7bd2b-41cf-4e3c-aa20-f639f5dcbe71 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1277 microversion: 2.1 time: 0.093677 May 10 02:56:37.403274 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3188/6335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:37 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:56:38.348081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ee9de056-1bb2-41ad-b843-222dc4c4de81 req-483d7b4a-18d4-4b74-9f78-0e48f73f1f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97f3bb2-ca14-405e-90d8-f7825d016c54", "tag": "faff37e8-2ece-4c27-9bda-710cded7e019"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:56:38.358264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ee9de056-1bb2-41ad-b843-222dc4c4de81 req-483d7b4a-18d4-4b74-9f78-0e48f73f1f3e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:38.359055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ee9de056-1bb2-41ad-b843-222dc4c4de81 req-483d7b4a-18d4-4b74-9f78-0e48f73f1f3e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:38.369611 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ee9de056-1bb2-41ad-b843-222dc4c4de81 req-483d7b4a-18d4-4b74-9f78-0e48f73f1f3e service nova] Creating event network-changed:faff37e8-2ece-4c27-9bda-710cded7e019 for instance c97f3bb2-ca14-405e-90d8-f7825d016c54 on n-h1-841089-2 May 10 02:56:38.374487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ee9de056-1bb2-41ad-b843-222dc4c4de81 req-483d7b4a-18d4-4b74-9f78-0e48f73f1f3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031016 May 10 02:56:38.375368 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3148/6336] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:56:38.420463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:38.421087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:38.428521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:38.428973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:38.429778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:38.430215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:38.558542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:38.566447 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09c6e2f5-de05-4849-89fe-c68dce897b00 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1319 microversion: 2.1 time: 0.150113 May 10 02:56:38.567031 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3189/6337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:38 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:56:39.585408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:39.586135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:39.592504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:39.593214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:39.594016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:39.594474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:39.752702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:39.760932 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13b84dc6-a74b-4942-b71a-9bca68e0b07a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1319 microversion: 2.1 time: 0.181168 May 10 02:56:39.761750 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3149/6338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:39 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:56:40.778744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:40.779401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:40.786703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:40.787195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:40.787982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:40.788434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:40.919877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:40.927774 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5c584c41-3cf8-40cc-a06c-66755786536f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1319 microversion: 2.1 time: 0.152936 May 10 02:56:40.928347 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3190/6339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:40 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:56:41.721220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-35517218-3252-494c-870b-fac7f7b0c8b5 req-8f791020-d8ce-4fc7-9920-00210765671f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97f3bb2-ca14-405e-90d8-f7825d016c54", "name": "network-vif-plugged", "status": "completed", "tag": "faff37e8-2ece-4c27-9bda-710cded7e019"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:56:41.730129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-35517218-3252-494c-870b-fac7f7b0c8b5 req-8f791020-d8ce-4fc7-9920-00210765671f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:41.730605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-35517218-3252-494c-870b-fac7f7b0c8b5 req-8f791020-d8ce-4fc7-9920-00210765671f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:41.742257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-35517218-3252-494c-870b-fac7f7b0c8b5 req-8f791020-d8ce-4fc7-9920-00210765671f service nova] Creating event network-vif-plugged:faff37e8-2ece-4c27-9bda-710cded7e019 for instance c97f3bb2-ca14-405e-90d8-f7825d016c54 on n-h1-841089-2 May 10 02:56:41.747018 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-35517218-3252-494c-870b-fac7f7b0c8b5 req-8f791020-d8ce-4fc7-9920-00210765671f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 May 10 02:56:41.747659 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3150/6340] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:56:41.943777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:41.944409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:41.951237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:41.951705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:41.952486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:41.953438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:42.079691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:42.087145 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a33946e-e0f1-48c0-bf38-6b56d9bb4b53 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1319 microversion: 2.1 time: 0.147237 May 10 02:56:42.087725 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3191/6341] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:41 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:56:43.105393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:56:43.106104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:56:43.112340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:43.112808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:43.113583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:56:43.114038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:56:43.248422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:56:43.255971 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-762a626d-d208-41b7-b7ae-1f21f55da1b5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1507 microversion: 2.1 time: 0.155637 May 10 02:56:43.256551 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3151/6342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:56:43 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:02.570660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2098bd32-9247-4308-8983-7c833114caf2", "device": "/dev/sdb"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:02.571855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:02.578282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:02.578740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:02.579574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:02.580022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:02.830103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f0413e41-f72f-4f2f-91b6-cd64ff8eba14 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "POST /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263403 May 10 02:57:02.830730 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3192/6343] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:57:02 2022] POST /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:57:07.947571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:07.948111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:07.954370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:07.955430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:07.956224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:07.956701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:07.980661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:57:08.054633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e143d5a2-a954-4387-91ac-0686100b170d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 204 len: 0 microversion: 2.1 time: 0.110894 May 10 02:57:08.055848 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3152/6344] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:57:07 2022] DELETE /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:57:08.065940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:08.067047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:08.073408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:08.073950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:08.074822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:08.075395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:08.209853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:08.217638 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e38359c1-9bd7-4267-953a-d21832e3d187 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1578 microversion: 2.1 time: 0.157784 May 10 02:57:08.218530 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3193/6345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:08 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:09.235694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:09.237035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:09.244255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:09.244729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:09.245548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:09.246010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:09.386740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:09.395425 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-057c60ff-ceab-4b1a-ba19-38bb9f244e48 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1578 microversion: 2.1 time: 0.163911 May 10 02:57:09.396025 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3153/6346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:09 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:57:10.413396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:10.414147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:10.422603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:10.423196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:10.424548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:10.425081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:10.677326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:10.684923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c226443c-8161-41fc-96f1-be1006e67d9f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1578 microversion: 2.1 time: 0.275688 May 10 02:57:10.685514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3194/6347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:10 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1578 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:57:10.915981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-48254898-a375-4bbb-b8cf-308acf15320c req-ad3c5a2b-f512-4c9b-b421-50dddf3cf0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec95f481-bbb5-43b9-a2f5-13afb5bb1282", "name": "network-vif-deleted", "tag": "ca166859-49ac-4bef-869b-624e56003a68"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:10.928657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-48254898-a375-4bbb-b8cf-308acf15320c req-ad3c5a2b-f512-4c9b-b421-50dddf3cf0d3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:10.934998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-48254898-a375-4bbb-b8cf-308acf15320c req-ad3c5a2b-f512-4c9b-b421-50dddf3cf0d3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:10.958589 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-48254898-a375-4bbb-b8cf-308acf15320c req-ad3c5a2b-f512-4c9b-b421-50dddf3cf0d3 service nova] Creating event network-vif-deleted:ca166859-49ac-4bef-869b-624e56003a68 for instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 on n-h2-841089-2 May 10 02:57:10.965501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-48254898-a375-4bbb-b8cf-308acf15320c req-ad3c5a2b-f512-4c9b-b421-50dddf3cf0d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056428 May 10 02:57:10.966773 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3154/6348] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:57:11.702681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:11.703732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:11.710564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:11.711022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:11.712583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:11.713030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:11.782811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:11.790777 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9dd32583-184f-4c11-b89b-2f5e0b056dc7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.091997 May 10 02:57:11.791748 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3195/6349] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:11 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:12.809786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:12.810630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:12.816916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:12.817377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:12.818211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:12.818673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:12.882876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:12.890876 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-149c14a3-406d-48d8-b812-8c7182d27738 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.086058 May 10 02:57:12.891506 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3155/6350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:12 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:13.908240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:13.908769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:13.915768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:13.916491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:13.917539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:13.917993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:13.979762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:13.987672 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26f91f1a-4d36-455b-9585-1a2342016220 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.083978 May 10 02:57:13.988269 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3196/6351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:13 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:15.004541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:15.005077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:15.011954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:15.012429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:15.013222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:15.013683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:15.077058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:15.085212 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-92a3fdef-61fd-4062-9817-c1de4b78d289 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.084822 May 10 02:57:15.085804 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3156/6352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:14 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:16.102096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:16.102716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:16.109520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:16.109979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:16.110763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:16.111236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:16.175554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:16.183237 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc95f066-8b49-4714-870c-6ddad7645cc6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.084924 May 10 02:57:16.183813 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3197/6353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:16 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:17.200728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:17.201427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:17.208229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:17.208697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:17.209481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:17.209937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:17.271001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:17.278605 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-843ecccc-d14d-4b48-8302-a6a67eb48933 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.081936 May 10 02:57:17.279219 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3157/6354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:17 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:18.295835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:18.296497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:18.304714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:18.305175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:18.305953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:18.306397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:18.369782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:18.377707 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a6f7214-b09a-425e-a82e-9b8ab72433a8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.086050 May 10 02:57:18.379192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3198/6355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:18 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:19.395384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:19.396049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:19.402989 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:19.403495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:19.404320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:19.404785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:19.471623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:19.479750 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8efb00e-0ab4-45f0-850b-1857b861662e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.088907 May 10 02:57:19.480587 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3158/6356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:19 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:20.496784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:20.497721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:20.505680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:20.506148 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:20.506937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:20.507417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:20.571723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:20.579699 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-16f6fc27-6bd6-4ecc-9b5a-07574be5882e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.086840 May 10 02:57:20.580286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3199/6357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:20 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:21.596545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:21.597259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:21.604249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:21.605114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:21.605935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:21.606502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:21.677161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:21.685864 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c3ccbcb-4a58-4db0-99b3-290815c48ea1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 200 len: 1226 microversion: 2.1 time: 0.094038 May 10 02:57:21.695871 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3159/6358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:21 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:22.702804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:22.703470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:22.710917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:22.711420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:22.712192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:22.712636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:22.725527 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 HTTP/1.1 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'ec95f481-bbb5-43b9-a2f5-13afb5bb1282'} May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:57:22.727229 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b1b4029-0055-4c6d-a9ae-bb0ccde1da86 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 404 len: 111 microversion: 2.1 time: 0.029910 May 10 02:57:22.732196 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3200/6359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:22 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:57:22.822804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1226398919", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101334833", "security_groups": [{"name": "tempest-secgroup-smoke-1192332852"}], "block_device_mapping_v2": [{"uuid": "5da12d0e-b7d0-4f09-9f27-1a9811f73442", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:22.962335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:57:23.390372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:57:23.390870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:57:23.391400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:57:23.391839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:57:23.392642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:57:23.402762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:23.403267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:23.404371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:23.405029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:23.421493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:57:23.427433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:57:23.487801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:57:23.489978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5da12d0e-b7d0-4f09-9f27-1a9811f73442',volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:57:23.616063 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [96576b52-2072-47c6-a496-4ce4951bf46d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 02:57:24.622971 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [96576b52-2072-47c6-a496-4ce4951bf46d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50266. May 10 02:57:24.632759 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d6159429-f30c-461f-9771-cd10b0d373d2 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.813637 May 10 02:57:24.633289 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3160/6360] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:57:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:57:24.644992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98fc3bdd-f704-498e-8c84-25c4519dbec7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:24.645630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98fc3bdd-f704-498e-8c84-25c4519dbec7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:24.701763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-98fc3bdd-f704-498e-8c84-25c4519dbec7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:24.714727 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98fc3bdd-f704-498e-8c84-25c4519dbec7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1095 microversion: 2.1 time: 0.074782 May 10 02:57:24.715356 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3201/6361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:24 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:25.732012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:25.732741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:25.739621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:25.740092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:25.740880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:25.741341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:25.810948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:25.818942 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb79f464-58c3-47fd-8dbf-c9e41a547916 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1211 microversion: 2.1 time: 0.091666 May 10 02:57:25.824767 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3161/6362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:25 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:26.837201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:26.841403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:26.851818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:26.852280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:26.853132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:26.853583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:27.129682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:27.140960 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4405e508-24fa-4e11-a996-fcc05777e0ea tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.307860 May 10 02:57:27.143429 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3202/6363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:26 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:27.578537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-dd04197d-1ab0-44ba-9175-402ff8bef661 req-3cbeb563-ee1e-4b5b-92f8-8f4cdf7d246e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9da65-ee20-4eeb-9bd7-0e3fa7339113", "tag": "9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:27.590085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-dd04197d-1ab0-44ba-9175-402ff8bef661 req-3cbeb563-ee1e-4b5b-92f8-8f4cdf7d246e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:27.590789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-dd04197d-1ab0-44ba-9175-402ff8bef661 req-3cbeb563-ee1e-4b5b-92f8-8f4cdf7d246e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:27.615489 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-dd04197d-1ab0-44ba-9175-402ff8bef661 req-3cbeb563-ee1e-4b5b-92f8-8f4cdf7d246e service nova] Creating event network-changed:9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548 for instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 on n-h2-841089-2 May 10 02:57:27.627376 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-dd04197d-1ab0-44ba-9175-402ff8bef661 req-3cbeb563-ee1e-4b5b-92f8-8f4cdf7d246e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052285 May 10 02:57:27.628573 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3162/6364] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:57:28.158579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:28.159243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:28.165900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:28.166608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:28.167861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:28.168463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:28.409944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:28.419116 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14b63fb1-f6dd-4c9d-aa53-01d1869ab3a7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.265069 May 10 02:57:28.419997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3203/6365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:28 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:29.438534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:29.440806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:29.449711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:29.450189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:29.451014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:29.451674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:29.600801 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:29.608668 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c077cda4-3621-4eae-86af-10940aa8931e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.175408 May 10 02:57:29.609269 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3163/6366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:29 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:30.627753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:30.629083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:30.638286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:30.639120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:30.640312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:30.641034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:30.783967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:30.792240 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-40a9270a-cc87-459c-9534-85feb69b2bdd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.169889 May 10 02:57:30.792948 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3204/6367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:30 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:31.810147 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:31.810951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:31.818320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:31.819016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:31.820288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:31.820908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:31.966146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:31.974215 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-611d4c8b-915f-4817-8ba5-8136eca2fc52 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.168633 May 10 02:57:31.974798 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3164/6368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:31 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:32.992105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:32.993462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:33.005177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:33.006086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:33.007161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:33.007992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:33.145074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:33.153611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33dd8dce-c144-41dd-a63d-ce667885946f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.165831 May 10 02:57:33.154309 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3205/6369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:32 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:34.170558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:34.171344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:34.178796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:34.179326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:34.180127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:34.181338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:34.332900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:34.341055 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-300775f4-76a9-41d6-b76b-fd9ba2fba2ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.174545 May 10 02:57:34.342195 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3165/6370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:34 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:35.358477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:35.359025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:35.366086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:35.366562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:35.367387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:35.367841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:35.499514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:35.506894 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4dba09d1-158b-4f27-878f-ea93cc08cfba tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1279 microversion: 2.1 time: 0.152616 May 10 02:57:35.507574 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3206/6371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:35 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:36.523930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:36.524685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:36.531541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:36.532011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:36.532795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:36.533787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:36.665444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:36.673198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c2ee91a-0401-4c19-b954-314b7e11319b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.153288 May 10 02:57:36.673828 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3166/6372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:36 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:37.690309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:37.690934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:37.697825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:37.698286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:37.699091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:37.699546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:37.867490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:37.878297 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-279b99c5-c0dc-45a5-bb84-b9096ff5180c tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.192388 May 10 02:57:37.878894 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3207/6373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:37 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:38.768453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:38.769004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:38.775625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:38.776103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:38.776889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:38.777346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:38.856552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lazy-loading 'services' on Instance uuid c97f3bb2-ca14-405e-90d8-f7825d016c54 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:57:38.894871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:38.895442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:38.902327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:38.902793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:38.903609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:38.904057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:38.928043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b144c1a8-85c7-4978-a4de-546399797ee1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54/os-volume_attachments/2098bd32-9247-4308-8983-7c833114caf2" status: 202 len: 0 microversion: 2.1 time: 0.163973 May 10 02:57:38.928896 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3167/6374] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:57:38 2022] DELETE /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54/os-volume_attachments/2098bd32-9247-4308-8983-7c833114caf2 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:57:39.051871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:39.059147 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c95444a-03c0-41a6-b340-91b4e959fdae tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.168303 May 10 02:57:39.059722 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3208/6375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:38 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:57:40.078222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:40.078949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:40.086934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:40.086934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:40.087660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:40.088124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:40.229581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:40.237689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cb76681a-1789-4291-848d-7a20104712c3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.165014 May 10 02:57:40.238272 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3168/6376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:40 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:41.254546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:41.255206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:41.262080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:41.262542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:41.263362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:41.263820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:41.397044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:41.404475 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e9a29e07-458a-440e-8a23-00dc1f90c588 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.153941 May 10 02:57:41.405056 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3209/6377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:41 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:42.421917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:42.422496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:42.429513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:42.429985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:42.430766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:42.431268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:42.560938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:42.568510 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfd0a029-30b3-47f4-bb0f-2b874ff5b02b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.150897 May 10 02:57:42.569087 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3169/6378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:42 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:43.585285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:43.585955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:43.592917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:43.593383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:43.594164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:43.594620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:43.730137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:43.738271 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33133c4e-4856-438e-b8a3-cf182a9c0543 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.156960 May 10 02:57:43.738849 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3210/6379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:43 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:44.755697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:44.756330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:44.762804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:44.763300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:44.764093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:44.764549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:44.897446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:44.906169 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-912c6fc7-c1ef-4068-bc9f-291f72480dd8 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.154516 May 10 02:57:44.906771 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3170/6380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:44 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:45.922976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:45.924209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:45.931330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:45.931802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:45.932593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:45.933106 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:46.067543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:46.075042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94ee7ae0-2165-4e52-8244-c1af68fe7bce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.156098 May 10 02:57:46.075647 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3211/6381] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:45 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:46.752565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-da56d3d9-c29e-4087-a699-5af29be432aa req-3ba20500-7b2a-464b-b960-0e53e9215480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a9da65-ee20-4eeb-9bd7-0e3fa7339113", "name": "network-vif-plugged", "status": "completed", "tag": "9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:46.761562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-da56d3d9-c29e-4087-a699-5af29be432aa req-3ba20500-7b2a-464b-b960-0e53e9215480 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:46.762107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-da56d3d9-c29e-4087-a699-5af29be432aa req-3ba20500-7b2a-464b-b960-0e53e9215480 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:46.773130 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-da56d3d9-c29e-4087-a699-5af29be432aa req-3ba20500-7b2a-464b-b960-0e53e9215480 service nova] Creating event network-vif-plugged:9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548 for instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 on n-h2-841089-2 May 10 02:57:46.778124 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-da56d3d9-c29e-4087-a699-5af29be432aa req-3ba20500-7b2a-464b-b960-0e53e9215480 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101471 May 10 02:57:46.778764 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3171/6382] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:57:47.092473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:47.093097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:47.100076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:47.100533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:47.101309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:47.101754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:47.234964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:47.243184 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5b6859a0-8c71-4397-90f5-de3a93679501 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1267 microversion: 2.1 time: 0.154598 May 10 02:57:47.243953 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3212/6383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:47 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:48.261632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:48.263295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:48.270305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.270784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.271626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.272280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.411680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:48.419627 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d4d0c9c-aa94-4c94-8e55-6e2afc7dcff3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1454 microversion: 2.1 time: 0.163223 May 10 02:57:48.420393 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3172/6384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:48 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:48.435488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:48.436110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:48.443881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.444348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.445146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.445603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.485869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:48.486969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:48.493056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.493527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.494329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.494787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.520290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:57:48.591095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:48.599453 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f24bc432-3aa7-43cf-ac0f-1b84739b70ee tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1454 microversion: 2.1 time: 0.167910 May 10 02:57:48.600042 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3213/6385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:48 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:48.616208 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2ea41eea-876c-4aa7-b471-c64d70871730 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 204 len: 0 microversion: 2.1 time: 0.133885 May 10 02:57:48.619989 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3173/6386] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:57:48 2022] DELETE /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:57:48.625528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:48.626293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:48.633078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.633656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.634497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:48.635687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:48.766805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:48.774818 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f6cd6f8-2476-4100-8959-acbafe244577 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1513 microversion: 2.1 time: 0.153510 May 10 02:57:48.775430 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3214/6387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:48 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:57:49.794716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:49.795790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:49.802827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:49.803431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:49.804307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:49.804849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:50.033742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:50.043441 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-40ef8b4a-97f4-42be-bc83-a0a9fe67807a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1513 microversion: 2.1 time: 0.253070 May 10 02:57:50.053678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3174/6388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:49 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:51.061279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:51.061889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:51.069400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:51.069862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:51.070643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:51.071104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:51.216807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:57:51.224800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-abbf986f-b675-445f-be6a-51d67464bc69 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 200 len: 1513 microversion: 2.1 time: 0.167490 May 10 02:57:51.225392 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3215/6389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:51 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:57:51.296662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-26e1c13b-3581-4953-919d-f517558bffca req-962f7de1-b063-4b2c-8940-55605ee71c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97f3bb2-ca14-405e-90d8-f7825d016c54", "name": "network-vif-deleted", "tag": "faff37e8-2ece-4c27-9bda-710cded7e019"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:51.306965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-26e1c13b-3581-4953-919d-f517558bffca req-962f7de1-b063-4b2c-8940-55605ee71c26 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:51.307479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-26e1c13b-3581-4953-919d-f517558bffca req-962f7de1-b063-4b2c-8940-55605ee71c26 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:51.322435 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-26e1c13b-3581-4953-919d-f517558bffca req-962f7de1-b063-4b2c-8940-55605ee71c26 service nova] Creating event network-vif-deleted:faff37e8-2ece-4c27-9bda-710cded7e019 for instance c97f3bb2-ca14-405e-90d8-f7825d016c54 on n-h1-841089-2 May 10 02:57:51.328856 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-26e1c13b-3581-4953-919d-f517558bffca req-962f7de1-b063-4b2c-8940-55605ee71c26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036263 May 10 02:57:51.329478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3175/6390] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:57:52.241978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:57:52.242602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: c97f3bb2-ca14-405e-90d8-f7825d016c54] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:57:52.249855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:52.250319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:52.251301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:52.251563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:52.266050 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] HTTP exception thrown: Instance c97f3bb2-ca14-405e-90d8-f7825d016c54 could not be found. May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Request method failure captured: May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 HTTP/1.1 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedQfsN_LS2iTqgIm1RQykgvtcMwXa0cpmhBLJAHmaosBTFKFD7IZk9rliHTlMX_Q8-DsiLBG9JZslJBbPMTeHZIRQph982m-loRD9zfw1hPRseYYmFN6_q7PCoYGhBPLg9XlLtTPLwm_OjO63t3XXyP-kCPTAdH2isXIV6JP9_GUOzc May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: bf829d11fdba4e38a1a249a0510425ef May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-232638109 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf829d11fdba4e38a1a249a0510425ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf829d11fdba4e38a1a249a0510425ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf829d11fdba4e38a1a249a0510425ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf829d11fdba4e38a1a249a0510425ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesSnapshotTestJSON-232638109 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: bf829d11fdba4e38a1a249a0510425ef May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-232638109 May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesSnapshotTestJSON-232638109-project May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4dff33500c704120aa7fe97cf4a7239d May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesSnapshotTestJSON-232638109-project May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance c97f3bb2-ca14-405e-90d8-f7825d016c54 could not be found. May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'c97f3bb2-ca14-405e-90d8-f7825d016c54'} May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97f3bb2-ca14-405e-90d8-f7825d016c54 could not be found. May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97f3bb2-ca14-405e-90d8-f7825d016c54 could not be found. May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:57:52.268345 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97f3bb2-ca14-405e-90d8-f7825d016c54 could not be found. May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Returning 404 to user: Instance c97f3bb2-ca14-405e-90d8-f7825d016c54 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a69f2adf-8e42-4bdf-af08-efab526fa7a2 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54" status: 404 len: 111 microversion: 2.1 time: 0.031811 May 10 02:57:52.272429 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3216/6391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:57:52 2022] GET /compute/v2.1/servers/c97f3bb2-ca14-405e-90d8-f7825d016c54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:57:53.346892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-04e10275-8ee9-4abc-afec-d6aee7147176 req-5cedb5e4-77c8-48ec-a2a6-cdfe640124ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9da65-ee20-4eeb-9bd7-0e3fa7339113", "tag": "9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:57:53.355207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-04e10275-8ee9-4abc-afec-d6aee7147176 req-5cedb5e4-77c8-48ec-a2a6-cdfe640124ec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:57:53.355681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-04e10275-8ee9-4abc-afec-d6aee7147176 req-5cedb5e4-77c8-48ec-a2a6-cdfe640124ec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:57:53.366815 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-04e10275-8ee9-4abc-afec-d6aee7147176 req-5cedb5e4-77c8-48ec-a2a6-cdfe640124ec service nova] Creating event network-changed:9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548 for instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 on n-h2-841089-2 May 10 02:57:53.371804 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-04e10275-8ee9-4abc-afec-d6aee7147176 req-5cedb5e4-77c8-48ec-a2a6-cdfe640124ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029686 May 10 02:57:53.372351 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3176/6392] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:58:02.099210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1359451190", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "3acfa81d-f370-4007-929c-998537e9fa6f"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:58:02.153182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] validate_networks() for [('3acfa81d-f370-4007-929c-998537e9fa6f', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:58:02.503361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:58:02.504076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:58:02.504664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:58:02.505175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:58:02.505606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:58:02.514693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:02.515275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:02.516190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:02.516678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:02.533943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Getting quotas for project bf829d11fdba4e38a1a249a0510425ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:58:02.539210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Getting quotas for user 4dff33500c704120aa7fe97cf4a7239d and project bf829d11fdba4e38a1a249a0510425ef. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:58:02.552372 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:58:02.554647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:58:02.599551 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99ba61a0-1e8d-4e4e-875a-ddb153c017bb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504704 May 10 02:58:02.600342 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3217/6393] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:58:02.612917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b4d03db-0ce2-4e73-8ced-c066041f5af7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:02.613645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b4d03db-0ce2-4e73-8ced-c066041f5af7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:02.682384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4b4d03db-0ce2-4e73-8ced-c066041f5af7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:02.689541 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b4d03db-0ce2-4e73-8ced-c066041f5af7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1219 microversion: 2.1 time: 0.082740 May 10 02:58:02.690209 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3177/6394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:02 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:03.708089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:03.708751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:03.715780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:03.716309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:03.717165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:03.717676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:03.785352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:03.794596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3876a5b5-dcbf-4a0d-8da3-2ca077298e6a tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1277 microversion: 2.1 time: 0.092393 May 10 02:58:03.801227 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3218/6395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:03 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:04.784807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4e6d4248-b94b-4ab1-a36a-25768fd9da95 req-0f35da52-6270-4e40-9e09-bb2bde62821a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ede18e4-1b47-4159-b680-1f81d289f7ae", "tag": "b0d906e1-7d17-4f53-99d6-6fc8639d42af"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:58:04.794521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4e6d4248-b94b-4ab1-a36a-25768fd9da95 req-0f35da52-6270-4e40-9e09-bb2bde62821a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:04.794997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4e6d4248-b94b-4ab1-a36a-25768fd9da95 req-0f35da52-6270-4e40-9e09-bb2bde62821a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:04.806415 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4e6d4248-b94b-4ab1-a36a-25768fd9da95 req-0f35da52-6270-4e40-9e09-bb2bde62821a service nova] Creating event network-changed:b0d906e1-7d17-4f53-99d6-6fc8639d42af for instance 4ede18e4-1b47-4159-b680-1f81d289f7ae on n-h1-841089-2 May 10 02:58:04.811740 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4e6d4248-b94b-4ab1-a36a-25768fd9da95 req-0f35da52-6270-4e40-9e09-bb2bde62821a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031084 May 10 02:58:04.812412 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3178/6396] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:58:04.815332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:04.816494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:04.824094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:04.824556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:04.825345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:04.825791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:04.959943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:04.967802 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-da8b78ff-7275-4f54-9e2a-2583af6283c5 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1319 microversion: 2.1 time: 0.159248 May 10 02:58:04.968466 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3219/6397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:04 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:58:05.989527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:05.990931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:06.000731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:06.001036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:06.001881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:06.003374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:06.181753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:06.192377 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cdd614c4-2ee2-492e-ad9f-38eb3470da6d tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1319 microversion: 2.1 time: 0.210618 May 10 02:58:06.192979 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3179/6398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:05 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:07.209891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:07.210519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:07.217363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:07.217826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:07.218606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:07.219053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:07.350139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:07.357758 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4834a7e8-4142-4494-b638-c96eb80d67eb tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1319 microversion: 2.1 time: 0.152492 May 10 02:58:07.358436 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3220/6399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:07 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:08.374272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:08.374909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:08.381407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:08.381882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:08.382681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:08.383165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:08.521825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:08.529137 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b255e79-c74e-4afd-8ce7-3121bee91c47 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1319 microversion: 2.1 time: 0.158943 May 10 02:58:08.529713 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3180/6400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:08 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:09.546233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:09.547018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:09.554700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:09.555188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:09.556055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:09.556547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:09.692044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:09.699705 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e491c679-524e-4a94-a7f4-f1da18a5d2fa tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1319 microversion: 2.1 time: 0.157804 May 10 02:58:09.700285 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3221/6401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:09 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:10.063077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9f7d7f73-3ca8-4599-9f40-02afa9a170c4 req-b32e3dcf-9aba-416f-839d-45ede002d474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ede18e4-1b47-4159-b680-1f81d289f7ae", "name": "network-vif-plugged", "status": "completed", "tag": "b0d906e1-7d17-4f53-99d6-6fc8639d42af"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:58:10.072929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9f7d7f73-3ca8-4599-9f40-02afa9a170c4 req-b32e3dcf-9aba-416f-839d-45ede002d474 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:10.073466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9f7d7f73-3ca8-4599-9f40-02afa9a170c4 req-b32e3dcf-9aba-416f-839d-45ede002d474 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:10.085486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9f7d7f73-3ca8-4599-9f40-02afa9a170c4 req-b32e3dcf-9aba-416f-839d-45ede002d474 service nova] Creating event network-vif-plugged:b0d906e1-7d17-4f53-99d6-6fc8639d42af for instance 4ede18e4-1b47-4159-b680-1f81d289f7ae on n-h1-841089-2 May 10 02:58:10.091315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9f7d7f73-3ca8-4599-9f40-02afa9a170c4 req-b32e3dcf-9aba-416f-839d-45ede002d474 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 May 10 02:58:10.092237 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3181/6402] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:58:10.717811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:10.718467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:10.725300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:10.725761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:10.726544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:10.726991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:10.857997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:10.866013 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5497bd0b-975b-4a62-8526-6a45f6e68a4e tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1319 microversion: 2.1 time: 0.152317 May 10 02:58:10.866594 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3222/6403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:10 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:11.884149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:11.884872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:11.891272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:11.891686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:11.892470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:11.892927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:12.030405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:12.037881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-acda757f-39c2-4971-af48-4dbb42c7ac82 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1507 microversion: 2.1 time: 0.158828 May 10 02:58:12.038456 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3182/6404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:11 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:12.054790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2bcae3d-0f78-4ac4-af2e-79dc73082bec", "device": "/dev/sdb"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:58:12.056054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:12.062930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:12.063428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:12.064211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:12.064663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:12.293420 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-257f98a7-0b8b-49fb-8247-f240c5cbcd0f tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "POST /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242913 May 10 02:58:12.294416 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3223/6405] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 02:58:12 2022] POST /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:58:44.113802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:44.114323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:44.120840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:44.121307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:44.122087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:44.122546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:44.199915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lazy-loading 'services' on Instance uuid 4ede18e4-1b47-4159-b680-1f81d289f7ae {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 02:58:44.268981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04ea10c9-2ad7-4251-9006-6e21855c57f1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae/os-volume_attachments/c2bcae3d-0f78-4ac4-af2e-79dc73082bec" status: 202 len: 0 microversion: 2.1 time: 0.159154 May 10 02:58:44.269567 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3183/6406] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 02:58:44 2022] DELETE /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae/os-volume_attachments/c2bcae3d-0f78-4ac4-af2e-79dc73082bec => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 02:58:53.810906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:53.811557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:53.817779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:53.818241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:53.819048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:53.819515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:53.844062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 02:58:53.915704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2bc52ba7-ddc1-478a-98f1-e61e57009e01 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 204 len: 0 microversion: 2.1 time: 0.109504 May 10 02:58:53.916559 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3224/6407] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 02:58:53 2022] DELETE /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 02:58:53.926314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:53.927060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:53.933829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:53.934307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:53.935343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:53.935807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:54.068396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:54.075854 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3660db2f-744e-4b69-9e97-e74090fd31e7 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1513 microversion: 2.1 time: 0.154018 May 10 02:58:54.076445 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3184/6408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:53 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:55.094351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:55.095094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:55.102215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:55.102678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:55.103496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:55.103947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:55.239905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff33500c704120aa7fe97cf4a7239d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf829d11fdba4e38a1a249a0510425ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:58:55.247997 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-846fd8a7-fe0d-4cba-9bbd-1f3b55017139 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 200 len: 1513 microversion: 2.1 time: 0.157954 May 10 02:58:55.248567 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3225/6409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:55 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:58:55.824155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-757698e6-fed5-4585-871f-abbb57e6c8ef req-560b081e-d844-44e9-beec-08b1cf4ca4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ede18e4-1b47-4159-b680-1f81d289f7ae", "name": "network-vif-deleted", "tag": "b0d906e1-7d17-4f53-99d6-6fc8639d42af"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:58:55.833211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-757698e6-fed5-4585-871f-abbb57e6c8ef req-560b081e-d844-44e9-beec-08b1cf4ca4f2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:55.833671 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-757698e6-fed5-4585-871f-abbb57e6c8ef req-560b081e-d844-44e9-beec-08b1cf4ca4f2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:55.844898 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-757698e6-fed5-4585-871f-abbb57e6c8ef req-560b081e-d844-44e9-beec-08b1cf4ca4f2 service nova] Creating event network-vif-deleted:b0d906e1-7d17-4f53-99d6-6fc8639d42af for instance 4ede18e4-1b47-4159-b680-1f81d289f7ae on n-h1-841089-2 May 10 02:58:55.850582 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-757698e6-fed5-4585-871f-abbb57e6c8ef req-560b081e-d844-44e9-beec-08b1cf4ca4f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 May 10 02:58:55.851199 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3185/6410] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:58:56.266557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:58:56.268039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] [instance: 4ede18e4-1b47-4159-b680-1f81d289f7ae] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:58:56.274957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:56.275448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:56.276252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:58:56.276703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:58:56.292738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] HTTP exception thrown: Instance 4ede18e4-1b47-4159-b680-1f81d289f7ae could not be found. May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Request method failure captured: May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae HTTP/1.1 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedQfsN_LS2iTqgIm1RQykgvtcMwXa0cpmhBLJAHmaosBTFKFD7IZk9rliHTlMX_Q8-DsiLBG9JZslJBbPMTeHZIRQph982m-loRD9zfw1hPRseYYmFN6_q7PCoYGhBPLg9XlLtTPLwm_OjO63t3XXyP-kCPTAdH2isXIV6JP9_GUOzc May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: bf829d11fdba4e38a1a249a0510425ef May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-232638109 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf829d11fdba4e38a1a249a0510425ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf829d11fdba4e38a1a249a0510425ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf829d11fdba4e38a1a249a0510425ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf829d11fdba4e38a1a249a0510425ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-VolumesSnapshotTestJSON-232638109 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: bf829d11fdba4e38a1a249a0510425ef May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-232638109 May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-VolumesSnapshotTestJSON-232638109-project May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 4dff33500c704120aa7fe97cf4a7239d May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-VolumesSnapshotTestJSON-232638109-project May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4ede18e4-1b47-4159-b680-1f81d289f7ae could not be found. May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4ede18e4-1b47-4159-b680-1f81d289f7ae'} May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ede18e4-1b47-4159-b680-1f81d289f7ae could not be found. May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ede18e4-1b47-4159-b680-1f81d289f7ae could not be found. May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 02:58:56.294380 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ede18e4-1b47-4159-b680-1f81d289f7ae could not be found. May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] Returning 404 to user: Instance 4ede18e4-1b47-4159-b680-1f81d289f7ae could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-11f99a6a-e1b9-490d-8de8-6056e7f3bda1 tempest-VolumesSnapshotTestJSON-232638109 tempest-VolumesSnapshotTestJSON-232638109-project] 10.222.0.52 "GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae" status: 404 len: 111 microversion: 2.1 time: 0.034451 May 10 02:58:56.299034 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3226/6411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:58:56 2022] GET /compute/v2.1/servers/4ede18e4-1b47-4159-b680-1f81d289f7ae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 02:59:32.860762 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 02:59:32.861316 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 02:59:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 02:59:33.312357 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 02:59:33.312930 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 02:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 02:59:37.450122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-460918930", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1101334833", "security_groups": [{"name": "tempest-secgroup-smoke-1192332852"}], "block_device_mapping_v2": [{"uuid": "5af01cab-e667-407b-86ee-50bd673667bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c11b85c5-6022-43e7-8055-c7b69d3be298"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:59:37.570538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] validate_networks() for [('c11b85c5-6022-43e7-8055-c7b69d3be298', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 02:59:37.973589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 02:59:37.974485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 02:59:37.975749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 02:59:37.978653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 02:59:37.979587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 02:59:37.989572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:37.990140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:37.991104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:37.991615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:38.009339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 02:59:38.015035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Getting quotas for user edbf98553e694f8da09fcdb473da56df and project f4bfef102a3e4c3080219c1324aebea2. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 02:59:38.083621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 02:59:38.086542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5af01cab-e667-407b-86ee-50bd673667bc',volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 02:59:38.225790 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b3e47ba-5444-4443-a251-3674268c6f6b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780061 May 10 02:59:38.227277 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3186/6412] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 02:59:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 02:59:38.236654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e1ed18c5-99ca-49f2-8010-2a1e316152e6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:38.237990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e1ed18c5-99ca-49f2-8010-2a1e316152e6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:38.326337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e1ed18c5-99ca-49f2-8010-2a1e316152e6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:38.338358 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e1ed18c5-99ca-49f2-8010-2a1e316152e6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1094 microversion: 2.1 time: 0.104272 May 10 02:59:38.349267 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3227/6413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:38 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:39.359728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:39.360483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:39.373264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:39.373747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:39.374712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:39.375516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:39.447686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:39.460361 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-72d02da2-5f5b-489b-9e15-9686e9678295 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1210 microversion: 2.1 time: 0.104711 May 10 02:59:39.470593 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3187/6414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:39 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:40.478549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:40.479333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:40.487600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:40.488075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:40.488868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:40.489319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:40.681817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:40.695700 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-199ed106-ef45-4d07-b00f-c2eb193815e5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.220017 May 10 02:59:40.697852 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3228/6415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:40 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:40.731038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8d878984-7675-4ac0-b8c9-3e7d57891b6c req-f8c2823a-11de-4c39-ad96-322dc25c70ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2a5e64-2799-43d3-a6ed-7bd7ce689946", "tag": "03c387cf-8d1a-4e03-af15-758721615630"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 02:59:40.755029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8d878984-7675-4ac0-b8c9-3e7d57891b6c req-f8c2823a-11de-4c39-ad96-322dc25c70ac service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:40.755538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8d878984-7675-4ac0-b8c9-3e7d57891b6c req-f8c2823a-11de-4c39-ad96-322dc25c70ac service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:40.782572 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8d878984-7675-4ac0-b8c9-3e7d57891b6c req-f8c2823a-11de-4c39-ad96-322dc25c70ac service nova] Creating event network-changed:03c387cf-8d1a-4e03-af15-758721615630 for instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 on n-h1-841089-2 May 10 02:59:40.792932 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8d878984-7675-4ac0-b8c9-3e7d57891b6c req-f8c2823a-11de-4c39-ad96-322dc25c70ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072151 May 10 02:59:40.794114 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3188/6416] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 02:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 02:59:41.714232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:41.715720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:41.727563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:41.728210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:41.729329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:41.730440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:41.883155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:41.891974 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69faf080-90ce-4eb9-bb4d-d3cf52e1dc0f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.181530 May 10 02:59:41.894348 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3229/6417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:41 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:42.913220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:42.913924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:42.920279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:42.920827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:42.921933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:42.922457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:43.057510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:43.065888 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b91ae26a-94b3-4577-9f8e-5fd26920493b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.158340 May 10 02:59:43.066772 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3189/6418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:42 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:44.083572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:44.084421 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:44.091627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:44.092089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:44.092881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:44.093327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:44.237423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:44.246264 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e33035df-7ee3-4a3a-8f85-29c4d0ab28d1 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.166889 May 10 02:59:44.246886 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3230/6419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:44 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:45.277423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:45.279357 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:45.294037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:45.295656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:45.297180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:45.297870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:45.468924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:45.478556 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c36d7dd-37e4-46e2-9254-553c4100cc12 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.218609 May 10 02:59:45.488527 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3190/6420] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:45 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:46.502807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:46.503472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:46.512734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:46.513208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:46.514000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:46.514453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:46.677808 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:46.686437 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d5106a39-d6c5-47f1-8a04-f5d5fde88d56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.194660 May 10 02:59:46.687114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3231/6421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:46 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:47.704758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:47.705424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:47.713234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:47.713692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:47.714482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:47.714935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:47.871602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:47.881900 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-556b91ac-6d03-431a-a6db-3492dda9578a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.180845 May 10 02:59:47.884644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3191/6422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:47 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 02:59:48.900759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:48.902055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:48.909477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:48.910015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:48.911431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:48.912133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:49.063043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:49.072517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9c9c5f92-ffde-4d1c-b958-0b4dbcf24bf0 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.176230 May 10 02:59:49.073201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3232/6423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:48 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:50.091761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:50.092849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:50.102795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:50.103351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:50.104437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:50.104898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:50.250627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:50.258313 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac61c495-4e5b-4a34-970a-e093c076c0d5 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1278 microversion: 2.1 time: 0.171863 May 10 02:59:50.263104 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3192/6424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:50 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:51.276349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:51.276970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:51.283828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:51.284293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:51.285082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:51.285535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:51.421059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:51.429454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dc7c00f6-17e1-40b8-8e26-b015525f33fd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.157076 May 10 02:59:51.430037 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3233/6425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:51 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:52.447711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:52.448635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:52.455894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:52.456715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:52.457765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:52.458634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:52.644625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:52.654205 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e8dc5617-ae28-4c4d-b0ca-630de1192a25 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.212289 May 10 02:59:52.654894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3193/6426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:52 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:53.671223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:53.672098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:53.679766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:53.680226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:53.681015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:53.681466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:53.819777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:53.828684 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ab8d4d16-66fe-496f-974e-e2b7878a2b27 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.161283 May 10 02:59:53.829305 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3234/6427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:53 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:54.845882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:54.846654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:54.854195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:54.854667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:54.855495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:54.855953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:54.998914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:55.007338 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac6caad8-00d5-444e-a90e-4dee3a64eb08 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.165272 May 10 02:59:55.007946 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3194/6428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:54 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:56.025528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:56.026193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:56.033566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:56.034031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:56.034833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:56.035308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:56.172953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:56.180608 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c972d542-9da0-4ace-88ef-372fa8ffeab3 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.160056 May 10 02:59:56.181196 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3235/6429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:56 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:57.197316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:57.197948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:57.204752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:57.205225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:57.206015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:57.206566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:57.345980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:57.355641 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf55aa56-5162-4d4c-83f0-f46ce7d8c399 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.161981 May 10 02:59:57.356337 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3195/6430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:57 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:58.373652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:58.374288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:58.383166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:58.383636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:58.384440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:58.384887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:58.569843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:58.578538 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61879433-713c-467c-9cb3-7a1ce858c5ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.208653 May 10 02:59:58.579476 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3236/6431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:58 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 02:59:59.595945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 02:59:59.596680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 02:59:59.603842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:59.604381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:59.605197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 02:59:59.605669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 02:59:59.750359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 02:59:59.759097 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0896429-26a5-4e54-8030-516c6fd9d163 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.167000 May 10 02:59:59.759716 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3196/6432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 02:59:59 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:00.546174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9dd22594-0107-4445-9c66-570928e38da0 req-2effccd5-90ea-4d70-a657-22e32a07b694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2a5e64-2799-43d3-a6ed-7bd7ce689946", "name": "network-vif-plugged", "status": "completed", "tag": "03c387cf-8d1a-4e03-af15-758721615630"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:00:00.557237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9dd22594-0107-4445-9c66-570928e38da0 req-2effccd5-90ea-4d70-a657-22e32a07b694 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:00.557816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9dd22594-0107-4445-9c66-570928e38da0 req-2effccd5-90ea-4d70-a657-22e32a07b694 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:00.570936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9dd22594-0107-4445-9c66-570928e38da0 req-2effccd5-90ea-4d70-a657-22e32a07b694 service nova] Creating event network-vif-plugged:03c387cf-8d1a-4e03-af15-758721615630 for instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 on n-h1-841089-2 May 10 03:00:00.579517 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9dd22594-0107-4445-9c66-570928e38da0 req-2effccd5-90ea-4d70-a657-22e32a07b694 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037102 May 10 03:00:00.580209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3237/6433] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:00:00.776338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:00.777008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:00.783803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:00.784311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:00.785113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:00.785560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:00.922311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:00:00.930453 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5be2a982-45ca-4e09-94ab-4a1121b5de5b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1266 microversion: 2.1 time: 0.158203 May 10 03:00:00.931029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3197/6434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:00 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:01.948606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:01.949312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:01.955981 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:01.956612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:01.957409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:01.957859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:02.095939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:00:02.105834 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a95f285-51d2-4a07-8cd7-086ddf9a4139 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1452 microversion: 2.1 time: 0.162350 May 10 03:00:02.106464 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3238/6435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:01 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:02.123276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:02.123918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:02.131148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:02.131632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:02.132429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:02.132888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:02.275666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:00:02.284299 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-32dc99c3-704b-4eab-8262-90157ce4f37a tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1452 microversion: 2.1 time: 0.165576 May 10 03:00:02.284901 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3198/6436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:02 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:00:04.014367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-24e4d93b-7bd2-490f-b06b-2e72045ef7d8 req-25503411-95b5-47f9-955c-8e852bbb0039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2a5e64-2799-43d3-a6ed-7bd7ce689946", "tag": "03c387cf-8d1a-4e03-af15-758721615630"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:00:04.029128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-24e4d93b-7bd2-490f-b06b-2e72045ef7d8 req-25503411-95b5-47f9-955c-8e852bbb0039 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:04.029596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-24e4d93b-7bd2-490f-b06b-2e72045ef7d8 req-25503411-95b5-47f9-955c-8e852bbb0039 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:04.048238 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-24e4d93b-7bd2-490f-b06b-2e72045ef7d8 req-25503411-95b5-47f9-955c-8e852bbb0039 service nova] Creating event network-changed:03c387cf-8d1a-4e03-af15-758721615630 for instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 on n-h1-841089-2 May 10 03:00:04.055744 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-24e4d93b-7bd2-490f-b06b-2e72045ef7d8 req-25503411-95b5-47f9-955c-8e852bbb0039 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044434 May 10 03:00:04.057213 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3239/6437] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:00:45.361902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-21c3972c-6f4a-4839-8378-9da283de406f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:45.362809 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:00:45.362809 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 03:00:45.363981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21c3972c-6f4a-4839-8378-9da283de406f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:45.364450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21c3972c-6f4a-4839-8378-9da283de406f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:45.365291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21c3972c-6f4a-4839-8378-9da283de406f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:45.365795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21c3972c-6f4a-4839-8378-9da283de406f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:45.390233 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-21c3972c-6f4a-4839-8378-9da283de406f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.175670 May 10 03:00:45.399188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3199/6438] 10.222.0.52 () {58 vars in 1184 bytes} [Tue May 10 03:00:45 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:00:45.597117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-719257219", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "availability_zone": "nova:n-h1-841089-2", "networks": [{"uuid": "65b1143c-3997-440c-b057-744e55b0a561"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:00:45.680133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] validate_networks() for [('65b1143c-3997-440c-b057-744e55b0a561', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:00:46.111463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:00:46.112200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:00:46.112697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:00:46.113118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:00:46.113547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:00:46.124878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:46.125379 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:46.126228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:46.126679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:46.148929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Getting quotas for project 8578641ea67141528c200f7e2d9a3346. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:00:46.154772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Getting quotas for user 886a185d4be7409daa5ab7958f5dc9c4 and project 8578641ea67141528c200f7e2d9a3346. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:00:46.168592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:00:46.171423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:00:46.231452 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [2578d95e-c7ef-4672-bb3b-885ad1afb475] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:00:47.239287 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [2578d95e-c7ef-4672-bb3b-885ad1afb475] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 51248. May 10 03:00:47.244296 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e3d2d60-bdbe-4821-a81c-edfd4649d57e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.651649 May 10 03:00:47.245340 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3240/6439] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:00:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:00:47.255137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b84711d2-18fd-42a2-89f9-828fa12d5911 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:47.256307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b84711d2-18fd-42a2-89f9-828fa12d5911 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:47.321874 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b84711d2-18fd-42a2-89f9-828fa12d5911 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1328 microversion: 2.1 time: 0.070625 May 10 03:00:47.322469 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3200/6440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:47 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1328 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:00:48.345982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:48.348346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:48.363737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:48.364422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:48.365613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:48.366560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:48.455463 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f90ec07c-7840-4fbc-96c4-0628347d4905 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1415 microversion: 2.1 time: 0.120293 May 10 03:00:48.456076 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3241/6441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:48 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1415 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:49.476254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:49.477374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:49.492382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:49.492916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:49.494624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:49.494624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:49.629895 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-217bbcde-c43a-4772-a100-8656b69cdbcd tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.159983 May 10 03:00:49.630644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3201/6442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:49 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:50.345255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-56465683-9df4-47c4-89ec-e0d589a5d788 req-65dc3f7b-02b0-427f-87bb-f8fefb8f749b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fc677b-07b0-44c6-9eb3-40ef2c9e2663", "tag": "5b8827cc-d321-41b9-a95a-9a10be5049bc"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:00:50.355195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-56465683-9df4-47c4-89ec-e0d589a5d788 req-65dc3f7b-02b0-427f-87bb-f8fefb8f749b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:50.355663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-56465683-9df4-47c4-89ec-e0d589a5d788 req-65dc3f7b-02b0-427f-87bb-f8fefb8f749b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:50.392111 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-56465683-9df4-47c4-89ec-e0d589a5d788 req-65dc3f7b-02b0-427f-87bb-f8fefb8f749b service nova] Creating event network-changed:5b8827cc-d321-41b9-a95a-9a10be5049bc for instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 on n-h1-841089-2 May 10 03:00:50.400954 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-56465683-9df4-47c4-89ec-e0d589a5d788 req-65dc3f7b-02b0-427f-87bb-f8fefb8f749b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154597 May 10 03:00:50.401887 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3242/6443] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:00:50.648196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:50.649444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:50.656347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:50.657100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:50.658039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:50.658589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:50.794046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-088d7afb-1800-4ed3-929f-33ce567ea0b7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.150251 May 10 03:00:50.794644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3202/6444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:50 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:51.812314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:51.813025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:51.819766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:51.820221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:51.821051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:51.821493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:51.948853 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b9eb1438-c37a-4b14-9992-b458e8c00a8b tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.141332 May 10 03:00:51.950206 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3243/6445] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:51 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:52.966233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:52.966872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:52.974046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:52.974524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:52.975354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:52.975818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:53.103020 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9566e0bd-68f7-46fc-b075-7ca1c16aa512 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.140477 May 10 03:00:53.103643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3203/6446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:52 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:54.119841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:54.120461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:54.127212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:54.127672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:54.128440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:54.128878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:54.249287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-162bde1a-9cb9-4bb5-a40a-d069335ba695 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.133200 May 10 03:00:54.249863 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3244/6447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:54 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:55.266869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:55.267570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:55.274907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:55.275411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:55.276213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:55.276675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:55.406516 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aa780ed4-d840-4725-ad6e-c26d97e53b6d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.143307 May 10 03:00:55.407116 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3204/6448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:55 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:56.424318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:56.424914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:56.432582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:56.433039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:56.433819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:56.434263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:56.562139 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f355bf3b-3696-437b-af01-03693d36d36a tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.141809 May 10 03:00:56.562916 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3245/6449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:56 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:56.900110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-009bdf93-802b-4360-94e6-0681ef1cf34c req-683aa1e7-fff4-495a-9182-7aed3dd3c828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fc677b-07b0-44c6-9eb3-40ef2c9e2663", "name": "network-vif-plugged", "status": "completed", "tag": "5b8827cc-d321-41b9-a95a-9a10be5049bc"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:00:56.909035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-009bdf93-802b-4360-94e6-0681ef1cf34c req-683aa1e7-fff4-495a-9182-7aed3dd3c828 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:56.909615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-009bdf93-802b-4360-94e6-0681ef1cf34c req-683aa1e7-fff4-495a-9182-7aed3dd3c828 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:56.923279 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-009bdf93-802b-4360-94e6-0681ef1cf34c req-683aa1e7-fff4-495a-9182-7aed3dd3c828 service nova] Creating event network-vif-plugged:5b8827cc-d321-41b9-a95a-9a10be5049bc for instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 on n-h1-841089-2 May 10 03:00:56.928667 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-009bdf93-802b-4360-94e6-0681ef1cf34c req-683aa1e7-fff4-495a-9182-7aed3dd3c828 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032879 May 10 03:00:56.929274 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3205/6450] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:00:57.578717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:57.579370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:57.586243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:57.586702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:57.587518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:57.587971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:57.711776 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3e32728-e69b-4066-8635-9bf23033f5cc tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1463 microversion: 2.1 time: 0.136687 May 10 03:00:57.712355 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3246/6451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:57 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1463 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:58.729634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:58.730358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:58.736690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:58.737166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:58.737963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:58.738429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:58.865835 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71a4f2df-ac0b-46bf-b5f1-6a2aa038b68e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1647 microversion: 2.1 time: 0.140977 May 10 03:00:58.866474 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3206/6452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:58 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1647 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:58.882173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:58.882798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:58.889907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:58.890376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:58.891248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:58.891640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:59.017108 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8634ba89-0912-45cd-8393-948d58206366 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1647 microversion: 2.1 time: 0.139107 May 10 03:00:59.017707 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3247/6453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:58 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1647 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:59.032709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:59.033455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:59.039434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:59.039907 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:59.040699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:59.041190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:59.165242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44b1cd28-e203-413b-aba3-5b2fb7d57644 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1647 microversion: 2.1 time: 0.136130 May 10 03:00:59.165821 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3207/6454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:59 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1647 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:00:59.217594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1955315399", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "availability_zone": "nova:n-h2-841089-2", "networks": [{"uuid": "65b1143c-3997-440c-b057-744e55b0a561"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:00:59.270670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] validate_networks() for [('65b1143c-3997-440c-b057-744e55b0a561', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:00:59.604975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:00:59.605404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:00:59.605934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:00:59.606369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:00:59.606784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:00:59.616046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:59.617083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:59.617897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:00:59.618334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:00:59.634546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Getting quotas for project 8578641ea67141528c200f7e2d9a3346. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:00:59.639838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Getting quotas for user 886a185d4be7409daa5ab7958f5dc9c4 and project 8578641ea67141528c200f7e2d9a3346. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:00:59.652023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:00:59.654318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:00:59.698144 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c12dfa4b-be3f-4967-8a2a-3a8db33e1d9d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484232 May 10 03:00:59.698733 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3248/6455] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:00:59.711847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e0576c2-a84b-44f7-b419-5eb13627d74d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:00:59.712477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e0576c2-a84b-44f7-b419-5eb13627d74d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:00:59.776918 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e0576c2-a84b-44f7-b419-5eb13627d74d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1329 microversion: 2.1 time: 0.069630 May 10 03:00:59.777507 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3208/6456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:00:59 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1329 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:00.795583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:00.796403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:00.802952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:00.804255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:00.805126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:00.805670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:00.889003 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f9a53a40-1cd2-4633-a762-6af43b61ffc0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1424 microversion: 2.1 time: 0.098722 May 10 03:01:00.889607 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3249/6457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:00 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:01.905496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:01.906135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:01.914023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:01.914503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:01.915863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:01.915863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:02.083857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b171fbb4-2431-4a59-bcbe-6aad92ff5510 req-a296bd06-95b3-4caa-9c2b-e54ef24c27ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc06a73a-20e8-4406-9029-2ecc70bbcbcd", "tag": "6f7e755b-e539-42bc-9e7a-2c0449aab941"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:02.093326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b171fbb4-2431-4a59-bcbe-6aad92ff5510 req-a296bd06-95b3-4caa-9c2b-e54ef24c27ee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:02.093880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b171fbb4-2431-4a59-bcbe-6aad92ff5510 req-a296bd06-95b3-4caa-9c2b-e54ef24c27ee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:02.110026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b171fbb4-2431-4a59-bcbe-6aad92ff5510 req-a296bd06-95b3-4caa-9c2b-e54ef24c27ee service nova] Creating event network-changed:6f7e755b-e539-42bc-9e7a-2c0449aab941 for instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd on n-h2-841089-2 May 10 03:01:02.121930 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b171fbb4-2431-4a59-bcbe-6aad92ff5510 req-a296bd06-95b3-4caa-9c2b-e54ef24c27ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127665 May 10 03:01:02.122608 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3250/6458] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:02.155009 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d3a7a92c-6ab2-474d-a6ac-3ff21c40d7c4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.253032 May 10 03:01:02.158930 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3209/6459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:01 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:03.174444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:03.175211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:03.182825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:03.183331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:03.184154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:03.184601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:03.313545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb54c78b-0357-44e4-ba84-e8b375be8c2d tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.144323 May 10 03:01:03.314129 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3251/6460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:03 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:04.330792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:04.331486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:04.338500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:04.338972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:04.339804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:04.340260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:04.468966 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02fc95c4-a437-4a33-a6ba-31ed401b5703 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.142532 May 10 03:01:04.469785 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3210/6461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:04 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:05.486682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:05.487339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:05.494349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:05.494818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:05.495659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:05.496114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:05.623165 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-091e5061-795c-4aab-aa90-af9227a1e8f7 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.140338 May 10 03:01:05.623955 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3252/6462] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:05 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:06.640375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:06.641051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:06.648479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:06.648953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:06.649744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:06.650205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:06.774269 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-046c28fa-4f93-4da5-bded-391bc9932864 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.137664 May 10 03:01:06.774852 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3211/6463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:06 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:07.773144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-558b50bd-e44d-487a-8950-d4826b10a867 req-4980aea6-3fb8-4624-8d5e-3074d437e9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc06a73a-20e8-4406-9029-2ecc70bbcbcd", "name": "network-vif-plugged", "status": "completed", "tag": "6f7e755b-e539-42bc-9e7a-2c0449aab941"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:07.782523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-558b50bd-e44d-487a-8950-d4826b10a867 req-4980aea6-3fb8-4624-8d5e-3074d437e9a9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:07.782995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-558b50bd-e44d-487a-8950-d4826b10a867 req-4980aea6-3fb8-4624-8d5e-3074d437e9a9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:07.791536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:07.792922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:07.794311 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-558b50bd-e44d-487a-8950-d4826b10a867 req-4980aea6-3fb8-4624-8d5e-3074d437e9a9 service nova] Creating event network-vif-plugged:6f7e755b-e539-42bc-9e7a-2c0449aab941 for instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd on n-h2-841089-2 May 10 03:01:07.799676 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-558b50bd-e44d-487a-8950-d4826b10a867 req-4980aea6-3fb8-4624-8d5e-3074d437e9a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030567 May 10 03:01:07.800477 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3253/6464] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:07.801195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:07.801708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:07.802634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:07.803263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:07.974537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6adee79-49de-42dc-8f55-5eeda82e6902 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.186956 May 10 03:01:07.975152 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3212/6465] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:07 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:08.993079 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:08.993801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:09.000164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:09.000633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:09.001419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:09.001871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:09.130119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-853b1723-7391-4a3d-99bc-52c1045978f4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1464 microversion: 2.1 time: 0.142186 May 10 03:01:09.130695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3254/6466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:08 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:10.146630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:10.147932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:10.154786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.155290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.156066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.156516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.280571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-06992f84-edf9-468c-8e72-68311b4180f9 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1648 microversion: 2.1 time: 0.137518 May 10 03:01:10.281149 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3213/6467] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:10 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1648 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:10.296139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:10.296753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:10.304167 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.304620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.305388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.305826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.429628 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-030de034-1226-4ed5-801a-09a3551f0575 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1648 microversion: 2.1 time: 0.137059 May 10 03:01:10.430210 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3255/6468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:10 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1648 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:10.445791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:10.446431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:10.452511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.452971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.453777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.454228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.577764 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23819d61-123b-4828-a0b2-85b308871068 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1648 microversion: 2.1 time: 0.136379 May 10 03:01:10.578346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3214/6469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:10 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1648 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:10.594378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:10.594888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:10.600777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.601228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.601996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.602434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.625651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:01:10.698726 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-556d2b8c-41f5-44dc-a4a0-98b67234dc09 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 204 len: 0 microversion: 2.1 time: 0.107645 May 10 03:01:10.699251 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3256/6470] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:01:10 2022] DELETE /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:01:10.707793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:10.708428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:10.715091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.715576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.716362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:10.716820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:10.838448 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac605503-4e63-41bd-a8c1-87cf81e9a11f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1654 microversion: 2.1 time: 0.134545 May 10 03:01:10.839060 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3215/6471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:10 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1654 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:11.856492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:11.857218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:11.864080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:11.864547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:11.865327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:11.865777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:11.989039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-edcf73e4-9a39-4d8f-88ac-42666ff2848e tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1654 microversion: 2.1 time: 0.136629 May 10 03:01:11.989620 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3257/6472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:11 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1654 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:12.520611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4d49bcad-2ed4-4750-b76c-c9dc4191e435 req-d73ac123-2a92-4cd3-acbe-0bf39ab29af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc06a73a-20e8-4406-9029-2ecc70bbcbcd", "name": "network-vif-deleted", "tag": "6f7e755b-e539-42bc-9e7a-2c0449aab941"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:12.531312 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4d49bcad-2ed4-4750-b76c-c9dc4191e435 req-d73ac123-2a92-4cd3-acbe-0bf39ab29af2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:12.531775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4d49bcad-2ed4-4750-b76c-c9dc4191e435 req-d73ac123-2a92-4cd3-acbe-0bf39ab29af2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:12.552375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4d49bcad-2ed4-4750-b76c-c9dc4191e435 req-d73ac123-2a92-4cd3-acbe-0bf39ab29af2 service nova] Creating event network-vif-deleted:6f7e755b-e539-42bc-9e7a-2c0449aab941 for instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd on n-h2-841089-2 May 10 03:01:12.562305 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4d49bcad-2ed4-4750-b76c-c9dc4191e435 req-d73ac123-2a92-4cd3-acbe-0bf39ab29af2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045930 May 10 03:01:12.563273 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3216/6473] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:13.005479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:13.006104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:13.013410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:13.013870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:13.014655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:13.015126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:13.048183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:13.048632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:13.049360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lazy-loading 'fault' on Instance uuid fc06a73a-20e8-4406-9029-2ecc70bbcbcd {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:01:13.098860 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76184e47-0590-4ce2-85ea-5b2be084d0a1 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 200 len: 1454 microversion: 2.1 time: 0.097023 May 10 03:01:13.099506 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3258/6474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:13 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:14.117507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:14.118226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: fc06a73a-20e8-4406-9029-2ecc70bbcbcd] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:14.124511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:14.124980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:14.125762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:14.126220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:14.139718 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] HTTP exception thrown: Instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd could not be found. May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Request method failure captured: May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd HTTP/1.1 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedVdQbNFqfYJ69H-XQvO63zEbdtUYZrizP6q3sasAQntURnaq1W-8T-TvP55LnW37kEyNAVJRrpaQiVLOk-032nQ6qkjGDA23WzJIpNMdnLjHbapMrHC8X1VgPY4wUK9DUAGioFEzWKl2Wg3og__XvqCyb15oE8nKfNcVgAW6J6_GUE May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 8578641ea67141528c200f7e2d9a3346 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestServerMultinode-906545448 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8578641ea67141528c200f7e2d9a3346", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8578641ea67141528c200f7e2d9a3346"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8578641ea67141528c200f7e2d9a3346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8578641ea67141528c200f7e2d9a3346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestServerMultinode-906545448 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 8578641ea67141528c200f7e2d9a3346 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestServerMultinode-906545448 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestServerMultinode-906545448-project-admin May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 886a185d4be7409daa5ab7958f5dc9c4 May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestServerMultinode-906545448-project-admin May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd could not be found. May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fc06a73a-20e8-4406-9029-2ecc70bbcbcd'} May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd could not be found. May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd could not be found. May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:01:14.141337 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd could not be found. May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Returning 404 to user: Instance fc06a73a-20e8-4406-9029-2ecc70bbcbcd could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4078b9b4-397b-4820-86ff-3fea99e66dfe tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd" status: 404 len: 111 microversion: 2.1 time: 0.030707 May 10 03:01:14.146324 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3217/6475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:14 2022] GET /compute/v2.1/servers/fc06a73a-20e8-4406-9029-2ecc70bbcbcd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:01:14.152027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:14.152540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:14.159317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:14.159788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:14.160566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:14.161047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:14.186757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:01:14.258103 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-641373e3-9442-43df-91e4-7a90b1ba7fc4 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 204 len: 0 microversion: 2.1 time: 0.109514 May 10 03:01:14.258701 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3259/6476] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:01:14 2022] DELETE /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:01:14.267259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:14.267894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:14.273878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:14.274347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:14.275148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:14.275605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:14.400833 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8fd8c5e1-8198-4cc1-a59a-29c161a5ddca tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1653 microversion: 2.1 time: 0.137373 May 10 03:01:14.401404 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3218/6477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:14 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1653 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:15.418249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:15.418971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:15.425963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:15.426430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:15.427238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:15.427688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:15.552589 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb62b157-4f76-43b1-8a1f-8eedf9ef2ed0 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1653 microversion: 2.1 time: 0.138413 May 10 03:01:15.553164 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3260/6478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:15 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1653 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:16.355871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3be23b3e-0f2e-44fb-bb1b-ad2bc19a2b4a req-e57ad3a4-bce0-4ce5-a0cc-5355edcb9c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fc677b-07b0-44c6-9eb3-40ef2c9e2663", "name": "network-vif-deleted", "tag": "5b8827cc-d321-41b9-a95a-9a10be5049bc"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:16.365979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3be23b3e-0f2e-44fb-bb1b-ad2bc19a2b4a req-e57ad3a4-bce0-4ce5-a0cc-5355edcb9c18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:16.367125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3be23b3e-0f2e-44fb-bb1b-ad2bc19a2b4a req-e57ad3a4-bce0-4ce5-a0cc-5355edcb9c18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:16.381202 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3be23b3e-0f2e-44fb-bb1b-ad2bc19a2b4a req-e57ad3a4-bce0-4ce5-a0cc-5355edcb9c18 service nova] Creating event network-vif-deleted:5b8827cc-d321-41b9-a95a-9a10be5049bc for instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 on n-h1-841089-2 May 10 03:01:16.386803 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3be23b3e-0f2e-44fb-bb1b-ad2bc19a2b4a req-e57ad3a4-bce0-4ce5-a0cc-5355edcb9c18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 May 10 03:01:16.387530 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3219/6479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:16.571164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:16.571735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:16.578340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:16.578803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:16.579639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:16.580090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:16.610844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:16.611336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:16.611811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lazy-loading 'fault' on Instance uuid c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:01:16.659245 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6c239ba4-1ba6-4c05-b7b4-d1eb5c74386f tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 200 len: 1453 microversion: 2.1 time: 0.092306 May 10 03:01:16.659821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3261/6480] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:16 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:17.677834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:17.679170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] [instance: c1fc677b-07b0-44c6-9eb3-40ef2c9e2663] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:17.685293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:17.685759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:17.686542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:17.686995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:17.700366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] HTTP exception thrown: Instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 could not be found. May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Request method failure captured: May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 HTTP/1.1 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedVdQbNFqfYJ69H-XQvO63zEbdtUYZrizP6q3sasAQntURnaq1W-8T-TvP55LnW37kEyNAVJRrpaQiVLOk-032nQ6qkjGDA23WzJIpNMdnLjHbapMrHC8X1VgPY4wUK9DUAGioFEzWKl2Wg3og__XvqCyb15oE8nKfNcVgAW6J6_GUE May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 8578641ea67141528c200f7e2d9a3346 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestServerMultinode-906545448 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8578641ea67141528c200f7e2d9a3346", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8578641ea67141528c200f7e2d9a3346"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8578641ea67141528c200f7e2d9a3346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8578641ea67141528c200f7e2d9a3346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestServerMultinode-906545448 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 8578641ea67141528c200f7e2d9a3346 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestServerMultinode-906545448 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestServerMultinode-906545448-project-admin May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 886a185d4be7409daa5ab7958f5dc9c4 May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestServerMultinode-906545448-project-admin May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 could not be found. May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'c1fc677b-07b0-44c6-9eb3-40ef2c9e2663'} May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 could not be found. May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 could not be found. May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:01:17.701993 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 could not be found. May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] Returning 404 to user: Instance c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-382b42ee-6315-4227-9246-70f0336fd816 tempest-TestServerMultinode-906545448 tempest-TestServerMultinode-906545448-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663" status: 404 len: 111 microversion: 2.1 time: 0.030822 May 10 03:01:17.706075 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3220/6481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:17 2022] GET /compute/v2.1/servers/c1fc677b-07b0-44c6-9eb3-40ef2c9e2663 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:01:32.993957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:32.999962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2b34a94a-d1c3-421c-9fab-f0c239e988e2 req-a3b14a3f-d34b-4eb6-ae3c-103f8cb65f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2a5e64-2799-43d3-a6ed-7bd7ce689946", "tag": "03c387cf-8d1a-4e03-af15-758721615630"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:33.004264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:33.017765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:33.018515 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:33.019669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:33.020326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:33.026384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2b34a94a-d1c3-421c-9fab-f0c239e988e2 req-a3b14a3f-d34b-4eb6-ae3c-103f8cb65f79 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:33.027190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2b34a94a-d1c3-421c-9fab-f0c239e988e2 req-a3b14a3f-d34b-4eb6-ae3c-103f8cb65f79 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:33.050514 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2b34a94a-d1c3-421c-9fab-f0c239e988e2 req-a3b14a3f-d34b-4eb6-ae3c-103f8cb65f79 service nova] Creating event network-changed:03c387cf-8d1a-4e03-af15-758721615630 for instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 on n-h1-841089-2 May 10 03:01:33.059287 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2b34a94a-d1c3-421c-9fab-f0c239e988e2 req-a3b14a3f-d34b-4eb6-ae3c-103f8cb65f79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062877 May 10 03:01:33.060457 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3221/6482] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:33.062641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:01:33.166285 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bfbc619d-f262-4430-96f7-481af1732ebe tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 204 len: 0 microversion: 2.1 time: 0.175724 May 10 03:01:33.170299 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3262/6483] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:01:32 2022] DELETE /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:01:33.179227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:33.180864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:33.192247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:33.193073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:33.194684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:33.195826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:33.428615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:33.445529 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7876a93f-2add-48bd-8c21-bfd9f765d227 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1577 microversion: 2.1 time: 0.271971 May 10 03:01:33.451750 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3222/6484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:33 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:34.470642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:34.471398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:34.478672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:34.479228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:34.480023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:34.480480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:34.871482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:34.882336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c7c9ac1-c0bf-4976-bda8-fab57cd8d3bf tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1577 microversion: 2.1 time: 0.415565 May 10 03:01:34.883258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3263/6485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:34 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1577 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:35.810351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a033555f-8d05-4d32-941b-859448833bb3 req-0ce87b76-d115-4278-972a-237eb21c659f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2a5e64-2799-43d3-a6ed-7bd7ce689946", "name": "network-vif-deleted", "tag": "03c387cf-8d1a-4e03-af15-758721615630"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:35.819167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a033555f-8d05-4d32-941b-859448833bb3 req-0ce87b76-d115-4278-972a-237eb21c659f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:35.819962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a033555f-8d05-4d32-941b-859448833bb3 req-0ce87b76-d115-4278-972a-237eb21c659f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:35.832709 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a033555f-8d05-4d32-941b-859448833bb3 req-0ce87b76-d115-4278-972a-237eb21c659f service nova] Creating event network-vif-deleted:03c387cf-8d1a-4e03-af15-758721615630 for instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 on n-h1-841089-2 May 10 03:01:35.838293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a033555f-8d05-4d32-941b-859448833bb3 req-0ce87b76-d115-4278-972a-237eb21c659f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 May 10 03:01:35.839012 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3223/6486] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:35.900514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:35.901205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:35.908773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:35.909238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:35.910035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:35.910676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:36.030131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:36.043863 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1aec2ab7-fdbd-4a53-a97e-3353502ed979 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.148081 May 10 03:01:36.053563 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3264/6487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:35 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:37.062289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:37.063033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:37.070570 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:37.071051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:37.071928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:37.072369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:37.344282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:37.354648 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-35b7f0b5-9cbc-4f86-9fb5-95f1543f3fce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.296745 May 10 03:01:37.364106 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3224/6488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:37 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:38.371932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:38.372560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:38.379463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:38.379929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:38.380721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:38.381202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:38.447226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:38.456658 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6076a790-30a5-4d9e-b4c3-207c84b444b9 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.088637 May 10 03:01:38.457480 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3265/6489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:38 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:39.473529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:39.474165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:39.481208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:39.481679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:39.482493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:39.482985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:39.551449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:39.559955 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-87764a9c-c1d6-4d70-a6df-94ab0974498b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.090289 May 10 03:01:39.560538 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3225/6490] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:39 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:40.576945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:40.578197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:40.584579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:40.585663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:40.586448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:40.586888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:40.649618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:40.657257 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90af783c-b03a-42ff-9f60-b01f32682c5d tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.084395 May 10 03:01:40.657893 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3266/6491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:40 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:41.673814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:41.674449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:41.682230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:41.682703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:41.683531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:41.683995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:41.745382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:41.752897 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-156900f7-d30d-4096-85e4-b9046569ea64 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.082980 May 10 03:01:41.753478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3226/6492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:41 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:42.769622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:42.770387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:42.777244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:42.777705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:42.778483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:42.778923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:42.840098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:42.847553 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-649383e7-2e00-4856-9cfa-5c14fe33acac tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.081899 May 10 03:01:42.848128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3267/6493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:42 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:43.865234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:43.866612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:43.873220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:43.873688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:43.874474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:43.874930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:43.940347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:43.948491 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-75d18f02-67a5-4d5f-af70-79c1f17f9e92 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1225 microversion: 2.1 time: 0.087370 May 10 03:01:43.949075 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3227/6494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:43 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:44.965279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:44.965913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:44.972842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:44.973315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:44.974092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:44.974544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:45.004698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:45.005162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:45.005622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lazy-loading 'fault' on Instance uuid 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:01:45.046052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:45.054172 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99f4011c-850f-4279-9282-099db4e33c1b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 200 len: 1230 microversion: 2.1 time: 0.092356 May 10 03:01:45.054757 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3268/6495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:44 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:46.071013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:46.071682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 8c2a5e64-2799-43d3-a6ed-7bd7ce689946] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:46.078454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:46.078936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:46.079760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:46.080218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:46.093930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 could not be found. May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 HTTP/1.1 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 could not be found. May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '8c2a5e64-2799-43d3-a6ed-7bd7ce689946'} May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 could not be found. May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 could not be found. May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:01:46.095655 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 could not be found. May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance 8c2a5e64-2799-43d3-a6ed-7bd7ce689946 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a73a3c5-d177-4f86-8c7e-c48bc7f1f89f tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946" status: 404 len: 111 microversion: 2.1 time: 0.030543 May 10 03:01:46.100983 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3228/6496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:46 2022] GET /compute/v2.1/servers/8c2a5e64-2799-43d3-a6ed-7bd7ce689946 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:01:55.426682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:55.427269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:55.429388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-6e253010-d345-4f53-ab92-83d0dc850779 req-d60cba44-5095-4300-9b61-65816f4ce2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9da65-ee20-4eeb-9bd7-0e3fa7339113", "tag": "9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:55.435162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:55.435644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:55.436662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:55.437115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:55.438233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6e253010-d345-4f53-ab92-83d0dc850779 req-d60cba44-5095-4300-9b61-65816f4ce2a5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:55.438969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-6e253010-d345-4f53-ab92-83d0dc850779 req-d60cba44-5095-4300-9b61-65816f4ce2a5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:55.450292 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-6e253010-d345-4f53-ab92-83d0dc850779 req-d60cba44-5095-4300-9b61-65816f4ce2a5 service nova] Creating event network-changed:9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548 for instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 on n-h2-841089-2 May 10 03:01:55.456102 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-6e253010-d345-4f53-ab92-83d0dc850779 req-d60cba44-5095-4300-9b61-65816f4ce2a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031165 May 10 03:01:55.456922 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3229/6497] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:01:55.464840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:01:55.547306 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e8ec62b-e910-450b-8a7d-ac93e94465cd tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 204 len: 0 microversion: 2.1 time: 0.124666 May 10 03:01:55.551404 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3269/6498] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:01:55 2022] DELETE /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:01:55.558730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:55.559511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:55.565882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:55.566348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:55.567176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:55.567627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:55.736353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:55.743999 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7a61b47-9398-4bbb-9283-721c6d0ed4d6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1577 microversion: 2.1 time: 0.191013 May 10 03:01:55.744585 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3230/6499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:55 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:56.761533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:56.762243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:56.769497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:56.769961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:56.770762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:56.771234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:56.915089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:56.922698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c2357f6-efc4-430e-b1c7-aab657a9780b tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1577 microversion: 2.1 time: 0.165491 May 10 03:01:56.923449 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3270/6500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:56 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:57.776188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-395fef78-aef0-41c0-9042-6ab6df3860ac req-ac9ea3f1-32dc-4efb-a23b-bed2b5bb5787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a9da65-ee20-4eeb-9bd7-0e3fa7339113", "name": "network-vif-deleted", "tag": "9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:01:57.785581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-395fef78-aef0-41c0-9042-6ab6df3860ac req-ac9ea3f1-32dc-4efb-a23b-bed2b5bb5787 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:57.786044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-395fef78-aef0-41c0-9042-6ab6df3860ac req-ac9ea3f1-32dc-4efb-a23b-bed2b5bb5787 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:57.798115 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-395fef78-aef0-41c0-9042-6ab6df3860ac req-ac9ea3f1-32dc-4efb-a23b-bed2b5bb5787 service nova] Creating event network-vif-deleted:9c8a1698-1ce0-4b9f-b9b5-5c5c4387d548 for instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 on n-h2-841089-2 May 10 03:01:57.803194 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-395fef78-aef0-41c0-9042-6ab6df3860ac req-ac9ea3f1-32dc-4efb-a23b-bed2b5bb5787 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 May 10 03:01:57.803877 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3231/6501] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:01:57.943367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:57.945360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:57.952235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:57.952695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:57.953471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:57.953913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:58.017845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:58.025846 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-54a8d2ee-1693-4b35-97ef-ac9b8daa18ef tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.086510 May 10 03:01:58.026423 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3271/6502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:57 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:01:59.043926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:01:59.044646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:01:59.051533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:59.052254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:59.053053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:01:59.054017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:01:59.116784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:01:59.124421 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-087b8f0b-eeb0-4b1e-bc58-b2d428c482be tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.085724 May 10 03:01:59.125001 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3232/6503] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:01:59 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:02:00.141754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:00.142388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:00.149903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:00.150369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:00.151183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:00.151636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:00.216203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:00.223833 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-95e09dda-34ee-401b-8289-1e2832ff0f56 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.085985 May 10 03:02:00.224413 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3272/6504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:00 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:01.241476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:01.242122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:01.249419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:01.249877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:01.250688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:01.251171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:01.315865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:01.324592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-239526fe-b718-4753-8594-59e648e3cde7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.087485 May 10 03:02:01.325202 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3233/6505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:01 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:02.341868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:02.342526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:02.349649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:02.350051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:02.350871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:02.351357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:02.413841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:02.421800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-689bf5e5-8e41-4d28-93cc-36898ab5ad03 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.083798 May 10 03:02:02.422621 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3273/6506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:02 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:03.438390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:03.439087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:03.447027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:03.447520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:03.448304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:03.448761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:03.511655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:03.519496 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f34f55cc-793b-40cf-911f-adfd1b3374ce tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.085493 May 10 03:02:03.520285 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3234/6507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:03 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:04.536595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:04.537195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:04.544450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:04.544908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:04.545680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:04.546129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:04.608370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:04.616713 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-edf9f7b2-e41f-48eb-ac63-e9965d606edb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.084163 May 10 03:02:04.617292 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3274/6508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:04 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:05.634949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:05.635673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:05.642870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:05.643372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:05.644163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:05.644615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:05.710377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:05.718375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-78dbf519-8ace-4aa0-b25e-38e7188564fb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.088735 May 10 03:02:05.718956 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3235/6509] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:05 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:06.735674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:06.736587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:06.744092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:06.744552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:06.745339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:06.745786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:06.808132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edbf98553e694f8da09fcdb473da56df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bfef102a3e4c3080219c1324aebea2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:06.815758 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b16a96a-6289-42df-bd93-4300e6a0c743 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 200 len: 1226 microversion: 2.1 time: 0.083894 May 10 03:02:06.816334 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3275/6510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:06 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:07.832943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:07.833579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: 40a9da65-ee20-4eeb-9bd7-0e3fa7339113] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:07.840976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:07.841450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:07.842244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:07.842699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:07.855725 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 could not be found. May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 HTTP/1.1 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 could not be found. May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '40a9da65-ee20-4eeb-9bd7-0e3fa7339113'} May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 could not be found. May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 could not be found. May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:07.857373 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 could not be found. May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance 40a9da65-ee20-4eeb-9bd7-0e3fa7339113 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98c86650-711a-418e-8f6a-140d04c41e4e tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113" status: 404 len: 111 microversion: 2.1 time: 0.029798 May 10 03:02:07.861962 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3236/6511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:07 2022] GET /compute/v2.1/servers/40a9da65-ee20-4eeb-9bd7-0e3fa7339113 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:02:08.304447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:08.304961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:08.311788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:08.312249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:08.313025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:08.313471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:08.327166 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 HTTP/1.1 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'ec95f481-bbb5-43b9-a2f5-13afb5bb1282'} May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:02:08.328881 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5816493-90ac-4d01-854f-3a11a3de60c6 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 404 len: 111 microversion: 2.1 time: 0.030609 May 10 03:02:08.333181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3276/6512] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:02:08 2022] DELETE /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:02:08.338805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:08.339462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] [instance: ec95f481-bbb5-43b9-a2f5-13afb5bb1282] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:08.345451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:08.345911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:08.346683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:08.347156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:08.360561 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] HTTP exception thrown: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Request method failure captured: May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 HTTP/1.1 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedKAodaAaqEqx6VeVknSPfI1GyCUxVjWH4eDqQWaNo6O6BMnCnV3zPSQ8tJuDFfsWL4nAlnZgaXDrrhW8aeJWpIJO2QR5KMM_rlN5bYMPR-T0AVDWe_w-Vr0bUKupZY9AehSuSLvfo-h68mvk0sN4KvG-1KKZLvK-2_imZhGoZ5xtN8 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f4bfef102a3e4c3080219c1324aebea2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f4bfef102a3e4c3080219c1324aebea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: f4bfef102a3e4c3080219c1324aebea2 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestVolumeBootPattern-1893282875 May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestVolumeBootPattern-1893282875-project May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: edbf98553e694f8da09fcdb473da56df May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestVolumeBootPattern-1893282875-project May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'ec95f481-bbb5-43b9-a2f5-13afb5bb1282'} May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:08.362070 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Returning 404 to user: Instance ec95f481-bbb5-43b9-a2f5-13afb5bb1282 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e933d092-b10c-4b58-9a16-e023016d30eb tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282" status: 404 len: 111 microversion: 2.1 time: 0.028587 May 10 03:02:08.367643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3237/6513] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:08 2022] GET /compute/v2.1/servers/ec95f481-bbb5-43b9-a2f5-13afb5bb1282 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:02:13.845830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-72b1c38a-7d92-431b-a722-1422c25bc3f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] Calling method '.version_select at 0x7f3d367dc430>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:13.871689 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-72b1c38a-7d92-431b-a722-1422c25bc3f7 tempest-TestVolumeBootPattern-1893282875 tempest-TestVolumeBootPattern-1893282875-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1101334833" status: 202 len: 0 microversion: 2.1 time: 0.029646 May 10 03:02:13.875915 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3277/6514] 10.222.0.52 () {58 vars in 1262 bytes} [Tue May 10 03:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1101334833 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:02:32.297162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1454001535", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:32.351978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] validate_networks() for None {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:02:32.622733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:02:32.623490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:02:32.624003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:02:32.624796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:02:32.625445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:02:32.634401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:32.634874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:32.635757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:32.636203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:32.652776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Getting quotas for project cba51a4956e149b086522e8a9a4b1302. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:02:32.657928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Getting quotas for user cb25412324fb49f5aca59e8c19e1f570 and project cba51a4956e149b086522e8a9a4b1302. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:02:32.670768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:02:32.673173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:02:32.714269 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [96576b52-2072-47c6-a496-4ce4951bf46d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:02:33.721322 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [96576b52-2072-47c6-a496-4ce4951bf46d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 51720. May 10 03:02:33.725166 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c894106-d3a1-44af-ac85-618052a9a2a4 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.561449 May 10 03:02:33.725853 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3238/6515] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:02:33.737011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7dd8c848-3199-456f-8f29-9d4b1dc1a1ca tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:33.737640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7dd8c848-3199-456f-8f29-9d4b1dc1a1ca tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:33.791695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7dd8c848-3199-456f-8f29-9d4b1dc1a1ca tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:33.798563 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7dd8c848-3199-456f-8f29-9d4b1dc1a1ca tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1222 microversion: 2.1 time: 0.066368 May 10 03:02:33.799167 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3278/6516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:33 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:34.817783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:34.818548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:34.825792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:34.826262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:34.827046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:34.827524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:34.895861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:34.903318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ad2c9034-30af-4f12-b2a9-d855b25d5c13 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1280 microversion: 2.1 time: 0.090673 May 10 03:02:34.903898 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3239/6517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:34 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:35.921259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:35.921884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:35.931725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:35.932201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:35.932991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:35.933448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:36.140338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:36.147893 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00c2a59f-b310-4054-b8e5-710f9fc0274a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.230761 May 10 03:02:36.148512 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3279/6518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:35 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:36.254397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fbd48b74-a12f-4d2f-bf36-96ddc9f097da req-1599621e-d4f8-45fa-8969-3f6353942bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c06cccf-595b-4a84-81cc-22075204a402", "tag": "58cfb8d0-628d-4dab-8ab1-2961d02f1c00"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:36.265149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fbd48b74-a12f-4d2f-bf36-96ddc9f097da req-1599621e-d4f8-45fa-8969-3f6353942bcf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:36.265614 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fbd48b74-a12f-4d2f-bf36-96ddc9f097da req-1599621e-d4f8-45fa-8969-3f6353942bcf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:36.277387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fbd48b74-a12f-4d2f-bf36-96ddc9f097da req-1599621e-d4f8-45fa-8969-3f6353942bcf service nova] Creating event network-changed:58cfb8d0-628d-4dab-8ab1-2961d02f1c00 for instance 3c06cccf-595b-4a84-81cc-22075204a402 on n-h2-841089-2 May 10 03:02:36.282636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fbd48b74-a12f-4d2f-bf36-96ddc9f097da req-1599621e-d4f8-45fa-8969-3f6353942bcf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 May 10 03:02:36.283211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3240/6519] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:37.163865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:37.164479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:37.171267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:37.171729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:37.172512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:37.172962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:37.299289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:37.307309 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d99eb4d9-24d0-467a-bba5-00e857fae8c7 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.147379 May 10 03:02:37.307883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3280/6520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:37 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:38.325307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:38.326033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:38.332221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:38.332698 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:38.333490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:38.333953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:38.462168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:38.469665 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de677f48-af97-4d25-8530-438f6b8992fb tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.149443 May 10 03:02:38.470252 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3241/6521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:38 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:39.486028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:39.486656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:39.494371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:39.494841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:39.495672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:39.496235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:39.626759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:39.634745 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-198135fa-a0d7-49d2-b85a-935d1ddd3b18 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.152653 May 10 03:02:39.635356 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3281/6522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:39 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:40.652224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:40.652954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:40.659926 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:40.660500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:40.661195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:40.661620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:40.789444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:40.796732 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e27de61-0af2-49ce-9340-0ec8b91f90c2 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.149078 May 10 03:02:40.797309 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3242/6523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:40 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:41.813508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:41.814127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:41.821459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:41.821916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:41.822687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:41.823158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:41.955419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:41.963388 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-13c44226-d5a1-4cf8-9802-0ef388998d2a tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.153739 May 10 03:02:41.963973 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3282/6524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:41 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:42.198039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-1c9d7668-b0d4-435f-8667-81ae75fe3106 req-6b03b010-b7b9-4651-b117-3a9e5019fa37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c06cccf-595b-4a84-81cc-22075204a402", "name": "network-vif-plugged", "status": "completed", "tag": "58cfb8d0-628d-4dab-8ab1-2961d02f1c00"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:42.207537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1c9d7668-b0d4-435f-8667-81ae75fe3106 req-6b03b010-b7b9-4651-b117-3a9e5019fa37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:42.208007 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-1c9d7668-b0d4-435f-8667-81ae75fe3106 req-6b03b010-b7b9-4651-b117-3a9e5019fa37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:42.219030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-1c9d7668-b0d4-435f-8667-81ae75fe3106 req-6b03b010-b7b9-4651-b117-3a9e5019fa37 service nova] Creating event network-vif-plugged:58cfb8d0-628d-4dab-8ab1-2961d02f1c00 for instance 3c06cccf-595b-4a84-81cc-22075204a402 on n-h2-841089-2 May 10 03:02:42.223968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-1c9d7668-b0d4-435f-8667-81ae75fe3106 req-6b03b010-b7b9-4651-b117-3a9e5019fa37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029630 May 10 03:02:42.224558 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3243/6525] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:42.979478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:42.980144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:42.986921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:42.987415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:42.988192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:42.988638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:43.114036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:43.121904 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa23615a-b6ee-4727-b29b-da6aebc622db tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1322 microversion: 2.1 time: 0.146459 May 10 03:02:43.122478 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3283/6526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:42 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:44.139972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:44.140690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:44.146908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.147406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.148189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.148644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.278853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:44.286234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de621e83-47ce-4a6f-98dc-88af0792997c tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1472 microversion: 2.1 time: 0.151548 May 10 03:02:44.286806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3244/6527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:44 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:44.364800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b608289a-59d0-43da-84ce-bff83b7b611c tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Calling method '.version_select at 0x7f3d35d4ed30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:44.428756 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b608289a-59d0-43da-84ce-bff83b7b611c tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/af7b7b7817b849c0b1c0a70559063b77" status: 200 len: 371 microversion: 2.1 time: 0.127795 May 10 03:02:44.429327 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3284/6528] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 03:02:44 2022] GET /compute/v2.1/os-quota-sets/af7b7b7817b849c0b1c0a70559063b77 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:44.440077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8ac4a7e3-0e4f-455f-881c-a87e34be7eb8 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-390227637", "id": 2010675223, "os-flavor-access:is_public": "True"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:44.441695 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:02:44.441695 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 03:02:44.456235 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8ac4a7e3-0e4f-455f-881c-a87e34be7eb8 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.019912 May 10 03:02:44.456798 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3245/6529] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:02:44 2022] POST /compute/v2.1/flavors => generated 437 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:44.468159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2010675223"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:44.469216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:44.475273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.475736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.476539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.476990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.676094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '89af6b7811ed40f794222761d1139ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7b7b7817b849c0b1c0a70559063b77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:44.683474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-390227637 {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:02:44.690837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.691393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.692191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.692895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.714371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Getting quotas for project cba51a4956e149b086522e8a9a4b1302. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:02:44.719470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Getting quotas for user cb25412324fb49f5aca59e8c19e1f570 and project cba51a4956e149b086522e8a9a4b1302. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:02:44.731039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.compute.api [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] ram quota exceeded for af7b7b7817b849c0b1c0a70559063b77, tried to resize instance. May 10 03:02:44.731612 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Request method failure captured: May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402/action HTTP/1.1 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 39 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedXIzszfnJQT0em-YdhNYVh8mApMIUuGrx5L12RzePwZYrhaes7usdsXu37sRAmFxpYwLb2aYpgYXoAiG1-eNH9Ph4rAjZi0doFdR0IT5ebwQbIIV3BlKwH21wCAsy0A0Ddjpd9NHTvGonFw6CI5fO2YQ19EhmVJdFc8x431FTyGAG0 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: af7b7b7817b849c0b1c0a70559063b77 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1821063207 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,admin,reader May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,admin,reader May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af7b7b7817b849c0b1c0a70559063b77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af7b7b7817b849c0b1c0a70559063b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af7b7b7817b849c0b1c0a70559063b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af7b7b7817b849c0b1c0a70559063b77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1821063207 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: af7b7b7817b849c0b1c0a70559063b77 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1821063207 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersAdminNegativeTestJSON-1821063207-project-admin May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 89af6b7811ed40f794222761d1139ee0 May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1821063207-project-admin May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: {"resize": {"flavorRef": "2010675223"}} May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '3c06cccf-595b-4a84-81cc-22075204a402', 'body': {'resize': {'flavorRef': '2010675223'}}} May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:02:44.733596 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2c30aa44-e937-4c28-9eb5-beed8c1c1abe tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402/action" status: 403 len: 118 microversion: 2.1 time: 0.270736 May 10 03:02:44.739377 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3285/6530] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:02:44 2022] POST /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402/action => generated 118 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 10 03:02:44.744644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb94d5cf-c289-4111-ab2a-fe71465bf7f4 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:44.745409 n-d-841089-2 devstack@n-api.service[118717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:02:44.745409 n-d-841089-2 devstack@n-api.service[118717]: warnings.warn(msg) May 10 03:02:44.761794 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb94d5cf-c289-4111-ab2a-fe71465bf7f4 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2010675223" status: 202 len: 0 microversion: 2.1 time: 0.021521 May 10 03:02:44.762354 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3246/6531] 10.222.0.52 () {58 vars in 1160 bytes} [Tue May 10 03:02:44 2022] DELETE /compute/v2.1/flavors/2010675223 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:02:44.770027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a0fbccb-66ba-4529-8cfe-4f203ad44fb6 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:44.788507 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a0fbccb-66ba-4529-8cfe-4f203ad44fb6 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022121 May 10 03:02:44.789052 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3286/6532] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 03:02:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:02:44.805804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6805878e-10b6-4886-919f-50af2e689025 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Calling method '.version_select at 0x7f3d35c0cf70>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:44.872779 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6805878e-10b6-4886-919f-50af2e689025 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/af7b7b7817b849c0b1c0a70559063b77" status: 200 len: 371 microversion: 2.1 time: 0.071328 May 10 03:02:44.873349 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3247/6533] 10.222.0.52 () {58 vars in 1241 bytes} [Tue May 10 03:02:44 2022] GET /compute/v2.1/os-quota-sets/af7b7b7817b849c0b1c0a70559063b77 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:44.883969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28ce290a-dd2e-4670-9286-8758ce00a2f5 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1566265303", "id": 611766137, "os-flavor-access:is_public": "True"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:44.885555 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:02:44.885555 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 03:02:44.899991 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28ce290a-dd2e-4670-9286-8758ce00a2f5 tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.020379 May 10 03:02:44.900558 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3287/6534] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:02:44 2022] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:44.911136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "611766137"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:44.912119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:44.918056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.918550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:44.919364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:44.919824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.054275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '89af6b7811ed40f794222761d1139ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7b7b7817b849c0b1c0a70559063b77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:45.060713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1566265303 {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:02:45.067125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:45.067551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.068376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:45.068829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.089272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Getting quotas for project cba51a4956e149b086522e8a9a4b1302. Resources: {'cores', 'ram'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:02:45.094164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Getting quotas for user cb25412324fb49f5aca59e8c19e1f570 and project cba51a4956e149b086522e8a9a4b1302. Resources: {'cores', 'ram'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:02:45.105711 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] cores quota exceeded for af7b7b7817b849c0b1c0a70559063b77, tried to resize instance. May 10 03:02:45.106264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Request method failure captured: May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402/action HTTP/1.1 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 38 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedXIzszfnJQT0em-YdhNYVh8mApMIUuGrx5L12RzePwZYrhaes7usdsXu37sRAmFxpYwLb2aYpgYXoAiG1-eNH9Ph4rAjZi0doFdR0IT5ebwQbIIV3BlKwH21wCAsy0A0Ddjpd9NHTvGonFw6CI5fO2YQ19EhmVJdFc8x431FTyGAG0 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: af7b7b7817b849c0b1c0a70559063b77 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1821063207 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,admin,reader May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,admin,reader May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af7b7b7817b849c0b1c0a70559063b77", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af7b7b7817b849c0b1c0a70559063b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af7b7b7817b849c0b1c0a70559063b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af7b7b7817b849c0b1c0a70559063b77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1821063207 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: af7b7b7817b849c0b1c0a70559063b77 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1821063207 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersAdminNegativeTestJSON-1821063207-project-admin May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 89af6b7811ed40f794222761d1139ee0 May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1821063207-project-admin May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: {"resize": {"flavorRef": "611766137"}} May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3c06cccf-595b-4a84-81cc-22075204a402', 'body': {'resize': {'flavorRef': '611766137'}}} May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:02:45.108354 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-657ddc67-6959-4879-bb70-95d8089d0d1f tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402/action" status: 403 len: 113 microversion: 2.1 time: 0.202544 May 10 03:02:45.113089 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3248/6535] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:02:44 2022] POST /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402/action => generated 113 bytes in 204 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 10 03:02:45.121630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56221fd0-d247-4067-a79d-8723612e472c tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:45.122388 n-d-841089-2 devstack@n-api.service[118716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:02:45.122388 n-d-841089-2 devstack@n-api.service[118716]: warnings.warn(msg) May 10 03:02:45.138803 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56221fd0-d247-4067-a79d-8723612e472c tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/611766137" status: 202 len: 0 microversion: 2.1 time: 0.020959 May 10 03:02:45.139417 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3288/6536] 10.222.0.52 () {58 vars in 1157 bytes} [Tue May 10 03:02:45 2022] DELETE /compute/v2.1/flavors/611766137 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:02:45.147299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5d63fc7c-186d-41b5-b45b-0f715e2617fb tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:45.167029 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5d63fc7c-186d-41b5-b45b-0f715e2617fb tempest-ServersAdminNegativeTestJSON-1821063207 tempest-ServersAdminNegativeTestJSON-1821063207-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023400 May 10 03:02:45.167611 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3249/6537] 10.222.0.52 () {58 vars in 1145 bytes} [Tue May 10 03:02:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:45.184535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:45.185045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:45.191004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:45.191503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.192295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:45.192747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.220479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:02:45.299113 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bca2c7e5-8e70-46a1-9dfc-08d91bb00a32 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 204 len: 0 microversion: 2.1 time: 0.117913 May 10 03:02:45.299749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3289/6538] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:02:45 2022] DELETE /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:02:45.309248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:45.309880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:45.316074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:45.316545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.317381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:45.317786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:45.442873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:45.450225 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0912ac09-352d-4081-9404-3e082f9a1530 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1478 microversion: 2.1 time: 0.145615 May 10 03:02:45.450798 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3250/6539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:45 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1478 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:46.467733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:46.468454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:46.475135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:46.475619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:46.476407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:46.476858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:46.606735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:46.614142 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e3d96d1-d2c2-4196-9fcf-35f274ab5fea tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1478 microversion: 2.1 time: 0.150765 May 10 03:02:46.614727 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3290/6540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:46 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1478 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:47.141724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-90ea375c-4910-473b-9de8-269c41e9973f req-ff2e01a4-6e19-4387-8522-4d26b1abf7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c06cccf-595b-4a84-81cc-22075204a402", "name": "network-vif-deleted", "tag": "58cfb8d0-628d-4dab-8ab1-2961d02f1c00"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:47.153306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-90ea375c-4910-473b-9de8-269c41e9973f req-ff2e01a4-6e19-4387-8522-4d26b1abf7f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:47.153769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-90ea375c-4910-473b-9de8-269c41e9973f req-ff2e01a4-6e19-4387-8522-4d26b1abf7f9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:47.166849 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-90ea375c-4910-473b-9de8-269c41e9973f req-ff2e01a4-6e19-4387-8522-4d26b1abf7f9 service nova] Creating event network-vif-deleted:58cfb8d0-628d-4dab-8ab1-2961d02f1c00 for instance 3c06cccf-595b-4a84-81cc-22075204a402 on n-h2-841089-2 May 10 03:02:47.172322 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-90ea375c-4910-473b-9de8-269c41e9973f req-ff2e01a4-6e19-4387-8522-4d26b1abf7f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034133 May 10 03:02:47.173079 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3251/6541] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:47.631259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:47.631884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:47.639356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:47.639821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:47.640603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:47.641255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:47.672919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:47.673375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:47.673815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lazy-loading 'fault' on Instance uuid 3c06cccf-595b-4a84-81cc-22075204a402 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:02:47.721063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb25412324fb49f5aca59e8c19e1f570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba51a4956e149b086522e8a9a4b1302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:47.729007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ca04da26-39e6-468c-b85d-6b24bf3016f5 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 200 len: 1312 microversion: 2.1 time: 0.101727 May 10 03:02:47.729580 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3291/6542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:47 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:48.746715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:48.747474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] [instance: 3c06cccf-595b-4a84-81cc-22075204a402] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:48.753632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:48.754090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:48.754865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:48.755416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:48.769144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] HTTP exception thrown: Instance 3c06cccf-595b-4a84-81cc-22075204a402 could not be found. May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Request method failure captured: May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 HTTP/1.1 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedXHS8OflWSOatLvtSmUFz4B_CpZoF9zbcmoB7Yj4Xhg2KpXgunB9zJYbi-VhI_0BfMeL56-hNYBuZ8BbPJWxOMWK62N8p4S85Mi9nKBKCW6lHxCvQyFI-EvcnAnASA3FMk4rv8-hewbzFah6s-HU8UYXSXpkWswYeAeRDTiY3vChz4 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: cba51a4956e149b086522e8a9a4b1302 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1819031169 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cba51a4956e149b086522e8a9a4b1302", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cba51a4956e149b086522e8a9a4b1302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cba51a4956e149b086522e8a9a4b1302"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cba51a4956e149b086522e8a9a4b1302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1819031169 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: cba51a4956e149b086522e8a9a4b1302 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1819031169 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersAdminNegativeTestJSON-1819031169-project May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: cb25412324fb49f5aca59e8c19e1f570 May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1819031169-project May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 3c06cccf-595b-4a84-81cc-22075204a402 could not be found. May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3c06cccf-595b-4a84-81cc-22075204a402'} May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c06cccf-595b-4a84-81cc-22075204a402 could not be found. May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c06cccf-595b-4a84-81cc-22075204a402 could not be found. May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:48.770795 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c06cccf-595b-4a84-81cc-22075204a402 could not be found. May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] Returning 404 to user: Instance 3c06cccf-595b-4a84-81cc-22075204a402 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d9b387d4-dcd3-4078-a834-ec622a5d3c63 tempest-ServersAdminNegativeTestJSON-1819031169 tempest-ServersAdminNegativeTestJSON-1819031169-project] 10.222.0.52 "GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402" status: 404 len: 111 microversion: 2.1 time: 0.030536 May 10 03:02:48.776547 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3252/6543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:48 2022] GET /compute/v2.1/servers/3c06cccf-595b-4a84-81cc-22075204a402 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:02:51.390622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-161950532", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "5be145ec-93ae-4c94-a4ab-38cec8ee1385"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:51.441443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] validate_networks() for [('5be145ec-93ae-4c94-a4ab-38cec8ee1385', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:02:51.779837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:02:51.780272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:02:51.780761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:02:51.781179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:02:51.781601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:02:51.790986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:51.791488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:51.792299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:51.792769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:51.809708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Getting quotas for project ccc9abfe5a284d2591b6f0fb9416ea68. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:02:51.815907 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Getting quotas for user 1d7bab44350a4b9b842cb316eea0d9fb and project ccc9abfe5a284d2591b6f0fb9416ea68. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:02:51.827913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:02:51.830155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:02:51.873841 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad579133-b7e8-48e1-a378-2493fc8b8435 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599210 May 10 03:02:51.874502 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3292/6544] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:02:51.884837 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47de771e-0741-43b7-b95d-8109035bec94 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:51.885576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47de771e-0741-43b7-b95d-8109035bec94 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:51.941362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-47de771e-0741-43b7-b95d-8109035bec94 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:51.947897 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47de771e-0741-43b7-b95d-8109035bec94 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1214 microversion: 2.1 time: 0.067115 May 10 03:02:51.948478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3253/6545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:51 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:02:52.888386 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:02:52.891338 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:02:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:02:52.967188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:52.967892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:52.978480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:52.978998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:52.979850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:52.980303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:53.049760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:53.057801 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-71a25de4-1c88-4599-ae48-cd4361a5ebfe tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1272 microversion: 2.1 time: 0.097230 May 10 03:02:53.058380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3293/6546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:52 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:54.075571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:54.076210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:54.084125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:54.084591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:54.085441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:54.085893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:54.597085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:54.607537 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7f82b2f0-97bf-4d0e-9911-c23169bc762b tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.536313 May 10 03:02:54.608430 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3254/6547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:54 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:54.618516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7c9844f4-c195-4235-abe8-44ac53bfd5b1 req-87fe42da-316e-494d-81d3-2dd1523db38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d78b1-001b-4931-aa4c-55a109eebb22", "tag": "df05b19a-4350-48a4-9fdf-46842fa575e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:02:54.627944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7c9844f4-c195-4235-abe8-44ac53bfd5b1 req-87fe42da-316e-494d-81d3-2dd1523db38e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:54.628495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7c9844f4-c195-4235-abe8-44ac53bfd5b1 req-87fe42da-316e-494d-81d3-2dd1523db38e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:54.641108 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7c9844f4-c195-4235-abe8-44ac53bfd5b1 req-87fe42da-316e-494d-81d3-2dd1523db38e service nova] Creating event network-changed:df05b19a-4350-48a4-9fdf-46842fa575e3 for instance f67d78b1-001b-4931-aa4c-55a109eebb22 on n-h2-841089-2 May 10 03:02:54.646542 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7c9844f4-c195-4235-abe8-44ac53bfd5b1 req-87fe42da-316e-494d-81d3-2dd1523db38e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 May 10 03:02:54.647486 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3294/6548] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:02:55.625065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:55.625705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:55.632525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:55.632976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:55.633797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:55.634252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:55.764543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:55.771811 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-04181fc0-ea07-47f4-8573-cad70bc15f6e tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.150720 May 10 03:02:55.772389 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3255/6549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:55 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:56.789077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:56.789792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:56.796122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:56.796586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:56.797419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:56.797868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:56.925389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:56.933589 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8d3b3c0-e633-44ca-9ab4-9c31f1791725 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.149652 May 10 03:02:56.934158 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3295/6550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:56 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:57.949895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:57.950533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:57.957325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:57.957795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:57.958587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:57.959052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:58.086752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:58.094069 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd4b44cf-f94a-42b5-b8e4-585d9da3bd54 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.148113 May 10 03:02:58.094652 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3256/6551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:57 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:02:59.111638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:02:59.112182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:02:59.119147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:59.119614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:59.120398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:02:59.120837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:02:59.250321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:02:59.257638 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eaa963eb-d993-46da-8fcc-9dcbb1a6e8bc tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.150054 May 10 03:02:59.258207 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3296/6552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:02:59 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:00.274642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:00.276674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:00.283877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:00.284359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:00.285123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:00.285583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:00.343497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-69265e9f-4f7c-4957-8512-9d083c8bf9fc req-a7b2f142-7c88-461b-91c5-a1565e539fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d78b1-001b-4931-aa4c-55a109eebb22", "name": "network-vif-plugged", "status": "completed", "tag": "df05b19a-4350-48a4-9fdf-46842fa575e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:00.353303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-69265e9f-4f7c-4957-8512-9d083c8bf9fc req-a7b2f142-7c88-461b-91c5-a1565e539fe5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:00.353855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-69265e9f-4f7c-4957-8512-9d083c8bf9fc req-a7b2f142-7c88-461b-91c5-a1565e539fe5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:00.365947 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-69265e9f-4f7c-4957-8512-9d083c8bf9fc req-a7b2f142-7c88-461b-91c5-a1565e539fe5 service nova] Creating event network-vif-plugged:df05b19a-4350-48a4-9fdf-46842fa575e3 for instance f67d78b1-001b-4931-aa4c-55a109eebb22 on n-h2-841089-2 May 10 03:03:00.371822 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-69265e9f-4f7c-4957-8512-9d083c8bf9fc req-a7b2f142-7c88-461b-91c5-a1565e539fe5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102625 May 10 03:03:00.372421 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3257/6553] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:03:00.424166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:00.432049 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c663401-8c00-4524-9445-138739a55d88 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.161243 May 10 03:03:00.432634 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3297/6554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:00 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:03:01.450191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:01.450905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:01.457083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:01.457590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:01.458373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:01.458830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:01.588665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:01.596076 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc3b013a-35f5-4302-9ce5-3814d945bb52 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1314 microversion: 2.1 time: 0.150936 May 10 03:03:01.596678 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3258/6555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:01 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:02.613081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:02.613714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:02.621124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:02.621591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:02.622484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:02.622946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:02.756989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:02.765039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-999dbc6c-bb27-4916-b87f-925bab4d83e8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1501 microversion: 2.1 time: 0.155875 May 10 03:03:02.765612 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3298/6556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:02 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:02.781239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:02.782239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:02.789002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:02.789467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:02.790240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:02.790691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:02.865048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:02.871292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Old instance type m1.heat2, new instance type m1.heat {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:03:02.877442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:03:02.877878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:03:02.878361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:03:02.878773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:03:02.879353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:03:03.265730 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-db729818-d869-49df-9d5e-d0f3ff6ec69d tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "POST /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22/action" status: 202 len: 0 microversion: 2.1 time: 0.488408 May 10 03:03:03.266528 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3259/6557] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:03:02 2022] POST /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:03:03.274296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:03.275235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:03.281181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:03.281632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:03.282671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:03.283215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:03.458123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:03.466796 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d371b8a6-7f73-4e5a-af5e-694e2da07da9 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1510 microversion: 2.1 time: 0.196243 May 10 03:03:03.468110 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3299/6558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:03 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:04.485469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:04.486110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:04.493732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:04.494203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:04.495001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:04.495536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:04.632125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:04.640625 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b7f49290-4bf4-4089-b034-19ded1394692 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1510 microversion: 2.1 time: 0.158976 May 10 03:03:04.641679 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3260/6559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:04 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:05.658701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:05.659345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:05.667230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:05.667693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:05.668513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:05.668962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:05.796461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:05.804036 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d8f6932-33ef-4ae1-9799-494790381997 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.149210 May 10 03:03:05.804614 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3300/6560] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:05 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:06.821242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:06.821911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:06.828802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:06.829274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:06.830061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:06.830518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:06.957223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:06.964543 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8f866dfc-eeed-46ee-8c2d-aee366229f22 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.147226 May 10 03:03:06.965111 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3261/6561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:06 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:07.982216 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:07.982870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:07.989809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:07.990272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:07.991050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:07.991521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:08.119524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:08.126802 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e5eeb7a7-b5ce-4bba-afa7-d586fe657fda tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.149149 May 10 03:03:08.127415 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3301/6562] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:07 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:09.143978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:09.144606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:09.151280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:09.151752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:09.152533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:09.152986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:09.278748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:09.286265 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-362df84f-2ecc-4f48-b347-996cd93444e0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.146258 May 10 03:03:09.286873 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3262/6563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:09 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:10.303842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:10.304497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:10.311790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:10.312255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:10.313031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:10.313478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:10.441572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:10.449521 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42cfd9bb-ebd6-4bdb-bb41-b2e2ed5434ca tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.149825 May 10 03:03:10.450095 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3302/6564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:10 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:11.466382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:11.467014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:11.473709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:11.474175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:11.474954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:11.475429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:11.601403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:11.609242 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-084a2f2c-12fb-4758-ae53-166788ce4409 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.146783 May 10 03:03:11.609806 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3263/6565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:11 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:12.626662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:12.627319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:12.634193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:12.634687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:12.636121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:12.636584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:12.764184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:12.773352 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c834492b-f1a9-4adf-aee0-6d0a643b8513 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.150586 May 10 03:03:12.773962 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3303/6566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:12 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:13.791176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:13.791847 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:13.798587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:13.799058 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:13.799901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:13.800364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:13.931665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:13.939680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e3ef6c04-1e11-40b9-a60c-966b9984737c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.152556 May 10 03:03:13.940259 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3264/6567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:13 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:14.957538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:14.958094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:14.965618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:14.966084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:14.966873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:14.967347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:15.094692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:15.102068 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e0486a9-6a4b-4d1c-b6de-ef65af2386c3 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.148524 May 10 03:03:15.102643 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3304/6568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:14 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:16.119197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:16.120354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:16.127131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:16.127603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:16.128384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:16.128840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:16.259525 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:16.267411 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-889404cd-0080-4e0f-a413-1ef8352132be tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.152170 May 10 03:03:16.267976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3265/6569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:16 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:17.283927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:17.284564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:17.291182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:17.292155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:17.292932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:17.293381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:17.419477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:17.426772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c149254e-9ec2-4041-9f44-6bd79e84a2ba tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.146763 May 10 03:03:17.427640 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3305/6570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:17 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:18.444596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:18.445221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:18.452582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:18.453045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:18.453853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:18.454307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:18.585594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:18.592989 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42059fff-6881-4d4a-9d7e-5d7360d3e92a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.152355 May 10 03:03:18.593563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3266/6571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:18 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:19.609871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:19.610501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:19.617318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:19.617783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:19.618563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:19.619011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:19.749022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:19.757119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3ca7bd9-0233-4756-87b8-2247b462ae9f tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.151127 May 10 03:03:19.757738 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3306/6572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:19 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:20.776609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:20.777246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:20.783861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:20.784337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:20.785127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:20.785587 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:20.916211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:20.924236 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab469ddc-2edd-41aa-86ea-82274bdba391 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.152161 May 10 03:03:20.924805 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3267/6573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:20 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:21.941470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:21.942100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:21.948940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:21.949406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:21.950182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:21.950635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:22.082303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:22.090059 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e130f352-181e-4b01-aa31-f5284e142737 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.152607 May 10 03:03:22.090618 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3307/6574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:21 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:23.106721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:23.107385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:23.114313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:23.114785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:23.115615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:23.116073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:23.241802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:23.249828 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1dd5a9af-199a-426d-840a-42a824b809f8 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.147070 May 10 03:03:23.250404 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3268/6575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:23 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:24.266878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:24.267525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:24.274280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:24.274737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:24.275538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:24.276587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:24.410123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:24.417596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f11f09a1-0ec3-4330-bb73-14c453db1c2a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.154651 May 10 03:03:24.418172 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3308/6576] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:24 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:25.434375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:25.435018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:25.441864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:25.442342 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:25.443167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:25.443635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:25.569308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:25.577154 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dd8ee9f8-60bd-4a8b-ba92-679871dcc8e6 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.146691 May 10 03:03:25.577727 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3269/6577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:25 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:26.594309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:26.594938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:26.601712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:26.602170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:26.602942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:26.603420 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:26.729944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:26.737219 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-639c42f0-eab7-4411-879d-fb1a3a71b9ad tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.146893 May 10 03:03:26.737794 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3309/6578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:26 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:27.754078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:27.754716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:27.761959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:27.762437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:27.763274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:27.763744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:27.891856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:27.899034 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3fcaca2d-4d9b-4ce6-b32c-da398036e569 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.148911 May 10 03:03:27.899628 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3270/6579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:27 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:28.915873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:28.916494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:28.923309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:28.923766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:28.924542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:28.924987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:29.050621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:29.058969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eb9687a8-b37f-410b-afba-fb7771a821c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.146911 May 10 03:03:29.059498 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3310/6580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:28 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:30.075313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:30.075961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:30.082677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:30.083192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:30.083984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:30.084447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:30.218355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:30.225931 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9f9446d-26fa-4e0f-ae4d-a27bf21d5bcd tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.155103 May 10 03:03:30.226507 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3271/6581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:30 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:31.242772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:31.243442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:31.250177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:31.250638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:31.251438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:31.251884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:31.378554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:31.386025 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7b54a56-f2fd-4556-8abe-f5e158686387 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1515 microversion: 2.1 time: 0.147162 May 10 03:03:31.386601 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3311/6582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:31 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:32.402136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:32.403349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:32.410781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:32.411358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:32.412164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:32.412620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:32.546063 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:32.554133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98ceafb8-bda6-4bef-839d-4705e4faed5a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1514 microversion: 2.1 time: 0.155849 May 10 03:03:32.554707 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3272/6583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:32 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:32.843530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-2a70d385-d5c3-434f-8569-74d8b9f80f70 req-a4e99d0f-2bb1-4401-a595-c206a06e2393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d78b1-001b-4931-aa4c-55a109eebb22", "name": "network-vif-unplugged", "status": "completed", "tag": "df05b19a-4350-48a4-9fdf-46842fa575e3"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:32.853325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2a70d385-d5c3-434f-8569-74d8b9f80f70 req-a4e99d0f-2bb1-4401-a595-c206a06e2393 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:32.853905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-2a70d385-d5c3-434f-8569-74d8b9f80f70 req-a4e99d0f-2bb1-4401-a595-c206a06e2393 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:32.869587 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-2a70d385-d5c3-434f-8569-74d8b9f80f70 req-a4e99d0f-2bb1-4401-a595-c206a06e2393 service nova] Creating event network-vif-unplugged:df05b19a-4350-48a4-9fdf-46842fa575e3 for instance f67d78b1-001b-4931-aa4c-55a109eebb22 on n-h1-841089-2 May 10 03:03:32.875350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-2a70d385-d5c3-434f-8569-74d8b9f80f70 req-a4e99d0f-2bb1-4401-a595-c206a06e2393 service nova] Instance f67d78b1-001b-4931-aa4c-55a109eebb22 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:03:32.886703 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-2a70d385-d5c3-434f-8569-74d8b9f80f70 req-a4e99d0f-2bb1-4401-a595-c206a06e2393 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047666 May 10 03:03:32.887678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3312/6584] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:03:33.571920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:33.572547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:33.580197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:33.580722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:33.581528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:33.581992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:33.716526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:33.723845 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac2ecd1a-8a14-418a-8f4b-aa217493391a tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1514 microversion: 2.1 time: 0.155862 May 10 03:03:33.724412 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3273/6585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:33 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:34.742702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:34.743442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:34.749682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:34.750146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:34.750923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:34.751412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:34.884672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:34.892703 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a58cc110-8861-40ef-b629-651d8a3eb377 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1512 microversion: 2.1 time: 0.155202 May 10 03:03:34.893285 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3313/6586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:34 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:34.901546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-991168c8-60cb-44ee-a568-294ef3f57486 req-e4972ad0-6566-47ed-ac7c-33b998ab7252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d78b1-001b-4931-aa4c-55a109eebb22", "tag": "df05b19a-4350-48a4-9fdf-46842fa575e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:34.910274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-991168c8-60cb-44ee-a568-294ef3f57486 req-e4972ad0-6566-47ed-ac7c-33b998ab7252 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:34.910817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-991168c8-60cb-44ee-a568-294ef3f57486 req-e4972ad0-6566-47ed-ac7c-33b998ab7252 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:34.922093 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-991168c8-60cb-44ee-a568-294ef3f57486 req-e4972ad0-6566-47ed-ac7c-33b998ab7252 service nova] Creating event network-changed:df05b19a-4350-48a4-9fdf-46842fa575e3 for instance f67d78b1-001b-4931-aa4c-55a109eebb22 on n-h1-841089-2 May 10 03:03:34.927598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-991168c8-60cb-44ee-a568-294ef3f57486 req-e4972ad0-6566-47ed-ac7c-33b998ab7252 service nova] Instance f67d78b1-001b-4931-aa4c-55a109eebb22 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:03:34.938708 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-991168c8-60cb-44ee-a568-294ef3f57486 req-e4972ad0-6566-47ed-ac7c-33b998ab7252 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040824 May 10 03:03:34.939335 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3274/6587] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:03:35.910158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:35.910672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:35.917571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:35.918095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:35.918866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:35.919407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:36.053287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:36.061312 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91b5b2ce-fb9c-4521-bf56-9679bc50a0f7 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1509 microversion: 2.1 time: 0.155181 May 10 03:03:36.061900 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3314/6588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:35 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:36.078641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:36.079271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:36.085333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:36.085800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:36.086589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:36.087045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:36.113028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:03:36.163933 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.compute.api [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Found an unconfirmed migration during delete, id: 16, status: finished May 10 03:03:37.588481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1117ac8c-a60e-435c-836e-71946bd0f92c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 204 len: 0 microversion: 2.1 time: 1.514796 May 10 03:03:37.589180 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3275/6589] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:03:36 2022] DELETE /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 0 bytes in 1516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:03:37.598463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:37.599331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:37.606060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:37.606517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:37.607319 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:37.607765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:37.735321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:37.742966 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-420c4955-b507-4c2a-b921-514557530571 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1501 microversion: 2.1 time: 0.148373 May 10 03:03:37.743606 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3315/6590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:37 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:37.865020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-48700cf4-3ab5-4524-bbfa-2f3f58343035 req-fd2bb02a-c673-46c6-bf0a-5b8208b426f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d78b1-001b-4931-aa4c-55a109eebb22", "name": "network-vif-plugged", "status": "completed", "tag": "df05b19a-4350-48a4-9fdf-46842fa575e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:37.873967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-48700cf4-3ab5-4524-bbfa-2f3f58343035 req-fd2bb02a-c673-46c6-bf0a-5b8208b426f0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:37.874442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-48700cf4-3ab5-4524-bbfa-2f3f58343035 req-fd2bb02a-c673-46c6-bf0a-5b8208b426f0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:37.885466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-48700cf4-3ab5-4524-bbfa-2f3f58343035 req-fd2bb02a-c673-46c6-bf0a-5b8208b426f0 service nova] Creating event network-vif-plugged:df05b19a-4350-48a4-9fdf-46842fa575e3 for instance f67d78b1-001b-4931-aa4c-55a109eebb22 on n-h1-841089-2 May 10 03:03:37.890919 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-48700cf4-3ab5-4524-bbfa-2f3f58343035 req-fd2bb02a-c673-46c6-bf0a-5b8208b426f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030018 May 10 03:03:37.891769 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3276/6591] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:03:38.758965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:38.759619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:38.766498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:38.766959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:38.767766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:38.768215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:38.900048 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7bab44350a4b9b842cb316eea0d9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc9abfe5a284d2591b6f0fb9416ea68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:38.908110 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b4c7dbdc-5b2b-41a3-a739-f4912ab54171 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 200 len: 1501 microversion: 2.1 time: 0.153070 May 10 03:03:38.908688 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3316/6592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:38 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:39.333215 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f8a634df-0cad-4080-be41-f3500d72722d req-4262c917-9fae-480d-a785-dcd03d816810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d78b1-001b-4931-aa4c-55a109eebb22", "name": "network-vif-deleted", "tag": "df05b19a-4350-48a4-9fdf-46842fa575e3"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:39.342365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f8a634df-0cad-4080-be41-f3500d72722d req-4262c917-9fae-480d-a785-dcd03d816810 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:39.342842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f8a634df-0cad-4080-be41-f3500d72722d req-4262c917-9fae-480d-a785-dcd03d816810 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:39.358008 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f8a634df-0cad-4080-be41-f3500d72722d req-4262c917-9fae-480d-a785-dcd03d816810 service nova] Creating event network-vif-deleted:df05b19a-4350-48a4-9fdf-46842fa575e3 for instance f67d78b1-001b-4931-aa4c-55a109eebb22 on n-h1-841089-2 May 10 03:03:39.362776 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f8a634df-0cad-4080-be41-f3500d72722d req-4262c917-9fae-480d-a785-dcd03d816810 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 May 10 03:03:39.363448 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3277/6593] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:03:39.924935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:39.925531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:39.932710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:39.933171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:39.934532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:39.934984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:39.948091 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] HTTP exception thrown: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Request method failure captured: May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 HTTP/1.1 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedXbCgakP1wNgOFO6JwX1j__pKwvAwzA-39_3a5Bm5zEwbCz8Z-Q42vJ8pwDtRBPWVk6-S0-D_5OuSy8edApJL7i_dcHs9KqtX8S1wkMwAVUT0UK-2trU_LGUYcY3w0IDkMpDU2ZK1hnJmfZFtReWurAkovyTQjEVLLKPKCg_lQMWI8 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ccc9abfe5a284d2591b6f0fb9416ea68 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-990061428 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ccc9abfe5a284d2591b6f0fb9416ea68", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-990061428 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ccc9abfe5a284d2591b6f0fb9416ea68 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-990061428 May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-990061428-project May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1d7bab44350a4b9b842cb316eea0d9fb May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-990061428-project May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f67d78b1-001b-4931-aa4c-55a109eebb22'} May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:03:39.949765 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Returning 404 to user: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c715bdeb-37d7-4506-a179-ca6c8e29de7c tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 404 len: 111 microversion: 2.1 time: 0.030235 May 10 03:03:39.954449 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3317/6594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:39 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:03:39.967163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:39.967775 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:39.974184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:39.974657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:39.975548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:39.976011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:39.989559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] HTTP exception thrown: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Request method failure captured: May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 HTTP/1.1 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedXbCgakP1wNgOFO6JwX1j__pKwvAwzA-39_3a5Bm5zEwbCz8Z-Q42vJ8pwDtRBPWVk6-S0-D_5OuSy8edApJL7i_dcHs9KqtX8S1wkMwAVUT0UK-2trU_LGUYcY3w0IDkMpDU2ZK1hnJmfZFtReWurAkovyTQjEVLLKPKCg_lQMWI8 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: ccc9abfe5a284d2591b6f0fb9416ea68 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-DeleteServersTestJSON-990061428 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ccc9abfe5a284d2591b6f0fb9416ea68", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-DeleteServersTestJSON-990061428 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: ccc9abfe5a284d2591b6f0fb9416ea68 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-DeleteServersTestJSON-990061428 May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-DeleteServersTestJSON-990061428-project May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 1d7bab44350a4b9b842cb316eea0d9fb May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-DeleteServersTestJSON-990061428-project May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'f67d78b1-001b-4931-aa4c-55a109eebb22'} May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:03:39.991245 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Returning 404 to user: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0fb5691a-6142-436b-9de5-d06ba7f8b8c0 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 404 len: 111 microversion: 2.1 time: 0.030245 May 10 03:03:39.996530 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3278/6595] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:03:39 2022] DELETE /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:03:40.001608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:40.002237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] [instance: f67d78b1-001b-4931-aa4c-55a109eebb22] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:40.008186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:40.008644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:40.009419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:40.009861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:40.022862 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] HTTP exception thrown: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Request method failure captured: May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 HTTP/1.1 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedXbCgakP1wNgOFO6JwX1j__pKwvAwzA-39_3a5Bm5zEwbCz8Z-Q42vJ8pwDtRBPWVk6-S0-D_5OuSy8edApJL7i_dcHs9KqtX8S1wkMwAVUT0UK-2trU_LGUYcY3w0IDkMpDU2ZK1hnJmfZFtReWurAkovyTQjEVLLKPKCg_lQMWI8 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: ccc9abfe5a284d2591b6f0fb9416ea68 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-DeleteServersTestJSON-990061428 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ccc9abfe5a284d2591b6f0fb9416ea68", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ccc9abfe5a284d2591b6f0fb9416ea68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-DeleteServersTestJSON-990061428 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: ccc9abfe5a284d2591b6f0fb9416ea68 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-DeleteServersTestJSON-990061428 May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-DeleteServersTestJSON-990061428-project May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 1d7bab44350a4b9b842cb316eea0d9fb May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-DeleteServersTestJSON-990061428-project May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'f67d78b1-001b-4931-aa4c-55a109eebb22'} May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:03:40.024414 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] Returning 404 to user: Instance f67d78b1-001b-4931-aa4c-55a109eebb22 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0febe59d-f80b-41e2-99af-b443a0324896 tempest-DeleteServersTestJSON-990061428 tempest-DeleteServersTestJSON-990061428-project] 10.222.0.52 "GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22" status: 404 len: 111 microversion: 2.1 time: 0.028030 May 10 03:03:40.029203 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3318/6596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:39 2022] GET /compute/v2.1/servers/f67d78b1-001b-4931-aa4c-55a109eebb22 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:03:42.677021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-392027744", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "ebd5e453-59a8-4400-b1e3-9960f19ad1dc"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:42.730994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] validate_networks() for [('ebd5e453-59a8-4400-b1e3-9960f19ad1dc', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:03:43.064363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:03:43.064830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:03:43.065361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:03:43.065790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:03:43.066223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:03:43.074841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:43.075346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:43.076173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:43.076630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:43.093780 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Getting quotas for project e1d813cdab7d4e46a7a549cfcf89ec48. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:03:43.098971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Getting quotas for user 7fb2562ff19644edac0364a3d2ee32f4 and project e1d813cdab7d4e46a7a549cfcf89ec48. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:03:43.111792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:03:43.114031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:03:43.157988 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d76a6ca3-887b-4b45-a9de-a6fa10764c18 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596055 May 10 03:03:43.158643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3279/6597] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:03:43.169343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fdf4a364-a2b1-4c18-b88b-139f0a4b4a66 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:43.169966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fdf4a364-a2b1-4c18-b88b-139f0a4b4a66 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:43.223577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fdf4a364-a2b1-4c18-b88b-139f0a4b4a66 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:43.231666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fdf4a364-a2b1-4c18-b88b-139f0a4b4a66 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1217 microversion: 2.1 time: 0.066751 May 10 03:03:43.232352 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3319/6598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:43 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:03:44.250136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:44.250813 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:44.257735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:44.258214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:44.259018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:44.259502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:44.321748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:44.329230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b4050ed7-a219-4b97-aad9-66fc2c646a0c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1275 microversion: 2.1 time: 0.084522 May 10 03:03:44.329813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3280/6599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:44 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:45.293643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-73672777-4758-4f77-89c9-2cfe2ba42231 req-ac1e308b-4468-400d-810b-1dd55b39dba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc10f0de-0629-45c4-a200-f89e2e2f9888", "tag": "7ac98d77-9fc0-47f5-84bd-720b7b92922c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:45.305453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-73672777-4758-4f77-89c9-2cfe2ba42231 req-ac1e308b-4468-400d-810b-1dd55b39dba5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:45.305904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-73672777-4758-4f77-89c9-2cfe2ba42231 req-ac1e308b-4468-400d-810b-1dd55b39dba5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:45.325348 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-73672777-4758-4f77-89c9-2cfe2ba42231 req-ac1e308b-4468-400d-810b-1dd55b39dba5 service nova] Creating event network-changed:7ac98d77-9fc0-47f5-84bd-720b7b92922c for instance fc10f0de-0629-45c4-a200-f89e2e2f9888 on n-h1-841089-2 May 10 03:03:45.330608 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-73672777-4758-4f77-89c9-2cfe2ba42231 req-ac1e308b-4468-400d-810b-1dd55b39dba5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042777 May 10 03:03:45.331314 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3320/6600] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:03:45.346255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:45.347022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:45.354407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:45.354880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:45.355728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:45.356181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:45.487728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:45.495327 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf7b0d2f-05b1-4ef5-bc6c-a53df8e25a5a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1317 microversion: 2.1 time: 0.153243 May 10 03:03:45.496409 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3281/6601] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:45 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:46.512966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:46.513675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:46.520741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:46.521210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:46.521971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:46.522413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:46.652766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:46.660319 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38b7d229-7e1f-4484-9f04-737604103de9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1317 microversion: 2.1 time: 0.151584 May 10 03:03:46.661000 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3321/6602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:46 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:47.676921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:47.677817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:47.685117 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:47.685572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:47.686354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:47.686806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:47.819460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:47.827729 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d001da0f-6959-4048-8858-c5a0c9ef41ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1317 microversion: 2.1 time: 0.154469 May 10 03:03:47.830080 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3282/6603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:47 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:48.846797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:48.847457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:48.854233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:48.854699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:48.855516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:48.855973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:48.984435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:48.991709 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fbd7c68-1505-4f78-ac90-d9c6ad62579c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1317 microversion: 2.1 time: 0.148818 May 10 03:03:48.992287 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3322/6604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:48 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:49.901676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4d5eac22-7298-41b8-8737-da4c2f2956d1 req-59cf2447-2f75-43b2-9549-cf84f4fc005a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc10f0de-0629-45c4-a200-f89e2e2f9888", "name": "network-vif-plugged", "status": "completed", "tag": "7ac98d77-9fc0-47f5-84bd-720b7b92922c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:49.911510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4d5eac22-7298-41b8-8737-da4c2f2956d1 req-59cf2447-2f75-43b2-9549-cf84f4fc005a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:49.912705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4d5eac22-7298-41b8-8737-da4c2f2956d1 req-59cf2447-2f75-43b2-9549-cf84f4fc005a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:49.924860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4d5eac22-7298-41b8-8737-da4c2f2956d1 req-59cf2447-2f75-43b2-9549-cf84f4fc005a service nova] Creating event network-vif-plugged:7ac98d77-9fc0-47f5-84bd-720b7b92922c for instance fc10f0de-0629-45c4-a200-f89e2e2f9888 on n-h1-841089-2 May 10 03:03:49.930069 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4d5eac22-7298-41b8-8737-da4c2f2956d1 req-59cf2447-2f75-43b2-9549-cf84f4fc005a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 May 10 03:03:49.930666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3283/6605] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:03:50.008637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:50.009268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:50.016077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:50.016546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:50.017330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:50.017786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:50.145743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:50.153618 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b99f8de2-5395-4608-afb9-c0ee576cd841 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1317 microversion: 2.1 time: 0.148911 May 10 03:03:50.154580 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3323/6606] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:50 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:51.174089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:51.174840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:51.182585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:51.183059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:51.184479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:51.184936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:51.323182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:51.330929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab6ed2eb-8583-4884-818e-fb67c18d85a8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1317 microversion: 2.1 time: 0.162930 May 10 03:03:51.331559 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3284/6607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:51 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:52.350573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:52.351701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:52.360574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.361049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.361843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.362300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.491654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:52.499345 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4bc4b6f4-1d94-4061-acc0-34f99dd1e0b7 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1506 microversion: 2.1 time: 0.154506 May 10 03:03:52.499935 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3324/6608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:52 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:03:52.515821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:52.516601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:52.523511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.524080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.524951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.525486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.661123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:52.669581 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ae9a104c-d72c-49a6-8ec1-f26629e9c267 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1506 microversion: 2.1 time: 0.158206 May 10 03:03:52.670274 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3285/6609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:52 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:52.685568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:52.686702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:52.692576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.693036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.693819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.694269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.756215 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88c7e652-98f1-4616-947c-5b8889f74ac9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "PUT /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1078 microversion: 2.1 time: 0.074461 May 10 03:03:52.765883 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3325/6610] 10.222.0.52 () {60 vars in 1255 bytes} [Tue May 10 03:03:52 2022] PUT /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1078 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:52.771494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:52.772127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:52.778615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.779102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.780116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.780607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.908329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:52.915656 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9ab645d-5d76-48db-a20a-cc79bf38ed01 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1504 microversion: 2.1 time: 0.148084 May 10 03:03:52.916225 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3286/6611] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:52 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:03:52.931472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:52.932090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:52.938394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.938844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:52.939645 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:52.940091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:53.066555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:53.074527 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-925f9d29-bebc-4f6c-9920-be44ecdd9d0f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1504 microversion: 2.1 time: 0.146518 May 10 03:03:53.075119 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3326/6612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:52 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:53.091110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:03:53.092126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:53.098066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:53.098544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:53.099362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:53.099824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:53.127446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:53.133006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Old instance type m1.heat2, new instance type m1.heat {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:03:53.139802 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:03:53.140252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:03:53.140752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:03:53.141201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:03:53.141618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:03:53.202178 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e9487d5-5023-4b2b-b2fb-3f0a74dbcdfa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "POST /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888/action" status: 202 len: 0 microversion: 2.1 time: 0.115479 May 10 03:03:53.202850 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3287/6613] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:03:53 2022] POST /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:03:53.210917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:53.211692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:53.217777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:53.218234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:53.219005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:53.219491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:53.374171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:53.382188 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ce8b496e-ea65-4c1d-b7ac-4d6b539b883c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1515 microversion: 2.1 time: 0.174671 May 10 03:03:53.382708 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3327/6614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:53 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:54.400684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:54.401327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:54.407409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:54.407888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:54.408689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:54.409155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:54.544457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:54.552185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eddc51dc-18dd-49f0-889b-5447150cf5a4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1515 microversion: 2.1 time: 0.156341 May 10 03:03:54.553037 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3288/6615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:54 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:55.569666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:55.570316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:55.577383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:55.577863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:55.578630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:55.579088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:55.707296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:55.714836 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ddd4b1d2-0fa8-4797-8c31-82b750c42ab5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.149042 May 10 03:03:55.715441 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3328/6616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:55 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:56.733467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:56.734105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:56.740936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:56.741406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:56.742190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:56.742673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:56.871656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:56.880024 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ab926b09-1d38-4f0c-b3af-e3863d1a55b8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.151122 May 10 03:03:56.880666 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3289/6617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:56 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:57.897477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:57.898026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:57.905018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:57.905479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:57.906260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:57.906706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:58.034880 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:58.042283 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c12e213-7f41-4661-8c85-2412289c1825 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.149057 May 10 03:03:58.042852 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3329/6618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:57 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:03:59.060339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:03:59.060981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:03:59.067859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:59.068329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:59.069118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:03:59.069578 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:03:59.199598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:03:59.206970 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b537c00e-6a34-4e31-8f60-f5a6d8c585d2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.151109 May 10 03:03:59.207583 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3290/6619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:03:59 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:00.223876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:00.224508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:00.231874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:00.232341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:00.233120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:00.233572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:00.362100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:00.369381 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb014592-0292-4362-bdeb-0866583957ff tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.149511 May 10 03:04:00.369949 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3330/6620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:00 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:01.385959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:01.386592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:01.393454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:01.393923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:01.394709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:01.395204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:01.521991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:01.530721 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-01edce38-57c0-4453-a892-b74e41bbde7d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.148664 May 10 03:04:01.531355 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3291/6621] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:01 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:02.547883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:02.548550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:02.555784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:02.556244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:02.557014 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:02.557461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:02.690208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:02.697844 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76f4bf14-0f38-41d2-a37f-83d64c6daf89 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.153988 May 10 03:04:02.698552 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3331/6622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:02 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:03.715027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:03.715693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:03.722798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:03.723329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:03.724133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:03.724590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:03.854308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:03.861886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13f6bfc2-35d6-448b-9cff-a4227af97176 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.150840 May 10 03:04:03.862469 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3292/6623] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:03 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:04.878304 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:04.878933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:04.885575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:04.886038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:04.886817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:04.887298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:05.370873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:05.378763 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32861b4b-76c7-49cb-90c9-a8e5c23fbefb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.504418 May 10 03:04:05.379453 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3332/6624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:04 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:06.396545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:06.397182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:06.405031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:06.405530 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:06.406346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:06.406803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:06.530165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:06.537433 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00d67e58-d596-46b1-b9eb-cbe74bfb5c23 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.144917 May 10 03:04:06.537999 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3293/6625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:06 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:07.557353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:07.558468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:07.567502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:07.567976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:07.569357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:07.570204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:07.705446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:07.712868 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-96c111bd-b780-49f2-9b1e-4b7353f64939 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.162552 May 10 03:04:07.713454 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3333/6626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:07 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:08.729799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:08.730460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:08.737861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:08.738334 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:08.739139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:08.739599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:08.865233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:08.873202 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d631e3f3-8b5b-4ea3-a422-62ddd360d7f4 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.147313 May 10 03:04:08.873782 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3294/6627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:08 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:09.889793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:09.890418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:09.897370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:09.897780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:09.898567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:09.899016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:10.024219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:10.031604 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d498c4d6-6660-46a0-91ae-6f7970e67885 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.146394 May 10 03:04:10.032185 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3334/6628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:09 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:11.048152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:11.048797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:11.055923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:11.056402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:11.057197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:11.057656 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:11.185932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:11.193327 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-90031705-4263-4337-b3e7-2b6281236929 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.149121 May 10 03:04:11.193907 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3295/6629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:11 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:12.212107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:12.212736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:12.220283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:12.220760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:12.221528 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:12.221976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:12.347632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:12.354881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9765922b-cbfb-43a4-b0db-425a2005458f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.146692 May 10 03:04:12.355515 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3335/6630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:12 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:13.372625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:13.373273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:13.380455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:13.380930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:13.381721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:13.382183 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:13.513987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:13.521353 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7d5ba6c4-cd6a-4f8c-a6f5-8a408ce347cd tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.153417 May 10 03:04:13.521930 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3296/6631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:13 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:14.538527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:14.539207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:14.546150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:14.546608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:14.547414 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:14.547860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:14.674744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:14.682291 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5789fcb8-8574-4800-9281-14932295c500 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.147595 May 10 03:04:14.682867 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3336/6632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:14 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:15.700883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:15.701544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:15.708521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:15.708991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:15.709773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:15.710259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:15.835477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:15.842715 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-270037f3-9ab6-4b3e-8774-364b4500e017 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.146498 May 10 03:04:15.843318 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3297/6633] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:15 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:16.859789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:16.860439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:16.866994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:16.867485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:16.868248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:16.868689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:16.999944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:17.007236 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f4143ad-6d30-47d1-985c-999bbe7fd3ac tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.151451 May 10 03:04:17.007799 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3337/6634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:16 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:18.026030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:18.027295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:18.034391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:18.034868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:18.035704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:18.036205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:18.162142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:18.169598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f89de86-e834-4dfc-af7d-c9eefcf7e14f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.147890 May 10 03:04:18.170177 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3298/6635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:18 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:19.186142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:19.186764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:19.193582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:19.194050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:19.194823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:19.195299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:19.326131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:19.333455 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-51fd7801-d19e-4441-9337-abe9f37b683c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.151247 May 10 03:04:19.334036 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3338/6636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:19 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:20.351569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:20.352244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:20.359295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:20.359773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:20.360566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:20.361030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:20.486261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:20.493747 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a1ff40c-e32d-4d71-9f18-277539e4015f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.146384 May 10 03:04:20.494326 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3299/6637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:20 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:21.509820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:21.510481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:21.517300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:21.517763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:21.518544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:21.518988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:21.655147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:21.662528 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0578d6cc-15ac-4e20-ba2d-26099b91aed1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1520 microversion: 2.1 time: 0.156627 May 10 03:04:21.663129 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3339/6638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:21 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:22.385507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-43adde5e-b32e-4ea5-9130-9525eada8028 req-e3ecc3fa-baeb-41d8-8b50-493587fab527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc10f0de-0629-45c4-a200-f89e2e2f9888", "name": "network-vif-unplugged", "status": "completed", "tag": "7ac98d77-9fc0-47f5-84bd-720b7b92922c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:22.396370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-43adde5e-b32e-4ea5-9130-9525eada8028 req-e3ecc3fa-baeb-41d8-8b50-493587fab527 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:22.396904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-43adde5e-b32e-4ea5-9130-9525eada8028 req-e3ecc3fa-baeb-41d8-8b50-493587fab527 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:22.410164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-43adde5e-b32e-4ea5-9130-9525eada8028 req-e3ecc3fa-baeb-41d8-8b50-493587fab527 service nova] Creating event network-vif-unplugged:7ac98d77-9fc0-47f5-84bd-720b7b92922c for instance fc10f0de-0629-45c4-a200-f89e2e2f9888 on n-h2-841089-2 May 10 03:04:22.415609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-43adde5e-b32e-4ea5-9130-9525eada8028 req-e3ecc3fa-baeb-41d8-8b50-493587fab527 service nova] Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:04:22.426763 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-43adde5e-b32e-4ea5-9130-9525eada8028 req-e3ecc3fa-baeb-41d8-8b50-493587fab527 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045176 May 10 03:04:22.428644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3300/6639] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:04:22.680137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:22.680762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:22.687576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:22.688037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:22.688823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:22.689269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:22.880578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:22.887963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a92be341-71ba-4553-b3d5-071892294a28 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1519 microversion: 2.1 time: 0.212212 May 10 03:04:22.888541 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3340/6640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:22 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:23.907024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:23.907695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:23.914610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:23.915107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:23.915885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:23.916341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:24.045041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:24.052971 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-76a153a6-6f4c-49d3-9a66-335b6b208b40 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1517 microversion: 2.1 time: 0.150883 May 10 03:04:24.053799 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3301/6641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:23 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:24.444623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b553b147-ee51-4a9a-922b-e9fc18964429 req-72be231d-243f-4234-aab8-de8b339900c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc10f0de-0629-45c4-a200-f89e2e2f9888", "tag": "7ac98d77-9fc0-47f5-84bd-720b7b92922c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:24.454429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b553b147-ee51-4a9a-922b-e9fc18964429 req-72be231d-243f-4234-aab8-de8b339900c2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:24.454885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b553b147-ee51-4a9a-922b-e9fc18964429 req-72be231d-243f-4234-aab8-de8b339900c2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:24.466298 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b553b147-ee51-4a9a-922b-e9fc18964429 req-72be231d-243f-4234-aab8-de8b339900c2 service nova] Creating event network-changed:7ac98d77-9fc0-47f5-84bd-720b7b92922c for instance fc10f0de-0629-45c4-a200-f89e2e2f9888 on n-h2-841089-2 May 10 03:04:24.472225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-b553b147-ee51-4a9a-922b-e9fc18964429 req-72be231d-243f-4234-aab8-de8b339900c2 service nova] Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:04:24.483101 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b553b147-ee51-4a9a-922b-e9fc18964429 req-72be231d-243f-4234-aab8-de8b339900c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042120 May 10 03:04:24.483725 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3341/6642] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:04:25.070788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:25.071785 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:25.079937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:25.080645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:25.081667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:25.082209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:25.308972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:25.316400 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1fdacd2-cf1d-4ebe-99df-9042515ab92c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1517 microversion: 2.1 time: 0.250359 May 10 03:04:25.316986 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3302/6643] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:25 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:26.335039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:26.335784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:26.342594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:26.343050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:26.343843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:26.344289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:26.478824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:26.486892 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f51d60b9-7ff3-4ab5-8d2c-3e814b896c83 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1514 microversion: 2.1 time: 0.156987 May 10 03:04:26.487507 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3342/6644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:26 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:04:26.503315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:26.504079 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:26.510870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:26.511445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:26.512307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:26.512862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:26.575531 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b2a977f-5808-4c91-8608-54b204831b9e tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "POST /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888/action" status: 204 len: 0 microversion: 2.1 time: 0.076121 May 10 03:04:26.576203 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3303/6645] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:04:26 2022] POST /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:04:26.585848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:26.586716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:26.593613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:26.594197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:26.595057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:26.595634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:26.739636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:26.747004 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-73a34cf2-2ef3-42d3-ad81-103788434f4a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1514 microversion: 2.1 time: 0.166062 May 10 03:04:26.747616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3343/6646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:26 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:27.766865 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:27.767618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:27.773824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:27.774293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:27.775110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:27.775574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:27.902257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:27.909679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc19a14f-1c49-4758-96da-9b551b1bfaaa tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1506 microversion: 2.1 time: 0.148698 May 10 03:04:27.910289 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3304/6647] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:27 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:04:27.925603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:27.926238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:27.933205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:27.933657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:27.934430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:27.934871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.065075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:28.072357 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0d19c4e-01eb-467c-ae3d-9dc5580ffd33 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1506 microversion: 2.1 time: 0.150561 May 10 03:04:28.072932 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3344/6648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:27 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:28.088437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:28.089085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:28.095155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.095629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.096417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.096867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.224040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:28.231405 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-608a11ae-70e5-425d-bd27-67d43f9634ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 200 len: 1506 microversion: 2.1 time: 0.146857 May 10 03:04:28.231983 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3305/6649] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:28 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:28.247327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:28.247832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:28.254203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.254660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.255463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.255913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.279271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:04:28.354761 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eca86745-0d7f-4498-9cf1-f3af987cc06a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 204 len: 0 microversion: 2.1 time: 0.110767 May 10 03:04:28.355399 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3345/6650] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:04:28 2022] DELETE /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:04:28.409908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1432592244", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "ebd5e453-59a8-4400-b1e3-9960f19ad1dc"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:28.459059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] validate_networks() for [('ebd5e453-59a8-4400-b1e3-9960f19ad1dc', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:04:28.632737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e093bd14-ca36-402f-949e-a74ad2946320 req-4846b651-130c-4fb6-b414-8613cc552da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc10f0de-0629-45c4-a200-f89e2e2f9888", "name": "network-vif-plugged", "status": "completed", "tag": "7ac98d77-9fc0-47f5-84bd-720b7b92922c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:28.644391 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e093bd14-ca36-402f-949e-a74ad2946320 req-4846b651-130c-4fb6-b414-8613cc552da5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.644861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e093bd14-ca36-402f-949e-a74ad2946320 req-4846b651-130c-4fb6-b414-8613cc552da5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.660401 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e093bd14-ca36-402f-949e-a74ad2946320 req-4846b651-130c-4fb6-b414-8613cc552da5 service nova] Creating event network-vif-plugged:7ac98d77-9fc0-47f5-84bd-720b7b92922c for instance fc10f0de-0629-45c4-a200-f89e2e2f9888 on n-h2-841089-2 May 10 03:04:28.666535 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e093bd14-ca36-402f-949e-a74ad2946320 req-4846b651-130c-4fb6-b414-8613cc552da5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 May 10 03:04:28.667460 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3346/6651] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:04:28.837391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:04:28.837859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:04:28.838325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:04:28.838791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:04:28.839288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:04:28.848661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.849135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.849971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:28.850435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:28.867654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Getting quotas for project e1d813cdab7d4e46a7a549cfcf89ec48. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:04:28.872901 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Getting quotas for user 7fb2562ff19644edac0364a3d2ee32f4 and project e1d813cdab7d4e46a7a549cfcf89ec48. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:04:28.885023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:04:28.887324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:04:28.934196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e749622c-65de-4743-8e77-4d84ea84e56b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528182 May 10 03:04:28.934866 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3306/6652] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:04:28.946539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dedc9ab8-604b-4b03-ae89-537470c89a00 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:28.947224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dedc9ab8-604b-4b03-ae89-537470c89a00 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:29.002616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dedc9ab8-604b-4b03-ae89-537470c89a00 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:29.009415 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dedc9ab8-604b-4b03-ae89-537470c89a00 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1218 microversion: 2.1 time: 0.068009 May 10 03:04:29.010009 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3347/6653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:28 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:30.027407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:30.028056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:30.035491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:30.035970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:30.036768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:30.037233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:30.108966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:30.116395 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1058bad3-3252-4614-8392-35d33793bd81 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1270 microversion: 2.1 time: 0.092962 May 10 03:04:30.121466 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3307/6654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:30 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:30.762741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-5336f477-5320-476e-986f-6b3e7ae8d2a4 req-149a59ed-75b1-42a5-b261-86f852f298ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc10f0de-0629-45c4-a200-f89e2e2f9888", "name": "network-vif-deleted", "tag": "7ac98d77-9fc0-47f5-84bd-720b7b92922c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:30.774992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5336f477-5320-476e-986f-6b3e7ae8d2a4 req-149a59ed-75b1-42a5-b261-86f852f298ce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:30.775593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-5336f477-5320-476e-986f-6b3e7ae8d2a4 req-149a59ed-75b1-42a5-b261-86f852f298ce service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:30.790075 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-5336f477-5320-476e-986f-6b3e7ae8d2a4 req-149a59ed-75b1-42a5-b261-86f852f298ce service nova] Creating event network-vif-deleted:7ac98d77-9fc0-47f5-84bd-720b7b92922c for instance fc10f0de-0629-45c4-a200-f89e2e2f9888 on n-h2-841089-2 May 10 03:04:30.794955 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-5336f477-5320-476e-986f-6b3e7ae8d2a4 req-149a59ed-75b1-42a5-b261-86f852f298ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035930 May 10 03:04:30.796205 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3348/6655] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:04:31.134008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:31.134770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:31.142583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:31.143124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:31.144009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:31.144524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:31.372025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:31.384218 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a8f7c587-2e3d-4547-b3d5-bd0a70065108 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1318 microversion: 2.1 time: 0.254803 May 10 03:04:31.384821 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3308/6656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:31 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:32.403136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:32.403855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:32.410017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:32.410479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:32.411292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:32.411746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:32.538803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:32.546566 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-919c87b1-7f8d-47e7-ac64-d102ef38a970 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1318 microversion: 2.1 time: 0.148532 May 10 03:04:32.547166 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3349/6657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:32 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:32.810485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fe4fd41f-8e90-4661-a536-c9d93168b9a1 req-774b4ae3-1eff-4d22-b394-dd5179b3ad34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ea5f67-34bb-4edb-b3d5-c78498b58c73", "tag": "1f10e9e1-88bd-4de8-b876-8ab41217243b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:32.820033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fe4fd41f-8e90-4661-a536-c9d93168b9a1 req-774b4ae3-1eff-4d22-b394-dd5179b3ad34 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:32.820506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fe4fd41f-8e90-4661-a536-c9d93168b9a1 req-774b4ae3-1eff-4d22-b394-dd5179b3ad34 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:32.831252 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fe4fd41f-8e90-4661-a536-c9d93168b9a1 req-774b4ae3-1eff-4d22-b394-dd5179b3ad34 service nova] Creating event network-changed:1f10e9e1-88bd-4de8-b876-8ab41217243b for instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 on n-h2-841089-2 May 10 03:04:32.836198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fe4fd41f-8e90-4661-a536-c9d93168b9a1 req-774b4ae3-1eff-4d22-b394-dd5179b3ad34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029462 May 10 03:04:32.836775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3309/6658] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:04:33.324115 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:04:33.324115 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:04:33.563845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:33.564523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:33.571387 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:33.571848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:33.572728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:33.573198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:33.706452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:33.713815 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3123a715-e2df-4eae-9a4f-0a68d82955a3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1318 microversion: 2.1 time: 0.154020 May 10 03:04:33.714380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3350/6659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:33 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:34.731374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:34.732101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:34.738897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:34.739416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:34.740203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:34.740663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:34.875130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:34.882515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8e15ee5d-4521-4478-8db8-e73ac5a414df tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1318 microversion: 2.1 time: 0.156419 May 10 03:04:34.883133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3310/6660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:34 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:35.899676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:35.900229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:35.907299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:35.907753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:35.908517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:35.908958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:36.036415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:36.043654 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91bef025-156b-484d-bc7a-4f1c895af34c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1318 microversion: 2.1 time: 0.147977 May 10 03:04:36.044221 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3351/6661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:35 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:36.715242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4bb23ec7-32b0-4752-81aa-e947bff6613e req-e235119f-d1fc-48ec-b3fc-15ea5871a8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ea5f67-34bb-4edb-b3d5-c78498b58c73", "name": "network-vif-plugged", "status": "completed", "tag": "1f10e9e1-88bd-4de8-b876-8ab41217243b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:36.725658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4bb23ec7-32b0-4752-81aa-e947bff6613e req-e235119f-d1fc-48ec-b3fc-15ea5871a8d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:36.726128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4bb23ec7-32b0-4752-81aa-e947bff6613e req-e235119f-d1fc-48ec-b3fc-15ea5871a8d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:36.737837 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4bb23ec7-32b0-4752-81aa-e947bff6613e req-e235119f-d1fc-48ec-b3fc-15ea5871a8d1 service nova] Creating event network-vif-plugged:1f10e9e1-88bd-4de8-b876-8ab41217243b for instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 on n-h2-841089-2 May 10 03:04:36.743293 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4bb23ec7-32b0-4752-81aa-e947bff6613e req-e235119f-d1fc-48ec-b3fc-15ea5871a8d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031613 May 10 03:04:36.743884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3311/6662] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:04:37.061524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:37.062708 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:37.071881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:37.072348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:37.073240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:37.073699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:37.201703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:37.209256 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cbff20e9-85bd-4e2f-b4b6-eefb7b1aadf9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1318 microversion: 2.1 time: 0.152348 May 10 03:04:37.209830 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3352/6663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:37 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:38.226436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:38.227178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:38.234638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.235243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.236035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.236491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.362201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:38.369655 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd98cfd2-673f-4bc3-b695-480edbeb040a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1507 microversion: 2.1 time: 0.147512 May 10 03:04:38.370228 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3312/6664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:38 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:04:38.386410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:38.387036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:38.394490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.394954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.395818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.396266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.526386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:38.533696 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3223d0d7-8f34-4a5d-9e42-a4472be34700 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1507 microversion: 2.1 time: 0.151166 May 10 03:04:38.534268 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3353/6665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:38 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:38.550120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:04:38.551213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:38.557333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.557836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.558622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.559112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.586773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:38.592496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Old instance type m1.heat2, new instance type m1.heat {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:04:38.598590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:04:38.599030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:04:38.599552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:04:38.600125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:04:38.600554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:04:38.662920 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b693ed98-bc2d-4824-9e45-0e46a5748c6a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "POST /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73/action" status: 202 len: 0 microversion: 2.1 time: 0.116682 May 10 03:04:38.663589 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3313/6666] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:04:38 2022] POST /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:04:38.673206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:38.673834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:38.679951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.680409 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.681186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:38.681631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:38.836122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:38.843618 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f8ac60b3-907f-4707-b97e-4a5c80cbc6bb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1514 microversion: 2.1 time: 0.175569 May 10 03:04:38.844200 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3354/6667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:38 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:39.861236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:39.861909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:39.868749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:39.869227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:39.870025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:39.870488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:40.092367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:40.099819 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6930cdf0-52f8-4292-8471-54cd1ab23857 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1514 microversion: 2.1 time: 0.242823 May 10 03:04:40.100413 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3314/6668] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:39 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:41.117337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:41.117977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:41.125550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:41.126001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:41.126770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:41.127248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:41.255957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:41.263294 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f01bad74-8f77-4b4d-9abb-b958fd8f7f8d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.149813 May 10 03:04:41.263870 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3355/6669] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:41 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:42.279931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:42.280827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:42.287669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:42.288155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:42.289006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:42.289475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:42.417125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:42.425067 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-74deb0a7-78cf-45db-89c8-7b21b3fac2f3 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.149625 May 10 03:04:42.425643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3315/6670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:42 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:43.442595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:43.443259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:43.450001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:43.450460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:43.451270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:43.451718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:43.580207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:43.587467 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aadd0cd8-5bc4-494a-b9ed-3da18697f9eb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.148782 May 10 03:04:43.588045 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3356/6671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:43 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:44.604508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:44.605146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:44.612054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:44.612531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:44.613355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:44.613818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:44.746521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:44.754087 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da3e5ea0-2e70-447e-b095-cc46f7b1208c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.153446 May 10 03:04:44.754664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3316/6672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:44 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:45.771960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:45.772588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:45.778922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:45.779417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:45.780184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:45.780640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:45.909602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:45.916980 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a79b4950-d78c-4b3e-ad04-02abe3c77869 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.149055 May 10 03:04:45.917560 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3357/6673] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:45 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:46.934157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:46.934706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:46.941420 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:46.941889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:46.942707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:46.943228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:47.070373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:47.078256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a5b5b6f9-b8e8-4a57-8525-a2250bce9160 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.147618 May 10 03:04:47.078837 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3317/6674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:46 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:48.095634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:48.096263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:48.102957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:48.103455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:48.104231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:48.104678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:48.229214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:48.237267 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-633b637c-7f96-4762-996e-5d3db21c8ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.146120 May 10 03:04:48.237839 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3358/6675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:48 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:49.254348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:49.254978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:49.261973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:49.262446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:49.263259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:49.263723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:49.397829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:49.405185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d3cb0f6d-4298-4456-a12e-116d8ad47eb6 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.154751 May 10 03:04:49.406258 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3318/6676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:49 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:50.422913 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:50.423518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:50.430541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:50.430998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:50.431800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:50.432251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:50.558354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:50.566432 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e34b6996-c939-4ed9-ab6b-55a18437d881 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.147690 May 10 03:04:50.567013 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3359/6677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:50 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:51.584288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:51.584931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:51.591384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:51.591859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:51.592663 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:51.593124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:51.734077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:51.741524 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-852d54db-a81e-45b5-9811-7b0088923f05 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.161517 May 10 03:04:51.742097 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3319/6678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:51 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:04:52.758330 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:52.758949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:52.765750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:52.766206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:52.767638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:52.768084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:52.900961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:52.908970 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-07cff459-7d34-44e9-9fc9-6ed9b04eb245 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.154534 May 10 03:04:52.909537 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3360/6679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:52 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:53.926575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:53.927140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:53.934218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:53.934694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:53.935508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:53.935973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:54.060873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:54.068878 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f3119f8-8584-4bf2-a955-172a5f63fb6f tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.146976 May 10 03:04:54.069463 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3320/6680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:53 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:55.085701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:55.086346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:55.093067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:55.093522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:55.094290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:55.094734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:55.226353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:55.233590 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8e5e2ab4-49ab-455f-a5df-4c7ca4ea6ede tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.151762 May 10 03:04:55.234161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3361/6681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:55 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:56.251467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:56.252017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:56.258758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:56.259286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:56.260080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:56.260544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:56.387260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:56.395230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e4f4256-3035-4e68-8a92-f02b4ec2d1e8 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.148349 May 10 03:04:56.395815 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3321/6682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:56 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:57.412713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:57.413338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:57.420213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:57.420674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:57.421453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:57.421901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:57.550687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:57.558307 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5a65ba9e-a68b-4a04-b911-f3d9074aab3d tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.149548 May 10 03:04:57.558888 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3362/6683] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:57 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:58.575423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:58.575963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:58.583885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:58.584358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:58.585509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:58.585963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:58.795898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:58.805968 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e0bda5e-0ebb-4df1-bca1-fbdd79edfc8a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.234547 May 10 03:04:58.806775 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3322/6684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:58 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:04:59.823790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:04:59.824407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:04:59.831214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:59.831675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:59.832444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:04:59.832899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:04:59.958499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:04:59.965903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f76b4e44-92a1-4500-ae2b-dad0a886adb9 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.145986 May 10 03:04:59.966473 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3363/6685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:04:59 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:00.982674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:00.983346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:00.990632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:00.991138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:00.991937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:00.992399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:01.123576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:01.131635 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-20ffdbbb-4253-4460-a3f2-dd4447e11900 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.152877 May 10 03:05:01.132238 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3323/6686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:00 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:02.148816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:02.149573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:02.156655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:02.157686 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:02.158457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:02.158897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:02.289766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:02.298458 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b09805ba-51c5-4776-94e7-7b6f1ec9985a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.152889 May 10 03:05:02.299276 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3364/6687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:02 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:03.316605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:03.317274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:03.324358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:03.324835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:03.325630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:03.326091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:03.459634 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:03.467169 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c2a8f1d-fe05-4fab-83ce-d417c98b3016 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.155185 May 10 03:05:03.467751 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3324/6688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:03 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:04.483383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:04.484008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:04.490466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:04.490922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:04.491716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:04.492158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:04.620599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:04.628485 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a826140e-fd47-46ce-adbd-a11f42bd2fe2 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.149139 May 10 03:05:04.629408 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3365/6689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:04 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:05.646287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:05.646946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:05.653966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:05.654439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:05.655259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:05.655717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:05.788468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:05.795941 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-44c99df2-7ef0-4d0b-9eed-1ef57e7c344c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.154560 May 10 03:05:05.796524 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3325/6690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:05 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:06.813629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:06.814252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:06.821178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:06.821632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:06.822436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:06.822883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:06.956643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:06.963948 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-13b5ee38-31f7-4f7e-a891-44f40bbb9003 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1519 microversion: 2.1 time: 0.154786 May 10 03:05:06.964530 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3366/6691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:06 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:07.981596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:07.982237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:07.988913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:07.989388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:07.990193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:07.990719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:08.121973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:08.130080 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d828202-e738-4e68-97cb-bec1c11490a5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1518 microversion: 2.1 time: 0.153082 May 10 03:05:08.130667 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3326/6692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:07 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:08.378189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-83e58cb5-e07d-4e79-9a9b-3faaf5768bcd req-17593ce8-431f-4a9c-868c-f865906cacd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ea5f67-34bb-4edb-b3d5-c78498b58c73", "name": "network-vif-unplugged", "status": "completed", "tag": "1f10e9e1-88bd-4de8-b876-8ab41217243b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:08.387963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-83e58cb5-e07d-4e79-9a9b-3faaf5768bcd req-17593ce8-431f-4a9c-868c-f865906cacd6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:08.388569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-83e58cb5-e07d-4e79-9a9b-3faaf5768bcd req-17593ce8-431f-4a9c-868c-f865906cacd6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:08.401246 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-83e58cb5-e07d-4e79-9a9b-3faaf5768bcd req-17593ce8-431f-4a9c-868c-f865906cacd6 service nova] Creating event network-vif-unplugged:1f10e9e1-88bd-4de8-b876-8ab41217243b for instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 on n-h1-841089-2 May 10 03:05:08.406639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-83e58cb5-e07d-4e79-9a9b-3faaf5768bcd req-17593ce8-431f-4a9c-868c-f865906cacd6 service nova] Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:05:08.418223 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-83e58cb5-e07d-4e79-9a9b-3faaf5768bcd req-17593ce8-431f-4a9c-868c-f865906cacd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044272 May 10 03:05:08.418990 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3367/6693] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:05:09.147584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:09.148241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:09.156539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:09.157589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:09.158391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:09.158876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:09.295959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:09.303864 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a754f2b5-db45-4b4d-b56c-c773421eab53 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1518 microversion: 2.1 time: 0.160332 May 10 03:05:09.307112 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3327/6694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:09 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:10.322580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:10.323344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:10.329839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:10.330381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:10.331301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:10.331753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:10.437510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-4bf8f866-8286-41a1-aa85-c42b70e6429e req-fa61e7a0-2463-417c-bb20-c2ff5974981d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ea5f67-34bb-4edb-b3d5-c78498b58c73", "tag": "1f10e9e1-88bd-4de8-b876-8ab41217243b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:10.446470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4bf8f866-8286-41a1-aa85-c42b70e6429e req-fa61e7a0-2463-417c-bb20-c2ff5974981d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:10.446942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-4bf8f866-8286-41a1-aa85-c42b70e6429e req-fa61e7a0-2463-417c-bb20-c2ff5974981d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:10.458486 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-4bf8f866-8286-41a1-aa85-c42b70e6429e req-fa61e7a0-2463-417c-bb20-c2ff5974981d service nova] Creating event network-changed:1f10e9e1-88bd-4de8-b876-8ab41217243b for instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 on n-h1-841089-2 May 10 03:05:10.464066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-4bf8f866-8286-41a1-aa85-c42b70e6429e req-fa61e7a0-2463-417c-bb20-c2ff5974981d service nova] Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:05:10.470481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:10.475615 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-4bf8f866-8286-41a1-aa85-c42b70e6429e req-fa61e7a0-2463-417c-bb20-c2ff5974981d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041791 May 10 03:05:10.476405 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3328/6695] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:05:10.479287 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c756847a-7480-49aa-b9ae-c30cbee186ef tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1516 microversion: 2.1 time: 0.161737 May 10 03:05:10.479874 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3368/6696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:10 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:11.498193 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:11.498956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:11.505998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:11.506469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:11.507291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:11.507777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:11.639820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:11.648023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b8faf32-1314-467c-a6d1-e7bc89754568 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1513 microversion: 2.1 time: 0.155053 May 10 03:05:11.648616 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3329/6697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:11 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:11.664063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:11.664602 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:11.671404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:11.671846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:11.673125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:11.673564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:11.728842 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a4d71a7-2b01-41d9-a87b-56f5e877a35a tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "POST /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73/action" status: 204 len: 0 microversion: 2.1 time: 0.068507 May 10 03:05:11.729512 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3369/6698] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:05:11 2022] POST /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:05:11.738087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:11.738867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:11.745852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:11.746328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:11.747153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:11.747612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:11.951990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:11.959483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-670bf190-f147-4e6f-9e32-7a48c686a7f1 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1513 microversion: 2.1 time: 0.225765 May 10 03:05:11.960075 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3330/6699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:11 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:05:12.977910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:12.978619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:12.984767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:12.985750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:12.986531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:12.986976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.120906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:13.128893 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b7dc2b0-a85f-46d8-95c7-32f2eb746ecf tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1505 microversion: 2.1 time: 0.156083 May 10 03:05:13.129472 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3370/6700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:12 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:13.144830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:13.145474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:13.152335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.152814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.153613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.154075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.284365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:13.291713 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-39c73335-d1fb-4fe1-9e91-c79174673474 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1505 microversion: 2.1 time: 0.150787 May 10 03:05:13.292290 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3331/6701] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:13 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:13.308075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:13.308694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:13.315293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.315749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.316509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.316950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.443995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:13.451336 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ca705640-450e-4579-bfdb-336d6adb2670 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1505 microversion: 2.1 time: 0.147465 May 10 03:05:13.451915 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3371/6702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:13 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:13.467176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:13.467705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:13.474101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.474580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.475414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.475878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.500307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:05:13.573018 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-445ca02d-b869-4af1-a429-20c53a2e1752 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 204 len: 0 microversion: 2.1 time: 0.109288 May 10 03:05:13.573729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3332/6703] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:05:13 2022] DELETE /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:05:13.586888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:13.587415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:13.593380 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.593850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.595201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.595649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.620526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:05:13.664464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.compute.api [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Instance is already in deleting state, ignoring this request May 10 03:05:13.665288 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fe432c06-4898-4f1c-a44a-5b7600d53a58 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 204 len: 0 microversion: 2.1 time: 0.082327 May 10 03:05:13.665860 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3372/6704] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:05:13 2022] DELETE /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:05:13.675415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:13.676169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:13.682335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.682812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.683639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:13.684102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:13.813398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:13.820843 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8cde9ea6-e9cc-48d3-97ac-f6ec256657fb tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1511 microversion: 2.1 time: 0.150658 May 10 03:05:13.821426 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3333/6705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:13 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:14.511244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3b8fde31-92d5-4abf-b2ea-dd055a165fa4 req-46a1f5f4-5359-49dd-81fb-140943eb73fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ea5f67-34bb-4edb-b3d5-c78498b58c73", "name": "network-vif-plugged", "status": "completed", "tag": "1f10e9e1-88bd-4de8-b876-8ab41217243b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:14.520455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3b8fde31-92d5-4abf-b2ea-dd055a165fa4 req-46a1f5f4-5359-49dd-81fb-140943eb73fd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:14.520876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3b8fde31-92d5-4abf-b2ea-dd055a165fa4 req-46a1f5f4-5359-49dd-81fb-140943eb73fd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:14.532528 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3b8fde31-92d5-4abf-b2ea-dd055a165fa4 req-46a1f5f4-5359-49dd-81fb-140943eb73fd service nova] Creating event network-vif-plugged:1f10e9e1-88bd-4de8-b876-8ab41217243b for instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 on n-h1-841089-2 May 10 03:05:14.537260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3b8fde31-92d5-4abf-b2ea-dd055a165fa4 req-46a1f5f4-5359-49dd-81fb-140943eb73fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029838 May 10 03:05:14.537844 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3373/6706] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:05:14.837439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:14.838159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:14.845637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:14.846133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:14.846931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:14.847412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:14.977273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2562ff19644edac0364a3d2ee32f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d813cdab7d4e46a7a549cfcf89ec48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:14.984901 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-88e6aade-067c-41ac-af11-5944eabfb361 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 200 len: 1511 microversion: 2.1 time: 0.151397 May 10 03:05:14.986114 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3334/6707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:14 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:15.602836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b3209a8e-3904-4f4d-a614-08337bb1dc97 req-2e4d3e27-1baa-4bb9-86ca-1e436f265a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ea5f67-34bb-4edb-b3d5-c78498b58c73", "name": "network-vif-deleted", "tag": "1f10e9e1-88bd-4de8-b876-8ab41217243b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:15.611160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b3209a8e-3904-4f4d-a614-08337bb1dc97 req-2e4d3e27-1baa-4bb9-86ca-1e436f265a35 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:15.611620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b3209a8e-3904-4f4d-a614-08337bb1dc97 req-2e4d3e27-1baa-4bb9-86ca-1e436f265a35 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:15.625234 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b3209a8e-3904-4f4d-a614-08337bb1dc97 req-2e4d3e27-1baa-4bb9-86ca-1e436f265a35 service nova] Creating event network-vif-deleted:1f10e9e1-88bd-4de8-b876-8ab41217243b for instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 on n-h1-841089-2 May 10 03:05:15.630990 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b3209a8e-3904-4f4d-a614-08337bb1dc97 req-2e4d3e27-1baa-4bb9-86ca-1e436f265a35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 May 10 03:05:15.631694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3374/6708] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:05:16.002377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:16.003025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: e5ea5f67-34bb-4edb-b3d5-c78498b58c73] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:16.009977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:16.010453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:16.011296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:16.011762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:16.024934 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] HTTP exception thrown: Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 could not be found. May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Request method failure captured: May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 HTTP/1.1 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedYOXYsMAZnOLJY7ww9yO08_v_IbKxrAtGabP-D4UEaj_AIOw-lhKzv1xZCEXc0JAtTApJIXoLKrJCxPZ6chSii5DmO3AUNBa2J4_eupESNZflF8lNpmBxZI7tiJw1hsGofA6V3gLBiI96IXWWKPVJdXqkALYoqSiOAykYYpe9GUU1M May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e1d813cdab7d4e46a7a549cfcf89ec48 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1d813cdab7d4e46a7a549cfcf89ec48", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e1d813cdab7d4e46a7a549cfcf89ec48 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1069838455-project May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 7fb2562ff19644edac0364a3d2ee32f4 May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1069838455-project May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 could not be found. May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'e5ea5f67-34bb-4edb-b3d5-c78498b58c73'} May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 could not be found. May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 could not be found. May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:05:16.026627 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 could not be found. May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Returning 404 to user: Instance e5ea5f67-34bb-4edb-b3d5-c78498b58c73 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6448a72a-1fac-4035-ba3d-83c70a322cf5 tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73" status: 404 len: 111 microversion: 2.1 time: 0.030303 May 10 03:05:16.031562 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3335/6709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:15 2022] GET /compute/v2.1/servers/e5ea5f67-34bb-4edb-b3d5-c78498b58c73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:05:16.037194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:16.037784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:16.043923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:16.044382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:16.045147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:16.045581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:16.059148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] HTTP exception thrown: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Request method failure captured: May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 HTTP/1.1 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedYOXYsMAZnOLJY7ww9yO08_v_IbKxrAtGabP-D4UEaj_AIOw-lhKzv1xZCEXc0JAtTApJIXoLKrJCxPZ6chSii5DmO3AUNBa2J4_eupESNZflF8lNpmBxZI7tiJw1hsGofA6V3gLBiI96IXWWKPVJdXqkALYoqSiOAykYYpe9GUU1M May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: e1d813cdab7d4e46a7a549cfcf89ec48 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1d813cdab7d4e46a7a549cfcf89ec48", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: e1d813cdab7d4e46a7a549cfcf89ec48 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerDiskConfigTestJSON-1069838455-project May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 7fb2562ff19644edac0364a3d2ee32f4 May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerDiskConfigTestJSON-1069838455-project May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'fc10f0de-0629-45c4-a200-f89e2e2f9888'} May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:05:16.060756 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Returning 404 to user: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42fb944d-f1ab-4727-9296-e654b0a6520c tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 404 len: 111 microversion: 2.1 time: 0.029195 May 10 03:05:16.065352 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3375/6710] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:05:16 2022] DELETE /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:05:16.071200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:16.071850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] [instance: fc10f0de-0629-45c4-a200-f89e2e2f9888] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:16.077896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:16.078371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:16.079195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:16.079662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:16.095796 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] HTTP exception thrown: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Request method failure captured: May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 HTTP/1.1 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedYOXYsMAZnOLJY7ww9yO08_v_IbKxrAtGabP-D4UEaj_AIOw-lhKzv1xZCEXc0JAtTApJIXoLKrJCxPZ6chSii5DmO3AUNBa2J4_eupESNZflF8lNpmBxZI7tiJw1hsGofA6V3gLBiI96IXWWKPVJdXqkALYoqSiOAykYYpe9GUU1M May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e1d813cdab7d4e46a7a549cfcf89ec48 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1d813cdab7d4e46a7a549cfcf89ec48", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1d813cdab7d4e46a7a549cfcf89ec48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e1d813cdab7d4e46a7a549cfcf89ec48 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1069838455 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerDiskConfigTestJSON-1069838455-project May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 7fb2562ff19644edac0364a3d2ee32f4 May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerDiskConfigTestJSON-1069838455-project May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'fc10f0de-0629-45c4-a200-f89e2e2f9888'} May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:05:16.097440 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] Returning 404 to user: Instance fc10f0de-0629-45c4-a200-f89e2e2f9888 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4cc0dc2d-da6f-4bd6-abe8-b1a9e4dcd74b tempest-ServerDiskConfigTestJSON-1069838455 tempest-ServerDiskConfigTestJSON-1069838455-project] 10.222.0.52 "GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888" status: 404 len: 111 microversion: 2.1 time: 0.031632 May 10 03:05:16.101642 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3336/6711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:16 2022] GET /compute/v2.1/servers/fc10f0de-0629-45c4-a200-f89e2e2f9888 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:05:21.977394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3cf9653-3915-4c88-8ce3-eff35af03b49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'create', calling method: .version_select at 0x7f3d35d37670>, body: {"keypair": {"name": "tempest-keypair-1198370491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw6uvqARS0zkjRZdxJvUFHbMQjHB6jZqWfGOdzcLRTYlckRZ5aCZfs2FZU/vVfSn8lhPrt5MMcOQyiWk1gJZiNZCyICjzL+Q6BfoYUyzwSZYCB1VeqCbEpTnpFEQvMeFQ=="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:21.994460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d3cf9653-3915-4c88-8ce3-eff35af03b49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:05:22.001586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-d3cf9653-3915-4c88-8ce3-eff35af03b49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'key_pairs'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:05:22.039206 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3cf9653-3915-4c88-8ce3-eff35af03b49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198869 May 10 03:05:22.040104 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3376/6712] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:05:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:05:23.382100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1731299044", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1055699-bb3f-45e1-8da4-7f6e1e27504d"}], "security_groups": [{"name": "tempest-securitygroup--829411176"}], "key_name": "tempest-keypair-1198370491", "user_data": "}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:23.494726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] validate_networks() for [('a1055699-bb3f-45e1-8da4-7f6e1e27504d', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:05:23.898843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:05:23.899336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:05:23.900136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:05:23.900579 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:05:23.901021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:05:23.910571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:23.911047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:23.911918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:23.912403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:23.929880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:05:23.935226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:05:23.948139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:05:23.950481 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:05:23.998268 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-93f76f8e-00d2-46cf-a09a-2996d795995c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.620579 May 10 03:05:23.999317 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3337/6713] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:05:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:05:24.010365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4a019ec1-1f12-40a4-8666-5391a47d86ed tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:24.011729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4a019ec1-1f12-40a4-8666-5391a47d86ed tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:24.088135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4a019ec1-1f12-40a4-8666-5391a47d86ed tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:24.095795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4a019ec1-1f12-40a4-8666-5391a47d86ed tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1239 microversion: 2.1 time: 0.090446 May 10 03:05:24.097131 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3377/6714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:24 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:05:25.114006 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:25.115399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:25.125068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:25.125769 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:25.126831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:25.127484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:25.223927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:25.231669 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c213f86c-6e6d-4f3b-8506-33a0146b83e0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1309 microversion: 2.1 time: 0.122730 May 10 03:05:25.241151 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3338/6715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:25 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:26.251001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:26.252246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:26.272962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:26.273799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:26.275350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:26.275966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:26.431730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:26.439926 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0767423c-f07d-4669-adb7-e5a9ab4fbbbb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.192826 May 10 03:05:26.440801 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3378/6716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:26 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:26.475103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-61ec9dc2-4efb-4203-bbad-6b11719b7b78 req-928131f7-dd5f-4c01-b00e-1c7a271f2e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:26.487660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-61ec9dc2-4efb-4203-bbad-6b11719b7b78 req-928131f7-dd5f-4c01-b00e-1c7a271f2e96 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:26.488191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-61ec9dc2-4efb-4203-bbad-6b11719b7b78 req-928131f7-dd5f-4c01-b00e-1c7a271f2e96 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:26.505490 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-61ec9dc2-4efb-4203-bbad-6b11719b7b78 req-928131f7-dd5f-4c01-b00e-1c7a271f2e96 service nova] Creating event network-changed:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h1-841089-2 May 10 03:05:26.520502 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-61ec9dc2-4efb-4203-bbad-6b11719b7b78 req-928131f7-dd5f-4c01-b00e-1c7a271f2e96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049165 May 10 03:05:26.521121 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3339/6717] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:05:27.456679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:27.457287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:27.464098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:27.464556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:27.465324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:27.465767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:27.593834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:27.601629 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b37b6fd-121c-443a-b9da-3c94ea196ebf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.148879 May 10 03:05:27.602200 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3379/6718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:27 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:28.620485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:28.621272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:28.628240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:28.628723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:28.629535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:28.630004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:28.757466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:28.764860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e389d1c0-a9d5-420a-9e34-9f8a860f583b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.149606 May 10 03:05:28.765465 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3340/6719] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:28 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:29.781504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:29.782125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:29.789529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:29.789989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:29.790766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:29.791250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:29.919135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:29.926746 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c69522ca-71fc-42d2-93b0-1bfb2d597f15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.149140 May 10 03:05:29.927362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3380/6720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:29 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:30.943458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:30.944040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:30.950834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:30.951340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:30.952134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:30.952595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:31.080250 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:31.087735 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5c596553-e574-47dd-9c37-0efbe33b285d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.148432 May 10 03:05:31.088320 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3341/6721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:30 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:32.105584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:32.106206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:32.114269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:32.114726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:32.115546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:32.115994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:32.246989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:32.255126 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-aa45326c-d9a1-4b5e-a830-0cb4302302b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.153426 May 10 03:05:32.255701 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3381/6722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:32 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:32.401384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ebef3510-28f5-4f48-97be-560b92a6ebf3 req-5cd48164-a834-4174-a3c5-a75ab779e868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "name": "network-vif-plugged", "status": "completed", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:32.411034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ebef3510-28f5-4f48-97be-560b92a6ebf3 req-5cd48164-a834-4174-a3c5-a75ab779e868 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:32.411533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ebef3510-28f5-4f48-97be-560b92a6ebf3 req-5cd48164-a834-4174-a3c5-a75ab779e868 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:32.423027 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ebef3510-28f5-4f48-97be-560b92a6ebf3 req-5cd48164-a834-4174-a3c5-a75ab779e868 service nova] Creating event network-vif-plugged:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h1-841089-2 May 10 03:05:32.428595 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ebef3510-28f5-4f48-97be-560b92a6ebf3 req-5cd48164-a834-4174-a3c5-a75ab779e868 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 May 10 03:05:32.429194 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3342/6723] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:05:33.272397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:33.273031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:33.279947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:33.280412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:33.281198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:33.281648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:33.409340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:33.416462 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b5705e95-eac2-49be-86d0-b8cfa84045ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1364 microversion: 2.1 time: 0.147986 May 10 03:05:33.417076 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3382/6724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:33 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:34.434983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:34.435680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:34.442169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:34.442639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:34.443450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:34.443908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:34.576953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:34.584776 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aa05fe65-82c4-498d-b738-6262f5124509 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1552 microversion: 2.1 time: 0.155421 May 10 03:05:34.585351 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3343/6725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:34 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:34.601361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:34.601873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:34.608389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:34.608858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:34.609641 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:34.610092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:34.689629 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ad94ed50-df58-4a79-816d-8868281968c4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092130 May 10 03:05:34.690235 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3383/6726] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 03:05:34 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:05:36.021628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:36.022275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:36.024619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-06665ff8-c5bf-400a-a14f-4f219dcd40f4 req-898ff538-cb79-4b21-a58e-40452566adc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:36.029547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:36.030025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:36.030834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:36.031332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:36.033084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-06665ff8-c5bf-400a-a14f-4f219dcd40f4 req-898ff538-cb79-4b21-a58e-40452566adc4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:36.033755 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-06665ff8-c5bf-400a-a14f-4f219dcd40f4 req-898ff538-cb79-4b21-a58e-40452566adc4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:36.046195 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-06665ff8-c5bf-400a-a14f-4f219dcd40f4 req-898ff538-cb79-4b21-a58e-40452566adc4 service nova] Creating event network-changed:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h1-841089-2 May 10 03:05:36.052014 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-06665ff8-c5bf-400a-a14f-4f219dcd40f4 req-898ff538-cb79-4b21-a58e-40452566adc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032362 May 10 03:05:36.055881 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3384/6727] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:05:36.178258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:36.186705 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-02c80e89-6715-4017-887a-ced1b4c41446 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1552 microversion: 2.1 time: 0.169071 May 10 03:05:36.187686 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3344/6728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:36 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:36.204624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:36.205347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:36.211556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:36.212024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:36.212810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:36.213440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:36.352614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:36.360170 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ee778b1-c948-4d91-aed8-195adcc6492a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1552 microversion: 2.1 time: 0.159731 May 10 03:05:36.361516 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3385/6729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:36 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:37.377733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:37.378369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:37.385554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.386041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.386870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.387362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.516174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:37.524047 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a59054d3-7b6e-4e1a-8cce-0b4fa10e0d5d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1671 microversion: 2.1 time: 0.150305 May 10 03:05:37.524623 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3345/6730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:37 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:37.540417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:37.541039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:37.547721 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.548209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.548977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.549423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.675090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:37.682759 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9cbc6168-9f34-4405-ae5a-6b8eea8ef9aa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1671 microversion: 2.1 time: 0.146199 May 10 03:05:37.683349 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3386/6731] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:37 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:37.699130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:05:37.700125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:37.706666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.707167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.707958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.708419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.735365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:37.740984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Old instance type m1.heat2, new instance type m1.heat {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:05:37.747056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:05:37.747531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:05:37.748027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:05:37.748455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:05:37.748890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:05:37.810470 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ef53069e-a025-4813-b1ec-9636d5fd6350 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7/action" status: 202 len: 0 microversion: 2.1 time: 0.115229 May 10 03:05:37.811111 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3346/6732] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:05:37 2022] POST /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:05:37.819599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:37.820389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:37.826338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.826844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.827749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:37.828188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:37.986086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:37.993905 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4e5c8658-a480-43c7-a50a-be0ec97942cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1680 microversion: 2.1 time: 0.178113 May 10 03:05:37.994489 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3387/6733] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:37 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:39.012549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:39.013226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:39.019819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:39.020301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:39.021137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:39.021602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:39.158910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:39.166902 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b69b6141-551d-477b-8b2d-9ab6a078c37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1680 microversion: 2.1 time: 0.159199 May 10 03:05:39.167601 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3347/6734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:39 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:40.184680 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:40.185234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:40.192504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:40.192964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:40.193731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:40.194175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:40.320557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:40.327897 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5b82fb48-0ddf-481b-8fa2-b6cd01c13a3e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.147237 May 10 03:05:40.328463 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3388/6735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:40 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:41.346482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:41.347169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:41.354145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:41.354603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:41.355419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:41.355882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:41.488782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:41.496161 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdf7c380-aa40-4cc5-9ce5-d14eaa796816 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.154360 May 10 03:05:41.496742 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3348/6736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:41 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:42.513173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:42.513793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:42.520548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:42.520997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:42.521768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:42.522207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:42.648053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:42.655303 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7813d546-6bf2-4972-b6c8-acd970d77e8e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.146015 May 10 03:05:42.655874 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3389/6737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:42 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:43.672679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:43.673824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:43.681325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:43.681811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:43.682612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:43.683101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:43.812874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:43.820207 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b196633-232a-4c0c-bf4b-beb6ed3c736b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.151558 May 10 03:05:43.820783 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3349/6738] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:43 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:44.836930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:44.837560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:44.844323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:44.844796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:44.846176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:44.846636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:44.978507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:44.985881 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bd3ce86e-0529-4d11-b521-d49e31886a04 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.153062 May 10 03:05:44.986471 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3390/6739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:44 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:46.003035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:46.003697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:46.010371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:46.010838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:46.011651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:46.012104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:46.145900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:46.153254 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-491a52f1-d9bc-4f17-b623-af8ec4bdd758 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.154142 May 10 03:05:46.153826 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3350/6740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:45 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:47.170960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:47.171633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:47.178100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:47.178557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:47.179364 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:47.180077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:47.311909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:47.319143 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4c8af82-63aa-4f25-80e4-56bea3e8c01e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.152322 May 10 03:05:47.319724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3391/6741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:47 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:48.336562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:48.337119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:48.343923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:48.344397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:48.345209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:48.345673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:48.472690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:48.480038 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f7e7c799-b981-4676-b1d3-c3aec359125e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.147517 May 10 03:05:48.480645 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3351/6742] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:48 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:49.496622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:49.497265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:49.504230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:49.504687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:49.505449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:49.505887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:49.634392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:49.642451 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ba7e8d73-25c1-4bca-929c-da28e10ffd9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.149106 May 10 03:05:49.643034 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3392/6743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:49 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:50.659670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:50.660323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:50.666792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:50.667311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:50.668101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:50.668561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:50.795098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:50.802583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5b382d3a-2cdd-4d63-8e3c-7b52662bfede tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.147120 May 10 03:05:50.803175 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3352/6744] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:50 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:51.819779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:51.820402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:51.827178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:51.827631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:51.828400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:51.828842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:51.955530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:51.962776 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-083aee37-f740-4036-9192-f1da97613c39 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.146872 May 10 03:05:51.963382 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3393/6745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:51 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:52.980435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:52.981046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:52.987882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:52.988354 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:52.989136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:52.989598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:53.363721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:53.371000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f94d2bc4-692c-422f-85ca-4edf36e22ed4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.394500 May 10 03:05:53.371595 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3353/6746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:52 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:54.388598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:54.389229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:54.396871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:54.397331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:54.398141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:54.398587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:54.528486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:54.535973 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00597de7-5b5e-4f1b-9cc5-6a989c032eac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.151210 May 10 03:05:54.536556 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3394/6747] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:54 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:55.553611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:55.554265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:55.562832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:55.563338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:55.564736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:55.565192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:55.697628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:55.705043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a6077db8-9f55-4011-96d9-5554ef2bf3cd tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.155354 May 10 03:05:55.705612 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3354/6748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:55 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:56.722307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:56.722940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:56.729761 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:56.730219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:56.730996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:56.731472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:56.857819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:56.865112 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-04bb8349-4e3e-46a4-9809-ce0120247823 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.147317 May 10 03:05:56.865686 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3395/6749] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:56 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:57.882873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:57.883537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:57.890378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:57.890790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:57.891611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:57.892074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:58.027992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:58.035545 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1b53e050-f7a3-41bf-9ce3-2d286fc3c571 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.156646 May 10 03:05:58.036123 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3355/6750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:57 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:05:59.052590 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:05:59.053238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:05:59.060247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:59.060702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:59.061463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:05:59.061902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:05:59.190034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:05:59.197372 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac17836c-a9e5-4f75-95e8-9dac903130ac tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.148661 May 10 03:05:59.197958 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3396/6751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:05:59 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:00.217447 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:00.218087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:00.224899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:00.225377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:00.226172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:00.226632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:00.351375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:00.359154 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8dccf0ab-81d7-4cc2-b2ea-a87ba1f688b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.145663 May 10 03:06:00.359754 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3356/6752] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:00 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:01.378065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:01.378623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:01.385908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:01.386367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:01.387177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:01.387625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:01.518361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:01.525653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f45526c-e413-409f-aa4d-ae8b34b676d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.152691 May 10 03:06:01.526232 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3397/6753] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:01 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:02.541903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:02.542567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:02.549435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:02.549915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:02.550705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:02.551209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:02.681974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:02.689541 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b4478a42-7939-44cc-b577-dd29db3ec2b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.151711 May 10 03:06:02.690122 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3357/6754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:02 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:03.706404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:03.707080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:03.713918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:03.714388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:03.715207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:03.715668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:03.848443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:03.856134 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fefd90a-f6a9-47bd-9d3f-3edcca63474e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.153651 May 10 03:06:03.856709 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3398/6755] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:03 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:04.873770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:04.874437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:04.881259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:04.881733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:04.882514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:04.882969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:05.008506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:05.016138 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-23c2293c-54e7-479d-a127-e5be18a82e38 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.146292 May 10 03:06:05.017229 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3358/6756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:04 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:06.034271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:06.034887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:06.041600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:06.042053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:06.042824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:06.043292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:06.169872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:06.177794 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-380c9147-cac6-44af-8883-060c0e5454e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.148064 May 10 03:06:06.178362 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3399/6757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:06 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:07.195654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:07.196319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:07.203216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:07.203693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:07.204491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:07.204948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:07.335990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:07.343406 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-27d3e190-dc5d-45b2-bbb0-5c2deb8955fb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.151711 May 10 03:06:07.343982 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3359/6758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:07 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:08.361916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:08.362570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:08.369990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:08.370455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:08.371315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:08.371800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:08.513220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:08.521857 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cad05e5c-b44c-4a31-bbcf-e50f36b84214 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.164792 May 10 03:06:08.522455 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3400/6759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:08 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:09.538991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:09.539650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:09.546522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:09.546993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:09.548361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:09.548820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:09.691046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:09.699046 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4965c54b-32f9-481c-917f-b8610579a88f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.164015 May 10 03:06:09.699785 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3360/6760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:09 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:10.719032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:10.719702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:10.726694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:10.727185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:10.727952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:10.728392 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:10.852994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:10.860738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-504d8e4d-49e8-4088-8f26-9a7b241e9ec9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1685 microversion: 2.1 time: 0.145024 May 10 03:06:10.861366 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3401/6761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:10 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1685 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:11.878455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:11.879236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:11.886159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:11.886642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:11.887483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:11.887957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:12.098490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:12.108350 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0efceb9f-6842-4446-a413-7789245dfed3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1684 microversion: 2.1 time: 0.234221 May 10 03:06:12.108977 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3361/6762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:11 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1684 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:12.157064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4c4a4156-fe45-4ab5-af82-b93116eaaf0b req-e18d2a1a-28c4-41f7-8426-005477fe4c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "name": "network-vif-unplugged", "status": "completed", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:12.166321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4c4a4156-fe45-4ab5-af82-b93116eaaf0b req-e18d2a1a-28c4-41f7-8426-005477fe4c3d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:12.167141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4c4a4156-fe45-4ab5-af82-b93116eaaf0b req-e18d2a1a-28c4-41f7-8426-005477fe4c3d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:12.183130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4c4a4156-fe45-4ab5-af82-b93116eaaf0b req-e18d2a1a-28c4-41f7-8426-005477fe4c3d service nova] Creating event network-vif-unplugged:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h2-841089-2 May 10 03:06:12.190197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-4c4a4156-fe45-4ab5-af82-b93116eaaf0b req-e18d2a1a-28c4-41f7-8426-005477fe4c3d service nova] Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:06:12.202331 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4c4a4156-fe45-4ab5-af82-b93116eaaf0b req-e18d2a1a-28c4-41f7-8426-005477fe4c3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127298 May 10 03:06:12.203702 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3402/6763] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:06:12.899902 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:06:12.900431 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:06:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:06:13.125576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:13.126724 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:13.133990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:13.134465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:13.135460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:13.135936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:13.266034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:13.273539 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3aec5b11-0f43-490a-85ad-a699b4d554cc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1684 microversion: 2.1 time: 0.152045 May 10 03:06:13.274118 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3362/6764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:13 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:14.217863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d2a09af3-b4bc-43e6-a078-d3ec2d2a80d7 req-36b47e9f-8f61-4342-9057-27816a423c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:14.226826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d2a09af3-b4bc-43e6-a078-d3ec2d2a80d7 req-36b47e9f-8f61-4342-9057-27816a423c0c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:14.227325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d2a09af3-b4bc-43e6-a078-d3ec2d2a80d7 req-36b47e9f-8f61-4342-9057-27816a423c0c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:14.238454 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d2a09af3-b4bc-43e6-a078-d3ec2d2a80d7 req-36b47e9f-8f61-4342-9057-27816a423c0c service nova] Creating event network-changed:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h2-841089-2 May 10 03:06:14.243743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-d2a09af3-b4bc-43e6-a078-d3ec2d2a80d7 req-36b47e9f-8f61-4342-9057-27816a423c0c service nova] Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:06:14.255139 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d2a09af3-b4bc-43e6-a078-d3ec2d2a80d7 req-36b47e9f-8f61-4342-9057-27816a423c0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041291 May 10 03:06:14.255679 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3403/6765] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:14.290458 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:14.291141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:14.297905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:14.298369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:14.299175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:14.299633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:14.432302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:14.440510 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fcca65f-f7d1-4f33-9536-14952acab217 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1682 microversion: 2.1 time: 0.154058 May 10 03:06:14.441097 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3363/6766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:14 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:15.459750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:15.460468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:15.466638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:15.467123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:15.467909 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:15.468361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:15.600503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:15.607955 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f53eb6bf-bff3-4d2a-9a83-7c596f139b06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1679 microversion: 2.1 time: 0.153935 May 10 03:06:15.608533 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3404/6767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:15 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:15.624095 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:15.624807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:15.632295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:15.632772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:15.633606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:15.634069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:15.694898 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-542bf7ca-6d46-41df-b3db-6404508da4f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7/action" status: 204 len: 0 microversion: 2.1 time: 0.074557 May 10 03:06:15.695669 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3364/6768] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:06:15 2022] POST /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:06:15.704526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:15.705249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:15.711410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:15.711823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:15.712632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:15.713092 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:15.843180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:15.850500 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-298febd0-4fc3-48d1-8465-5295538f3441 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1679 microversion: 2.1 time: 0.150655 May 10 03:06:15.851096 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3405/6769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:15 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:16.870326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:16.871100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:16.879390 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:16.879864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:16.880731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:16.881194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.011703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:17.019101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68ee8f98-eeb2-478f-b5cc-67efda5c5722 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1671 microversion: 2.1 time: 0.153056 May 10 03:06:17.019679 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3365/6770] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:16 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:17.035143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:17.035765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:17.042355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.042819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.043622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.044063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.172485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:17.180857 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-62592a5a-1781-497d-afc2-cb92afa5e51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1671 microversion: 2.1 time: 0.149611 May 10 03:06:17.181432 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3406/6771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:17 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:17.197400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:17.198034 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:17.204100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.204572 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.205366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.205825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.334871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:17.342317 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-46eb7fe4-60e5-400d-a6ec-6a4e5e343261 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1671 microversion: 2.1 time: 0.149061 May 10 03:06:17.342890 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3366/6772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:17 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:17.358533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:17.359087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:17.365718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.366182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.366957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.367432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.391413 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:06:17.470204 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a05f5b7-dc1a-4ce5-81c8-375a4fabfc8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 204 len: 0 microversion: 2.1 time: 0.114472 May 10 03:06:17.470730 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3407/6773] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:06:17 2022] DELETE /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:06:17.480164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:17.481010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:17.487627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.488099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.488922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:17.489383 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:17.624538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:17.632090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9c304867-90f1-4a62-a696-54630d0ed24c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1677 microversion: 2.1 time: 0.156439 May 10 03:06:17.632661 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3367/6774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:17 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:18.650069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:18.650787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:18.657794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:18.658251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:18.659054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:18.659525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:18.787460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:18.794770 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fbd7c7f9-4e62-485e-b40f-3c7de6a0e748 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1677 microversion: 2.1 time: 0.148926 May 10 03:06:18.795403 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3408/6775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:18 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:19.194789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e5c7d7e1-bf07-42f3-8a41-18927708bb8c req-99f8da35-b531-4917-af73-62a986d78502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "name": "network-vif-plugged", "status": "completed", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:19.204586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e5c7d7e1-bf07-42f3-8a41-18927708bb8c req-99f8da35-b531-4917-af73-62a986d78502 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:19.205174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e5c7d7e1-bf07-42f3-8a41-18927708bb8c req-99f8da35-b531-4917-af73-62a986d78502 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:19.216930 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e5c7d7e1-bf07-42f3-8a41-18927708bb8c req-99f8da35-b531-4917-af73-62a986d78502 service nova] Creating event network-vif-plugged:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h2-841089-2 May 10 03:06:19.222304 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e5c7d7e1-bf07-42f3-8a41-18927708bb8c req-99f8da35-b531-4917-af73-62a986d78502 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 May 10 03:06:19.223243 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3368/6776] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:06:19.804272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f6649146-2876-45dd-a9ea-f1e35e0b901a req-8f7d8dc8-6c96-49dd-9995-0b371a7672e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f87f694-4d32-43cc-97f5-c0393ea3fef7", "name": "network-vif-deleted", "tag": "0174273a-575f-4338-bb3d-0ada68cd1cd2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:19.815541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:19.816229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f6649146-2876-45dd-a9ea-f1e35e0b901a req-8f7d8dc8-6c96-49dd-9995-0b371a7672e2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:19.816807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f6649146-2876-45dd-a9ea-f1e35e0b901a req-8f7d8dc8-6c96-49dd-9995-0b371a7672e2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:19.816942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:19.823475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:19.823959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:19.824778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:19.825236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:19.829425 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f6649146-2876-45dd-a9ea-f1e35e0b901a req-8f7d8dc8-6c96-49dd-9995-0b371a7672e2 service nova] Creating event network-vif-deleted:0174273a-575f-4338-bb3d-0ada68cd1cd2 for instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 on n-h2-841089-2 May 10 03:06:19.834783 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f6649146-2876-45dd-a9ea-f1e35e0b901a req-8f7d8dc8-6c96-49dd-9995-0b371a7672e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034102 May 10 03:06:19.835450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3409/6777] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:19.893494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:19.901812 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf9a362a-2ba5-46c2-a47b-b9603e32098c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 200 len: 1610 microversion: 2.1 time: 0.091578 May 10 03:06:19.902402 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3369/6778] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:19 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 1610 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:06:20.920953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:20.921662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:20.928486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:20.928939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:20.929703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:20.930404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:20.945393 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 HTTP/1.1 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f87f694-4d32-43cc-97f5-c0393ea3fef7'} May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:06:20.946999 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa8f57b1-062e-41b5-aeff-71ce813e1df3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 404 len: 111 microversion: 2.1 time: 0.032535 May 10 03:06:20.955138 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3410/6779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:20 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:06:20.963273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:20.963965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:20.971419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:20.971890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:20.972676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:20.973133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:20.986740 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 HTTP/1.1 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6f87f694-4d32-43cc-97f5-c0393ea3fef7'} May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:06:20.988428 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee6baad8-6a34-438e-afd1-f9b3f0f43894 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 404 len: 111 microversion: 2.1 time: 0.030558 May 10 03:06:20.992804 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3370/6780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:20 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:06:21.035010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-127254251", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a1055699-bb3f-45e1-8da4-7f6e1e27504d"}], "security_groups": [{"name": "tempest-securitygroup--829411176"}], "key_name": "tempest-keypair-1198370491", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:21.131666 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] validate_networks() for [('a1055699-bb3f-45e1-8da4-7f6e1e27504d', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:06:21.761664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:06:21.762098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:06:21.762584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:06:21.763005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:06:21.763452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:06:21.772223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:21.772690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:21.773508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:21.773958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:21.790609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:06:21.795824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:06:21.808757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:06:21.811027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:06:21.855708 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c62d141-cfd1-4822-b815-50a58f32fde5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825041 May 10 03:06:21.856457 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3411/6781] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:06:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:06:21.867121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3ee9ab2a-f8ac-4fd4-9644-bdb36d363081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:21.867816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3ee9ab2a-f8ac-4fd4-9644-bdb36d363081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:21.921596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3ee9ab2a-f8ac-4fd4-9644-bdb36d363081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:21.929005 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3ee9ab2a-f8ac-4fd4-9644-bdb36d363081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1238 microversion: 2.1 time: 0.065813 May 10 03:06:21.934594 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3371/6782] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:21 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:22.948525 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:22.949211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:22.956809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:22.957271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:22.958051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:22.958492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:23.039087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:23.046595 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-367608c9-5085-4d39-b3eb-3bf870fd1fec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1308 microversion: 2.1 time: 0.103204 May 10 03:06:23.047209 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3412/6783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:22 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:24.064613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:24.065261 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:24.080033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:24.080512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:24.081551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:24.082016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:24.263274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:24.271286 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ed31dbe-3123-4b6b-8500-e70341ce1212 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1363 microversion: 2.1 time: 0.210706 May 10 03:06:24.271870 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3372/6784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:24 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:24.369532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9b7ba020-1674-4745-98c3-4d321fef2881 req-2dbdb198-8b95-4a49-97a4-36782e903f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:24.386105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9b7ba020-1674-4745-98c3-4d321fef2881 req-2dbdb198-8b95-4a49-97a4-36782e903f0a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:24.386566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9b7ba020-1674-4745-98c3-4d321fef2881 req-2dbdb198-8b95-4a49-97a4-36782e903f0a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:24.398594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9b7ba020-1674-4745-98c3-4d321fef2881 req-2dbdb198-8b95-4a49-97a4-36782e903f0a service nova] Creating event network-changed:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h2-841089-2 May 10 03:06:24.403835 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9b7ba020-1674-4745-98c3-4d321fef2881 req-2dbdb198-8b95-4a49-97a4-36782e903f0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037973 May 10 03:06:24.407520 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3413/6785] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:25.289280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:25.290064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:25.296774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:25.297240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:25.298083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:25.298539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:25.427119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:25.434739 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5709eaab-a88d-41d3-b2ee-5227924e34ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1363 microversion: 2.1 time: 0.149499 May 10 03:06:25.435355 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3373/6786] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:25 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:26.453437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:26.454788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:26.461298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:26.461765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:26.462586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:26.463037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:26.589830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:26.598936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-60534564-a0ca-41f6-aaaf-c7c13ba1a8b9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1363 microversion: 2.1 time: 0.150313 May 10 03:06:26.599802 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3414/6787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:26 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:27.616189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:27.616827 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:27.623680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:27.624160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:27.624959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:27.625952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:27.756740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:27.763997 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ebbfc2c-f195-45c5-85d1-28fb8222b74a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1363 microversion: 2.1 time: 0.151770 May 10 03:06:27.764566 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3374/6788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:27 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:06:28.782339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:28.782968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:28.789735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:28.790193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:28.790973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:28.791448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:28.918470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:28.925805 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fae0e18-e568-41a0-9e20-b7237976edf6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1363 microversion: 2.1 time: 0.148022 May 10 03:06:28.926379 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3415/6789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:28 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:29.209853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bf2aefee-f016-43f2-a72b-f606eb367056 req-48dd70c1-a415-4d6e-86a1-396146f7848e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "name": "network-vif-plugged", "status": "completed", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:29.219286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bf2aefee-f016-43f2-a72b-f606eb367056 req-48dd70c1-a415-4d6e-86a1-396146f7848e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:29.219759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bf2aefee-f016-43f2-a72b-f606eb367056 req-48dd70c1-a415-4d6e-86a1-396146f7848e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:29.230839 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bf2aefee-f016-43f2-a72b-f606eb367056 req-48dd70c1-a415-4d6e-86a1-396146f7848e service nova] Creating event network-vif-plugged:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h2-841089-2 May 10 03:06:29.235881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bf2aefee-f016-43f2-a72b-f606eb367056 req-48dd70c1-a415-4d6e-86a1-396146f7848e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 May 10 03:06:29.236488 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3375/6790] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:29.942963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:29.943521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:29.950273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:29.950726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:29.951530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:29.951971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:30.076903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:30.084958 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b9d08483-c111-4b90-8fdf-0550a6c47bf8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1363 microversion: 2.1 time: 0.145977 May 10 03:06:30.085529 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3416/6791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:29 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:31.103114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:31.103857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:31.110244 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:31.110721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:31.112047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:31.112511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:31.240987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:31.248511 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c367153-c3e9-4304-8c85-b8d0043e32ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1551 microversion: 2.1 time: 0.150611 May 10 03:06:31.249103 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3376/6792] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:31 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:31.265568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:31.266053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:31.273065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:31.273527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:31.274301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:31.274746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:31.353806 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a2a6f60b-90c3-4465-9c27-2f0d35370fb4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091998 May 10 03:06:31.354369 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3417/6793] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 03:06:31 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:06:32.592924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-38014663-6157-41e7-93f7-a7d7c4802be3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:32.595566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-76fa88b1-bd58-4dd8-a247-e1f8d137796b req-cdf0b71c-3bb1-4bfb-852c-d7055fb362bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:32.600262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38014663-6157-41e7-93f7-a7d7c4802be3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:32.600742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-38014663-6157-41e7-93f7-a7d7c4802be3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:32.603613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-76fa88b1-bd58-4dd8-a247-e1f8d137796b req-cdf0b71c-3bb1-4bfb-852c-d7055fb362bf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:32.604077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-76fa88b1-bd58-4dd8-a247-e1f8d137796b req-cdf0b71c-3bb1-4bfb-852c-d7055fb362bf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:32.618295 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-76fa88b1-bd58-4dd8-a247-e1f8d137796b req-cdf0b71c-3bb1-4bfb-852c-d7055fb362bf service nova] Creating event network-changed:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h2-841089-2 May 10 03:06:32.624689 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-76fa88b1-bd58-4dd8-a247-e1f8d137796b req-cdf0b71c-3bb1-4bfb-852c-d7055fb362bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033061 May 10 03:06:32.625326 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3418/6794] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:06:32.625582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-38014663-6157-41e7-93f7-a7d7c4802be3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Going to try to stop instance {{(pid=118717) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 03:06:32.675251 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-38014663-6157-41e7-93f7-a7d7c4802be3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action" status: 202 len: 0 microversion: 2.1 time: 0.086128 May 10 03:06:32.676305 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3377/6795] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:06:32 2022] POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:06:32.686113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:32.687101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:32.695363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:32.695962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:32.697620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:32.698101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:32.898174 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:32.906111 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-45e1f595-929d-4839-9b65-58fc75d7d53d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1561 microversion: 2.1 time: 0.224357 May 10 03:06:32.906888 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3419/6796] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:32 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1561 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:33.925448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:33.926173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:33.932688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:33.933163 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:33.933952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:33.934423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:34.063814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:34.072030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41dbccaa-885f-4f05-8b00-5366dab2a09c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.152313 May 10 03:06:34.072618 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3378/6797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:33 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:35.089315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:35.089942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:35.096696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:35.097163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:35.097948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:35.098402 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:35.286411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:35.294131 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4d03744-5b79-47bb-b589-0f2706130173 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.208736 May 10 03:06:35.294716 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3420/6798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:35 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:36.311914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:36.312480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:36.319287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:36.319759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:36.320544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:36.321279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:36.447977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:36.455927 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98b5b8e7-61fd-44d5-bd2c-59da5a469b50 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.148104 May 10 03:06:36.456498 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3379/6799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:36 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:37.473423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:37.474047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:37.480892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:37.481357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:37.482137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:37.482586 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:37.611629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:37.618903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3a6eac4-97ec-4665-aed2-4c18291928b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.149397 May 10 03:06:37.619509 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3421/6800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:37 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:38.636405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:38.637043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:38.644483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:38.644953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:38.645748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:38.646200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:38.830293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:38.838624 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c621940d-76f7-4c92-a164-f8cfb832d02c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.206186 May 10 03:06:38.839228 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3380/6801] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:38 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:39.855969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:39.856617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:39.863479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:39.863939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:39.864719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:39.865163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:39.994884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:40.002323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3028bc8-6a6c-4982-a08d-bd7563f5bb0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.150236 May 10 03:06:40.003499 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3422/6802] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:39 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:41.019921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:41.020574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:41.027399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:41.027875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:41.028665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:41.029127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:41.153497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:41.161342 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-125c76d5-da9f-48d9-b139-9aeae873fdbc tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.145334 May 10 03:06:41.162078 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3381/6803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:41 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:42.178309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:42.178929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:42.186009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:42.186472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:42.187292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:42.187738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:42.312564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:42.320511 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a10a6e5f-d6d0-4bd4-8cb2-a6583d70816a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.146655 May 10 03:06:42.321094 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3423/6804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:42 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:43.337627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:43.338265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:43.345066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:43.345538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:43.346477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:43.346931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:43.478879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:43.486214 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aba1aa3c-ee80-434d-b086-309ed238ba7c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.152557 May 10 03:06:43.486782 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3382/6805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:43 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:44.502781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:44.503433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:44.510251 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:44.510711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:44.511521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:44.511976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:44.638980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:44.646970 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-22307e2f-62fe-4394-852b-ba4844fed288 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.148051 May 10 03:06:44.647577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3424/6806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:44 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:45.665042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:45.665042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:45.672228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:45.672706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:45.673533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:45.674035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:45.805017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:45.812688 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2c048982-d495-4841-9795-43d38546f8cf tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.152607 May 10 03:06:45.813258 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3383/6807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:45 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:46.830199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:46.831302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:46.837787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:46.838248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:46.839025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:46.839497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:46.966979 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:46.975013 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c850cbe-bb5a-4353-9ee9-703b3e1c9223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.148806 May 10 03:06:46.975684 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3425/6808] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:46 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:47.991969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:47.992606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:47.999466 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:47.999939 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:48.000729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:48.001186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:48.125922 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:48.133766 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c37202e4-72e9-4676-bf01-132f7545b0a7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.145782 May 10 03:06:48.134346 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3384/6809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:47 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:49.151536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:49.152160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:49.159564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:49.160032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:49.160840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:49.161289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:49.556551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:49.565503 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4f4f7d1f-eb58-48fa-9685-48bd0250b74c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.417492 May 10 03:06:49.566080 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3426/6810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:49 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:50.582761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:50.583427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:50.589938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:50.590416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:50.591243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:50.591717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:50.719389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:50.726734 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c0c8312f-503c-4a54-8096-f3af75a67e34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.148057 May 10 03:06:50.727357 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3385/6811] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:50 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:51.743917 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:51.744549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:51.751334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:51.751800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:51.752726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:51.753180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:51.886518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:51.894053 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-870d8975-1d82-4058-8f38-8d500fd80aad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.154040 May 10 03:06:51.894554 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3427/6812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:51 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:06:52.911132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:52.911779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:52.918585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:52.919091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:52.919906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:52.920401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:53.048340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:53.056577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-24904f8c-23f5-4ee6-95d3-a93bd4b07a08 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.149449 May 10 03:06:53.057153 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3386/6813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:52 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:54.073565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:54.074214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:54.081724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:54.082183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:54.082962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:54.083435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:54.211211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:54.218580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1c6b5fd4-ff4e-4fba-b589-18b3cc82a328 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.148948 May 10 03:06:54.219151 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3428/6814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:54 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:55.235347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:55.236040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:55.243535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:55.244013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:55.244812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:55.245272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:55.377662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:55.385133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a378cab3-56d6-44e0-886d-de548cd49f75 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.153751 May 10 03:06:55.385705 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3387/6815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:55 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:56.401937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:56.402470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:56.409408 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:56.409904 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:56.410747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:56.411229 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:56.538606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:56.546007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c8698b2a-696e-4d20-b752-71b7b884dd3b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.148071 May 10 03:06:56.546576 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3429/6816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:56 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:57.563793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:57.564424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:57.572472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:57.572943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:57.573732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:57.574187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:57.710768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:57.718199 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-29e4e57d-3f86-4128-9bbe-ce43b3ba81ca tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.158370 May 10 03:06:57.718766 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3388/6817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:57 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:58.735242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:58.735919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:58.743147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:58.743607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:58.744381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:58.744828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:58.872455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:58.880542 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ae94fbf-3398-489b-b81c-a70662b5fa15 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1657 microversion: 2.1 time: 0.149227 May 10 03:06:58.881127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3430/6818] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:58 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1657 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:06:58.896776 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:06:58.897700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:58.904442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:58.904909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:58.905689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:58.906143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:58.933810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:58.939396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Old instance type m1.heat2, new instance type m1.heat {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:06:58.946072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:06:58.946509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:06:58.947000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:06:58.947451 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:06:58.947876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:06:59.008451 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-28b1ae41-d4df-4cb3-881f-89d4652a3bde tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action" status: 202 len: 0 microversion: 2.1 time: 0.115671 May 10 03:06:59.009059 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3389/6819] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:06:58 2022] POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:06:59.017192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:06:59.017926 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:06:59.024030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:59.024498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:59.025291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:06:59.025746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:06:59.183360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:06:59.190826 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-df3e1ef7-e4b6-41e2-ad44-13e43abf8c03 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.177596 May 10 03:06:59.191413 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3431/6820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:06:59 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:00.208798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:00.209514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:00.215715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:00.216214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:00.217011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:00.217474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:00.363883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:00.371527 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-205b48ae-bcb0-46c6-9d97-c51954a153af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.167466 May 10 03:07:00.372120 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3390/6821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:00 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:01.393630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:01.394449 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:01.401342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:01.402008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:01.402675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:01.403142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:01.598447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:01.606203 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3526e68a-39bf-45f7-bdd1-995d10b5c8d9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1680 microversion: 2.1 time: 0.217776 May 10 03:07:01.606905 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3432/6822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:01 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:02.623783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:02.624548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:02.631564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:02.632051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:02.632864 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:02.633330 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:02.771760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:02.779265 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a0070884-5607-47a5-b971-6b05ed118180 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1685 microversion: 2.1 time: 0.159535 May 10 03:07:02.779846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3391/6823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:02 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:03.796812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:03.797444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:03.804452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:03.804920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:03.806411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:03.806411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:03.946670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:03.954189 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7fe401f2-83e3-45a2-841b-842ce9a49ae1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1685 microversion: 2.1 time: 0.161269 May 10 03:07:03.954777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3433/6824] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:03 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:04.486987 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d5b24080-daa3-4a51-b660-3f6fe41e9e61 req-726c7b28-50cf-4c66-9046-6c4d2aafd714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "name": "network-vif-unplugged", "status": "completed", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:04.495513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d5b24080-daa3-4a51-b660-3f6fe41e9e61 req-726c7b28-50cf-4c66-9046-6c4d2aafd714 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:04.495982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d5b24080-daa3-4a51-b660-3f6fe41e9e61 req-726c7b28-50cf-4c66-9046-6c4d2aafd714 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:04.508539 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d5b24080-daa3-4a51-b660-3f6fe41e9e61 req-726c7b28-50cf-4c66-9046-6c4d2aafd714 service nova] Creating event network-vif-unplugged:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h1-841089-2 May 10 03:07:04.514534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-d5b24080-daa3-4a51-b660-3f6fe41e9e61 req-726c7b28-50cf-4c66-9046-6c4d2aafd714 service nova] Instance b9606f19-2c53-485a-b4f1-443d8931866a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:07:04.526483 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d5b24080-daa3-4a51-b660-3f6fe41e9e61 req-726c7b28-50cf-4c66-9046-6c4d2aafd714 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117115 May 10 03:07:04.527361 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3392/6825] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:04.972599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:04.973236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:04.980635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:04.981100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:04.981899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:04.982518 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:05.127513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:05.135279 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-12282219-b698-4574-9442-c5abb4635020 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1684 microversion: 2.1 time: 0.167197 May 10 03:07:05.135876 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3434/6826] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:04 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:06.155110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:06.155838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:06.162731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:06.163252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:06.164048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:06.164509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:06.294531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:06.301950 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c77f6a0-1d9a-4ec1-89ba-28f034505c9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1682 microversion: 2.1 time: 0.151961 May 10 03:07:06.302521 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3393/6827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:06 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:06.552667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e242ee7d-33e6-46be-ab9f-ac45a0405e93 req-76fff5a1-ecc1-45bb-b2d5-e25944dcfa5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:06.561624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e242ee7d-33e6-46be-ab9f-ac45a0405e93 req-76fff5a1-ecc1-45bb-b2d5-e25944dcfa5d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:06.562083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e242ee7d-33e6-46be-ab9f-ac45a0405e93 req-76fff5a1-ecc1-45bb-b2d5-e25944dcfa5d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:06.574010 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e242ee7d-33e6-46be-ab9f-ac45a0405e93 req-76fff5a1-ecc1-45bb-b2d5-e25944dcfa5d service nova] Creating event network-changed:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h1-841089-2 May 10 03:07:06.579252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-e242ee7d-33e6-46be-ab9f-ac45a0405e93 req-76fff5a1-ecc1-45bb-b2d5-e25944dcfa5d service nova] Instance b9606f19-2c53-485a-b4f1-443d8931866a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:07:06.590545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e242ee7d-33e6-46be-ab9f-ac45a0405e93 req-76fff5a1-ecc1-45bb-b2d5-e25944dcfa5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041599 May 10 03:07:06.591153 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3435/6828] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:07.319719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:07.320352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:07.327017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:07.327517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:07.328303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:07.328758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:07.467267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:07.475134 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ae9ce60-5ee8-46ca-aeb0-94202e39966a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1678 microversion: 2.1 time: 0.159383 May 10 03:07:07.475710 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3394/6829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:07 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:07.492478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:07.493108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:07.499334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:07.499795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:07.500563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:07.501007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:07.556550 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c765635e-30c3-457d-8613-9b4db485272d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action" status: 204 len: 0 microversion: 2.1 time: 0.068820 May 10 03:07:07.557510 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3436/6830] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:07:07 2022] POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:07:07.565745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:07.566541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:07.572615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:07.573086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:07.573883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:07.574359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:07.782550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:07.792338 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f86480e-c07c-4e7d-a595-d76619855d79 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1678 microversion: 2.1 time: 0.230028 May 10 03:07:07.792690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3395/6831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:07 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:08.809892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:08.810619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:08.817827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:08.818297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:08.819109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:08.819820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:08.964071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:08.972387 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14cfbd87-9717-44cb-8bf2-37b427ed5491 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1657 microversion: 2.1 time: 0.166465 May 10 03:07:08.972978 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3437/6832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:08 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1657 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:08.989616 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:08.990256 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:08.996568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:08.997050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:08.997850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:08.998313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:09.131555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:09.139445 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b28e233-fe12-48ae-98e7-6153f7432770 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1657 microversion: 2.1 time: 0.154465 May 10 03:07:09.140041 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3396/6833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:08 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:09.156460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bac906b0-3637-4f3c-b4f7-79ca294f9c6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:09.163085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bac906b0-3637-4f3c-b4f7-79ca294f9c6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:09.163562 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bac906b0-3637-4f3c-b4f7-79ca294f9c6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:09.188225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bac906b0-3637-4f3c-b4f7-79ca294f9c6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Going to try to start instance {{(pid=118716) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 03:07:09.230156 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bac906b0-3637-4f3c-b4f7-79ca294f9c6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action" status: 202 len: 0 microversion: 2.1 time: 0.077414 May 10 03:07:09.231053 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3438/6834] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:07:09 2022] POST /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:07:09.240596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:09.241409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:09.248629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:09.249239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:09.250291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:09.250866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:09.394441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:09.401896 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-abe160b9-06eb-457c-b478-b353959a3bd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1666 microversion: 2.1 time: 0.166415 May 10 03:07:09.402483 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3397/6835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:09 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:10.420589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:10.421232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:10.428254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.428722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.429509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.429963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.556316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:10.563675 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-752acefe-9096-47ec-a79d-4db39481b553 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1670 microversion: 2.1 time: 0.147413 May 10 03:07:10.564251 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3439/6836] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:10 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:10.580284 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:10.580823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:10.588156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.588628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.589418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.589880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.614477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:07:10.689077 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9fd6406-f503-4658-a246-205ee25ce284 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 204 len: 0 microversion: 2.1 time: 0.112206 May 10 03:07:10.689661 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3398/6837] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:07:10 2022] DELETE /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:07:10.698807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:10.699467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:10.705566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.706036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.706817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.707322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.834507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:10.842005 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fc1ac3ec-69a6-4e95-9a3a-b2d14d7d626b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1676 microversion: 2.1 time: 0.147110 May 10 03:07:10.842570 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3440/6838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:10 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:10.935896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-262888a7-e07e-4098-a8ab-51c89d0507ff req-3944a504-83d9-4314-b5f2-316ed2400449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "name": "network-vif-plugged", "status": "completed", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:10.944565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-262888a7-e07e-4098-a8ab-51c89d0507ff req-3944a504-83d9-4314-b5f2-316ed2400449 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:10.945100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-262888a7-e07e-4098-a8ab-51c89d0507ff req-3944a504-83d9-4314-b5f2-316ed2400449 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:10.956466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-262888a7-e07e-4098-a8ab-51c89d0507ff req-3944a504-83d9-4314-b5f2-316ed2400449 service nova] Creating event network-vif-plugged:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h1-841089-2 May 10 03:07:10.961274 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-262888a7-e07e-4098-a8ab-51c89d0507ff req-3944a504-83d9-4314-b5f2-316ed2400449 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029532 May 10 03:07:10.961881 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3399/6839] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:11.859026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:11.859674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:11.867284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:11.867782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:11.868567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:11.869020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:11.999699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:12.007282 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61748b44-c9ac-4002-be2f-37e5b19a1af9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1676 microversion: 2.1 time: 0.152064 May 10 03:07:12.007862 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3441/6840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:11 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:12.873275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8e899cc5-7281-4ba8-a937-f3eea4b80be5 req-962f8227-5d17-4d7b-9167-2cefd5392c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9606f19-2c53-485a-b4f1-443d8931866a", "name": "network-vif-deleted", "tag": "df1c9268-6142-419f-9e89-06fee6c63e61"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:12.882930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8e899cc5-7281-4ba8-a937-f3eea4b80be5 req-962f8227-5d17-4d7b-9167-2cefd5392c63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:12.883436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8e899cc5-7281-4ba8-a937-f3eea4b80be5 req-962f8227-5d17-4d7b-9167-2cefd5392c63 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:12.896501 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8e899cc5-7281-4ba8-a937-f3eea4b80be5 req-962f8227-5d17-4d7b-9167-2cefd5392c63 service nova] Creating event network-vif-deleted:df1c9268-6142-419f-9e89-06fee6c63e61 for instance b9606f19-2c53-485a-b4f1-443d8931866a on n-h1-841089-2 May 10 03:07:12.901551 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8e899cc5-7281-4ba8-a937-f3eea4b80be5 req-962f8227-5d17-4d7b-9167-2cefd5392c63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033901 May 10 03:07:12.902168 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3400/6841] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:13.024132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:13.024759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:13.032278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:13.033110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:13.034094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:13.034579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:13.069803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:13.070271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:13.071136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lazy-loading 'fault' on Instance uuid b9606f19-2c53-485a-b4f1-443d8931866a {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:07:13.114830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:13.121952 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-adc6bdf5-2a4b-4233-b107-60c274540054 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 200 len: 1328 microversion: 2.1 time: 0.101891 May 10 03:07:13.122538 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3442/6842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:13 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:14.140260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:14.140950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:14.147917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:14.148389 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:14.149179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:14.149638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:14.162678 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a HTTP/1.1 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'b9606f19-2c53-485a-b4f1-443d8931866a'} May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:14.164367 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4ef46280-1951-46bc-96f5-d86ceb3d5653 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 404 len: 111 microversion: 2.1 time: 0.030819 May 10 03:07:14.169014 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3401/6843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:14 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:07:14.183841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:14.184466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:14.191800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:14.192258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:14.193031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:14.193472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:14.207018 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a HTTP/1.1 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'b9606f19-2c53-485a-b4f1-443d8931866a'} May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:07:14.208695 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49166f01-bafd-4e2b-9bbf-75c7f929b012 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 404 len: 111 microversion: 2.1 time: 0.030492 May 10 03:07:14.213086 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3443/6844] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:14 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:07:14.255875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-477272454", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a1055699-bb3f-45e1-8da4-7f6e1e27504d"}], "security_groups": [{"name": "tempest-securitygroup--829411176"}], "key_name": "tempest-keypair-1198370491", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:14.356096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] validate_networks() for [('a1055699-bb3f-45e1-8da4-7f6e1e27504d', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:07:14.994177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:07:14.994621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:07:14.995143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:07:14.995571 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:07:14.996000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:07:15.005137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:15.005602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:15.006421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:15.006876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:15.023507 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:07:15.028630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:07:15.040550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:07:15.042760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:07:15.088518 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-846ff21d-c4c0-40e3-bd3d-14c899de04ee tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.837096 May 10 03:07:15.089174 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3402/6845] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:07:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:07:15.099447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-952a9f4a-3d0d-4a0b-a0d0-8ba8165c4d7b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:15.100076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-952a9f4a-3d0d-4a0b-a0d0-8ba8165c4d7b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:15.153187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-952a9f4a-3d0d-4a0b-a0d0-8ba8165c4d7b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:15.159738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-952a9f4a-3d0d-4a0b-a0d0-8ba8165c4d7b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1238 microversion: 2.1 time: 0.064259 May 10 03:07:15.160311 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3444/6846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:15 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:16.178265 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:16.178972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:16.185324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:16.185794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:16.186583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:16.187037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:16.279205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:16.286697 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9e697333-3fc8-4b87-8cd1-01f03969c208 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1296 microversion: 2.1 time: 0.113337 May 10 03:07:16.287463 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3403/6847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:16 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:17.304022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:17.304770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:17.313757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:17.314230 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:17.315036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:17.316062 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:17.419980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e71b1e5d-7bc3-4749-9b12-509cb1697f89 req-8a51f1a5-6fab-4a40-9d3d-f49797f72441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:17.433331 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e71b1e5d-7bc3-4749-9b12-509cb1697f89 req-8a51f1a5-6fab-4a40-9d3d-f49797f72441 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:17.433913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e71b1e5d-7bc3-4749-9b12-509cb1697f89 req-8a51f1a5-6fab-4a40-9d3d-f49797f72441 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:17.446949 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e71b1e5d-7bc3-4749-9b12-509cb1697f89 req-8a51f1a5-6fab-4a40-9d3d-f49797f72441 service nova] Creating event network-changed:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h2-841089-2 May 10 03:07:17.452751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e71b1e5d-7bc3-4749-9b12-509cb1697f89 req-8a51f1a5-6fab-4a40-9d3d-f49797f72441 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036806 May 10 03:07:17.456345 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3404/6848] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:17.581801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:17.589545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d148d5a2-724a-4d1e-b1db-f972a5175e48 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.289445 May 10 03:07:17.590128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3445/6849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:17 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:18.608704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:18.609430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:18.615732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:18.616208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:18.617000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:18.617461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:18.745676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:18.753626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4b463421-e4b0-46a3-bf88-6e7f9d4444be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.149525 May 10 03:07:18.754277 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3405/6850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:18 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:19.771646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:19.772257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:19.779061 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:19.779548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:19.780325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:19.780770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:19.909968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:19.917186 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-52abe83c-cbfc-4a7a-aa46-a30053e90e49 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.150111 May 10 03:07:19.917764 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3446/6851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:19 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:20.935411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:20.935977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:20.943146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:20.943632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:20.944424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:20.944884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:21.074376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:21.082303 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1a03353-439e-4984-83f3-d831373a8e6e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.151301 May 10 03:07:21.082884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3406/6852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:20 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:22.099354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:22.099973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:22.106800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:22.107302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:22.108076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:22.108522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:22.238043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:22.245335 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e85ef037-f766-443b-9516-e780d06b58b1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.149905 May 10 03:07:22.245906 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3447/6853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:22 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:23.263417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:23.264040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:23.271429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:23.271902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:23.272691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:23.273151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:23.398529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:23.405791 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d741681-118b-4f88-bf13-fad6309d7f3c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.146415 May 10 03:07:23.406368 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3407/6854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:23 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:23.613213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-4e7252b4-6bff-41c2-92ad-14c742a3a6e1 req-5f6bcfc2-3bba-4f2e-a786-a19d4be113f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "name": "network-vif-plugged", "status": "completed", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:23.622433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4e7252b4-6bff-41c2-92ad-14c742a3a6e1 req-5f6bcfc2-3bba-4f2e-a786-a19d4be113f5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:23.622903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-4e7252b4-6bff-41c2-92ad-14c742a3a6e1 req-5f6bcfc2-3bba-4f2e-a786-a19d4be113f5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:23.635093 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-4e7252b4-6bff-41c2-92ad-14c742a3a6e1 req-5f6bcfc2-3bba-4f2e-a786-a19d4be113f5 service nova] Creating event network-vif-plugged:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h2-841089-2 May 10 03:07:23.641483 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-4e7252b4-6bff-41c2-92ad-14c742a3a6e1 req-5f6bcfc2-3bba-4f2e-a786-a19d4be113f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032459 May 10 03:07:23.642095 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3448/6855] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:24.422867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:24.423445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:24.430703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:24.431457 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:24.432243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:24.432701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:24.558186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:24.565633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9d3afd3-65ab-4d53-b88f-fb2f517b1f97 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1363 microversion: 2.1 time: 0.146815 May 10 03:07:24.566213 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3408/6856] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:24 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:25.583855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:25.584596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:25.590842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:25.591343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:25.592120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:25.592596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:25.724738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:25.732266 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3fae4603-222d-4390-b7e5-075f8a287633 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1550 microversion: 2.1 time: 0.154212 May 10 03:07:25.732837 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3449/6857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:25 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:25.749553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:25.750074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:25.757610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:25.758084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:25.758885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:25.759374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:25.837890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-664361b0-6900-41a0-8a67-8a364ce1ffb1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092186 May 10 03:07:25.838527 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3409/6858] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 03:07:25 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:26.799607 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:26.800679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:26.801214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b19054c1-245d-4121-8c73-95f0b3fc3f7a req-eeb0efa0-d325-4f06-810d-23e4fd0e33c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:26.808287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:26.808860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:26.809737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:26.810264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:26.811464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b19054c1-245d-4121-8c73-95f0b3fc3f7a req-eeb0efa0-d325-4f06-810d-23e4fd0e33c6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:26.812164 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b19054c1-245d-4121-8c73-95f0b3fc3f7a req-eeb0efa0-d325-4f06-810d-23e4fd0e33c6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:26.824801 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b19054c1-245d-4121-8c73-95f0b3fc3f7a req-eeb0efa0-d325-4f06-810d-23e4fd0e33c6 service nova] Creating event network-changed:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h2-841089-2 May 10 03:07:26.830592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b19054c1-245d-4121-8c73-95f0b3fc3f7a req-eeb0efa0-d325-4f06-810d-23e4fd0e33c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032890 May 10 03:07:26.832420 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3410/6859] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:26.841318 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:26.847944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Old instance type m1.heat2, new instance type m1.heat {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:07:26.855322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:07:26.855953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:07:26.856616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:07:26.857197 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:07:26.857797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:07:26.927092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-01ff115a-509e-462d-8fea-46b1829b4561 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654/action" status: 202 len: 0 microversion: 2.1 time: 0.131684 May 10 03:07:26.928235 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3450/6860] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:07:26 2022] POST /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:07:26.938316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:26.939426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:26.949294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:26.950413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:26.951668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:26.952443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:27.237976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:27.246893 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-209fcbde-c372-4288-a756-8028a091bf8d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1559 microversion: 2.1 time: 0.313413 May 10 03:07:27.251947 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3411/6861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:26 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1559 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:28.270108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:28.270764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:28.276804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:28.277273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:28.278063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:28.278512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:28.405371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:28.412936 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-31ade108-5668-49d1-b95a-cb585e2c027e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1678 microversion: 2.1 time: 0.148292 May 10 03:07:28.413520 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3451/6862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:28 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:29.430205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:29.431143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:29.437970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:29.438460 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:29.439369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:29.439845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:29.572234 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:29.579705 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-feddbc04-5bea-4ffc-ba4b-35555374acae tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.153457 May 10 03:07:29.580294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3412/6863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:29 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:30.599159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:30.599782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:30.606549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:30.607002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:30.607800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:30.608245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:30.736113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:30.744031 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80d31220-aa44-4a65-87b7-e3a441480436 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.149395 May 10 03:07:30.744598 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3452/6864] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:30 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:31.764166 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:31.764781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:31.772431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:31.772908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:31.773754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:31.774227 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:31.901881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:31.909895 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1676974d-7ed5-4db6-aa35-9d6eb744f0be tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.149530 May 10 03:07:31.910482 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3413/6865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:31 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:32.927208 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:32.927690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:32.934307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:32.934764 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:32.935606 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:32.936055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:33.066238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:33.073531 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b97349a2-f594-4a9f-82e0-227b893ff223 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.151532 May 10 03:07:33.074096 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3453/6866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:32 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:34.089712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:34.090371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:34.097230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:34.097734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:34.098523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:34.098985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:34.226648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:34.233971 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b9cb4bf1-df1f-476c-9f0e-af5dd0c19916 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.148202 May 10 03:07:34.234542 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3414/6867] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:34 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:35.251236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:35.251856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:35.258199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:35.258654 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:35.259455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:35.259898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:35.389949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:35.397801 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7239f4d4-79fe-43b6-9901-a810a8c3b54d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.150732 May 10 03:07:35.398371 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3454/6868] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:35 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:36.414408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:36.414952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:36.421946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:36.422423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:36.423243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:36.423708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:36.552946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:36.560605 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-88e3d354-70a3-40d4-9956-742cac004b9c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.150837 May 10 03:07:36.561188 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3415/6869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:36 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:37.577918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:37.578588 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:37.585855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:37.586310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:37.587135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:37.587580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:37.715531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:37.722885 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c6e3a4b0-f872-4c93-8d27-91204cefd152 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.148806 May 10 03:07:37.723487 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3455/6870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:37 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:38.740803 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:38.741548 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:38.749806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:38.750281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:38.751102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:38.751569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:38.882945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:38.890516 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-18fe5f1b-86fd-4d5a-a730-b56217ce1faa tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.154543 May 10 03:07:38.891039 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3416/6871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:38 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:39.907583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:39.908156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:39.915240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:39.915702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:39.916501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:39.916952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:40.042619 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:40.050302 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-787cb1b5-a2be-4cb7-97a1-690a40563b72 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.146676 May 10 03:07:40.050884 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3456/6872] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:39 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:41.067684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:41.068315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:41.075143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:41.075615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:41.076398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:41.076855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:41.207630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:41.214944 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e0452dc7-60bd-4b75-8275-7ba3047dd447 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.151231 May 10 03:07:41.215568 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3417/6873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:41 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:42.232674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:42.233329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:42.240476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:42.240934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:42.241718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:42.242183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:42.370401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:42.378595 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f2f336b4-b31a-496d-b500-9f927b10cf20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.150006 May 10 03:07:42.379185 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3457/6874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:42 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:43.395762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:43.397024 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:43.403843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:43.404313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:43.405100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:43.405554 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:43.534161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:43.541532 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50f53b49-ec11-41c9-9794-f872852ddab8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.149824 May 10 03:07:43.542109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3418/6875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:43 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:44.558407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:44.559183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:44.565988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:44.566451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:44.567263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:44.567825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:44.698480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:44.705942 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-197296f1-4ef6-4891-9682-57a70b271964 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.151678 May 10 03:07:44.706527 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3458/6876] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:44 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:45.723629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:45.724770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:45.731595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:45.732068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:45.732859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:45.733323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:45.859951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:45.867365 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b222dc23-f647-4503-a9cb-8ad9f4b0c0f1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.147818 May 10 03:07:45.867943 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3419/6877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:45 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:46.884043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:46.884695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:46.891326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:46.891724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:46.892495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:46.892940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:47.023737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:47.031257 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6f9b5f6b-b422-4e6c-bd69-7c032b0ad157 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.151092 May 10 03:07:47.031832 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3459/6878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:46 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:48.048877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:48.049523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:48.056840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:48.057318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:48.058118 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:48.058583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:48.187445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:48.194969 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1e3e2e57-3e27-4660-9499-1c93b3a5ef9f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.150026 May 10 03:07:48.195590 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3420/6879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:48 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:49.211927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:49.212547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:49.219160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:49.219621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:49.220394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:49.220836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:49.355902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:49.363677 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2de10855-7772-4ffe-8b84-9f5625a1399c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.155638 May 10 03:07:49.364255 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3460/6880] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:49 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:50.382523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:50.383189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:50.389676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:50.390150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:50.390942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:50.391442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:50.518043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:50.526023 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0b3855e4-aa03-489c-b9bd-9301935249ec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.148280 May 10 03:07:50.526611 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3421/6881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:50 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:07:51.542587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:51.543243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:51.550091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:51.550576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:51.551382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:51.551830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:51.678557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:51.686611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-451920ef-8b56-4431-ba21-30529813b843 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.147961 May 10 03:07:51.687224 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3461/6882] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:51 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:52.704385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:52.705016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:52.711817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:52.712293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:52.713084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:52.713547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:52.846739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:52.854142 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d729c1ed-44ae-46f0-8335-6a45a525e502 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.153887 May 10 03:07:52.854740 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3422/6883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:52 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:53.333078 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:07:53.334150 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:07:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:07:53.871694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:53.872317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:53.879059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:53.879547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:53.880321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:53.880795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:54.005802 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:54.013130 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b00f504d-ba4f-4e6c-8623-27dfea3c883e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.145441 May 10 03:07:54.013692 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3462/6884] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:53 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:55.029742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:55.030370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:55.037201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:55.037673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:55.038452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:55.038908 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:55.167965 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:55.175371 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53c98f42-df38-4405-8182-b090bde2523e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.149511 May 10 03:07:55.175945 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3423/6885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:55 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:56.193622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:56.194262 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:56.201156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:56.201626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:56.202477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:56.202940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:56.338568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:56.346190 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3c15a01-3f9a-4b7b-b61a-d4ea0717b35f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1683 microversion: 2.1 time: 0.156936 May 10 03:07:56.346770 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3463/6886] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:56 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:56.729434 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7f650235-4a63-4ffd-be8e-89260b99618c req-934cb65d-a6a2-4151-9b6f-2dd2ecfcdf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "name": "network-vif-unplugged", "status": "completed", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:56.738771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7f650235-4a63-4ffd-be8e-89260b99618c req-934cb65d-a6a2-4151-9b6f-2dd2ecfcdf2b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:56.740066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7f650235-4a63-4ffd-be8e-89260b99618c req-934cb65d-a6a2-4151-9b6f-2dd2ecfcdf2b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:56.752530 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7f650235-4a63-4ffd-be8e-89260b99618c req-934cb65d-a6a2-4151-9b6f-2dd2ecfcdf2b service nova] Creating event network-vif-unplugged:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h1-841089-2 May 10 03:07:56.758379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-7f650235-4a63-4ffd-be8e-89260b99618c req-934cb65d-a6a2-4151-9b6f-2dd2ecfcdf2b service nova] Instance d0dbe006-42de-41f9-a6a9-fff978513654 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:07:56.769984 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7f650235-4a63-4ffd-be8e-89260b99618c req-934cb65d-a6a2-4151-9b6f-2dd2ecfcdf2b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044654 May 10 03:07:56.770625 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3424/6887] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:57.362742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:57.363397 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:57.370127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:57.370585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:57.371490 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:57.372121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:57.514560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:57.522809 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0b82814b-72fe-4ac3-ae70-24b929bebde0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1682 microversion: 2.1 time: 0.164056 May 10 03:07:57.523481 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3464/6888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:57 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:58.541201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:58.541970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:58.549018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:58.549496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:58.550296 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:58.550762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:58.679650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:58.688040 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5e41578d-6d07-4030-bfef-15c6b7ccd2c2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1680 microversion: 2.1 time: 0.151559 May 10 03:07:58.693059 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3425/6889] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:58 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:58.784170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8fdbe0ca-e4af-4271-b8b6-e2a822ab79fb req-0b562de8-190e-48de-9ea0-84ef0e53b383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:58.793477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8fdbe0ca-e4af-4271-b8b6-e2a822ab79fb req-0b562de8-190e-48de-9ea0-84ef0e53b383 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:58.793946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8fdbe0ca-e4af-4271-b8b6-e2a822ab79fb req-0b562de8-190e-48de-9ea0-84ef0e53b383 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:58.805237 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8fdbe0ca-e4af-4271-b8b6-e2a822ab79fb req-0b562de8-190e-48de-9ea0-84ef0e53b383 service nova] Creating event network-changed:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h1-841089-2 May 10 03:07:58.810784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-8fdbe0ca-e4af-4271-b8b6-e2a822ab79fb req-0b562de8-190e-48de-9ea0-84ef0e53b383 service nova] Instance d0dbe006-42de-41f9-a6a9-fff978513654 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:07:58.823449 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8fdbe0ca-e4af-4271-b8b6-e2a822ab79fb req-0b562de8-190e-48de-9ea0-84ef0e53b383 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042820 May 10 03:07:58.824239 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3465/6890] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:07:59.710014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:07:59.710657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:59.718794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:59.719300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:59.720119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:59.720846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:59.853146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:07:59.860514 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed3d1730-8f4d-4ea7-bd32-2f112dd9b9f2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1677 microversion: 2.1 time: 0.154515 May 10 03:07:59.861094 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3426/6891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:07:59 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:07:59.879356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:07:59.880000 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:07:59.886874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:59.887371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:59.888142 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:59.888583 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:59.924201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:59.924660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:59.925671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:07:59.926123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:07:59.946226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:07:59.951273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:08:00.047664 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9cf670a9-1765-4e3d-9c51-e56738fba242 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654/action" status: 202 len: 0 microversion: 2.1 time: 0.172530 May 10 03:08:00.048195 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3466/6892] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:07:59 2022] POST /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:08:00.057636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:00.057884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:00.064949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:00.065512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:00.066509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:00.066976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:00.200485 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:00.208826 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d55f1ae-6b26-460d-af31-9de17fd42dd0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1676 microversion: 2.1 time: 0.155265 May 10 03:08:00.209419 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3427/6893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:00 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:01.227204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:01.227894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:01.235184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:01.235650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:01.236443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:01.236889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:01.368937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:01.377122 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d71886b-d401-43a4-8f10-c6d69180cbd2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1676 microversion: 2.1 time: 0.154747 May 10 03:08:01.377720 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3467/6894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:01 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:08:02.394957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:02.395659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:02.402213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:02.402690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:02.403512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:02.403977 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:02.546098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:02.554598 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0401808e-222e-4e9e-9ec7-dbf0052dcd22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1676 microversion: 2.1 time: 0.163463 May 10 03:08:02.555194 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3428/6895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:02 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:03.572800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:03.573438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:03.581159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:03.581637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:03.582434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:03.583770 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:03.782513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:03.790547 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-25211371-de6e-40d8-ad8a-62cd13857ffe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1676 microversion: 2.1 time: 0.221716 May 10 03:08:03.791450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3468/6896] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:03 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:03.866082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-03205691-0fc1-4b81-b9cd-f83f80b905d0 req-cca67b2f-b09f-4a62-be25-39b3f114a57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:03.878276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-03205691-0fc1-4b81-b9cd-f83f80b905d0 req-cca67b2f-b09f-4a62-be25-39b3f114a57c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:03.879475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-03205691-0fc1-4b81-b9cd-f83f80b905d0 req-cca67b2f-b09f-4a62-be25-39b3f114a57c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:03.897603 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-03205691-0fc1-4b81-b9cd-f83f80b905d0 req-cca67b2f-b09f-4a62-be25-39b3f114a57c service nova] Creating event network-changed:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h2-841089-2 May 10 03:08:03.907416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-03205691-0fc1-4b81-b9cd-f83f80b905d0 req-cca67b2f-b09f-4a62-be25-39b3f114a57c service nova] Instance d0dbe006-42de-41f9-a6a9-fff978513654 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:08:03.920349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-03205691-0fc1-4b81-b9cd-f83f80b905d0 req-cca67b2f-b09f-4a62-be25-39b3f114a57c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058643 May 10 03:08:03.921657 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3429/6897] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:04.808544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:04.809120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:04.815769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:04.816234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:04.817017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:04.817471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:04.948290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:04.955806 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4f2a7c9-f49e-4dcb-84c6-eb8b24d59969 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1676 microversion: 2.1 time: 0.151575 May 10 03:08:04.956378 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3469/6898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:04 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:05.974615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:05.975364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:05.981842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:05.982323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:05.983142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:05.983680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:06.166874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:06.174476 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c911f6b-03bd-4674-a3af-d4c03041a25e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1676 microversion: 2.1 time: 0.205472 May 10 03:08:06.175088 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3430/6899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:05 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:07.191192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:07.191840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:07.199320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.199780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.200557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.201004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.334459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:07.342002 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa4e97e4-6883-4386-a263-53e1c92a9a0c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1669 microversion: 2.1 time: 0.155000 May 10 03:08:07.342578 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3470/6900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:07 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:08:07.358339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:07.358970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:07.366338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.366810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.367667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.368133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.493740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:07.501138 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-aba85985-f939-4f35-ab15-b0e0cb10a93f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1669 microversion: 2.1 time: 0.146737 May 10 03:08:07.501712 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3431/6901] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:07 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1669 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:07.516679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:07.517293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:07.523246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.523704 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.524472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.524915 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.653282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:07.660674 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8336b036-fb88-4f73-9b58-f39b5f4a7ef7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1669 microversion: 2.1 time: 0.147840 May 10 03:08:07.661832 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3471/6902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:07 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:07.676857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:07.677388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:07.683655 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.684136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.684932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.685400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.710220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:08:07.786080 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68771517-2035-4dd7-9b57-b72cb9e71bf4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 204 len: 0 microversion: 2.1 time: 0.112732 May 10 03:08:07.787327 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3432/6903] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:08:07 2022] DELETE /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:08:07.795853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:07.796629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:07.803166 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.803857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.804667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:07.805159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:07.936772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:07.944812 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb059656-fa69-4478-91bb-8154d6b186a3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1675 microversion: 2.1 time: 0.152786 May 10 03:08:07.945394 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3472/6904] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:07 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:08.962712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:08.963468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:08.969968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:08.970445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:08.971280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:08.971750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:09.100378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:09.107820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3df46f9e-8b00-47ec-b431-13451a8cb0ce tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1675 microversion: 2.1 time: 0.149635 May 10 03:08:09.108408 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3433/6905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:08 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:10.125412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:10.126791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:10.135055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:10.135627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:10.136430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:10.137124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:10.246670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:10.254031 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3487b4d0-fef1-475a-b97f-6015acf84b5e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 200 len: 1608 microversion: 2.1 time: 0.132946 May 10 03:08:10.258713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3473/6906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:10 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 1608 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:10.331999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-30848c69-2716-4f23-bd7a-d7d719542e51 req-fc023b59-64e6-4116-8047-339886d4ba14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0dbe006-42de-41f9-a6a9-fff978513654", "name": "network-vif-deleted", "tag": "cb29c8d6-645f-4697-96ee-f116a33cc345"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:10.343760 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-30848c69-2716-4f23-bd7a-d7d719542e51 req-fc023b59-64e6-4116-8047-339886d4ba14 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:10.344237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-30848c69-2716-4f23-bd7a-d7d719542e51 req-fc023b59-64e6-4116-8047-339886d4ba14 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:10.362105 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-30848c69-2716-4f23-bd7a-d7d719542e51 req-fc023b59-64e6-4116-8047-339886d4ba14 service nova] Creating event network-vif-deleted:cb29c8d6-645f-4697-96ee-f116a33cc345 for instance d0dbe006-42de-41f9-a6a9-fff978513654 on n-h2-841089-2 May 10 03:08:10.367989 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-30848c69-2716-4f23-bd7a-d7d719542e51 req-fc023b59-64e6-4116-8047-339886d4ba14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039637 May 10 03:08:10.368954 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3434/6907] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:11.271489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:11.272125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:11.278897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:11.279395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:11.280192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:11.280647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:11.294376 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 HTTP/1.1 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd0dbe006-42de-41f9-a6a9-fff978513654'} May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:08:11.296091 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ea92618b-ed75-4407-a0ca-dfe9736813b3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 404 len: 111 microversion: 2.1 time: 0.030035 May 10 03:08:11.302631 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3474/6908] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:11 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:08:11.318890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:11.319750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:11.326414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:11.326858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:11.327745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:11.328272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:11.343604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 HTTP/1.1 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd0dbe006-42de-41f9-a6a9-fff978513654'} May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:08:11.346071 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cdd898b7-e4e9-4cdd-896f-c6a1932c2d62 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 404 len: 111 microversion: 2.1 time: 0.033024 May 10 03:08:11.351479 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3435/6909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:11 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:08:11.394720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-952991085", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "a1055699-bb3f-45e1-8da4-7f6e1e27504d"}], "security_groups": [{"name": "tempest-securitygroup--829411176"}], "key_name": "tempest-keypair-1198370491", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:11.493577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] validate_networks() for [('a1055699-bb3f-45e1-8da4-7f6e1e27504d', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:08:11.900416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:08:11.900862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:08:11.901346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:08:11.901827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:08:11.902250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:08:11.910887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:11.911382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:11.912201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:11.912649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:11.928943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:08:11.936294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:08:11.949701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:08:11.952023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:08:11.997176 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-844aa07e-a591-4fa8-8879-2d6e0b433f47 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.606308 May 10 03:08:11.997837 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3475/6910] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:08:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:08:12.008422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51d67281-ac42-48fc-9738-0867c38a47ef tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:12.009072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-51d67281-ac42-48fc-9738-0867c38a47ef tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:12.062520 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-51d67281-ac42-48fc-9738-0867c38a47ef tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:12.069897 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51d67281-ac42-48fc-9738-0867c38a47ef tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1238 microversion: 2.1 time: 0.065906 May 10 03:08:12.070475 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3436/6911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:12 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:13.088001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:13.088639 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:13.095171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:13.095633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:13.096423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:13.096871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:13.198361 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:13.205621 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a07d0f1f-630c-40ee-8c9d-56b3b167c51f tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1296 microversion: 2.1 time: 0.122494 May 10 03:08:13.206191 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3476/6912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:13 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:14.223441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:14.224680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:14.232774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:14.233335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:14.234156 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:14.234622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:14.401161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-e435b3de-966c-4d9c-ac59-c316ab22277d req-afbd953d-1c20-4121-b616-b082c30f1be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:14.416087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e435b3de-966c-4d9c-ac59-c316ab22277d req-afbd953d-1c20-4121-b616-b082c30f1be9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:14.416837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-e435b3de-966c-4d9c-ac59-c316ab22277d req-afbd953d-1c20-4121-b616-b082c30f1be9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:14.431866 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-e435b3de-966c-4d9c-ac59-c316ab22277d req-afbd953d-1c20-4121-b616-b082c30f1be9 service nova] Creating event network-changed:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h2-841089-2 May 10 03:08:14.437520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-e435b3de-966c-4d9c-ac59-c316ab22277d req-afbd953d-1c20-4121-b616-b082c30f1be9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040314 May 10 03:08:14.438134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3477/6913] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:08:14.455202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:14.464184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c3f0f1b8-c0bc-4284-a82b-f5dff8bfc7b6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.244669 May 10 03:08:14.464785 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3437/6914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:14 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:15.481798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:15.482519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:15.489610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:15.490744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:15.491564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:15.492019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:15.622007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:15.629465 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-37b0fde5-db1d-493b-b1a3-42efd4965d1b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.151921 May 10 03:08:15.630039 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3478/6915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:15 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:16.646341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:16.646985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:16.653815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:16.654290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:16.655125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:16.655591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:16.784770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:16.792138 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a8550874-909e-45c0-8b2e-3afb246ce1da tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.149710 May 10 03:08:16.792734 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3438/6916] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:16 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:17.809914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:17.810717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:17.817252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:17.817735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:17.819016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:17.819483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:17.952970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:17.961035 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3c4c835-3d91-4477-84e0-684ecbcfea57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.155767 May 10 03:08:17.961612 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3479/6917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:17 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:18.979362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:18.980030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:18.986846 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:18.987355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:18.988143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:18.988603 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:19.113862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:19.121235 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0ab514b-e9df-4f4d-9409-798dddd882a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.145846 May 10 03:08:19.121807 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3439/6918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:18 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:20.025471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3c578561-8585-414a-96d9-b8e64dadb76a req-78dd608d-0dd0-49db-a0fd-175271cf90d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "name": "network-vif-plugged", "status": "completed", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:20.033687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3c578561-8585-414a-96d9-b8e64dadb76a req-78dd608d-0dd0-49db-a0fd-175271cf90d0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:20.034144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3c578561-8585-414a-96d9-b8e64dadb76a req-78dd608d-0dd0-49db-a0fd-175271cf90d0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:20.045341 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3c578561-8585-414a-96d9-b8e64dadb76a req-78dd608d-0dd0-49db-a0fd-175271cf90d0 service nova] Creating event network-vif-plugged:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h2-841089-2 May 10 03:08:20.050249 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3c578561-8585-414a-96d9-b8e64dadb76a req-78dd608d-0dd0-49db-a0fd-175271cf90d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094211 May 10 03:08:20.050833 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3480/6919] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:08:20.137910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:20.138545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:20.145019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:20.145493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:20.146297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:20.146762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:20.289567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:20.296928 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d731fac-c05a-465b-8ebc-fbdaaff28761 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.163103 May 10 03:08:20.297499 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3440/6920] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:20 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:21.316468 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:21.317181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:21.324185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:21.324647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:21.325440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:21.325886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:21.454560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:21.461899 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-210db025-dfac-4799-bfbc-dc99025754e8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1363 microversion: 2.1 time: 0.150700 May 10 03:08:21.462463 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3481/6921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:21 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:22.479088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:22.479735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:22.486470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:22.486944 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:22.487763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:22.488226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:22.617937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:22.625513 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cc33c393-2c1a-4453-8087-f55eb8d752c0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1551 microversion: 2.1 time: 0.150430 May 10 03:08:22.626091 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3441/6922] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:22 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:22.642676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:22.643225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:22.650063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:22.650513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:22.651334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:22.651824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:22.728428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5795624c-c440-49ba-8400-1c5a38181db5 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089612 May 10 03:08:22.729040 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3482/6923] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 03:08:22 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:23.946924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b73179ae-62fc-4fba-9dea-c488696ab91d req-43ca84c6-06e0-4a48-9088-e54e66555499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:23.956747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b73179ae-62fc-4fba-9dea-c488696ab91d req-43ca84c6-06e0-4a48-9088-e54e66555499 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:23.957218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b73179ae-62fc-4fba-9dea-c488696ab91d req-43ca84c6-06e0-4a48-9088-e54e66555499 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:23.969625 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b73179ae-62fc-4fba-9dea-c488696ab91d req-43ca84c6-06e0-4a48-9088-e54e66555499 service nova] Creating event network-changed:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h2-841089-2 May 10 03:08:23.974915 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b73179ae-62fc-4fba-9dea-c488696ab91d req-43ca84c6-06e0-4a48-9088-e54e66555499 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032041 May 10 03:08:23.975716 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3442/6924] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:26.358004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:26.358648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:26.365103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:26.365632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:26.366401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:26.366841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:26.494231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:26.501668 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-14ae83c7-e3f8-410c-b8b4-ef905f8470f4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1670 microversion: 2.1 time: 0.148330 May 10 03:08:26.502247 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3483/6925] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:26 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:26.519731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "164f23a8-e749-4a6c-9344-ed348f8656c5"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:26.520909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:26.527097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:26.527589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:26.528385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:26.528851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:26.759593 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98df4fa5-9e6b-4a30-93ff-3dd177463b6d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244803 May 10 03:08:26.760161 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3443/6926] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 03:08:26 2022] POST /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:42.641441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:42.642417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:42.649722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:42.650185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:42.650963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:42.651434 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:42.678223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:42.684117 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=118716) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:08:42.691203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:08:42.691691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:08:42.692178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:08:42.693151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:08:42.693569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:08:42.753385 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-38792e83-9842-427a-980f-46391ceb8980 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/action" status: 202 len: 0 microversion: 2.1 time: 0.115896 May 10 03:08:42.754286 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3484/6927] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:08:42 2022] POST /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:08:42.764714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:42.765432 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:42.772487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:42.772961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:42.773819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:42.774263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:42.945948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:42.954042 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54176a1d-1f05-4484-b56a-6f4fb0f9b857 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1725 microversion: 2.1 time: 0.194657 May 10 03:08:42.954643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3444/6928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:42 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:43.972418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:43.973049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:43.982795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:43.983293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:43.984134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:43.984585 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:44.204076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:44.212520 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d3459967-101e-4fdf-b9ef-39606f39eb20 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1725 microversion: 2.1 time: 0.245054 May 10 03:08:44.213110 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3485/6929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:43 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:45.229791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:45.230424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:45.237381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:45.237849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:45.238662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:45.239148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:45.367540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:45.375366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8b01659d-514a-4478-a583-b012f753681d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.149529 May 10 03:08:45.375946 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3445/6930] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:45 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:46.393747 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:46.394299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:46.401446 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:46.401899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:46.402778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:46.403261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:46.533853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:46.541715 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-88d874cc-fae5-442b-b21b-eb9fb6bb90b4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.152418 May 10 03:08:46.542295 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3486/6931] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:46 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:47.558473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:47.559176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:47.565941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:47.566419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:47.567245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:47.567706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:47.701563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:47.710590 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-21b6188a-c1d4-4d18-b248-3207622464ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.156341 May 10 03:08:47.711214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3446/6932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:47 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:48.727113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:48.727754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:48.735049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:48.735540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:48.736329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:48.736855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:48.864100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:48.872511 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fa7f36d0-5736-4177-9228-1d827968aeab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.149353 May 10 03:08:48.873084 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3487/6933] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:48 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:49.890258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:49.890941 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:49.898415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:49.898891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:49.899721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:49.900184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:50.030562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:50.038525 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9bcc4a8-a6f8-4a58-b2a3-ce1e970a2cfe tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.152222 May 10 03:08:50.039119 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3447/6934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:49 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:51.056243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:51.057126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:51.063928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:51.064410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:51.065175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:51.065624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:51.192752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:51.201270 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4df58af-cc37-484c-a5a8-ed8dfba0ea92 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.149510 May 10 03:08:51.201838 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3488/6935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:51 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:52.217809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:52.218454 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:52.225419 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:52.225900 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:52.226695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:52.227179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:52.359288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:52.367504 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-efb8dd72-6c20-44c4-80b9-d1581df15433 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.153544 May 10 03:08:52.368025 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3448/6936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:52 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:53.384748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:53.385378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:53.392153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:53.392614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:53.393396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:53.393843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:53.521510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:53.530178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b2ff7cb-41a8-4609-a229-c2b32930c7d8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.149481 May 10 03:08:53.530781 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3489/6937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:53 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:54.548041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:54.548688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:54.555620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:54.556470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:54.557538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:54.558001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:54.688852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:54.697708 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c95e174-4e77-4d75-a6a5-fd8516cb0a57 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.153661 May 10 03:08:54.698333 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3449/6938] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:54 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:55.714462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:55.715247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:55.721962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:55.722428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:55.723260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:55.723710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:55.855039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:55.863027 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61f8aba7-1356-460e-b86f-07b37d8e3440 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1730 microversion: 2.1 time: 0.152564 May 10 03:08:55.863636 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3490/6939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:55 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:56.092365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-a6b48965-07aa-4604-b070-b53521486361 req-88ae0c53-a50c-4250-b219-a4ad04c836a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "name": "network-vif-unplugged", "status": "completed", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:56.103332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a6b48965-07aa-4604-b070-b53521486361 req-88ae0c53-a50c-4250-b219-a4ad04c836a5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:56.105276 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-a6b48965-07aa-4604-b070-b53521486361 req-88ae0c53-a50c-4250-b219-a4ad04c836a5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:56.121444 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-a6b48965-07aa-4604-b070-b53521486361 req-88ae0c53-a50c-4250-b219-a4ad04c836a5 service nova] Creating event network-vif-unplugged:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h1-841089-2 May 10 03:08:56.127061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-a6b48965-07aa-4604-b070-b53521486361 req-88ae0c53-a50c-4250-b219-a4ad04c836a5 service nova] Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:08:56.139281 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-a6b48965-07aa-4604-b070-b53521486361 req-88ae0c53-a50c-4250-b219-a4ad04c836a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050621 May 10 03:08:56.140047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3450/6940] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:08:56.879697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:56.880424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:56.887267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:56.887728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:56.888514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:56.888969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:57.025960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:57.035440 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28e70737-b2da-4de8-b3de-33404360b9a0 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1729 microversion: 2.1 time: 0.159489 May 10 03:08:57.036049 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3491/6941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:56 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:57.868778 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-307a999f-4e05-45f5-ac34-2f2f33846db8 req-8d000f92-8fa7-44cd-b39d-d2e5ba385f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:08:57.877537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-307a999f-4e05-45f5-ac34-2f2f33846db8 req-8d000f92-8fa7-44cd-b39d-d2e5ba385f88 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:57.878350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-307a999f-4e05-45f5-ac34-2f2f33846db8 req-8d000f92-8fa7-44cd-b39d-d2e5ba385f88 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:57.892144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-307a999f-4e05-45f5-ac34-2f2f33846db8 req-8d000f92-8fa7-44cd-b39d-d2e5ba385f88 service nova] Creating event network-changed:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h1-841089-2 May 10 03:08:57.898308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-307a999f-4e05-45f5-ac34-2f2f33846db8 req-8d000f92-8fa7-44cd-b39d-d2e5ba385f88 service nova] Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:08:57.910086 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-307a999f-4e05-45f5-ac34-2f2f33846db8 req-8d000f92-8fa7-44cd-b39d-d2e5ba385f88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046708 May 10 03:08:57.910987 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3451/6942] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:08:58.055499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:58.056131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:58.063385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:58.064100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:58.064888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:58.065509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:58.285803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:58.294265 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c2fc5bad-9c7b-403f-af6d-2be052aa9a29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1729 microversion: 2.1 time: 0.243320 May 10 03:08:58.294840 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3492/6943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:58 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:08:59.314029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:08:59.314759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:08:59.321683 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:59.322162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:59.322957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:08:59.323450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:08:59.457784 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:08:59.466601 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-144bd3b6-6c48-46f9-aae1-5331c5cb9b8b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.157695 May 10 03:08:59.471179 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3452/6944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:08:59 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:00.484750 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:00.485375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:00.492188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:00.492649 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:00.493424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:00.493867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:00.622702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:00.632236 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0f441ee-7df8-407e-ac8e-c74a21c0e0ad tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.151424 May 10 03:09:00.632813 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3493/6945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:00 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:01.649248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:01.650018 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:01.657318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:01.657887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:01.658693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:01.659178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:01.793424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:01.801879 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e9922420-55be-4038-b6d2-8ca6829b9f1e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.157052 May 10 03:09:01.803518 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3453/6946] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:01 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:02.819437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:02.820068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:02.827388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:02.827989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:02.828960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:02.829508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:02.992385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:03.001191 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-42b82944-50af-41bb-ae1b-e40b76f769b7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.185988 May 10 03:09:03.003108 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3494/6947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:02 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:04.018113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:04.018749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:04.026790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:04.027294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:04.028092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:04.028551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:04.168583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:04.177257 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ca86e5e3-1df0-410d-8fd2-7f0bf17f60e7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.163126 May 10 03:09:04.178998 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3454/6948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:04 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:05.195370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:05.196043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:05.202824 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:05.203312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:05.204101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:05.204544 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:05.337527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:05.345472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-297fe77a-8f10-4b2f-af82-ac176fa61e70 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.154040 May 10 03:09:05.346051 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3495/6949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:05 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:06.363401 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:06.364046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:06.371433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:06.371909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:06.372715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:06.373180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:06.506743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:06.514577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62b368a1-bd8b-4297-a41a-f8ffdebc70ff tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.155296 May 10 03:09:06.515169 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3455/6950] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:06 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:07.531677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:07.532200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:07.540069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:07.540541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:07.541359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:07.541818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:07.671410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:07.679444 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d49371f-708a-4b32-a969-626053301c12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.151740 May 10 03:09:07.680029 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3496/6951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:07 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:09:08.696715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:08.697352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:08.703796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:08.704269 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:08.705057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:08.705516 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:08.840831 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:08.848870 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e816a6f-6fcf-424c-b86a-b42e2aa09f1a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.156457 May 10 03:09:08.849500 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3456/6952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:08 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:09.867085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:09.867739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:09.874549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:09.875015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:09.875833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:09.876289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:10.008810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:10.016879 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6bc43be1-2bda-4933-b6fa-56a3f65fdff8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.154355 May 10 03:09:10.017450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3497/6953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:09 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:11.033974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:11.034615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:11.041488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:11.041960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:11.042745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:11.043241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:11.224816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:11.232702 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4e3b4858-0db3-40a2-98b3-b98e72554f9a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.202704 May 10 03:09:11.233296 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3457/6954] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:11 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:12.248994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:12.249644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:12.256357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:12.256816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:12.257582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:12.258037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:12.422577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:12.430534 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-104e1a90-f6e6-4716-ba96-9b685f153a2d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.185470 May 10 03:09:12.431310 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3498/6955] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:12 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:13.447863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:13.448783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:13.456219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:13.456719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:13.457503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:13.457956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:13.585676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:13.593562 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-26412643-3447-45ee-afab-5edeef1dc42d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.149635 May 10 03:09:13.594140 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3458/6956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:13 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:09:14.610436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:14.611056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:14.617846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:14.618306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:14.619100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:14.619546 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:14.750153 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:14.758989 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-240d399f-0ead-4edd-906a-ad5457badce3 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1727 microversion: 2.1 time: 0.152452 May 10 03:09:14.759591 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3499/6957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:14 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:15.776645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:15.777393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:15.784377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:15.784854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:15.785716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:15.786187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:15.920091 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:15.928013 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6b41bfcb-57ec-458c-a5b1-77f7d6e55cd4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1724 microversion: 2.1 time: 0.155326 May 10 03:09:15.928595 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3459/6958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:15 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:15.945406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:09:15.945978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:15.952561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:15.953027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:15.953821 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:15.954272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:15.993246 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:15.993710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:15.994532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:15.994985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:16.014520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:09:16.019683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Getting quotas for user 2526af43511f4b4bb7c268e8204f6f3f and project abccce521d68478b9858cc98befbfeea. Resources: {'cores', 'ram'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:09:16.118687 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-40286d3d-7423-43b6-a679-2b09baf9a9a1 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "POST /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/action" status: 202 len: 0 microversion: 2.1 time: 0.177258 May 10 03:09:16.119484 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3500/6959] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:09:15 2022] POST /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:09:16.127770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:16.128408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:16.134799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:16.135352 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:16.136113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:16.136569 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:16.270379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:16.279182 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-960522c2-a37e-4214-a9cc-721241510e9b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.155453 May 10 03:09:16.279774 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3460/6960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:16 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:17.296903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:17.297617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:17.304707 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:17.305165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:17.305936 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:17.306389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:17.517288 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:17.525902 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-182ce706-b629-4043-8d4d-2b4b8b6f89f7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.233264 May 10 03:09:17.526695 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3501/6961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:17 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:17.617257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bb556fb0-695d-4e48-8037-0a4d12724ac2 req-c52c0099-442f-4e0e-8369-25831cd85000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "name": "network-vif-plugged", "status": "completed", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:09:17.626816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bb556fb0-695d-4e48-8037-0a4d12724ac2 req-c52c0099-442f-4e0e-8369-25831cd85000 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:17.627371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bb556fb0-695d-4e48-8037-0a4d12724ac2 req-c52c0099-442f-4e0e-8369-25831cd85000 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:17.642761 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bb556fb0-695d-4e48-8037-0a4d12724ac2 req-c52c0099-442f-4e0e-8369-25831cd85000 service nova] Creating event network-vif-plugged:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h1-841089-2 May 10 03:09:17.649000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-bb556fb0-695d-4e48-8037-0a4d12724ac2 req-c52c0099-442f-4e0e-8369-25831cd85000 service nova] Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:09:17.660308 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bb556fb0-695d-4e48-8037-0a4d12724ac2 req-c52c0099-442f-4e0e-8369-25831cd85000 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046834 May 10 03:09:17.660937 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3461/6962] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:09:18.543879 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:18.544517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:18.551662 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:18.552127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:18.553524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:18.554156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:18.687419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:18.695899 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b6453baa-2cfb-46ef-867b-5a29ca8327eb tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.156067 May 10 03:09:18.696479 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3502/6963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:18 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:19.713676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:19.714394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:19.721699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:19.722170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:19.722950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:19.723427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:19.939436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:19.947606 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-00682ec0-bf3a-4f6c-a3fe-64f7ebb4ca34 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.238404 May 10 03:09:19.948193 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3462/6964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:19 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:20.965508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:20.966136 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:20.973298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:20.973762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:20.974551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:20.975001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:21.104560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:21.112464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d8cbc90f-7be4-4673-a343-b6ed007ede12 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.150881 May 10 03:09:21.113044 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3503/6965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:20 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:21.589690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e6927930-34b9-4b1e-8e5c-a30cf4f61f25 req-d27057a1-8fd9-4b1b-8614-804e2411f17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "name": "network-vif-unplugged", "status": "completed", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:09:21.598793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e6927930-34b9-4b1e-8e5c-a30cf4f61f25 req-d27057a1-8fd9-4b1b-8614-804e2411f17c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:21.599205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e6927930-34b9-4b1e-8e5c-a30cf4f61f25 req-d27057a1-8fd9-4b1b-8614-804e2411f17c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:21.612194 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e6927930-34b9-4b1e-8e5c-a30cf4f61f25 req-d27057a1-8fd9-4b1b-8614-804e2411f17c service nova] Creating event network-vif-unplugged:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h1-841089-2 May 10 03:09:21.618422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-e6927930-34b9-4b1e-8e5c-a30cf4f61f25 req-d27057a1-8fd9-4b1b-8614-804e2411f17c service nova] Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:09:21.634899 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e6927930-34b9-4b1e-8e5c-a30cf4f61f25 req-d27057a1-8fd9-4b1b-8614-804e2411f17c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048424 May 10 03:09:21.635755 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3463/6966] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:09:22.129714 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:22.130341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:22.137657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:22.138125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:22.138908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:22.139396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:22.267461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:22.275975 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f7b48cd2-3180-48e9-ade9-110d2e4127ea tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.150215 May 10 03:09:22.276559 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3504/6967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:22 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:23.295686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:23.296492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:23.303253 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:23.303735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:23.304541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:23.305041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:23.508676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:23.516585 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8197efb-2cca-4372-b40f-c7315d051140 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.226506 May 10 03:09:23.517202 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3464/6968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:23 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:23.580484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1ed32f40-aaed-4f06-a60b-354ef1315b23 req-05262b9e-b64f-41a4-9748-4d7bc7f11472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:09:23.591041 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1ed32f40-aaed-4f06-a60b-354ef1315b23 req-05262b9e-b64f-41a4-9748-4d7bc7f11472 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:23.592083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1ed32f40-aaed-4f06-a60b-354ef1315b23 req-05262b9e-b64f-41a4-9748-4d7bc7f11472 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:23.604840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1ed32f40-aaed-4f06-a60b-354ef1315b23 req-05262b9e-b64f-41a4-9748-4d7bc7f11472 service nova] Creating event network-changed:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h2-841089-2 May 10 03:09:23.616129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-1ed32f40-aaed-4f06-a60b-354ef1315b23 req-05262b9e-b64f-41a4-9748-4d7bc7f11472 service nova] Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:09:23.628241 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1ed32f40-aaed-4f06-a60b-354ef1315b23 req-05262b9e-b64f-41a4-9748-4d7bc7f11472 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051606 May 10 03:09:23.629194 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3505/6969] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:09:24.533852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:24.534818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:24.541814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:24.542403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:24.543369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:24.543936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:25.017947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:25.028028 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6746739c-5601-465c-bb7c-d8a17c81fd1c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.498134 May 10 03:09:25.029054 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3465/6970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:24 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:26.046530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:26.047312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:26.053791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:26.054247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:26.055023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:26.055494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:26.189843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:26.198987 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3e93c02d-8145-4ade-a3a7-84aab03be37d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.157556 May 10 03:09:26.199590 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3506/6971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:26 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:27.216082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:27.216708 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:27.223716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:27.224186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:27.225550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:27.226004 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:27.352838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:27.360981 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6c2a6f18-1d1c-48a6-9088-e1540af3c43d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.148793 May 10 03:09:27.361720 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3466/6972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:27 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:28.377954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:28.378652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:28.385757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:28.386214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:28.386988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:28.387476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:28.517867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:28.526408 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f29a3b9-8ce1-46d9-99f0-ae9e932c9a96 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.152504 May 10 03:09:28.526994 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3507/6973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:28 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:29.543433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:29.544188 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:29.551041 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:29.551545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:29.552871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:29.553324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:29.689703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:29.697982 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12e0d5f0-491e-4e2d-a674-f11cc4944681 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.158516 May 10 03:09:29.698562 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3467/6974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:29 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:30.715735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:30.716362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:30.723204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:30.723664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:30.724466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:30.724910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:30.855182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:30.863108 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3fbe8856-59fd-4795-800e-da2a5e5aec06 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.151216 May 10 03:09:30.863731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3508/6975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:30 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:31.881141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:31.881678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:31.888998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:31.889464 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:31.890252 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:31.890702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:32.017873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:32.026450 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51e8712f-f87c-4215-a054-e0c735b80a64 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.149950 May 10 03:09:32.027296 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3468/6976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:31 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:32.908433 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:09:32.909074 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:09:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:09:33.044004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:33.044644 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:33.051757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:33.052225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:33.053010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:33.053475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:33.188689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:33.197000 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-023ee380-8aec-42c0-9656-123c32f96f98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.156927 May 10 03:09:33.197604 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3509/6977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:33 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:34.214380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:34.215013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:34.221773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:34.222248 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:34.223088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:34.223553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:34.350243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:34.358201 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56f1088d-7055-4bbc-b830-a175d8d90fe9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.147898 May 10 03:09:34.358777 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3469/6978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:34 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:09:35.374557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:35.375215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:35.381631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:35.382097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:35.382881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:35.383360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:35.508561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:35.516619 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5df8a74c-0d98-4cb9-acf9-6ef734f886ab tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.146206 May 10 03:09:35.517200 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3510/6979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:35 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:36.533709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:36.534350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:36.541171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:36.541646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:36.542435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:36.542893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:36.675409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:36.684104 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9cdcb703-bc2c-4150-8bf9-38646f700f94 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.154400 May 10 03:09:36.684690 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3470/6980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:36 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:37.701825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:37.702455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:37.709902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:37.710365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:37.711171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:37.711626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:37.840205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:37.848160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee905482-6274-496e-be13-c959c77ad029 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.150258 May 10 03:09:37.848722 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3511/6981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:37 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:38.866049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:38.866701 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:38.873302 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:38.873766 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:38.874542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:38.874994 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:39.004405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:39.013185 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1533ccbb-eed6-4450-9d83-3709f253211e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.152042 May 10 03:09:39.013768 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3471/6982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:38 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:40.030222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:40.030877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:40.037726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:40.038190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:40.038971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:40.039444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:40.164992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:40.172821 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7cff760-0c25-4629-8ae3-03e98996d4af tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.146509 May 10 03:09:40.173396 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3512/6983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:40 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:41.190750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:41.191398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:41.198177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:41.198644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:41.199461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:41.199915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:41.326477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:41.334341 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0564527-535f-4a27-a4db-09d3ec22e297 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1723 microversion: 2.1 time: 0.147653 May 10 03:09:41.335655 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3472/6984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:41 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:42.352226 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:42.352978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:42.359767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.360234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.361015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.361467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.497697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:42.505688 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-93d21ef7-85c3-4e59-801e-3dd21c951c98 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1716 microversion: 2.1 time: 0.157367 May 10 03:09:42.506312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3513/6985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:42 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:09:42.522440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:42.523096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:42.529854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.530332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.531436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.531898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.659737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:42.667601 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19d63c8c-68df-4748-ad59-a621abfda9d7 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1716 microversion: 2.1 time: 0.149061 May 10 03:09:42.668187 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3473/6986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:42 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:42.684169 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:42.684793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:42.690698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.691192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.691964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.692411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.828463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:42.836356 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-68f8113e-23df-4c99-a021-34e99178b14a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1716 microversion: 2.1 time: 0.156285 May 10 03:09:42.836937 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3514/6987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:42 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:42.853607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:42.854129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:42.860020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.860490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.861274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.861733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.886170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:09:42.961197 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-42ebe5b1-fe36-4c90-9f8e-cbe984a412b8 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 204 len: 0 microversion: 2.1 time: 0.111651 May 10 03:09:42.962092 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3474/6988] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:09:42 2022] DELETE /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:09:42.971600 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:42.972220 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:42.979009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.979506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:42.980291 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:42.980774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:43.117135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:43.125121 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09715985-6e7d-418d-b605-0d458bd1c749 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1722 microversion: 2.1 time: 0.157647 May 10 03:09:43.125712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3515/6989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:42 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:44.142875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:44.143677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:44.151013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:44.151518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:44.152305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:44.152759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:44.291157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:44.300188 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-79e2f7f3-1359-4f08-bbed-29a56e3af55e tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1722 microversion: 2.1 time: 0.161580 May 10 03:09:44.300987 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3475/6990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:44 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:44.399613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ba36e45a-53a7-4a60-8b87-5b6c3afe299e req-cd4506d6-c4b2-4cfb-bfef-4121d27f5698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "name": "network-vif-plugged", "status": "completed", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:09:44.407676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ba36e45a-53a7-4a60-8b87-5b6c3afe299e req-cd4506d6-c4b2-4cfb-bfef-4121d27f5698 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:44.408224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ba36e45a-53a7-4a60-8b87-5b6c3afe299e req-cd4506d6-c4b2-4cfb-bfef-4121d27f5698 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:44.419908 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ba36e45a-53a7-4a60-8b87-5b6c3afe299e req-cd4506d6-c4b2-4cfb-bfef-4121d27f5698 service nova] Creating event network-vif-plugged:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h2-841089-2 May 10 03:09:44.425211 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ba36e45a-53a7-4a60-8b87-5b6c3afe299e req-cd4506d6-c4b2-4cfb-bfef-4121d27f5698 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080770 May 10 03:09:44.425802 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3516/6991] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:09:45.317546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:45.318174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:45.326109 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:45.326799 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:45.327621 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:45.328076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:45.408243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:45.417617 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc8b258c-f72c-45dd-8885-f490cef99f13 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1655 microversion: 2.1 time: 0.103965 May 10 03:09:45.418217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3476/6992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:45 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:09:45.685658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-94188f69-9736-4ede-8e55-b5b12fdb7130 req-897f6bd4-f0ba-4b48-9b2d-677c3f496bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e041ff0-d9dc-4556-af93-55e1d31ffc6e", "name": "network-vif-deleted", "tag": "9ff878a8-d080-45fe-9343-7c36e43e5c87"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:09:45.698219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-94188f69-9736-4ede-8e55-b5b12fdb7130 req-897f6bd4-f0ba-4b48-9b2d-677c3f496bf3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:45.698962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-94188f69-9736-4ede-8e55-b5b12fdb7130 req-897f6bd4-f0ba-4b48-9b2d-677c3f496bf3 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:45.712067 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-94188f69-9736-4ede-8e55-b5b12fdb7130 req-897f6bd4-f0ba-4b48-9b2d-677c3f496bf3 service nova] Creating event network-vif-deleted:9ff878a8-d080-45fe-9343-7c36e43e5c87 for instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e on n-h2-841089-2 May 10 03:09:45.717190 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-94188f69-9736-4ede-8e55-b5b12fdb7130 req-897f6bd4-f0ba-4b48-9b2d-677c3f496bf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089193 May 10 03:09:45.718241 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3517/6993] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:09:46.435169 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:46.435958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:46.443195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:46.444011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:46.445028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:46.445669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:46.513637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:46.524499 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-eb5232d3-8b22-4ea7-afd6-deebdde1b7f6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.093655 May 10 03:09:46.525120 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3477/6994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:46 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:47.543949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:47.544769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:47.551018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:47.551521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:47.552275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:47.552716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:47.615297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:47.623804 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-255d48f2-07d1-4896-a3ca-4822405adc0b tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.085163 May 10 03:09:47.633157 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3518/6995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:47 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:48.640834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:48.641474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:48.648870 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:48.649345 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:48.650155 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:48.650798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:48.714736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:48.722806 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1f11b8ad-8fe5-487c-9056-934db63fbea9 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.085966 May 10 03:09:48.723414 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3478/6996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:48 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:49.740332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:49.741604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:49.748531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:49.748996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:49.749780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:49.750231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:49.815276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:49.823409 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3b91c7cb-17e7-43b8-a5d0-2bf8cfbdb40c tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.087062 May 10 03:09:49.823985 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3519/6997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:49 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:50.840681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:50.841350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:50.848128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:50.848599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:50.849405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:50.849867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:50.913881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:50.922442 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3d27a447-78c0-492a-8e29-5623d780b1df tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.085944 May 10 03:09:50.923035 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3479/6998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:50 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:51.940034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:51.940629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:51.947441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:51.947903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:51.948683 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:51.949132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:52.010931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:52.018945 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6a1e7447-bfcc-4012-9ad0-0d98a9085dec tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.083020 May 10 03:09:52.019543 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3520/6999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:51 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:53.035819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:53.036456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:53.043336 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:53.043812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:53.044601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:53.045059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:53.106422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:53.114313 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e60c3408-132a-4f80-b1dd-f1594599446a tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.082398 May 10 03:09:53.114871 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3480/7000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:53 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:54.132290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:54.132918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:54.139789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:54.140248 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:54.141025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:54.141467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:54.202902 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:54.211570 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-794155f0-8553-45a7-b969-c6755c0de413 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1369 microversion: 2.1 time: 0.083704 May 10 03:09:54.212153 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3521/7001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:54 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:55.228444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:55.229755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:55.236411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:55.236888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:55.237690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:55.238148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:55.269677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:55.270480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:55.271197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lazy-loading 'fault' on Instance uuid 4e041ff0-d9dc-4556-af93-55e1d31ffc6e {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:09:55.319817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2526af43511f4b4bb7c268e8204f6f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abccce521d68478b9858cc98befbfeea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:09:55.326601 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b033099e-fd51-4e8d-896e-f2dbc7dfbf3d tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 200 len: 1328 microversion: 2.1 time: 0.102701 May 10 03:09:55.327203 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3481/7002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:55 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:09:56.344754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:56.345377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:56.352780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:56.353242 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:56.354030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:56.354479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:56.368251 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e HTTP/1.1 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4e041ff0-d9dc-4556-af93-55e1d31ffc6e'} May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:09:56.369942 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-02717a87-0ba8-4d32-859c-16377e2d51b2 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 404 len: 111 microversion: 2.1 time: 0.030633 May 10 03:09:56.374678 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3522/7003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:09:56 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:09:56.425918 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:56.426868 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:09:56.434393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:56.434863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:56.435673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:56.436129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:56.448694 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-volume_attachments HTTP/1.1 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '4e041ff0-d9dc-4556-af93-55e1d31ffc6e'} May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:09:56.450186 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a0ef5a9-8193-4851-acf3-e36f6ccb9a37 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029756 May 10 03:09:56.454484 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3482/7004] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:09:56 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:01.842728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:01.843264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:01.850100 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.850563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.852021 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.852469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.868855 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e HTTP/1.1 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '4e041ff0-d9dc-4556-af93-55e1d31ffc6e'} May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:01.870463 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c42f5681-364f-4601-ae87-99f317728d29 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 404 len: 111 microversion: 2.1 time: 0.033236 May 10 03:10:01.874506 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3523/7005] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:01 2022] DELETE /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:10:01.880497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:01.881734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 4e041ff0-d9dc-4556-af93-55e1d31ffc6e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:01.889186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.889923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.890718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.891212 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.908789 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e HTTP/1.1 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4e041ff0-d9dc-4556-af93-55e1d31ffc6e'} May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.910406 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 4e041ff0-d9dc-4556-af93-55e1d31ffc6e could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-683c55c7-6ffc-4243-96e5-670078566861 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e" status: 404 len: 111 microversion: 2.1 time: 0.035433 May 10 03:10:01.916220 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3483/7006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:01 2022] GET /compute/v2.1/servers/4e041ff0-d9dc-4556-af93-55e1d31ffc6e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:01.921867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:01.922398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:01.928664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.929089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.929866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.930314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.943977 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 HTTP/1.1 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'd0dbe006-42de-41f9-a6a9-fff978513654'} May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:01.946028 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-39b89654-858c-4bd0-9643-4e7fadb2f475 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 404 len: 111 microversion: 2.1 time: 0.029696 May 10 03:10:01.950670 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3524/7007] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:01 2022] DELETE /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:10:01.957078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:01.957844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: d0dbe006-42de-41f9-a6a9-fff978513654] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:01.964734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.965287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.966140 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:01.966670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:01.980478 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 HTTP/1.1 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'd0dbe006-42de-41f9-a6a9-fff978513654'} May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:01.982112 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance d0dbe006-42de-41f9-a6a9-fff978513654 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:01.987170 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1c3ff853-f3cf-499b-8871-5cba887e4473 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654" status: 404 len: 111 microversion: 2.1 time: 0.031974 May 10 03:10:01.988292 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3484/7008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:01 2022] GET /compute/v2.1/servers/d0dbe006-42de-41f9-a6a9-fff978513654 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:01.995084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:01.995598 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:02.001746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.002199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.002970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.003453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.017155 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a HTTP/1.1 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': 'b9606f19-2c53-485a-b4f1-443d8931866a'} May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:02.018717 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0c6f1249-d553-48c4-8181-74b53f627783 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 404 len: 111 microversion: 2.1 time: 0.029056 May 10 03:10:02.023365 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3525/7009] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:01 2022] DELETE /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:02.029343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:02.029980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: b9606f19-2c53-485a-b4f1-443d8931866a] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:02.035934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.036400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.037177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.037632 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.051275 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a HTTP/1.1 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'b9606f19-2c53-485a-b4f1-443d8931866a'} May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.052810 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance b9606f19-2c53-485a-b4f1-443d8931866a could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-65ec4bda-8858-426a-9a33-c9c97c953e22 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a" status: 404 len: 111 microversion: 2.1 time: 0.028790 May 10 03:10:02.058592 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3485/7010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:02 2022] GET /compute/v2.1/servers/b9606f19-2c53-485a-b4f1-443d8931866a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:02.063454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:02.063958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:02.069905 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.070303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.071094 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.071539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.084596 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 HTTP/1.1 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '6f87f694-4d32-43cc-97f5-c0393ea3fef7'} May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:02.086221 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1c19a6f-7ead-4816-81dc-b0534fdaf081 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 404 len: 111 microversion: 2.1 time: 0.027989 May 10 03:10:02.091426 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3526/7011] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:02 2022] DELETE /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:10:02.097150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:02.097915 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] [instance: 6f87f694-4d32-43cc-97f5-c0393ea3fef7] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:02.105487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.106195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.107028 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:02.107506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:02.122604 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] HTTP exception thrown: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Request method failure captured: May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 HTTP/1.1 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedZxo5fzWY3qH5Cej_Ctp2BG9YU_g5A_OlAG4J_zeiM9uEewTIA35KFyg7Ys3C2c-y2eg63soTmiOFTkZQgE20e4xF2ZJjVQtZTTvC_QfigLurHpOvAG9Un4rw-iqUgmGT9zWLWxMmkzlNJFfcPu-91p06Qnw-4pdPiX77F-uE9uYy4 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abccce521d68478b9858cc98befbfeea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abccce521d68478b9858cc98befbfeea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abccce521d68478b9858cc98befbfeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: abccce521d68478b9858cc98befbfeea May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServerActionsTestJSON-788494766 May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 2526af43511f4b4bb7c268e8204f6f3f May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServerActionsTestJSON-788494766-project May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6f87f694-4d32-43cc-97f5-c0393ea3fef7'} May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:02.124217 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Returning 404 to user: Instance 6f87f694-4d32-43cc-97f5-c0393ea3fef7 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:02.128639 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c345385f-da95-4060-9a40-fc7a879dbaa4 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7" status: 404 len: 111 microversion: 2.1 time: 0.033067 May 10 03:10:02.129494 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3486/7012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:02 2022] GET /compute/v2.1/servers/6f87f694-4d32-43cc-97f5-c0393ea3fef7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:02.134731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-08dc5247-0216-44a9-a64b-907e6e4e0fd6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] Calling method '.version_select at 0x7f3d361a0ee0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:02.156415 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-08dc5247-0216-44a9-a64b-907e6e4e0fd6 tempest-ServerActionsTestJSON-788494766 tempest-ServerActionsTestJSON-788494766-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198370491" status: 202 len: 0 microversion: 2.1 time: 0.025501 May 10 03:10:02.160367 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3527/7013] 10.222.0.52 () {58 vars in 1220 bytes} [Tue May 10 03:10:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198370491 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:10:07.813351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-136417654", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "512601ea-6fab-42b0-88ae-b413589a1d12"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:07.865721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] validate_networks() for [('512601ea-6fab-42b0-88ae-b413589a1d12', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:10:08.287526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:10:08.287985 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:10:08.288484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:10:08.288946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:10:08.289380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:10:08.298264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:08.298690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:08.299558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:08.300021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:08.317426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Getting quotas for project 9f40b1565fd34310bc2b1b2ddc4800da. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:10:08.323492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Getting quotas for user 28a4b8f5b0e7400cb5cc498f840a53fc and project 9f40b1565fd34310bc2b1b2ddc4800da. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:10:08.335795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:10:08.338078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:10:08.383818 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c78f2156-3ca0-4056-9a87-3daff3820ef3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680794 May 10 03:10:08.384490 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3487/7014] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:10:08.396850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0fce0b02-702a-4d00-b615-c615cec1ad6b tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:08.397643 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0fce0b02-702a-4d00-b615-c615cec1ad6b tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:08.456724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0fce0b02-702a-4d00-b615-c615cec1ad6b tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:08.463424 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0fce0b02-702a-4d00-b615-c615cec1ad6b tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1216 microversion: 2.1 time: 0.071642 May 10 03:10:08.464011 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3528/7015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:08 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:09.481291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:09.482327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:09.489608 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:09.490255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:09.491139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:09.491728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:09.558552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:09.566153 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e77029a2-5dc9-46fe-9d73-6fa560dd1a6e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1274 microversion: 2.1 time: 0.089782 May 10 03:10:09.566734 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3488/7016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:09 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:10.584069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:10.584891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:10.596765 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:10.597234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:10.598038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:10.598488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:10.787332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ca2da2cd-679e-41aa-89ad-4d3018322a5c req-37baede2-5e71-44b4-97cf-1be35a4c471a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ccd3ab-7c97-456f-a020-3c0501c52393", "tag": "9ee6d9cb-d94c-414a-9742-cb128201f3a2"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:10.799351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ca2da2cd-679e-41aa-89ad-4d3018322a5c req-37baede2-5e71-44b4-97cf-1be35a4c471a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:10.800262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ca2da2cd-679e-41aa-89ad-4d3018322a5c req-37baede2-5e71-44b4-97cf-1be35a4c471a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:10.812273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:10.820542 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7d71dea-ddae-44f8-b79d-d6a75ea50192 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.240532 May 10 03:10:10.821364 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3529/7017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:10 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:10.831643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ca2da2cd-679e-41aa-89ad-4d3018322a5c req-37baede2-5e71-44b4-97cf-1be35a4c471a service nova] Creating event network-changed:9ee6d9cb-d94c-414a-9742-cb128201f3a2 for instance 76ccd3ab-7c97-456f-a020-3c0501c52393 on n-h2-841089-2 May 10 03:10:10.842889 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ca2da2cd-679e-41aa-89ad-4d3018322a5c req-37baede2-5e71-44b4-97cf-1be35a4c471a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059144 May 10 03:10:10.843833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3489/7018] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:10:11.838020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:11.838671 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:11.845431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:11.845892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:11.846681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:11.847165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:11.976668 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:11.984025 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3ad892b-5143-45c9-a191-a4b5a388cc67 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.150559 May 10 03:10:11.984599 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3530/7019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:11 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:13.001726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:13.002487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:13.010136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:13.010605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:13.011426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:13.011884 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:13.139397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:13.146703 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f4ff7880-93e1-45d6-80a8-c26966af5faa tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.149274 May 10 03:10:13.147309 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3490/7020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:12 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:14.163393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:14.164027 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:14.170948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:14.171441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:14.172234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:14.172684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:14.297531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:14.305354 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d7515294-6cb9-4da1-bd7c-84afef1dbcff tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.145956 May 10 03:10:14.306133 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3531/7021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:14 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:15.322706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:15.323467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:15.330755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:15.331273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:15.332083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:15.332546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:15.466204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:15.473553 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41499f4a-83a5-4539-8d4a-56a6f0183cf7 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.155635 May 10 03:10:15.474160 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3491/7022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:15 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:16.479876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0399f4c9-1f88-4d27-8ca5-94df01dc20fd req-b9138d4d-6dd9-419a-9887-fd8ae1f8c028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ccd3ab-7c97-456f-a020-3c0501c52393", "name": "network-vif-plugged", "status": "completed", "tag": "9ee6d9cb-d94c-414a-9742-cb128201f3a2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:16.488461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0399f4c9-1f88-4d27-8ca5-94df01dc20fd req-b9138d4d-6dd9-419a-9887-fd8ae1f8c028 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:16.488922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0399f4c9-1f88-4d27-8ca5-94df01dc20fd req-b9138d4d-6dd9-419a-9887-fd8ae1f8c028 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:16.490711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:16.492275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:16.499617 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:16.500502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:16.501100 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0399f4c9-1f88-4d27-8ca5-94df01dc20fd req-b9138d4d-6dd9-419a-9887-fd8ae1f8c028 service nova] Creating event network-vif-plugged:9ee6d9cb-d94c-414a-9742-cb128201f3a2 for instance 76ccd3ab-7c97-456f-a020-3c0501c52393 on n-h2-841089-2 May 10 03:10:16.501329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:16.501808 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:16.506212 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0399f4c9-1f88-4d27-8ca5-94df01dc20fd req-b9138d4d-6dd9-419a-9887-fd8ae1f8c028 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 May 10 03:10:16.506822 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3532/7023] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:10:16.686585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:16.694194 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-19d459df-6368-4d9e-84b4-72c6d1ca6e03 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.207960 May 10 03:10:16.694746 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3492/7024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:16 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:17.712935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:17.713653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:17.719840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:17.720303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:17.721077 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:17.721523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:17.851976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:17.859419 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1d1ea5b1-9562-4ce9-82b2-3b43a9c6efca tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1316 microversion: 2.1 time: 0.151665 May 10 03:10:17.859997 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3533/7025] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:17 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:18.876102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:18.876748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:18.883615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:18.884094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:18.884888 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:18.885353 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:19.011674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:19.019037 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6e925e06-cf31-45d6-a963-9beb27a173b9 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.146878 May 10 03:10:19.019632 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3493/7026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:18 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:19.071592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-839994802", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "512601ea-6fab-42b0-88ae-b413589a1d12"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:19.121883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] validate_networks() for [('512601ea-6fab-42b0-88ae-b413589a1d12', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:10:19.478244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:10:19.478678 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:10:19.479196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:10:19.479667 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:10:19.480036 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:10:19.489046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:19.489503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:19.490314 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:19.490825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:19.508482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Getting quotas for project 9f40b1565fd34310bc2b1b2ddc4800da. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:10:19.513608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Getting quotas for user 28a4b8f5b0e7400cb5cc498f840a53fc and project 9f40b1565fd34310bc2b1b2ddc4800da. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:10:19.525655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:10:19.527955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:10:19.572995 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8d94c7e4-99da-445e-94f3-c1035902592a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505253 May 10 03:10:19.573647 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3534/7027] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:10:19.583582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0984bad0-919c-4dc9-be28-cdfb63fb04b3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:19.584218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0984bad0-919c-4dc9-be28-cdfb63fb04b3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:19.636871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0984bad0-919c-4dc9-be28-cdfb63fb04b3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:19.643471 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0984bad0-919c-4dc9-be28-cdfb63fb04b3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1216 microversion: 2.1 time: 0.063843 May 10 03:10:19.644078 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3494/7028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:19 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:20.661035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:20.661701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:20.669284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:20.669728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:20.670523 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:20.670971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:20.736007 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:20.743843 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1fd47e21-99e8-4f05-85fc-ba49e995cfe5 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1274 microversion: 2.1 time: 0.087502 May 10 03:10:20.744552 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3535/7029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:20 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:21.760597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:21.761288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:21.767642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:21.768108 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:21.768954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:21.769436 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:21.906107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:21.914515 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-588a8b2c-1a36-4990-b957-9d17b0b55cf3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1316 microversion: 2.1 time: 0.158103 May 10 03:10:21.915123 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3495/7030] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:21 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:22.201404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-9377f8f0-89ea-4458-9ea2-004de66ed84e req-ad0dec2f-b0db-4ba9-a68f-df89e71c42a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74679608-c1dc-4e09-8030-f4f02bf2e595", "tag": "fb725b0f-2c5a-46d7-a416-c7ed599ada20"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:22.211599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9377f8f0-89ea-4458-9ea2-004de66ed84e req-ad0dec2f-b0db-4ba9-a68f-df89e71c42a4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:22.212057 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-9377f8f0-89ea-4458-9ea2-004de66ed84e req-ad0dec2f-b0db-4ba9-a68f-df89e71c42a4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:22.223119 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-9377f8f0-89ea-4458-9ea2-004de66ed84e req-ad0dec2f-b0db-4ba9-a68f-df89e71c42a4 service nova] Creating event network-changed:fb725b0f-2c5a-46d7-a416-c7ed599ada20 for instance 74679608-c1dc-4e09-8030-f4f02bf2e595 on n-h1-841089-2 May 10 03:10:22.228395 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-9377f8f0-89ea-4458-9ea2-004de66ed84e req-ad0dec2f-b0db-4ba9-a68f-df89e71c42a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086877 May 10 03:10:22.229258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3536/7031] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:10:22.932189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:22.932992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:22.940027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:22.940491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:22.941307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:22.941763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:23.068557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:23.075926 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-52d29c9d-f8d5-4dd5-8c70-9e17c7563f10 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1316 microversion: 2.1 time: 0.148491 May 10 03:10:23.076504 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3496/7032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:22 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:24.092992 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:24.093703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:24.100631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:24.101082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:24.101849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:24.102292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:24.237652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:24.245471 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5f70001-b461-436e-8aaa-f5a3656687d3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1316 microversion: 2.1 time: 0.156775 May 10 03:10:24.246054 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3537/7033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:24 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:25.261726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:25.262341 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:25.271450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:25.271916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:25.272728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:25.273180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:25.401826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:25.409009 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2bee2866-75a9-4c45-b269-57bc7585b26a tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1316 microversion: 2.1 time: 0.151252 May 10 03:10:25.409578 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3497/7034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:25 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:25.986582 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f62e4fbe-8987-4551-b4d1-94b9f25aea44 req-b1c916db-f105-44d3-b1a8-1bba2e64a576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74679608-c1dc-4e09-8030-f4f02bf2e595", "name": "network-vif-plugged", "status": "completed", "tag": "fb725b0f-2c5a-46d7-a416-c7ed599ada20"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:25.999604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f62e4fbe-8987-4551-b4d1-94b9f25aea44 req-b1c916db-f105-44d3-b1a8-1bba2e64a576 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:26.000162 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f62e4fbe-8987-4551-b4d1-94b9f25aea44 req-b1c916db-f105-44d3-b1a8-1bba2e64a576 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:26.011368 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f62e4fbe-8987-4551-b4d1-94b9f25aea44 req-b1c916db-f105-44d3-b1a8-1bba2e64a576 service nova] Creating event network-vif-plugged:fb725b0f-2c5a-46d7-a416-c7ed599ada20 for instance 74679608-c1dc-4e09-8030-f4f02bf2e595 on n-h1-841089-2 May 10 03:10:26.016350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f62e4fbe-8987-4551-b4d1-94b9f25aea44 req-b1c916db-f105-44d3-b1a8-1bba2e64a576 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 May 10 03:10:26.017059 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3538/7035] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:10:26.426297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:26.426930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:26.434134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:26.434599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:26.435416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:26.435871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:26.566607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:26.573993 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-14897eff-7e99-4fee-bd22-3f0510dfbe3c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1316 microversion: 2.1 time: 0.151533 May 10 03:10:26.574565 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3498/7036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:26 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:27.591701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:27.592417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:27.598603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:27.599088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:27.599887 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:27.600836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:27.731082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:27.738543 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ef65bb1-7dcd-475d-82d3-f0ac81223dbf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1505 microversion: 2.1 time: 0.152099 May 10 03:10:27.739149 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3539/7037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:27 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:27.756049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:27.756626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:27.763595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:27.764066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:27.764848 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:27.765304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:27.793484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:10:27.868888 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ccfa7726-51d8-4557-bf63-e5e870eb9abd tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "DELETE /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 204 len: 0 microversion: 2.1 time: 0.116544 May 10 03:10:27.869454 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3499/7038] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:27 2022] DELETE /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:10:27.878002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:27.878637 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:27.884930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:27.885395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:27.886173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:27.886660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:28.012293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:28.019588 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-207dc2cf-d457-4b51-bcd0-888601cd4f06 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1511 microversion: 2.1 time: 0.145941 May 10 03:10:28.020156 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3540/7039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:27 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:29.037320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:29.038066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:29.046510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:29.046972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:29.047781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:29.048233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:29.181254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:29.189391 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4c01501a-6008-43e1-938e-cb77392a3e8f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 200 len: 1511 microversion: 2.1 time: 0.156365 May 10 03:10:29.189976 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3500/7040] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:29 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:29.595508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-fb33d4fe-fe4f-4576-a713-88d3c2a510f8 req-9727c01b-4222-491a-a2a4-3b1021b0b4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74679608-c1dc-4e09-8030-f4f02bf2e595", "name": "network-vif-deleted", "tag": "fb725b0f-2c5a-46d7-a416-c7ed599ada20"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:29.605658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fb33d4fe-fe4f-4576-a713-88d3c2a510f8 req-9727c01b-4222-491a-a2a4-3b1021b0b4e0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:29.606044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-fb33d4fe-fe4f-4576-a713-88d3c2a510f8 req-9727c01b-4222-491a-a2a4-3b1021b0b4e0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:29.622647 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-fb33d4fe-fe4f-4576-a713-88d3c2a510f8 req-9727c01b-4222-491a-a2a4-3b1021b0b4e0 service nova] Creating event network-vif-deleted:fb725b0f-2c5a-46d7-a416-c7ed599ada20 for instance 74679608-c1dc-4e09-8030-f4f02bf2e595 on n-h1-841089-2 May 10 03:10:29.628650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-fb33d4fe-fe4f-4576-a713-88d3c2a510f8 req-9727c01b-4222-491a-a2a4-3b1021b0b4e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037512 May 10 03:10:29.629737 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3541/7041] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:10:30.206661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:30.207462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.214817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.215338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.216128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.216590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.230388 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] HTTP exception thrown: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 HTTP/1.1 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '74679608-c1dc-4e09-8030-f4f02bf2e595'} May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:30.232088 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 404 to user: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c08863c-b7ca-4116-94be-2d0ec6c97fb3 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 404 len: 111 microversion: 2.1 time: 0.030820 May 10 03:10:30.236783 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3501/7042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:30 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:30.243316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:30.244032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.250308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.250773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.251592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.252043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.380711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:30.388594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f45cc3b-a4b1-4bed-9c73-f98611ff920d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.149604 May 10 03:10:30.389175 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3542/7043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:30 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:30.406550 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8de47d88-7eef-4532-93dc-4c38af8c46de tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:30.407590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8de47d88-7eef-4532-93dc-4c38af8c46de tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 4ceaadc2-6308-490d-8d4b-a637166782ad] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.413167 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-8de47d88-7eef-4532-93dc-4c38af8c46de tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] HTTP exception thrown: Instance 4ceaadc2-6308-490d-8d4b-a637166782ad could not be found. May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8de47d88-7eef-4532-93dc-4c38af8c46de tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/4ceaadc2-6308-490d-8d4b-a637166782ad/action HTTP/1.1 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 32 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: {"resize": {"flavorRef": "452"}} May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4ceaadc2-6308-490d-8d4b-a637166782ad could not be found. May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4ceaadc2-6308-490d-8d4b-a637166782ad', 'body': {'resize': {'flavorRef': '452'}}} May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ceaadc2-6308-490d-8d4b-a637166782ad could not be found. May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:30.414787 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ceaadc2-6308-490d-8d4b-a637166782ad could not be found. May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ceaadc2-6308-490d-8d4b-a637166782ad could not be found. May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8de47d88-7eef-4532-93dc-4c38af8c46de tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 404 to user: Instance 4ceaadc2-6308-490d-8d4b-a637166782ad could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8de47d88-7eef-4532-93dc-4c38af8c46de tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "POST /compute/v2.1/servers/4ceaadc2-6308-490d-8d4b-a637166782ad/action" status: 404 len: 111 microversion: 2.1 time: 0.013815 May 10 03:10:30.419644 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3502/7044] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:10:30 2022] POST /compute/v2.1/servers/4ceaadc2-6308-490d-8d4b-a637166782ad/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:30.424818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:30.425473 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.431572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.431972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.433002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.433444 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.565514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:30.573348 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f0297a2c-fd32-4805-8c86-823b543f5dc4 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.152326 May 10 03:10:30.573925 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3543/7045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:30 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:30.591101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:30.591740 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.598564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.599049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.599876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.600377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.731086 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:30.738472 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c64dce08-499f-49f6-817f-de059d30d737 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.151265 May 10 03:10:30.739047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3503/7046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:30 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:30.754994 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:30.756054 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.763370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.763831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.764601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.765039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.792176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:30.797088 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] HTTP exception thrown: Flavor 506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2 could not be found. May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: request: POST /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393/action HTTP/1.1 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 65 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: {"resize": {"flavorRef": "506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2"}} May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: exception: Flavor 506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2 could not be found. May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '76ccd3ab-7c97-456f-a020-3c0501c52393', 'body': {'resize': {'flavorRef': '506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2'}}} May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:10:30.798993 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2 could not be found. May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2 could not be found. May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2 could not be found. May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 400 to user: Flavor 506c6b77-2dd9-4b3a-b9bb-cb6c3972f3c2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-81ef841c-599e-48e0-9075-0318ac355986 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "POST /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393/action" status: 400 len: 107 microversion: 2.1 time: 0.049508 May 10 03:10:30.804107 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3544/7047] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:10:30 2022] POST /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393/action => generated 107 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:10:30.810272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:30.810909 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.816873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.817379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.818171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.818629 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.945050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:30.952411 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-54cd8893-ddaa-4af9-916e-548523a57bc6 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.146460 May 10 03:10:30.952995 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3504/7048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:30 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:30.969313 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:30.969946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:30.975881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.976334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:30.977128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:30.977568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.111019 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:31.118792 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d757c6eb-5980-4a8a-8a5d-ea4c32f8e82f tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.153476 May 10 03:10:31.119400 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3545/7049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:30 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:31.135423 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03693517-116a-4d09-9d6b-30e88e2c7905 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03693517-116a-4d09-9d6b-30e88e2c7905 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: request: POST /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393/action HTTP/1.1 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 29 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: {"resize": {"flavorRef": ""}} May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '76ccd3ab-7c97-456f-a020-3c0501c52393', 'body': {'resize': {'flavorRef': ''}}} May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise error May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi On instance['resize']: May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi '' May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.137745 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-03693517-116a-4d09-9d6b-30e88e2c7905 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-03693517-116a-4d09-9d6b-30e88e2c7905 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "POST /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393/action" status: 400 len: 113 microversion: 2.1 time: 0.008391 May 10 03:10:31.142397 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3505/7050] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:10:31 2022] POST /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:10:31.147154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:31.147779 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:31.153859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.154316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.155101 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.155564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.280885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:31.288757 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-effeb773-6351-40f1-afbf-47c962454b0c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1505 microversion: 2.1 time: 0.144740 May 10 03:10:31.289335 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3546/7051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:31 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:31.310089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:31.310714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:31.318245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.318648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.319473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.319927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.334243 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] HTTP exception thrown: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 HTTP/1.1 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '74679608-c1dc-4e09-8030-f4f02bf2e595'} May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:31.335842 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 404 to user: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3615f104-f77e-43c4-a765-0346d901cbdf tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "DELETE /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 404 len: 111 microversion: 2.1 time: 0.032301 May 10 03:10:31.340527 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3506/7052] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:31 2022] DELETE /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:31.345853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:31.346478 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 74679608-c1dc-4e09-8030-f4f02bf2e595] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:31.353032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.353491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.354268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.354745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.368800 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] HTTP exception thrown: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 HTTP/1.1 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '74679608-c1dc-4e09-8030-f4f02bf2e595'} May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:31.370376 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 404 to user: Instance 74679608-c1dc-4e09-8030-f4f02bf2e595 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bdc0dd12-f261-45ff-ae8b-eebadeff6ee1 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595" status: 404 len: 111 microversion: 2.1 time: 0.029849 May 10 03:10:31.375847 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3547/7053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:31 2022] GET /compute/v2.1/servers/74679608-c1dc-4e09-8030-f4f02bf2e595 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:10:31.380175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:31.380745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:31.386712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.387208 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.387997 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.388452 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.417699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:10:31.493559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb9599da-0f6b-447c-8967-08a6f94d8921 tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 204 len: 0 microversion: 2.1 time: 0.116849 May 10 03:10:31.494215 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3507/7054] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:10:31 2022] DELETE /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:10:31.502635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:31.503324 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:31.509390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.509842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.510612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:31.511053 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:31.641856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:31.650200 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-261db0f2-e90a-4fba-9c93-2444ba41420d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1511 microversion: 2.1 time: 0.151485 May 10 03:10:31.650776 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3548/7055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:31 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:32.668427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:32.669187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:32.675995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:32.676467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:32.677255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:32.677725 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:32.805998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:32.813666 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98c97d81-6026-49b1-808c-c3bb78b7787e tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1511 microversion: 2.1 time: 0.149611 May 10 03:10:32.814245 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3508/7056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:32 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:33.429489 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8e21f201-0209-43d8-a138-9894e7675f8d req-31e70334-11b3-4eb4-865e-5f042720776d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ccd3ab-7c97-456f-a020-3c0501c52393", "name": "network-vif-deleted", "tag": "9ee6d9cb-d94c-414a-9742-cb128201f3a2"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:10:33.440509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8e21f201-0209-43d8-a138-9894e7675f8d req-31e70334-11b3-4eb4-865e-5f042720776d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:33.440968 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8e21f201-0209-43d8-a138-9894e7675f8d req-31e70334-11b3-4eb4-865e-5f042720776d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:33.453540 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8e21f201-0209-43d8-a138-9894e7675f8d req-31e70334-11b3-4eb4-865e-5f042720776d service nova] Creating event network-vif-deleted:9ee6d9cb-d94c-414a-9742-cb128201f3a2 for instance 76ccd3ab-7c97-456f-a020-3c0501c52393 on n-h2-841089-2 May 10 03:10:33.458840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8e21f201-0209-43d8-a138-9894e7675f8d req-31e70334-11b3-4eb4-865e-5f042720776d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 May 10 03:10:33.459472 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3549/7057] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:10:33.829713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:33.830339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:33.837675 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:33.838136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:33.838919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:33.839400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:33.871103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:33.871678 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:33.872165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lazy-loading 'fault' on Instance uuid 76ccd3ab-7c97-456f-a020-3c0501c52393 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:10:33.914664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a4b8f5b0e7400cb5cc498f840a53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f40b1565fd34310bc2b1b2ddc4800da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:10:33.922381 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff4ed09e-8341-409d-a71e-0f18f22f1f1c tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 200 len: 1306 microversion: 2.1 time: 0.096584 May 10 03:10:33.922970 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3509/7058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:33 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:10:34.940437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:10:34.941070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] [instance: 76ccd3ab-7c97-456f-a020-3c0501c52393] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:10:34.947944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:34.948400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:34.949187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:10:34.949635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:10:34.964274 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] HTTP exception thrown: Instance 76ccd3ab-7c97-456f-a020-3c0501c52393 could not be found. May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Request method failure captured: May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 HTTP/1.1 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedePRSbNniPgVDJ28nj16U7mO-XUlXA6g0-11lFlZH7OIDVVkIyi7iZl0U-wrA5uCfvj26fv4Gqa4E_CTWeSm-f3ngT__Tmdn9iFzyHL-23YvCM1F0dNyN-8pi2Vhh5mJY_00FBTosfrzvohNTffCO8-W10S6-BlJun5RgFxfjaPN-s May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f40b1565fd34310bc2b1b2ddc4800da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f40b1565fd34310bc2b1b2ddc4800da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 9f40b1565fd34310bc2b1b2ddc4800da May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1415954430 May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 28a4b8f5b0e7400cb5cc498f840a53fc May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-ServersNegativeTestJSON-1415954430-project May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 76ccd3ab-7c97-456f-a020-3c0501c52393 could not be found. May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '76ccd3ab-7c97-456f-a020-3c0501c52393'} May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ccd3ab-7c97-456f-a020-3c0501c52393 could not be found. May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ccd3ab-7c97-456f-a020-3c0501c52393 could not be found. May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:10:34.965892 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ccd3ab-7c97-456f-a020-3c0501c52393 could not be found. May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] Returning 404 to user: Instance 76ccd3ab-7c97-456f-a020-3c0501c52393 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d4f2ef17-b3f4-4fb3-970f-d580f226e93d tempest-ServersNegativeTestJSON-1415954430 tempest-ServersNegativeTestJSON-1415954430-project] 10.222.0.52 "GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393" status: 404 len: 111 microversion: 2.1 time: 0.031224 May 10 03:10:34.970989 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3550/7059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:10:34 2022] GET /compute/v2.1/servers/76ccd3ab-7c97-456f-a020-3c0501c52393 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:11:06.644297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-99546e30-6df3-4338-bd66-d9fa59f24d0b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Action: 'create', calling method: .version_select at 0x7f3d36fe4d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1693486872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTW5MokAYbJSALws8syR/GPK+lyJ52+g1bNsFzKlTTT/PjjKTVToZo/MsTmDkFdBb+NEAlE2kw1tGSV+d0mFBCUPPiiQbRrNgS7e0/6i0nrjS8PhFb0byZtYCybsi2LLQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:06.662664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-99546e30-6df3-4338-bd66-d9fa59f24d0b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for project 82de855c37b640308e76e513b3462c8f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:11:06.668218 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-99546e30-6df3-4338-bd66-d9fa59f24d0b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for user 511051c7d2764e5bbce14d5ce1b11a38 and project 82de855c37b640308e76e513b3462c8f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:11:06.698654 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-99546e30-6df3-4338-bd66-d9fa59f24d0b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.238564 May 10 03:11:06.699336 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3510/7060] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:11:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:06.748185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1617796300", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1693486872", "networks": [{"uuid": "3d21bb98-248c-4bb1-aee7-4362cae5d4b9"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:06.799945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] validate_networks() for [('3d21bb98-248c-4bb1-aee7-4362cae5d4b9', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:11:07.295871 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:11:07.296315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:11:07.296789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:11:07.297207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:11:07.297630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:11:07.309743 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:07.310205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:07.311026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:07.311502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:07.331756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for project 82de855c37b640308e76e513b3462c8f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:11:07.337441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for user 511051c7d2764e5bbce14d5ce1b11a38 and project 82de855c37b640308e76e513b3462c8f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:11:07.350906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:11:07.353276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:11:07.398350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-539c782d-c6fb-4903-a9a6-ccecd0ced734 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654312 May 10 03:11:07.399181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3551/7061] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:11:07.408967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-013663a4-e231-4c46-9ca5-81064bba9236 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:07.409618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-013663a4-e231-4c46-9ca5-81064bba9236 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:07.474975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-013663a4-e231-4c46-9ca5-81064bba9236 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:07.485066 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-013663a4-e231-4c46-9ca5-81064bba9236 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1263 microversion: 2.1 time: 0.080046 May 10 03:11:07.485646 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3511/7062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:07 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:08.503032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:08.503767 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:08.515793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:08.517488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:08.518611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:08.519445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:08.604769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:08.616131 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b0f83b3f-1fab-4112-b3f3-df1fdd303086 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1321 microversion: 2.1 time: 0.118176 May 10 03:11:08.617547 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3552/7063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:08 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1321 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:09.635318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:09.635963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:09.648738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:09.649226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:09.650272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:09.651237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:09.858478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:09.869779 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6dbb32e2-cfef-4a0c-a31e-7b689b3510f7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1363 microversion: 2.1 time: 0.239750 May 10 03:11:09.883028 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3512/7064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:09 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:09.989144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-c81168a2-50ed-4d94-929b-08529b1d102a req-2a0e7876-9b55-4b64-b5b8-b62f010b3e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebfb904-456e-43b9-b6bd-a39a4e994185", "tag": "e89a0e49-096a-4e7d-bfa6-b054b4ce2d77"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:10.006991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c81168a2-50ed-4d94-929b-08529b1d102a req-2a0e7876-9b55-4b64-b5b8-b62f010b3e18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:10.006991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-c81168a2-50ed-4d94-929b-08529b1d102a req-2a0e7876-9b55-4b64-b5b8-b62f010b3e18 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:10.020122 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-c81168a2-50ed-4d94-929b-08529b1d102a req-2a0e7876-9b55-4b64-b5b8-b62f010b3e18 service nova] Creating event network-changed:e89a0e49-096a-4e7d-bfa6-b054b4ce2d77 for instance cebfb904-456e-43b9-b6bd-a39a4e994185 on n-h2-841089-2 May 10 03:11:10.028109 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-c81168a2-50ed-4d94-929b-08529b1d102a req-2a0e7876-9b55-4b64-b5b8-b62f010b3e18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042153 May 10 03:11:10.028749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3553/7065] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:10.886328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:10.886961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:10.894050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:10.894490 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:10.895320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:10.895782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:11.040242 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:11.047742 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed02697e-9ae9-4d61-ab78-298743792010 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1363 microversion: 2.1 time: 0.165343 May 10 03:11:11.048333 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3513/7066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:10 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:12.066141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:12.066850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:12.073221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:12.073677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:12.074462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:12.074958 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:12.204179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:12.212145 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e39328c1-25d7-47d0-af8b-0b5b0af9b5ca tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1363 microversion: 2.1 time: 0.151173 May 10 03:11:12.212727 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3554/7067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:12 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:13.228741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:13.229380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:13.236211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:13.236686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:13.237473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:13.237933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:13.370685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:13.378051 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cbb72d7b-9f0a-4833-81dc-5aa6de42708b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1363 microversion: 2.1 time: 0.153236 May 10 03:11:13.378637 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3514/7068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:13 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:14.395334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:14.395952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:14.402712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:14.403206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:14.403978 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:14.404418 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:14.530932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:14.539464 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4428666-8633-4634-86c0-66f7b238796d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1363 microversion: 2.1 time: 0.148001 May 10 03:11:14.540242 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3555/7069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:14 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:14.661811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-36692ad1-b6ad-4c74-b791-881c5ad9e28e req-0b467e35-72d3-43f7-b80c-1c3f175169d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebfb904-456e-43b9-b6bd-a39a4e994185", "name": "network-vif-plugged", "status": "completed", "tag": "e89a0e49-096a-4e7d-bfa6-b054b4ce2d77"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:14.673168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-36692ad1-b6ad-4c74-b791-881c5ad9e28e req-0b467e35-72d3-43f7-b80c-1c3f175169d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:14.673984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-36692ad1-b6ad-4c74-b791-881c5ad9e28e req-0b467e35-72d3-43f7-b80c-1c3f175169d1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:14.687036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-36692ad1-b6ad-4c74-b791-881c5ad9e28e req-0b467e35-72d3-43f7-b80c-1c3f175169d1 service nova] Creating event network-vif-plugged:e89a0e49-096a-4e7d-bfa6-b054b4ce2d77 for instance cebfb904-456e-43b9-b6bd-a39a4e994185 on n-h2-841089-2 May 10 03:11:14.692176 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-36692ad1-b6ad-4c74-b791-881c5ad9e28e req-0b467e35-72d3-43f7-b80c-1c3f175169d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034334 May 10 03:11:14.692902 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3515/7070] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:15.557097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:15.557730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:15.564833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:15.565296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:15.566072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:15.566520 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:15.692726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:15.700117 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-879859ee-ff6d-41d5-b2ab-a24b5d18afdb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1363 microversion: 2.1 time: 0.147560 May 10 03:11:15.700631 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3556/7071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:15 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:16.718893 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:16.719820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:16.727478 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:16.727949 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:16.728732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:16.729191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:16.854863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:16.862285 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ebc7a802-3c97-4eea-ba6a-e43b73723488 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1555 microversion: 2.1 time: 0.149043 May 10 03:11:16.862853 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3516/7072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:16 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:16.878316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:16.878946 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:16.888513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:16.889017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:16.889803 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:16.890258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:17.023971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:17.031350 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5fd7c9b-d7f8-45da-aea6-41d6f904d54f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1555 microversion: 2.1 time: 0.156852 May 10 03:11:17.031940 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3557/7073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:16 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:19.690819 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:19.691934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:19.699476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:19.699946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:19.700734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:19.701187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:19.926520 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e7f2aa24-9091-42d8-9360-62f74a71ccfa tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "POST /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239493 May 10 03:11:19.928008 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3517/7074] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 03:11:19 2022] POST /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:35.812301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:35.812799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:35.819276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:35.819794 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:35.820541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:35.820982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:35.897095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lazy-loading 'services' on Instance uuid cebfb904-456e-43b9-b6bd-a39a4e994185 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:11:35.966343 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b2dfc53c-37a3-4890-83fa-e6a4dea50f9a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments/db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56" status: 202 len: 0 microversion: 2.1 time: 0.158310 May 10 03:11:35.966936 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3558/7075] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 03:11:35 2022] DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments/db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:11:35.976205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:35.977318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:35.987538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:35.988013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:35.988902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:35.989472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:36.020693 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-50a39e1a-f30a-4a61-8393-b4464d5d82f3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048908 May 10 03:11:36.021450 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3518/7076] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:35 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:11:37.033840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:37.034874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:37.041479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:37.041937 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:37.042722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:37.043194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:37.073776 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7eeef5fc-9664-4a43-8ee4-505e9442f27d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 May 10 03:11:37.074345 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3559/7077] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:37 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:38.085972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:38.086929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:38.093504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:38.094002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:38.094783 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:38.095273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:38.124234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-af92baef-d96d-40fc-bc05-523299ac903e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 May 10 03:11:38.124816 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3519/7078] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:38 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:39.136818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:39.137763 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:39.144571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:39.145029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:39.145809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:39.146260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:39.174971 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5d961100-1791-4708-95c4-2cbdbe385dcc tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 May 10 03:11:39.175564 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3560/7079] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:39 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:40.187493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:40.188461 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:40.195216 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:40.195688 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:40.196476 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:40.196928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:40.227101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bb4cf751-a944-4413-850b-22e2d7670cb4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 May 10 03:11:40.227681 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3520/7080] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:40 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:41.237974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:41.238943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:41.246279 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:41.246746 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:41.247556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:41.248009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:41.277171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c76793b9-d308-4e14-8274-82d563dc0fd1 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 May 10 03:11:41.277740 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3561/7081] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:41 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:11:42.289463 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:42.290468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:42.297350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:42.297853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:42.298662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:42.299149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:42.332094 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-da8e615c-3e1d-46e2-8c2b-9e1ae0ced746 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047391 May 10 03:11:42.332687 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3521/7082] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:42 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:43.344225 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:43.345172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:43.352001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:43.352463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:43.353241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:43.353689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:43.382735 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb53a8dd-a3f1-48a3-a5b7-d2c763c28e28 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 May 10 03:11:43.383332 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3562/7083] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:43 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:44.394014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:44.395098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:44.402181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:44.402661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:44.403487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:44.403945 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:44.436239 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e81d4f4a-9c5a-4a39-b0b2-edd4518d453c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 May 10 03:11:44.437018 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3522/7084] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:44 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:45.446900 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:45.447901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:45.454581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:45.455040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:45.455850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:45.456295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:45.487025 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2d08accb-6e95-42e0-8043-4cecc8a9fbe4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044086 May 10 03:11:45.487622 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3563/7085] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:11:45 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:11:45.498224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:45.498759 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:45.505973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:45.506444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:45.507293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:45.507750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:45.580706 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] HTTP exception thrown: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 is not attached to volume db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Request method failure captured: May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments/db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 HTTP/1.1 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedfEHxwgHzvQAdVCA1qd6NdSFt6mVWHlUFzEnvrbXwliTEuHw04E1scOwxk_e_LbJfPFCu0r3vBfrIv6pG2dvml1xkx28in5P5-GeDsLGr52bYlaidJXv7NYxTuU8AkePG69qMw5T0M2ERFdDb-iymzhd2hH8sXOFl_PuE-21UPvnp4 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 82de855c37b640308e76e513b3462c8f May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82de855c37b640308e76e513b3462c8f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82de855c37b640308e76e513b3462c8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 82de855c37b640308e76e513b3462c8f May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 511051c7d2764e5bbce14d5ce1b11a38 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 is not attached to volume db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': 'cebfb904-456e-43b9-b6bd-a39a4e994185', 'id': 'db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56'} May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56. May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 is not attached to volume db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:11:45.587515 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 is not attached to volume db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Returning 404 to user: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 is not attached to volume db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d017316d-2277-41d4-99c0-1797c422aa17 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments/db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56" status: 404 len: 154 microversion: 2.1 time: 0.095040 May 10 03:11:45.593190 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3523/7086] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 03:11:45 2022] DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185/os-volume_attachments/db1ec1ce-aa2c-4679-b88c-8bae4ad8ce56 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:11:51.007454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:51.008011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:51.014458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:51.014919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:51.015735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:51.016182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:51.040433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:11:51.117903 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-22c8c68a-bf6b-4de6-a791-309943d9b176 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 204 len: 0 microversion: 2.1 time: 0.115162 May 10 03:11:51.118821 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3564/7087] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:11:51 2022] DELETE /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:11:51.127756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:51.128470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:51.136771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:51.137320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:51.138214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:51.138738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:51.270787 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:51.278261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-25aacfaf-d2a3-416d-a4f8-b8240e167027 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1561 microversion: 2.1 time: 0.154855 May 10 03:11:51.278838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3524/7088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:51 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:52.295349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:52.296085 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:52.302855 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:52.303399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:52.304233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:52.304675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:52.436454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:52.444545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8667f9f2-cafc-43f4-ad5e-2b55d0117274 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1561 microversion: 2.1 time: 0.153547 May 10 03:11:52.445134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3565/7089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:52 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:53.253513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ed114435-22ad-4aaa-a452-f084b9b89320 req-4b846115-944b-4e64-9f27-cac3fb4f079b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebfb904-456e-43b9-b6bd-a39a4e994185", "name": "network-vif-deleted", "tag": "e89a0e49-096a-4e7d-bfa6-b054b4ce2d77"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:53.262897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ed114435-22ad-4aaa-a452-f084b9b89320 req-4b846115-944b-4e64-9f27-cac3fb4f079b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:53.263400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ed114435-22ad-4aaa-a452-f084b9b89320 req-4b846115-944b-4e64-9f27-cac3fb4f079b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:53.275480 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ed114435-22ad-4aaa-a452-f084b9b89320 req-4b846115-944b-4e64-9f27-cac3fb4f079b service nova] Creating event network-vif-deleted:e89a0e49-096a-4e7d-bfa6-b054b4ce2d77 for instance cebfb904-456e-43b9-b6bd-a39a4e994185 on n-h2-841089-2 May 10 03:11:53.280857 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ed114435-22ad-4aaa-a452-f084b9b89320 req-4b846115-944b-4e64-9f27-cac3fb4f079b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031092 May 10 03:11:53.281696 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3525/7090] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:53.462217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:53.462841 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:53.469531 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:53.469998 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:53.470766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:53.471243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:53.501506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:53.501963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:53.502415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lazy-loading 'fault' on Instance uuid cebfb904-456e-43b9-b6bd-a39a4e994185 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:11:53.547949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:53.555928 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1551f2a-4b09-4f83-a8e9-732286da02c6 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 200 len: 1353 microversion: 2.1 time: 0.098178 May 10 03:11:53.556525 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3566/7091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:53 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 1353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:54.574748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:54.575414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: cebfb904-456e-43b9-b6bd-a39a4e994185] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:54.581540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:54.582015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:54.582814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:54.583311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:54.596352 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] HTTP exception thrown: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 could not be found. May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Request method failure captured: May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 HTTP/1.1 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedfEHxwgHzvQAdVCA1qd6NdSFt6mVWHlUFzEnvrbXwliTEuHw04E1scOwxk_e_LbJfPFCu0r3vBfrIv6pG2dvml1xkx28in5P5-GeDsLGr52bYlaidJXv7NYxTuU8AkePG69qMw5T0M2ERFdDb-iymzhd2hH8sXOFl_PuE-21UPvnp4 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 82de855c37b640308e76e513b3462c8f May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82de855c37b640308e76e513b3462c8f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82de855c37b640308e76e513b3462c8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 82de855c37b640308e76e513b3462c8f May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 511051c7d2764e5bbce14d5ce1b11a38 May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 could not be found. May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'cebfb904-456e-43b9-b6bd-a39a4e994185'} May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 could not be found. May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 could not be found. May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:11:54.597971 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 could not be found. May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Returning 404 to user: Instance cebfb904-456e-43b9-b6bd-a39a4e994185 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7ec6173d-f48d-48ec-bd62-5036e6cfc068 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185" status: 404 len: 111 microversion: 2.1 time: 0.029951 May 10 03:11:54.603315 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3526/7092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:54 2022] GET /compute/v2.1/servers/cebfb904-456e-43b9-b6bd-a39a4e994185 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:11:54.608532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b97b4e89-8477-4f02-9fe6-5a9d19cc853b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '.version_select at 0x7f3d361d63a0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:54.627806 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b97b4e89-8477-4f02-9fe6-5a9d19cc853b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1693486872" status: 202 len: 0 microversion: 2.1 time: 0.023052 May 10 03:11:54.628402 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3567/7093] 10.222.0.52 () {58 vars in 1277 bytes} [Tue May 10 03:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1693486872 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:11:54.646659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ffd6dc99-9ca8-43ad-b81f-23b21b155dbb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Action: 'create', calling method: .version_select at 0x7f3d36fa3670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-800171090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkGiulotFjmKS9IwLnRFyXXKltw2tDyoafYUNmLu1Ks0uFhT0tb04vUDjdm22vsIDLhAXjrpcZg3EvvOPfw+khZoQx/NFFjwLGI4PHmQIJ7DxA5tv83DeCWvCCTgZ5z8Q=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:54.660400 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ffd6dc99-9ca8-43ad-b81f-23b21b155dbb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for project 82de855c37b640308e76e513b3462c8f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:11:54.666386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ffd6dc99-9ca8-43ad-b81f-23b21b155dbb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for user 511051c7d2764e5bbce14d5ce1b11a38 and project 82de855c37b640308e76e513b3462c8f. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:11:54.689647 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ffd6dc99-9ca8-43ad-b81f-23b21b155dbb tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.046952 May 10 03:11:54.690249 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3527/7094] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:11:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:54.737382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-237654353", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-800171090", "networks": [{"uuid": "3d21bb98-248c-4bb1-aee7-4362cae5d4b9"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:54.789192 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] validate_networks() for [('3d21bb98-248c-4bb1-aee7-4362cae5d4b9', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:11:55.151358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:11:55.151798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:11:55.152315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:11:55.152832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:11:55.153265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:11:55.162465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:55.162933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:55.163996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:55.164457 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:55.181342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for project 82de855c37b640308e76e513b3462c8f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:11:55.186693 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Getting quotas for user 511051c7d2764e5bbce14d5ce1b11a38 and project 82de855c37b640308e76e513b3462c8f. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:11:55.199306 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:11:55.201651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:11:55.247192 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-99d45229-6f4b-4c22-8c74-96b22bad5096 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513636 May 10 03:11:55.248036 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3568/7095] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:11:55.257972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bdd0802e-0acd-44fc-93ef-4cf4447ee9a9 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:55.258762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bdd0802e-0acd-44fc-93ef-4cf4447ee9a9 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:55.321421 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bdd0802e-0acd-44fc-93ef-4cf4447ee9a9 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:55.328019 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bdd0802e-0acd-44fc-93ef-4cf4447ee9a9 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1261 microversion: 2.1 time: 0.074176 May 10 03:11:55.328602 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3528/7096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:55 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:56.345687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:56.346320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:56.353872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:56.354338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:56.355456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:56.355914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:56.434941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:56.443160 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7398ac31-5893-4a08-b470-ec65706a1d10 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1319 microversion: 2.1 time: 0.102127 May 10 03:11:56.443749 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3569/7097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:56 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:57.462280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:57.463707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:57.470696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:57.471245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:57.472050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:57.472545 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:57.660772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:57.669038 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-de86631f-78c2-49b0-99f0-6ce31d71b34f tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1361 microversion: 2.1 time: 0.212548 May 10 03:11:57.669617 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3529/7098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:57 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:57.925287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-35b28dd9-df5c-4e5f-b05c-87951188a876 req-e9052b46-c480-4604-a463-9503bac6aab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818d8e7b-6bae-4f3f-bf24-77275a882ab0", "tag": "cc84b1f2-34d7-4308-a923-18424d05810b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:57.937554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-35b28dd9-df5c-4e5f-b05c-87951188a876 req-e9052b46-c480-4604-a463-9503bac6aab6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:57.938104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-35b28dd9-df5c-4e5f-b05c-87951188a876 req-e9052b46-c480-4604-a463-9503bac6aab6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:57.950770 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-35b28dd9-df5c-4e5f-b05c-87951188a876 req-e9052b46-c480-4604-a463-9503bac6aab6 service nova] Creating event network-changed:cc84b1f2-34d7-4308-a923-18424d05810b for instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 on n-h2-841089-2 May 10 03:11:57.956428 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-35b28dd9-df5c-4e5f-b05c-87951188a876 req-e9052b46-c480-4604-a463-9503bac6aab6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034876 May 10 03:11:57.961763 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3570/7099] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:11:58.686045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:58.686679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:58.693446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:58.693928 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:58.694718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:58.695200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:58.824475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:58.831835 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0fb568a7-3b54-4fe5-9df2-b981dad697d3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1361 microversion: 2.1 time: 0.149997 May 10 03:11:58.832426 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3530/7100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:58 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:59.852479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:59.853186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:11:59.859194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:59.859650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:59.860419 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:11:59.860860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:11:59.992254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:11:59.999556 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9e6f46d1-d810-4935-b31a-1f6a438b6e4b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1361 microversion: 2.1 time: 0.152222 May 10 03:12:00.000147 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3571/7101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:11:59 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:01.016714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:01.017465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:01.024623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:01.025093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:01.025881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:01.026361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:01.157672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:01.164979 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-15ab7cc5-048b-4b98-b84d-b946fb044877 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1361 microversion: 2.1 time: 0.152273 May 10 03:12:01.165563 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3531/7102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:01 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:02.182870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:02.183858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:02.190682 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:02.191176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:02.191953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:02.192400 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:02.325614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:02.333153 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-859b907d-f627-4587-9d4d-53a71b890ca0 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1361 microversion: 2.1 time: 0.154442 May 10 03:12:02.333724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3572/7103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:02 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:02.825806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-db490d69-55de-45ff-8d41-d5a5b8835d07 req-bb160ec7-aab2-443f-9388-7238c0543f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d8e7b-6bae-4f3f-bf24-77275a882ab0", "name": "network-vif-plugged", "status": "completed", "tag": "cc84b1f2-34d7-4308-a923-18424d05810b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:02.835959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-db490d69-55de-45ff-8d41-d5a5b8835d07 req-bb160ec7-aab2-443f-9388-7238c0543f21 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:02.837154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-db490d69-55de-45ff-8d41-d5a5b8835d07 req-bb160ec7-aab2-443f-9388-7238c0543f21 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:02.849642 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-db490d69-55de-45ff-8d41-d5a5b8835d07 req-bb160ec7-aab2-443f-9388-7238c0543f21 service nova] Creating event network-vif-plugged:cc84b1f2-34d7-4308-a923-18424d05810b for instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 on n-h2-841089-2 May 10 03:12:02.855691 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-db490d69-55de-45ff-8d41-d5a5b8835d07 req-bb160ec7-aab2-443f-9388-7238c0543f21 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 May 10 03:12:02.856729 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3532/7104] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:03.349807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:03.350425 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:03.357784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:03.358240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:03.359016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:03.359486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:03.488194 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:03.496221 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1ae5392b-e5fb-401f-93a9-b56a58daf67c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1361 microversion: 2.1 time: 0.150353 May 10 03:12:03.496796 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3573/7105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:03 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:04.514409 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.515083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:04.521359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:04.521834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:04.522623 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:04.523101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:04.650620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:04.658001 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6cd7c0c8-4594-4c8e-b070-9696144e6b75 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1554 microversion: 2.1 time: 0.148851 May 10 03:12:04.658574 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3533/7106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:04.674199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.674934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:04.682751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:04.683510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:04.684296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:04.684749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:04.817146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:04.824500 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7d4a3754-8f20-4232-a50f-0d4015854dd7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1554 microversion: 2.1 time: 0.154218 May 10 03:12:04.825071 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3574/7107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:07.361966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eec7efce-d4eb-45ca-be85-24596a57a0d8"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:07.363116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:07.370549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:07.371025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:07.371844 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:07.372308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:07.596366 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2e347f8-5fb6-4ec3-8a62-d83785a9a591 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "POST /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238184 May 10 03:12:07.597098 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3534/7108] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 03:12:07 2022] POST /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:23.487263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:23.487786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:23.494536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:23.495035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:23.495863 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:23.496311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:23.574972 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lazy-loading 'services' on Instance uuid 818d8e7b-6bae-4f3f-bf24-77275a882ab0 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:12:23.643941 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7ad18124-05fb-45fa-8af6-8c9356ecffc8 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments/eec7efce-d4eb-45ca-be85-24596a57a0d8" status: 202 len: 0 microversion: 2.1 time: 0.160545 May 10 03:12:23.644811 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3575/7109] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 03:12:23 2022] DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments/eec7efce-d4eb-45ca-be85-24596a57a0d8 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:12:23.655348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:23.656380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:23.662601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:23.663105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:23.663913 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:23.664373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:23.700681 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c706b683-2c63-4121-ab0e-41ae59f34ec7 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050754 May 10 03:12:23.701248 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3535/7110] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:23 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:24.713774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:24.714816 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:24.721960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:24.722432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:24.723263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:24.723719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:24.753674 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3ef16c45-756c-4540-b278-ec6b48650e8a tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 May 10 03:12:24.754422 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3576/7111] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:24 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:12:25.765547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:25.766506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:25.773679 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:25.774158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:25.774982 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:25.775479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:25.812280 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57dc99f5-fdd9-4346-846f-87ee02d0f89b tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050765 May 10 03:12:25.812894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3536/7112] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:25 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:26.823889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:26.824838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:26.831660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:26.832119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:26.832896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:26.833338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:26.866178 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a3a032c4-d48b-4881-925a-b710eb7070e3 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 May 10 03:12:26.866756 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3577/7113] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:26 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:27.878609 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:27.879636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:27.886615 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:27.887123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:27.887917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:27.888372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:27.917814 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-77ae73e1-a62f-42ee-8ed2-5324cc340644 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 May 10 03:12:27.918288 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3537/7114] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:27 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:28.929341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:28.930202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:28.937172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:28.937630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:28.938393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:28.938838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:28.968042 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c66cca86-de17-4e34-9524-d6330bca9a6d tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 May 10 03:12:28.968874 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3578/7115] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:28 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:29.979586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:29.980528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:29.987344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:29.987810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:29.988592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:29.989044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:30.017940 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9668a9d9-aa66-452d-b100-a297d971a604 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 May 10 03:12:30.018511 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3538/7116] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:29 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:31.029522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:31.030493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:31.037178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:31.037629 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:31.038389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:31.038827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:31.071198 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d814fc92-4856-4e90-b0cc-f919e8e77e64 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 May 10 03:12:31.071797 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3579/7117] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:31 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:32.082712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:32.083694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:32.091160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:32.091636 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:32.092607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:32.093070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:32.122815 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf8a8d82-5301-4af1-940e-0a84b3ceffcf tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 May 10 03:12:32.123417 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3539/7118] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:32 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:33.133895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:33.134839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:33.141616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:33.142084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:33.142864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:33.143337 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:33.172589 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-48e3f984-f800-4db4-aa10-5f76e47612ff tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042722 May 10 03:12:33.173156 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3580/7119] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:12:33 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:12:33.183017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:33.183820 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:33.190586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:33.190993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:33.191811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:33.192267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:33.265890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] HTTP exception thrown: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 is not attached to volume eec7efce-d4eb-45ca-be85-24596a57a0d8 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Request method failure captured: May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: request: DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments/eec7efce-d4eb-45ca-be85-24596a57a0d8 HTTP/1.1 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedfEHxwgHzvQAdVCA1qd6NdSFt6mVWHlUFzEnvrbXwliTEuHw04E1scOwxk_e_LbJfPFCu0r3vBfrIv6pG2dvml1xkx28in5P5-GeDsLGr52bYlaidJXv7NYxTuU8AkePG69qMw5T0M2ERFdDb-iymzhd2hH8sXOFl_PuE-21UPvnp4 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 82de855c37b640308e76e513b3462c8f May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82de855c37b640308e76e513b3462c8f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82de855c37b640308e76e513b3462c8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 82de855c37b640308e76e513b3462c8f May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 511051c7d2764e5bbce14d5ce1b11a38 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 is not attached to volume eec7efce-d4eb-45ca-be85-24596a57a0d8 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'server_id': '818d8e7b-6bae-4f3f-bf24-77275a882ab0', 'id': 'eec7efce-d4eb-45ca-be85-24596a57a0d8'} May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eec7efce-d4eb-45ca-be85-24596a57a0d8. May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 is not attached to volume eec7efce-d4eb-45ca-be85-24596a57a0d8 May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:33.267607 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 is not attached to volume eec7efce-d4eb-45ca-be85-24596a57a0d8 May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Returning 404 to user: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 is not attached to volume eec7efce-d4eb-45ca-be85-24596a57a0d8 {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b4b205e2-b004-45a7-bc80-a49d6ca59357 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments/eec7efce-d4eb-45ca-be85-24596a57a0d8" status: 404 len: 154 microversion: 2.1 time: 0.090162 May 10 03:12:33.273101 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3540/7120] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 03:12:33 2022] DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0/os-volume_attachments/eec7efce-d4eb-45ca-be85-24596a57a0d8 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:12:38.677459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:38.677988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:38.685133 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:38.685595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:38.686366 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:38.687017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:38.713720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:12:38.788611 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f06ff04-78ee-465e-8664-fd3c472e4e41 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 204 len: 0 microversion: 2.1 time: 0.114866 May 10 03:12:38.789450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3581/7121] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:12:38 2022] DELETE /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:12:38.797948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:38.799272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:38.805943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:38.806483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:38.807372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:38.807911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:38.938066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:38.946244 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adaa3711-9581-4559-b364-92f7c5636ff4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1560 microversion: 2.1 time: 0.151921 May 10 03:12:38.946798 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3541/7122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:38 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:39.964185 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:39.964896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:39.971580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:39.972033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:39.972818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:39.973250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:40.106744 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:40.114172 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0e98715c-e713-4f3d-a617-ae85e6c20ba2 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1560 microversion: 2.1 time: 0.154844 May 10 03:12:40.114743 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3582/7123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:39 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:40.914238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-0f2dcb00-600d-4ed8-b8fa-6340d4781777 req-9d4f11a7-28aa-41fe-898b-3f4fc4409225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d8e7b-6bae-4f3f-bf24-77275a882ab0", "name": "network-vif-deleted", "tag": "cc84b1f2-34d7-4308-a923-18424d05810b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:40.923580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0f2dcb00-600d-4ed8-b8fa-6340d4781777 req-9d4f11a7-28aa-41fe-898b-3f4fc4409225 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:40.924042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-0f2dcb00-600d-4ed8-b8fa-6340d4781777 req-9d4f11a7-28aa-41fe-898b-3f4fc4409225 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:40.937085 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-0f2dcb00-600d-4ed8-b8fa-6340d4781777 req-9d4f11a7-28aa-41fe-898b-3f4fc4409225 service nova] Creating event network-vif-deleted:cc84b1f2-34d7-4308-a923-18424d05810b for instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 on n-h2-841089-2 May 10 03:12:40.943714 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-0f2dcb00-600d-4ed8-b8fa-6340d4781777 req-9d4f11a7-28aa-41fe-898b-3f4fc4409225 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 May 10 03:12:40.944318 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3542/7124] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:41.131455 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:41.132006 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:41.138722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:41.139224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:41.140001 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:41.140445 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:41.171168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:41.171620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:41.172068 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lazy-loading 'fault' on Instance uuid 818d8e7b-6bae-4f3f-bf24-77275a882ab0 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:12:41.214126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511051c7d2764e5bbce14d5ce1b11a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82de855c37b640308e76e513b3462c8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:12:41.221771 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0f6fb3ca-23a5-453a-9b2e-65bb9b0daef4 tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 200 len: 1351 microversion: 2.1 time: 0.094377 May 10 03:12:41.227674 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3583/7125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:41 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:42.240133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:42.240849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] [instance: 818d8e7b-6bae-4f3f-bf24-77275a882ab0] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:12:42.248533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:42.249001 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:42.249859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:12:42.250224 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:12:42.263308 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] HTTP exception thrown: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 could not be found. May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Request method failure captured: May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 HTTP/1.1 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedfEHxwgHzvQAdVCA1qd6NdSFt6mVWHlUFzEnvrbXwliTEuHw04E1scOwxk_e_LbJfPFCu0r3vBfrIv6pG2dvml1xkx28in5P5-GeDsLGr52bYlaidJXv7NYxTuU8AkePG69qMw5T0M2ERFdDb-iymzhd2hH8sXOFl_PuE-21UPvnp4 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 82de855c37b640308e76e513b3462c8f May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_82de855c37b640308e76e513b3462c8f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/82de855c37b640308e76e513b3462c8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/82de855c37b640308e76e513b3462c8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 82de855c37b640308e76e513b3462c8f May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1776310396 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 511051c7d2764e5bbce14d5ce1b11a38 May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestEncryptedCinderVolumes-1776310396-project May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 could not be found. May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '818d8e7b-6bae-4f3f-bf24-77275a882ab0'} May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 could not be found. May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 could not be found. May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:42.264959 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 could not be found. May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Returning 404 to user: Instance 818d8e7b-6bae-4f3f-bf24-77275a882ab0 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-544d762c-5f46-4119-a921-a21bff9f513e tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0" status: 404 len: 111 microversion: 2.1 time: 0.030612 May 10 03:12:42.271134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3543/7126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:12:42 2022] GET /compute/v2.1/servers/818d8e7b-6bae-4f3f-bf24-77275a882ab0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:12:42.274881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7758fe9b-48a3-49f1-bf1f-4c43ccfd093c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] Calling method '.version_select at 0x7f3d36fcc5e0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:42.292786 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7758fe9b-48a3-49f1-bf1f-4c43ccfd093c tempest-TestEncryptedCinderVolumes-1776310396 tempest-TestEncryptedCinderVolumes-1776310396-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-800171090" status: 202 len: 0 microversion: 2.1 time: 0.021687 May 10 03:12:42.293353 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3584/7127] 10.222.0.52 () {58 vars in 1274 bytes} [Tue May 10 03:12:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-800171090 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:12:52.916645 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:12:52.917262 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:12:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:13:09.522176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-960ab09b-6def-48e0-9904-8d43038b2184 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Action: 'create', calling method: .version_select at 0x7f3d36567a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1051639007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM7ZUMracfl5dK0+x8Bm2lM0tQ4m9wpCZfZ12+UfBfnxK0JBXexT68fZxQadX5Fq2YlBwUJZn6oe5pM+SY9MhdiRjNlOPAiCS7mBCJHamEeusjDJNp63fpV6EzIBSqKQw=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:09.537600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-960ab09b-6def-48e0-9904-8d43038b2184 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Getting quotas for project 956dfaab2efd4f33a37ad46017163d01. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:13:09.543444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-960ab09b-6def-48e0-9904-8d43038b2184 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Getting quotas for user 92f42c873c354d4ba56c0f817ed539f0 and project 956dfaab2efd4f33a37ad46017163d01. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:13:09.566560 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-960ab09b-6def-48e0-9904-8d43038b2184 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048243 May 10 03:13:09.567175 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3544/7128] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:13:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:09.616046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-592443673", "imageRef": "665ee451-1238-4b75-be93-b2b053db7b43", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1051639007", "networks": [{"uuid": "0b39d511-d329-46b5-aef6-563fd8223b42"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:09.665591 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] validate_networks() for [('0b39d511-d329-46b5-aef6-563fd8223b42', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:13:10.016069 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:13:10.016509 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:13:10.017023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:13:10.017502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:13:10.017875 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:13:10.027091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:10.027561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:10.028382 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:10.028829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:10.048384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Getting quotas for project 956dfaab2efd4f33a37ad46017163d01. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:13:10.053463 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Getting quotas for user 92f42c873c354d4ba56c0f817ed539f0 and project 956dfaab2efd4f33a37ad46017163d01. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:13:10.065617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:13:10.067823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='665ee451-1238-4b75-be93-b2b053db7b43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:13:10.112875 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f073a34a-72e0-45f7-948e-ed480d9d53de tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502440 May 10 03:13:10.113542 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3585/7129] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:13:10.123425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-433e02ea-68f8-4594-bcd7-720b603d47ad tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:10.124056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-433e02ea-68f8-4594-bcd7-720b603d47ad tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:10.182542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-433e02ea-68f8-4594-bcd7-720b603d47ad tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:10.189377 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-433e02ea-68f8-4594-bcd7-720b603d47ad tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1258 microversion: 2.1 time: 0.070006 May 10 03:13:10.189955 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3545/7130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:10 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:11.206908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:11.207543 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:11.213949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:11.214452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:11.215275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:11.215723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:11.307923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:11.316040 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-18b1ae1e-7300-43e3-9b7c-af8db34b693c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1318 microversion: 2.1 time: 0.113871 May 10 03:13:11.316713 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3586/7131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:11 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1318 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:12.334553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:12.335309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:12.345205 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:12.345692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:12.346511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:12.346979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:12.496268 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:12.504689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bbf18e7b-347d-4a37-a96a-c1930e7a1a62 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.174590 May 10 03:13:12.505450 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3546/7132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:12 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:13.522501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.523285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:13.531944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:13.532189 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:13.532815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:13.533336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:13.676709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:13.684895 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ffb45d94-a56d-45a3-915a-84e8c58a2f45 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.166400 May 10 03:13:13.685488 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3587/7133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:14.701637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:14.702535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:14.709325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:14.709730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:14.710539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:14.710993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:14.859278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:14.867505 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-49a6027d-ea9c-4f62-a1bf-6542b5eac39d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.169885 May 10 03:13:14.868478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3547/7134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:14 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:15.886254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:15.886848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:15.893356 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:15.893818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:15.894650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:15.895124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:16.033109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:16.041741 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3c58b9ba-87e5-4884-a767-8bc2f3ab7f60 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.160155 May 10 03:13:16.042518 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3588/7135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:15 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:17.059754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:17.061077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:17.070121 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:17.070647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:17.071430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:17.071880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:17.206448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:17.217311 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-306ad2c5-fb99-497f-b206-b7fc7948b108 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.162266 May 10 03:13:17.218102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3548/7136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:17 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:18.235484 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:18.236287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:18.243705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:18.244250 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:18.245112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:18.245699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:18.388813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:18.402679 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-633f6577-3cd3-47b8-b448-b2fa503a1f06 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.171306 May 10 03:13:18.403450 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3589/7137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:18 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:19.419643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:19.420280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:19.427111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:19.427610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:19.428374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:19.428835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:19.622723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:19.630626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c1773d7-24fc-410e-a884-7b36c43f54f0 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.214906 May 10 03:13:19.631254 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3549/7138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:19 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:13:20.224423 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b079749b-a1e9-4c3f-b893-990f4526800f req-1c8bcdbd-c540-46ca-a402-7de477395f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:20.241369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b079749b-a1e9-4c3f-b893-990f4526800f req-1c8bcdbd-c540-46ca-a402-7de477395f40 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:20.241931 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b079749b-a1e9-4c3f-b893-990f4526800f req-1c8bcdbd-c540-46ca-a402-7de477395f40 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:20.256523 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b079749b-a1e9-4c3f-b893-990f4526800f req-1c8bcdbd-c540-46ca-a402-7de477395f40 service nova] Creating event network-changed:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:13:20.262942 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b079749b-a1e9-4c3f-b893-990f4526800f req-1c8bcdbd-c540-46ca-a402-7de477395f40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043477 May 10 03:13:20.263820 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3590/7139] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:20.648271 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:20.648911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:20.655403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:20.655881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:20.656677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:20.657136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:20.789891 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:20.797852 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53dd7c43-8c30-4303-9801-3493e9dd315f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.153748 May 10 03:13:20.798439 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3550/7140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:20 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:21.816971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:21.817687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:21.823736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:21.824196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:21.824971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:21.825417 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:22.039357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:22.046615 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-80225fef-b17c-491c-85f5-a347db8b9481 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.234747 May 10 03:13:22.047212 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3591/7141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:21 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:23.064207 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:23.064853 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:23.071687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:23.072168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:23.072992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:23.073459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:23.210622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:23.218133 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2071c29-c45f-4e67-b040-89ea5c39880c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.157859 May 10 03:13:23.218717 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3551/7142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:23 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:24.235587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:24.236205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:24.243134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:24.243594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:24.245008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:24.245451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:24.420231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:24.427510 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c8f47d6f-d0e9-4cab-a0b4-4d8b7f7bc99a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.195860 May 10 03:13:24.428095 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3592/7143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:24 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:25.264391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-062e5d25-6a4d-4c0d-b61b-efa591214236 req-b29a55f8-4f27-4252-ac90-1e964cb378ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "name": "network-vif-plugged", "status": "completed", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:25.275850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-062e5d25-6a4d-4c0d-b61b-efa591214236 req-b29a55f8-4f27-4252-ac90-1e964cb378ad service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:25.277567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-062e5d25-6a4d-4c0d-b61b-efa591214236 req-b29a55f8-4f27-4252-ac90-1e964cb378ad service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:25.287637 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-062e5d25-6a4d-4c0d-b61b-efa591214236 req-b29a55f8-4f27-4252-ac90-1e964cb378ad service nova] Creating event network-vif-plugged:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:13:25.293256 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-062e5d25-6a4d-4c0d-b61b-efa591214236 req-b29a55f8-4f27-4252-ac90-1e964cb378ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 May 10 03:13:25.293856 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3552/7144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:25.444396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:25.445125 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:25.452395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:25.452858 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:25.453650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:25.454104 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:25.582988 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:25.590866 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0322461e-e563-4d62-b381-42253645635b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.150414 May 10 03:13:25.591487 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3593/7145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:25 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:26.611467 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:26.612113 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:26.620406 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:26.621241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:26.622308 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:26.622898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:26.758638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:26.766208 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-51fcb38a-42d4-4036-af69-ba5abb8471b6 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1358 microversion: 2.1 time: 0.161379 May 10 03:13:26.766784 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3553/7146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:26 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:27.782999 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:27.783672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:27.790443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:27.790908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:27.791724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:27.792173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:27.921823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:27.929244 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-eaa37939-1881-4435-b615-d74798e00c03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1548 microversion: 2.1 time: 0.150224 May 10 03:13:27.929815 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3594/7147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:27 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:27.945966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:27.946600 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:27.953524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:27.953990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:27.954770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:27.955255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:28.079625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:28.086881 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a2f40cdf-fbcc-47e1-a8a6-bf2ac55e7ede tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1548 microversion: 2.1 time: 0.144836 May 10 03:13:28.087486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3554/7148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:27 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:28.103130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:28.106610 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:28.107422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Searching by: {'deleted': False, 'project_id': '956dfaab2efd4f33a37ad46017163d01'} {{(pid=118716) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 03:13:28.112651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:28.113115 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:28.113929 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:28.114378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:28.137856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.multi_cell_list [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 03:13:28.164278 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae4be440-5ceb-4609-b562-b68019f20cf1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.065114 May 10 03:13:28.164858 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3595/7149] 10.222.0.52 () {58 vars in 1124 bytes} [Tue May 10 03:13:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:28.175124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:28.175770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:28.181834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:28.182349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:28.183165 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:28.183624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:28.310178 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:28.317725 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c2f68457-5f70-41e9-a19b-2fe70694e412 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1548 microversion: 2.1 time: 0.146577 May 10 03:13:28.318307 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3555/7150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:28 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:30.856158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "494d343a-ec61-4fa6-8ada-ff51a6f57505"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:30.857240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:30.863948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:30.864404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:30.865177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:30.865622 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:31.090102 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acc6aad5-05ab-4dc1-8e97-e1e8ebca8c21 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238461 May 10 03:13:31.093057 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3596/7151] 10.222.0.52 () {60 vars in 1322 bytes} [Tue May 10 03:13:30 2022] POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:47.028375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:47.029015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:47.042538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:47.043011 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:47.043849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:47.044310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:47.173921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:47.181820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0ca760f8-cb25-4d88-929b-3dc02662b145 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1594 microversion: 2.1 time: 0.157376 May 10 03:13:47.182406 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3556/7152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:47 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:48.892530 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7b192038-9b26-4493-a533-bc778cef6174 req-a121b8b2-0ca7-4fc6-88a5-eca93da45de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:48.901923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7b192038-9b26-4493-a533-bc778cef6174 req-a121b8b2-0ca7-4fc6-88a5-eca93da45de4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:48.902460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7b192038-9b26-4493-a533-bc778cef6174 req-a121b8b2-0ca7-4fc6-88a5-eca93da45de4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:48.914566 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7b192038-9b26-4493-a533-bc778cef6174 req-a121b8b2-0ca7-4fc6-88a5-eca93da45de4 service nova] Creating event network-changed:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:13:48.920680 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7b192038-9b26-4493-a533-bc778cef6174 req-a121b8b2-0ca7-4fc6-88a5-eca93da45de4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033650 May 10 03:13:48.921298 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3597/7153] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:49.961367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2100761549"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:49.962226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:49.970098 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:49.970567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:49.971386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:49.971876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:50.108241 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.network.security_group_api [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Adding security group 3eaf2415-4fe4-458f-88f0-5fedcb48cb55 to port 3ae946a3-f103-40cc-8916-bc66535dc600 May 10 03:13:50.470703 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9bac46d8-ae60-4fe5-ae4d-f089adf6bada tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/action" status: 202 len: 0 microversion: 2.1 time: 0.512756 May 10 03:13:50.479878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1731fb72-81f8-4c97-85d6-5ca037bf0729 req-b185d41f-4f75-4612-b50d-fb0fc7fd6c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:13:50.480921 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3557/7154] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:13:49 2022] POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:13:50.486170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:50.487061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:13:50.499404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:50.500096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:50.501776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1731fb72-81f8-4c97-85d6-5ca037bf0729 req-b185d41f-4f75-4612-b50d-fb0fc7fd6c06 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:50.502257 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1731fb72-81f8-4c97-85d6-5ca037bf0729 req-b185d41f-4f75-4612-b50d-fb0fc7fd6c06 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:50.508558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:13:50.509298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:13:50.519556 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1731fb72-81f8-4c97-85d6-5ca037bf0729 req-b185d41f-4f75-4612-b50d-fb0fc7fd6c06 service nova] Creating event network-changed:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:13:50.526704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1731fb72-81f8-4c97-85d6-5ca037bf0729 req-b185d41f-4f75-4612-b50d-fb0fc7fd6c06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051766 May 10 03:13:50.528258 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3598/7155] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:50.770094 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:13:50.779975 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71c678c0-7294-4544-92ad-43eac8af6914 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1760 microversion: 2.1 time: 0.297918 May 10 03:13:50.780760 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3558/7156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:13:50 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1760 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:02.761151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:02.762211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:02.769209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:02.769673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:02.770452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:02.770899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:02.842712 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3f9ddcb5-2e34-4c68-9689-9d427883f066 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/action" status: 202 len: 0 microversion: 2.1 time: 0.085700 May 10 03:14:02.846510 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3599/7157] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:14:02 2022] POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:14:02.851978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:02.852665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:02.860404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:02.860823 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:02.861703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:02.862272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:03.098567 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:03.107857 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6776aad5-1842-4bd2-852c-f294bc4eac7f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1752 microversion: 2.1 time: 0.259819 May 10 03:14:03.108942 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3559/7158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:02 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:04.127283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:04.127990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:04.134134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:04.134587 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:04.135399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:04.135838 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:04.287416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:04.296039 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6b1e6885-3bf4-4f07-9b53-4908e45cf1a5 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.173868 May 10 03:14:04.296624 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3600/7159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:04 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:05.315185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:05.315896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:05.323426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:05.323898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:05.324898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:05.325170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:05.463618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:05.471648 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a110837a-744f-461f-a6f2-4532071b22f9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.160466 May 10 03:14:05.472234 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3560/7160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:05 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:14:06.489172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:06.489834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:06.496722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:06.497182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:06.498129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:06.498584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:06.641756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:06.649606 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2993f29e-71b7-433a-b095-36ded21f15ec tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.164448 May 10 03:14:06.650176 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3601/7161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:06 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:07.666043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:07.666709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:07.675171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:07.675709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:07.676789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:07.677329 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:07.824742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:07.832730 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-771343ad-5bea-4f5c-af6f-bb8a8d195d1e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.170768 May 10 03:14:07.833314 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3561/7162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:07 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:08.848785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:08.849416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:08.856555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:08.857020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:08.857825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:08.858280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:09.084187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:09.092261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7866cff8-ae98-4aae-b779-2277896a5a8c tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.247431 May 10 03:14:09.092848 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3602/7163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:08 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:10.109527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:10.110162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:10.116641 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:10.117114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:10.117905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:10.118367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:10.259866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:10.268284 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-13768235-cd90-43ac-98db-baad7ca0de54 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.162866 May 10 03:14:10.268875 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3562/7164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:10 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:11.285854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:11.286479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:11.293259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:11.293724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:11.294500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:11.294948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:11.438349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:11.446181 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fddccf00-f92b-4e3c-ae17-15ccbef878bd tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.164296 May 10 03:14:11.446759 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3603/7165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:11 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:12.463300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:12.463930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:12.470646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:12.471141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:12.471927 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:12.472380 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:12.616589 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:12.624626 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-76f4dd84-698e-483f-bffd-d83794ab8ec9 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.165293 May 10 03:14:12.625217 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3563/7166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:12 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:13.641742 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:13.642407 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:13.649285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:13.649748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:13.650533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:13.650987 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:13.794642 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:13.802525 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-737ccda7-aeb9-4d66-ba80-5eb3218b78a7 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1757 microversion: 2.1 time: 0.164754 May 10 03:14:13.803121 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3604/7167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:13 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:14.819677 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:14.820316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:14.827456 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:14.827933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:14.828723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:14.829186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:14.967804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:14:14.975869 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8af0ca4d-7647-4d40-83a7-40847e942f09 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1760 microversion: 2.1 time: 0.160109 May 10 03:14:14.976451 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3564/7168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:14:14 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:14:47.306195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2100761549"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:47.306822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:47.313720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:47.314180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:47.314959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:47.315433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:47.547158 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.network.security_group_api [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Removing security group 3eaf2415-4fe4-458f-88f0-5fedcb48cb55 from port 3ae946a3-f103-40cc-8916-bc66535dc600 May 10 03:14:47.882046 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8a6f6162-94fd-4857-af74-1fb4c50c3390 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/action" status: 202 len: 0 microversion: 2.1 time: 0.579987 May 10 03:14:47.891786 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3605/7169] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:14:47 2022] POST /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:14:47.993684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-8c35ee1f-095b-41c3-a81b-2890f979011a req-397a0083-866b-46f4-ae4b-a044a2b51c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:48.005658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8c35ee1f-095b-41c3-a81b-2890f979011a req-397a0083-866b-46f4-ae4b-a044a2b51c68 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.006167 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-8c35ee1f-095b-41c3-a81b-2890f979011a req-397a0083-866b-46f4-ae4b-a044a2b51c68 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.021760 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-8c35ee1f-095b-41c3-a81b-2890f979011a req-397a0083-866b-46f4-ae4b-a044a2b51c68 service nova] Creating event network-changed:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:14:48.028764 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-8c35ee1f-095b-41c3-a81b-2890f979011a req-397a0083-866b-46f4-ae4b-a044a2b51c68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136194 May 10 03:14:48.033221 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3565/7170] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:48.988830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:48.989358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:48.990669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-e05170b3-9a55-4771-94ec-e09dbeb3d617 req-7a24b8a9-ceb6-402c-ae33-491dc3564e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:14:48.996186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.996655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:48.997454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:48.997903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.001346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e05170b3-9a55-4771-94ec-e09dbeb3d617 req-7a24b8a9-ceb6-402c-ae33-491dc3564e0d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.001807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-e05170b3-9a55-4771-94ec-e09dbeb3d617 req-7a24b8a9-ceb6-402c-ae33-491dc3564e0d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.013119 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-e05170b3-9a55-4771-94ec-e09dbeb3d617 req-7a24b8a9-ceb6-402c-ae33-491dc3564e0d service nova] Creating event network-changed:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:14:49.018222 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-e05170b3-9a55-4771-94ec-e09dbeb3d617 req-7a24b8a9-ceb6-402c-ae33-491dc3564e0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 May 10 03:14:49.019111 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3566/7171] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:49.083860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lazy-loading 'services' on Instance uuid 1d65d433-b892-4229-8685-96f8993ddb4c {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:14:49.160260 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae14e8fb-e154-4aac-a091-5477cb14a4a3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments/494d343a-ec61-4fa6-8ada-ff51a6f57505" status: 202 len: 0 microversion: 2.1 time: 0.176337 May 10 03:14:49.161494 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3606/7172] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 03:14:48 2022] DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments/494d343a-ec61-4fa6-8ada-ff51a6f57505 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:14:49.172051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:49.173431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:49.180298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.180998 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.181910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:49.182471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:49.221673 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3c9eacd0-8827-489c-8f69-3dd6cea57f5a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055554 May 10 03:14:49.222478 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3567/7173] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:49 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:50.234332 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:50.235475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:50.242477 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.242938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.243735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:50.244177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:50.279148 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5cdff272-1997-44d8-a03e-3741ae319c56 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049103 May 10 03:14:50.280092 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3607/7174] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:50 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:51.290204 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:51.291243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:51.301731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.302210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.303023 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:51.303505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:51.333387 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53c6e898-32d8-4126-92f4-baf242159350 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047329 May 10 03:14:51.333968 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3568/7175] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:51 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:52.345233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:52.346217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:52.353410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.354432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.355343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:52.356121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:52.385963 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5ba85f7b-f17c-495b-986b-46f9fc1e543d tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 May 10 03:14:52.387192 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3608/7176] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:52 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:53.398377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:53.399376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:53.407084 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.407593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.408453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:53.409030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:53.440043 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b64e6825-cf6e-4f23-9560-f2271bdcde4f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 May 10 03:14:53.440621 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3569/7177] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:53 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:54.451834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:54.452813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:54.459584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.460043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.460822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:54.461270 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:54.494016 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ff1ce903-866a-4e1f-b6c4-f9f08ef5cd03 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 May 10 03:14:54.494605 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3609/7178] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:54 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:55.505763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:55.506755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:55.514245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.514715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.515526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:55.515983 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:55.544244 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4483045b-cf4d-4464-822c-e41664d4773a tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042521 May 10 03:14:55.544808 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3570/7179] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:55 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:56.556173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:56.557119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:56.564395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.564795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.565566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:56.566009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:56.595482 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f8b3ef11-35a7-4fb3-b7ac-f682822204df tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 May 10 03:14:56.596053 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3610/7180] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:56 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:57.607356 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:57.608295 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:57.615008 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.615509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.616290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:57.616743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:57.647007 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-89ae6c67-357c-4e55-a2cc-c046fa65841f tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 May 10 03:14:57.647617 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3571/7181] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:57 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:58.659047 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:58.660024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:58.666892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.667448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.668259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:58.668691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:58.697644 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b32ce414-6a14-4a99-8dae-690cafc517f3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 May 10 03:14:58.698234 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3611/7182] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:58 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:14:59.709792 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:59.710734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:59.718483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.719257 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.720054 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.720514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.748351 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2163ed5c-f99a-4389-8db4-6763c1b89f2e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042534 May 10 03:14:59.748945 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3572/7183] 10.222.0.52 () {58 vars in 1301 bytes} [Tue May 10 03:14:59 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:14:59.758611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:14:59.759139 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:14:59.766393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.766848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.767651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:14:59.768093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:14:59.843405 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] HTTP exception thrown: Instance 1d65d433-b892-4229-8685-96f8993ddb4c is not attached to volume 494d343a-ec61-4fa6-8ada-ff51a6f57505 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Request method failure captured: May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: request: DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments/494d343a-ec61-4fa6-8ada-ff51a6f57505 HTTP/1.1 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedg2xUjNz9FYhJDaLSHa4M6xAQpy46QepkSX6kExgdPJx-LUpaePfAcoqgIBy93ysbgtQBuIGZaeKwIeS8AgSxAg8L05ILPGCB-ZmHmmUtgymtwPwj6FKAXNLTIQwcMcTQUCcmQiWt4yn4gsxPRW5P5-ZjPF8DgPx5A_IIPAtMZ9Q3Y May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 956dfaab2efd4f33a37ad46017163d01 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestMinimumBasicScenario-884197596 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_956dfaab2efd4f33a37ad46017163d01", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/956dfaab2efd4f33a37ad46017163d01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/956dfaab2efd4f33a37ad46017163d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/956dfaab2efd4f33a37ad46017163d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestMinimumBasicScenario-884197596 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 956dfaab2efd4f33a37ad46017163d01 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-884197596 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestMinimumBasicScenario-884197596-project May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 92f42c873c354d4ba56c0f817ed539f0 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestMinimumBasicScenario-884197596-project May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1d65d433-b892-4229-8685-96f8993ddb4c is not attached to volume 494d343a-ec61-4fa6-8ada-ff51a6f57505 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'server_id': '1d65d433-b892-4229-8685-96f8993ddb4c', 'id': '494d343a-ec61-4fa6-8ada-ff51a6f57505'} May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 494d343a-ec61-4fa6-8ada-ff51a6f57505. May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d65d433-b892-4229-8685-96f8993ddb4c is not attached to volume 494d343a-ec61-4fa6-8ada-ff51a6f57505 May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:14:59.845340 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d65d433-b892-4229-8685-96f8993ddb4c is not attached to volume 494d343a-ec61-4fa6-8ada-ff51a6f57505 May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Returning 404 to user: Instance 1d65d433-b892-4229-8685-96f8993ddb4c is not attached to volume 494d343a-ec61-4fa6-8ada-ff51a6f57505 {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9760a95e-717b-45d0-bf7a-043d6bdff4b3 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments/494d343a-ec61-4fa6-8ada-ff51a6f57505" status: 404 len: 154 microversion: 2.1 time: 0.092189 May 10 03:14:59.850889 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3612/7184] 10.222.0.52 () {58 vars in 1415 bytes} [Tue May 10 03:14:59 2022] DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c/os-volume_attachments/494d343a-ec61-4fa6-8ada-ff51a6f57505 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:05.171967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:05.172483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:05.179591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.180068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.180897 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.181358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.206346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:15:05.285654 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-edd90e4a-960e-4bc3-8e63-3bfbe677932b tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 204 len: 0 microversion: 2.1 time: 0.117840 May 10 03:15:05.286211 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3573/7185] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:15:05 2022] DELETE /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:15:05.295084 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:05.295768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:05.302437 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.302901 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.303768 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:05.304219 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:05.433866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:05.441576 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3606abed-9b98-48ee-b20e-1bd0c9e443b2 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1554 microversion: 2.1 time: 0.150973 May 10 03:15:05.442165 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3613/7186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:05 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:06.459817 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:06.460549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:06.468056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.468444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.469251 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:06.469711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:06.649524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:06.657521 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0e4276ac-fee8-4e62-b498-bf1095b4f672 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1554 microversion: 2.1 time: 0.202115 May 10 03:15:06.658102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3574/7187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:06 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:07.674178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:07.674813 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:07.681769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:07.682239 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:07.683762 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:07.684074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:07.695047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-58efd773-81d7-4d4f-9111-e014f4c3608e req-bb9c6f38-5c61-4f53-9e10-5f4e8c938c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d65d433-b892-4229-8685-96f8993ddb4c", "name": "network-vif-deleted", "tag": "3ae946a3-f103-40cc-8916-bc66535dc600"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:07.713558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-58efd773-81d7-4d4f-9111-e014f4c3608e req-bb9c6f38-5c61-4f53-9e10-5f4e8c938c44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:07.713988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-58efd773-81d7-4d4f-9111-e014f4c3608e req-bb9c6f38-5c61-4f53-9e10-5f4e8c938c44 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:07.730181 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-58efd773-81d7-4d4f-9111-e014f4c3608e req-bb9c6f38-5c61-4f53-9e10-5f4e8c938c44 service nova] Creating event network-vif-deleted:3ae946a3-f103-40cc-8916-bc66535dc600 for instance 1d65d433-b892-4229-8685-96f8993ddb4c on n-h2-841089-2 May 10 03:15:07.735284 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-58efd773-81d7-4d4f-9111-e014f4c3608e req-bb9c6f38-5c61-4f53-9e10-5f4e8c938c44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044324 May 10 03:15:07.736016 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3575/7188] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:07.756107 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f42c873c354d4ba56c0f817ed539f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956dfaab2efd4f33a37ad46017163d01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:07.765238 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd798d7d-fe0a-4877-933e-f14fd359bf67 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 200 len: 1512 microversion: 2.1 time: 0.095066 May 10 03:15:07.765828 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3614/7189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:07 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 1512 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:15:08.785533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:08.786301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] [instance: 1d65d433-b892-4229-8685-96f8993ddb4c] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:08.792767 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.793247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.794047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:08.794511 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:08.808173 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] HTTP exception thrown: Instance 1d65d433-b892-4229-8685-96f8993ddb4c could not be found. May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Request method failure captured: May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c HTTP/1.1 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedg2xUjNz9FYhJDaLSHa4M6xAQpy46QepkSX6kExgdPJx-LUpaePfAcoqgIBy93ysbgtQBuIGZaeKwIeS8AgSxAg8L05ILPGCB-ZmHmmUtgymtwPwj6FKAXNLTIQwcMcTQUCcmQiWt4yn4gsxPRW5P5-ZjPF8DgPx5A_IIPAtMZ9Q3Y May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 956dfaab2efd4f33a37ad46017163d01 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestMinimumBasicScenario-884197596 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_956dfaab2efd4f33a37ad46017163d01", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/956dfaab2efd4f33a37ad46017163d01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/956dfaab2efd4f33a37ad46017163d01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/956dfaab2efd4f33a37ad46017163d01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestMinimumBasicScenario-884197596 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 956dfaab2efd4f33a37ad46017163d01 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestMinimumBasicScenario-884197596 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestMinimumBasicScenario-884197596-project May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 92f42c873c354d4ba56c0f817ed539f0 May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestMinimumBasicScenario-884197596-project May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 1d65d433-b892-4229-8685-96f8993ddb4c could not be found. May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '1d65d433-b892-4229-8685-96f8993ddb4c'} May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d65d433-b892-4229-8685-96f8993ddb4c could not be found. May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d65d433-b892-4229-8685-96f8993ddb4c could not be found. May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:15:08.810089 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d65d433-b892-4229-8685-96f8993ddb4c could not be found. May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Returning 404 to user: Instance 1d65d433-b892-4229-8685-96f8993ddb4c could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0a153962-2022-4947-af95-3d4f30c690f1 tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c" status: 404 len: 111 microversion: 2.1 time: 0.031250 May 10 03:15:08.815682 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3576/7190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:08 2022] GET /compute/v2.1/servers/1d65d433-b892-4229-8685-96f8993ddb4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:15:08.820565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-81406db1-00be-46b5-9cad-faf4dba4e16e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] Calling method '.version_select at 0x7f3d371879d0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:08.839981 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-81406db1-00be-46b5-9cad-faf4dba4e16e tempest-TestMinimumBasicScenario-884197596 tempest-TestMinimumBasicScenario-884197596-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1051639007" status: 202 len: 0 microversion: 2.1 time: 0.023342 May 10 03:15:08.840559 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3615/7191] 10.222.0.52 () {58 vars in 1271 bytes} [Tue May 10 03:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1051639007 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:15:18.053531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4a9a6d01-ebd0-4a1e-a50c-c9108d6cbe4a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: .version_select at 0x7f3d360a7160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1072750884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt7ySIj31ZX4QGDddw8/MGpppLNdcA7scUKYZMe7YEru45x8TANfoAMNSuiUNepLIGshwbGMHcWm8TQQ6LrAmYAaT27sc/5vA4uaYt/6Z0SAr/a6gdU67aeNd1tkBqarQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:18.068050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-4a9a6d01-ebd0-4a1e-a50c-c9108d6cbe4a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:15:18.073090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-4a9a6d01-ebd0-4a1e-a50c-c9108d6cbe4a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:15:18.097359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4a9a6d01-ebd0-4a1e-a50c-c9108d6cbe4a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.201040 May 10 03:15:18.097956 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3577/7192] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:15:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:23.872030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1024246418", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "6811fc5c-b576-443d-a682-f4d0da7d9fae"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1072750884", "security_groups": [{"name": "tempest-secgroup-smoke-476153208"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:23.989015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] validate_networks() for [('6811fc5c-b576-443d-a682-f4d0da7d9fae', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:15:24.392389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:15:24.393043 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:15:24.393752 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:15:24.394182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:15:24.394618 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:15:24.404377 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:24.405082 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:24.406159 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:24.406822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:24.424479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:15:24.429869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:15:24.443287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:15:24.445626 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:15:24.501078 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a543ab1c-0608-4bb9-a6a6-976d723331c3 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.633571 May 10 03:15:24.506593 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3616/7193] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:15:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:15:24.512728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e5c3ab9f-c42c-4b7c-b43f-37ce16dfc196 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:24.513361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e5c3ab9f-c42c-4b7c-b43f-37ce16dfc196 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:24.579240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e5c3ab9f-c42c-4b7c-b43f-37ce16dfc196 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:24.586813 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e5c3ab9f-c42c-4b7c-b43f-37ce16dfc196 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1267 microversion: 2.1 time: 0.078817 May 10 03:15:24.587664 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3578/7194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:24 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:25.605997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:25.606722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:25.613674 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:25.614143 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:25.614939 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:25.615497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:25.689620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:25.698530 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3a8e66af-00fe-451f-b4ed-0c8e7284b379 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1319 microversion: 2.1 time: 0.097110 May 10 03:15:25.700712 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3617/7195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:25 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:26.717747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:26.719379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:26.732950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:26.733693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:26.734768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:26.735605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:26.988137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:26.995606 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8c90fdb3-12ca-4589-a95b-be5fae1e970b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.282758 May 10 03:15:26.996204 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3579/7196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:26 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:27.352297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-1769bd2c-e3fb-4825-adaa-5977f87f9291 req-cc7424d8-8fc7-4672-800a-4e39d0fec168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c337521-e064-4528-befe-8e42e4ad974b", "tag": "11659808-a36e-4cf6-9cb3-e82b5b09bd94"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:27.365718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1769bd2c-e3fb-4825-adaa-5977f87f9291 req-cc7424d8-8fc7-4672-800a-4e39d0fec168 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:27.366182 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-1769bd2c-e3fb-4825-adaa-5977f87f9291 req-cc7424d8-8fc7-4672-800a-4e39d0fec168 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:27.378455 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-1769bd2c-e3fb-4825-adaa-5977f87f9291 req-cc7424d8-8fc7-4672-800a-4e39d0fec168 service nova] Creating event network-changed:11659808-a36e-4cf6-9cb3-e82b5b09bd94 for instance 3c337521-e064-4528-befe-8e42e4ad974b on n-h2-841089-2 May 10 03:15:27.383737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-1769bd2c-e3fb-4825-adaa-5977f87f9291 req-cc7424d8-8fc7-4672-800a-4e39d0fec168 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035509 May 10 03:15:27.384577 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3618/7197] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:28.012287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:28.012934 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:28.019705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:28.020177 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:28.020954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:28.021405 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:28.150477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:28.157783 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-827c3c67-bb8e-4bf1-b417-230ede7698aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.149529 May 10 03:15:28.158353 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3580/7198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:28 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:29.176102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:29.176849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:29.183966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:29.184613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:29.185415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:29.185861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:29.611078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:29.618594 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5fa41f3-0da1-43ee-aa21-d68c0abf11e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.447762 May 10 03:15:29.619211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3619/7199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:29 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:30.635757 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:30.636301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:30.643233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:30.643709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:30.644497 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:30.644954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:30.773186 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:30.781012 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc0793d9-db37-483e-b355-3a4ee90220e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.149393 May 10 03:15:30.781589 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3581/7200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:30 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:31.798264 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:31.798918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:31.805630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:31.806118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:31.806895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:31.808144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:31.944157 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:31.951884 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c7cd30b7-aa91-4571-a7f0-fe6ec879191c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.157529 May 10 03:15:31.952478 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3620/7201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:31 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:32.970391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:32.971325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:32.978233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:32.978717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:32.979549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:32.980021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:33.108245 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:33.115577 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f1cd6388-d90d-4c50-b8b5-1b332d949959 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.150393 May 10 03:15:33.116157 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3582/7202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:32 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:33.770260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-991a6fca-a5d1-41d2-a15a-8e1ac97dbfa8 req-025acdfe-c87d-4091-95f6-41f11cf90882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c337521-e064-4528-befe-8e42e4ad974b", "name": "network-vif-plugged", "status": "completed", "tag": "11659808-a36e-4cf6-9cb3-e82b5b09bd94"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:33.778730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-991a6fca-a5d1-41d2-a15a-8e1ac97dbfa8 req-025acdfe-c87d-4091-95f6-41f11cf90882 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:33.779214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-991a6fca-a5d1-41d2-a15a-8e1ac97dbfa8 req-025acdfe-c87d-4091-95f6-41f11cf90882 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:33.789900 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-991a6fca-a5d1-41d2-a15a-8e1ac97dbfa8 req-025acdfe-c87d-4091-95f6-41f11cf90882 service nova] Creating event network-vif-plugged:11659808-a36e-4cf6-9cb3-e82b5b09bd94 for instance 3c337521-e064-4528-befe-8e42e4ad974b on n-h2-841089-2 May 10 03:15:33.795620 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-991a6fca-a5d1-41d2-a15a-8e1ac97dbfa8 req-025acdfe-c87d-4091-95f6-41f11cf90882 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102935 May 10 03:15:33.796244 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3621/7203] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:15:34.133267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:34.133841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:34.141137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:34.141611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:34.142399 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:34.142854 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:34.278705 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:34.286198 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd8e623b-4e65-4d70-8b7e-439e3978542d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1392 microversion: 2.1 time: 0.156988 May 10 03:15:34.286785 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3583/7204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:34 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:35.303684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:35.304398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:35.311266 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:35.311734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:35.312513 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:35.312962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:35.443049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:35.451340 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8d588bd-24bb-4ee5-895e-890d3d165cab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1564 microversion: 2.1 time: 0.152039 May 10 03:15:35.452174 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3622/7205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:35 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:35.468162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:35.468795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:35.475602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:35.476085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:35.476882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:35.477343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:35.609394 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:35.616721 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-722424fd-f0c3-4a82-9c82-4fcc3d838d5e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1564 microversion: 2.1 time: 0.153084 May 10 03:15:35.617294 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3584/7206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:35 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:15:37.213935 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:15:37.214575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:15:37.215506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-d940474c-d39d-4afc-82e0-df490d8c34c6 req-3f2d9064-4869-4b26-85f8-b1191c6f3ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c337521-e064-4528-befe-8e42e4ad974b", "tag": "11659808-a36e-4cf6-9cb3-e82b5b09bd94"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:15:37.226224 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:37.226839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:37.227438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d940474c-d39d-4afc-82e0-df490d8c34c6 req-3f2d9064-4869-4b26-85f8-b1191c6f3ba6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:37.227698 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:15:37.227912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-d940474c-d39d-4afc-82e0-df490d8c34c6 req-3f2d9064-4869-4b26-85f8-b1191c6f3ba6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:37.228131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:15:37.242571 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-d940474c-d39d-4afc-82e0-df490d8c34c6 req-3f2d9064-4869-4b26-85f8-b1191c6f3ba6 service nova] Creating event network-changed:11659808-a36e-4cf6-9cb3-e82b5b09bd94 for instance 3c337521-e064-4528-befe-8e42e4ad974b on n-h2-841089-2 May 10 03:15:37.248440 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-d940474c-d39d-4afc-82e0-df490d8c34c6 req-3f2d9064-4869-4b26-85f8-b1191c6f3ba6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039387 May 10 03:15:37.249432 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3585/7207] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:15:37.460501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:15:37.469348 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fccaf984-7ffe-4d49-90ec-7776d7186c02 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1564 microversion: 2.1 time: 0.264567 May 10 03:15:37.470398 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3623/7208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:15:37 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:02.780881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:02.781950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:02.788408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:02.788885 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:02.789681 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:02.790141 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:02.845392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a948a7e2-6ec3-48cf-9c87-6213907d49b2 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action" status: 200 len: 24567 microversion: 2.1 time: 0.069864 May 10 03:16:02.846047 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3586/7209] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:16:02 2022] POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action => generated 24567 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:16:12.927238 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:16:12.927866 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:16:13.886672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:13.887376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:13.894023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.894432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.895238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.895702 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.958911 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-059eac53-1c23-4eb5-9daf-e935a3c86f9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action" status: 202 len: 0 microversion: 2.1 time: 0.076244 May 10 03:16:13.959599 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3624/7210] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:16:13 2022] POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:16:13.968644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:13.969370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:13.976185 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.976668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:13.977512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:13.977932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:14.107777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:14.115703 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-68a8703e-db15-4b0d-b908-7ddf04279f29 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1688 microversion: 2.1 time: 0.151592 May 10 03:16:14.116273 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3587/7211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:13 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:15.135285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:15.136012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:15.142173 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:15.142631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:15.143422 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:15.143862 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:15.275431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:15.282755 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d66ee6f2-bc47-4f27-92d8-dcd0f663914a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1668 microversion: 2.1 time: 0.152796 May 10 03:16:15.283359 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3625/7212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:15 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:16.371933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:16.372952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:16.380552 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.381032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.381825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.382281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.438488 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f84020a5-2e96-465c-965b-fc9efcca0c63 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action" status: 200 len: 32642 microversion: 2.1 time: 0.070354 May 10 03:16:16.439146 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3588/7213] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:16:16 2022] POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action => generated 32642 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:16:16.450448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:16.450996 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:16.457415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.457876 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.458661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.459130 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.523811 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4d50f36b-d115-4bfd-aba3-c2519c876061 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action" status: 202 len: 0 microversion: 2.1 time: 0.077363 May 10 03:16:16.524439 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3626/7214] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:16:16 2022] POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:16:16.533795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:16.534514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:16.541549 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.542025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.542826 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:16.543317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:16.674172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:16.683041 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d09146d5-3e00-4ffe-b32a-3f9606cdffa7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1675 microversion: 2.1 time: 0.154211 May 10 03:16:16.683640 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3589/7215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:16 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:17.703787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:17.704508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:17.710696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.711181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.711956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.712403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.849190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:17.856690 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-471f657e-64b5-4834-a40e-b2a51261a0b1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1683 microversion: 2.1 time: 0.158705 May 10 03:16:17.857290 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3627/7216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:17 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:17.947360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:17.948306 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:17.958347 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.958849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:17.959719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:17.960219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:18.017798 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-259e89e4-8250-48f0-91c5-42b15565ae3f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action" status: 200 len: 38397 microversion: 2.1 time: 0.074249 May 10 03:16:18.018456 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3590/7217] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:16:17 2022] POST /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b/action => generated 38397 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:16:19.378681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:19.384778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:19.392492 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.393317 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.394212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.394736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.424916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:16:19.443830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fb952091-2d66-4f0b-a62d-14916cd70082 req-4e24ee05-c5b5-4f0e-88d4-57f2c717720a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c337521-e064-4528-befe-8e42e4ad974b", "tag": "11659808-a36e-4cf6-9cb3-e82b5b09bd94"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:19.455398 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fb952091-2d66-4f0b-a62d-14916cd70082 req-4e24ee05-c5b5-4f0e-88d4-57f2c717720a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.456048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fb952091-2d66-4f0b-a62d-14916cd70082 req-4e24ee05-c5b5-4f0e-88d4-57f2c717720a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.468633 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fb952091-2d66-4f0b-a62d-14916cd70082 req-4e24ee05-c5b5-4f0e-88d4-57f2c717720a service nova] Creating event network-changed:11659808-a36e-4cf6-9cb3-e82b5b09bd94 for instance 3c337521-e064-4528-befe-8e42e4ad974b on n-h2-841089-2 May 10 03:16:19.473940 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fb952091-2d66-4f0b-a62d-14916cd70082 req-4e24ee05-c5b5-4f0e-88d4-57f2c717720a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099106 May 10 03:16:19.474799 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3591/7218] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:16:19.515218 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-32a652ce-2c00-4aae-9c5f-adb51654e9fb tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 204 len: 0 microversion: 2.1 time: 0.143771 May 10 03:16:19.519090 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3628/7219] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:16:19 2022] DELETE /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:16:19.525484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:19.526198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:19.532974 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.533453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.534279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:19.534731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:19.677266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:19.685216 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8bb7b73b-4612-4cdb-80bc-e322240ef81d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1689 microversion: 2.1 time: 0.164169 May 10 03:16:19.686291 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3592/7220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:19 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:16:20.703829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:20.704538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:20.711294 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.711751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.712516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:20.712957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:20.841281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:20.848639 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33a0193c-66ab-46bb-ab21-de831ead1a2d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1689 microversion: 2.1 time: 0.149821 May 10 03:16:20.849218 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3629/7221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:20 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:21.866499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:21.867299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:21.874320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.874874 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:21.875771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:21.876307 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.146517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:22.154191 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e2e0913c-7e56-4448-b55e-fcfdd6f8878b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 200 len: 1689 microversion: 2.1 time: 0.292119 May 10 03:16:22.154873 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3593/7222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:21 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 1689 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:22.330482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ec857fea-a3aa-4a1e-871c-89943694e16c req-73340287-eae8-4066-9320-5a6427615a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c337521-e064-4528-befe-8e42e4ad974b", "name": "network-vif-deleted", "tag": "11659808-a36e-4cf6-9cb3-e82b5b09bd94"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:22.339299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ec857fea-a3aa-4a1e-871c-89943694e16c req-73340287-eae8-4066-9320-5a6427615a45 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:22.339776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ec857fea-a3aa-4a1e-871c-89943694e16c req-73340287-eae8-4066-9320-5a6427615a45 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:22.350607 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ec857fea-a3aa-4a1e-871c-89943694e16c req-73340287-eae8-4066-9320-5a6427615a45 service nova] Creating event network-vif-deleted:11659808-a36e-4cf6-9cb3-e82b5b09bd94 for instance 3c337521-e064-4528-befe-8e42e4ad974b on n-h2-841089-2 May 10 03:16:22.355752 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ec857fea-a3aa-4a1e-871c-89943694e16c req-73340287-eae8-4066-9320-5a6427615a45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029762 May 10 03:16:22.356598 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3630/7223] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:23.171038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:23.171692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 3c337521-e064-4528-befe-8e42e4ad974b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:23.179473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.179946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.180736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:23.181195 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:23.194624 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] HTTP exception thrown: Instance 3c337521-e064-4528-befe-8e42e4ad974b could not be found. May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Request method failure captured: May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b HTTP/1.1 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedjFcg7L922vc8HP_gGSjZkw4jV_gyZhFI8LgrHCNBj6feSk2xeN9Rkb87lSChP5EgEPnYxwqbhacaAKt0B6hflO9YVVh5QIdWUyiNRBqnUiIgD7jz3y2Z_MR0w3H9ykb0bB0OMXxUa4Zu6p-QjOejQnYiXpqhlGWJbmXDGGftvDGC8 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99bc8147a93448ee99d972b2fd820b20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 37c7f29840bb4875b5f068b101c05072 May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 3c337521-e064-4528-befe-8e42e4ad974b could not be found. May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '3c337521-e064-4528-befe-8e42e4ad974b'} May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c337521-e064-4528-befe-8e42e4ad974b could not be found. May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c337521-e064-4528-befe-8e42e4ad974b could not be found. May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:16:23.196314 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c337521-e064-4528-befe-8e42e4ad974b could not be found. May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Returning 404 to user: Instance 3c337521-e064-4528-befe-8e42e4ad974b could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-47e78ea1-9938-483d-b515-6b2b9e3251e5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b" status: 404 len: 111 microversion: 2.1 time: 0.030695 May 10 03:16:23.201582 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3594/7224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:23 2022] GET /compute/v2.1/servers/3c337521-e064-4528-befe-8e42e4ad974b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:16:26.230176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-876b690c-f077-49b4-a3f1-575ae2f74e46 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '.version_select at 0x7f3d36765160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:26.249439 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-876b690c-f077-49b4-a3f1-575ae2f74e46 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072750884" status: 202 len: 0 microversion: 2.1 time: 0.024412 May 10 03:16:26.250148 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3631/7225] 10.222.0.52 () {58 vars in 1283 bytes} [Tue May 10 03:16:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072750884 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:16:26.278878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-afdd97be-36dd-4b63-bb6d-63b3e8973756 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: .version_select at 0x7f3d36dacdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-760005588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAjLcwEwiDHnSyrUshQ5NqBcD7seKZXHQhQrhUhUuWnkHHArPAkMbdZslzq/7oke9+CyEK1jbV5nQEll6nD5ZNEtffr9oN/cAI89BdFtdnBQRLiDzJ4oReAvXRoGNurPQ=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:26.299340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-afdd97be-36dd-4b63-bb6d-63b3e8973756 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:26.305845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-afdd97be-36dd-4b63-bb6d-63b3e8973756 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:26.330824 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-afdd97be-36dd-4b63-bb6d-63b3e8973756 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055838 May 10 03:16:26.331486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3595/7226] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:16:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:31.978109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1448200536", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "4a2f8cdd-9edd-422d-a38c-214efa3bca90"}], "key_name": "tempest-TestNetworkAdvancedServerOps-760005588", "security_groups": [{"name": "tempest-secgroup-smoke-1458991738"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:32.083822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] validate_networks() for [('4a2f8cdd-9edd-422d-a38c-214efa3bca90', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:16:32.944910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:16:32.945616 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:16:32.946502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:16:32.947025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:16:32.947579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:16:32.957396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.958025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.958933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:32.959670 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:32.980466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:16:32.987203 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:16:33.001180 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:16:33.004026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:16:33.052968 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-30e9b500-da50-43da-9acc-9128002baab6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.080556 May 10 03:16:33.054322 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3632/7227] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:16:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:16:33.065924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d20694ac-ff16-43c0-827c-b378fe0c2f25 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:33.067309 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d20694ac-ff16-43c0-827c-b378fe0c2f25 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:33.127684 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d20694ac-ff16-43c0-827c-b378fe0c2f25 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:33.134631 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d20694ac-ff16-43c0-827c-b378fe0c2f25 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1266 microversion: 2.1 time: 0.073983 May 10 03:16:33.135396 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3596/7228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:33 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:34.160715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:34.161369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:34.168740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.169459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.170819 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:34.171519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:34.267566 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:34.277204 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cb3392f3-a769-46f5-bcde-b34970fd43ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1326 microversion: 2.1 time: 0.124789 May 10 03:16:34.278111 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3633/7229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:34 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:35.296631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:35.297264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:35.304815 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.305287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.306107 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.306682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.502746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:35.513843 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cf937278-2173-4748-acaf-75d6592028e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.221914 May 10 03:16:35.514540 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3597/7230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:35 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:35.773817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7726751b-04d3-4519-97ec-4fbf27ecdd6b req-867219d1-70ef-4115-a8d1-7522ed3d87cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674ec7f2-6913-4d00-a3fb-2bd3072f8d13", "tag": "d684b99c-5f05-47fd-9c93-d41c7790eb2b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:35.793845 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7726751b-04d3-4519-97ec-4fbf27ecdd6b req-867219d1-70ef-4115-a8d1-7522ed3d87cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:35.794567 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7726751b-04d3-4519-97ec-4fbf27ecdd6b req-867219d1-70ef-4115-a8d1-7522ed3d87cf service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:35.817092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7726751b-04d3-4519-97ec-4fbf27ecdd6b req-867219d1-70ef-4115-a8d1-7522ed3d87cf service nova] Creating event network-changed:d684b99c-5f05-47fd-9c93-d41c7790eb2b for instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 on n-h2-841089-2 May 10 03:16:35.824703 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7726751b-04d3-4519-97ec-4fbf27ecdd6b req-867219d1-70ef-4115-a8d1-7522ed3d87cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056953 May 10 03:16:35.825335 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3634/7231] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:36.530873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:36.531534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:36.538274 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.538744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:36.539560 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:36.540012 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:36.671595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:36.678959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3807d6dc-8b22-4ffe-94ac-0953e37c76e0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.151996 May 10 03:16:36.679557 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3598/7232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:36 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:37.698004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:37.698651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:37.705496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:37.705964 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.706754 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:37.707341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:37.840276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:37.848274 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4c210f44-81c0-4c44-b41f-e45ff938f64c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.155525 May 10 03:16:37.848853 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3635/7233] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:37 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:38.865239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:38.865879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:38.872364 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.873402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:38.874196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:38.874659 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:39.001951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:39.009210 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-81d145fa-c8ac-4564-bad6-ebf0eac2cdb0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.148186 May 10 03:16:39.009778 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3599/7234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:38 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:40.025817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:40.026452 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:40.033158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.033625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.034411 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:40.034861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:40.170042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:40.178030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26ac01e1-d6c2-44a1-a098-a9f6147c8823 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.156225 May 10 03:16:40.178851 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3636/7235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:40 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:41.194304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:41.194966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:41.202495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.202980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.203805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:41.204272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:41.333761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:41.341181 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-561ea370-5dff-4754-9fe7-63568448067a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.150805 May 10 03:16:41.341813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3600/7236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:41 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:42.260910 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-f3dd07a2-a83c-4a47-baea-67a74742b96a req-4981e7aa-a0c2-4c37-91ca-0d2f906afeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674ec7f2-6913-4d00-a3fb-2bd3072f8d13", "name": "network-vif-plugged", "status": "completed", "tag": "d684b99c-5f05-47fd-9c93-d41c7790eb2b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:42.270487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f3dd07a2-a83c-4a47-baea-67a74742b96a req-4981e7aa-a0c2-4c37-91ca-0d2f906afeaa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:42.270942 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-f3dd07a2-a83c-4a47-baea-67a74742b96a req-4981e7aa-a0c2-4c37-91ca-0d2f906afeaa service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.284092 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-f3dd07a2-a83c-4a47-baea-67a74742b96a req-4981e7aa-a0c2-4c37-91ca-0d2f906afeaa service nova] Creating event network-vif-plugged:d684b99c-5f05-47fd-9c93-d41c7790eb2b for instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 on n-h2-841089-2 May 10 03:16:42.289140 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-f3dd07a2-a83c-4a47-baea-67a74742b96a req-4981e7aa-a0c2-4c37-91ca-0d2f906afeaa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031934 May 10 03:16:42.289869 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3637/7237] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:42.358093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:42.358750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:42.365791 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:42.366262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.367048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:42.367527 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:42.529535 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:42.537196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a403e3a7-4ed6-4612-858a-f142333c0c6a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.183005 May 10 03:16:42.537779 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3601/7238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:42 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:43.554209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:43.554991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:43.562236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:43.562706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:43.563514 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:43.563970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:43.700401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:43.708691 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbe26fc9-bb3a-4e39-b857-ae659adea97d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1392 microversion: 2.1 time: 0.158716 May 10 03:16:43.709276 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3638/7239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:43 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:44.725700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:44.726515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:44.733217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.733691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.735135 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.735611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.863887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:44.871308 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7eb81b6f-bae8-449a-a291-835e1b467a9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1564 microversion: 2.1 time: 0.149575 May 10 03:16:44.871894 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3602/7240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:44 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:44.887135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:44.887766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:44.894572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.894957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:44.895848 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:44.896298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:45.024624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:45.032550 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7290db3b-7073-4128-9b83-3af9646317e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1564 microversion: 2.1 time: 0.149339 May 10 03:16:45.033123 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3639/7241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:44 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:46.611422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:46.616892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-89a455b5-e38d-441d-bf55-ecb18752a9bb req-07710d17-a3c7-4b9d-a0b5-bec056b89796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674ec7f2-6913-4d00-a3fb-2bd3072f8d13", "tag": "d684b99c-5f05-47fd-9c93-d41c7790eb2b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:16:46.619112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:16:46.632854 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-89a455b5-e38d-441d-bf55-ecb18752a9bb req-07710d17-a3c7-4b9d-a0b5-bec056b89796 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:46.633234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-89a455b5-e38d-441d-bf55-ecb18752a9bb req-07710d17-a3c7-4b9d-a0b5-bec056b89796 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:46.638577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:46.639060 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:46.639898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:46.640903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:46.652294 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-89a455b5-e38d-441d-bf55-ecb18752a9bb req-07710d17-a3c7-4b9d-a0b5-bec056b89796 service nova] Creating event network-changed:d684b99c-5f05-47fd-9c93-d41c7790eb2b for instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 on n-h2-841089-2 May 10 03:16:46.658095 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-89a455b5-e38d-441d-bf55-ecb18752a9bb req-07710d17-a3c7-4b9d-a0b5-bec056b89796 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044996 May 10 03:16:46.658981 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3640/7242] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:47.166539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:16:47.176193 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6fd070ee-e038-480b-aa33-f9988e66d4d9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1564 microversion: 2.1 time: 0.569866 May 10 03:16:47.176712 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3603/7243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:16:46 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1564 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:10.459505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:10.460595 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:10.467462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:10.467930 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:10.468716 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:10.469780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:10.538735 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-94d8c24d-4f11-4025-838e-e90fcb79b3da tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13/action" status: 200 len: 24559 microversion: 2.1 time: 0.083464 May 10 03:17:10.539416 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3641/7244] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:17:10 2022] POST /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13/action => generated 24559 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:17:21.666131 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:17:21.667194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:21.674051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.674519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.675325 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.675782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.746636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-456219ad-57cb-4f3c-95d8-a1fd66fce99a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13/action" status: 202 len: 0 microversion: 2.1 time: 0.084462 May 10 03:17:21.747318 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3604/7245] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:17:21 2022] POST /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:17:21.756556 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:21.757276 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:21.764829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.765292 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.766049 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:21.766497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:21.982168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:21.990291 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7b0f96d6-056d-4e9b-bbc9-62a8c9279580 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1674 microversion: 2.1 time: 0.237917 May 10 03:17:21.990872 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3642/7246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:21 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:17:23.009324 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:23.010044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:23.016904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:23.017381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:23.018179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:23.018638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:23.148104 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:23.155395 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a4131995-ac86-49f7-99ab-d9f38ef0bf7f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.151388 May 10 03:17:23.155978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3605/7247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:23 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:24.172781 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:24.173404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:24.180205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:24.180695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:24.181464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:24.181908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:24.314724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:24.322074 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f741bcd-2624-4e3f-a70f-f008a3250661 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.153273 May 10 03:17:24.322653 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3643/7248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:24 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:17:25.340517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:25.341206 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:25.348368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:25.348861 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:25.349644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:25.350097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:25.481133 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:25.488466 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2b23644d-5b41-4c73-91e1-4da5639f7f74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.152339 May 10 03:17:25.489045 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3606/7249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:25 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:26.505906 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:26.506529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:26.513343 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:26.513799 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:26.514568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:26.515011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:26.646923 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:26.654343 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-0d06f556-b88f-41e0-8f3f-d6e482ec128f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.152458 May 10 03:17:26.654909 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3644/7250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:26 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:27.672547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:27.673182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:27.680029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:27.680509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:27.681327 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:27.681781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:27.818214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:27.825559 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cd92b2ab-fe89-43f9-9628-44b284d3bc5a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.157569 May 10 03:17:27.826133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3607/7251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:27 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:28.841745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:28.842373 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:28.849316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:28.849778 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:28.850564 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:28.851013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:28.980521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:28.987979 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d0e988da-3469-4c71-95b6-2bf0ce380ee7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.150181 May 10 03:17:28.988559 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3645/7252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:28 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:30.005050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:30.005691 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:30.012528 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:30.013005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:30.013789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:30.014247 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:30.146627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:30.154068 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-309321d2-43b8-4898-891e-675133c6e2aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.152976 May 10 03:17:30.154643 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3608/7253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:29 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:31.172383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:31.173017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:31.179846 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:31.180303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:31.181072 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:31.181516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:31.309004 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:31.316580 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-903a22e4-ccd0-4cd4-95fc-75429bd3b4e1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.148776 May 10 03:17:31.317157 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3646/7254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:31 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:32.334102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:32.334739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:32.341598 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:32.342065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:32.342855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:32.343340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:32.470415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:32.477751 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dbbda3c1-2e73-4fe8-9fe2-239372e06cca tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.147598 May 10 03:17:32.478323 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3609/7255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:32 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:33.495357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:33.495982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:33.503326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:33.503785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:33.504558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:33.505003 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:33.639517 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:33.647497 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8b47bde5-dfe9-438b-8deb-b477053ef186 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.156102 May 10 03:17:33.648082 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3647/7256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:33 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:34.664604 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:34.665172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:34.671981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:34.672446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:34.673223 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:34.673674 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:34.806075 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:34.814388 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1b0f4fe-2e4c-4aa3-9322-c28fe2919dcd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.153787 May 10 03:17:34.814968 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3610/7257] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:34 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:35.831545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:35.832206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:35.838833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:35.839335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:35.840123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:35.840578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:35.974119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:35.981548 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c647c7b4-3ba3-4c26-90af-b4134b882eb6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.153909 May 10 03:17:35.982128 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3648/7258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:35 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:36.998981 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:36.999638 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:37.006384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:37.006855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:37.007669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:37.008125 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:37.135562 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:37.143610 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9f3b2022-f68a-4080-aa17-7010d860149d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.148588 May 10 03:17:37.144185 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3611/7259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:36 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:38.163088 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:38.163710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:38.170700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:38.171198 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:38.172002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:38.172459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:38.309176 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:38.317789 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9554eb4f-0548-4367-9996-4de0c63144d5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1679 microversion: 2.1 time: 0.161933 May 10 03:17:38.318373 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3649/7260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:38 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:17:39.335368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:39.336087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:17:39.344494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:39.344963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:39.345924 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:39.346396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:39.476912 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:17:39.484912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45c5e6b8-fa71-4c6b-9cd7-f6e3e9e1ec6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1682 microversion: 2.1 time: 0.153317 May 10 03:17:39.485490 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3612/7261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:17:39 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:05.671675 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:05.672631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:05.678829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.679340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.680135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:05.680624 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:05.741045 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-bfd27262-9dfc-408b-ab2c-a65b04c2a159 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13/action" status: 200 len: 68954 microversion: 2.1 time: 0.073438 May 10 03:18:05.741744 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3650/7262] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:18:05 2022] POST /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13/action => generated 68954 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:18:13.156317 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:13.156914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:13.163349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.163832 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.164639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.165344 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.188371 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-46693ee0-f19c-408f-99a6-be697fb7fc2a req-47587b5c-f7f4-443e-aa0d-1d9ac3266c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674ec7f2-6913-4d00-a3fb-2bd3072f8d13", "tag": "d684b99c-5f05-47fd-9c93-d41c7790eb2b"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:13.200161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:18:13.208563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-46693ee0-f19c-408f-99a6-be697fb7fc2a req-47587b5c-f7f4-443e-aa0d-1d9ac3266c77 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.209022 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-46693ee0-f19c-408f-99a6-be697fb7fc2a req-47587b5c-f7f4-443e-aa0d-1d9ac3266c77 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.230544 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-46693ee0-f19c-408f-99a6-be697fb7fc2a req-47587b5c-f7f4-443e-aa0d-1d9ac3266c77 service nova] Creating event network-changed:d684b99c-5f05-47fd-9c93-d41c7790eb2b for instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 on n-h2-841089-2 May 10 03:18:13.236157 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-46693ee0-f19c-408f-99a6-be697fb7fc2a req-47587b5c-f7f4-443e-aa0d-1d9ac3266c77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057086 May 10 03:18:13.237395 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3651/7263] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:13.300770 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-71ca5258-e031-4bd9-a76e-88161b03ee08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 204 len: 0 microversion: 2.1 time: 0.148298 May 10 03:18:13.301810 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3613/7264] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:18:13 2022] DELETE /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:18:13.312326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:13.313042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:13.319494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.319959 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.320757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:13.321206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:13.458456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:13.466290 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e8a2b5ad-e359-420a-94e1-0f479b265d35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1688 microversion: 2.1 time: 0.159872 May 10 03:18:13.466875 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3652/7265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:13 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:18:14.484220 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:14.484936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:14.491651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.492128 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.492914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:14.493371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:14.627450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:14.635507 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-321ff78c-2473-4eb0-8cf0-c79957496714 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1688 microversion: 2.1 time: 0.156118 May 10 03:18:14.636295 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3614/7266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:14 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:15.653244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:15.653851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:15.663473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-7589a520-6c97-461b-805f-e1b0721938df req-acffd805-be4b-43c7-a77b-f759f9df4898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674ec7f2-6913-4d00-a3fb-2bd3072f8d13", "name": "network-vif-deleted", "tag": "d684b99c-5f05-47fd-9c93-d41c7790eb2b"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:15.667971 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.668462 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.669249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.669701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.673469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7589a520-6c97-461b-805f-e1b0721938df req-acffd805-be4b-43c7-a77b-f759f9df4898 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:15.673933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-7589a520-6c97-461b-805f-e1b0721938df req-acffd805-be4b-43c7-a77b-f759f9df4898 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:15.688184 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-7589a520-6c97-461b-805f-e1b0721938df req-acffd805-be4b-43c7-a77b-f759f9df4898 service nova] Creating event network-vif-deleted:d684b99c-5f05-47fd-9c93-d41c7790eb2b for instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 on n-h2-841089-2 May 10 03:18:15.693649 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-7589a520-6c97-461b-805f-e1b0721938df req-acffd805-be4b-43c7-a77b-f759f9df4898 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034002 May 10 03:18:15.694347 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3615/7267] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:15.736851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:15.744167 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-acb43a96-f281-4ce4-895c-fc17fdcb5ac0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 200 len: 1502 microversion: 2.1 time: 0.095029 May 10 03:18:15.744806 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3653/7268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:15 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 1502 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:16.762300 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:16.763029 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 674ec7f2-6913-4d00-a3fb-2bd3072f8d13] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:16.770734 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.771246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.772040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:16.772506 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:16.786292 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] HTTP exception thrown: Instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 could not be found. May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Request method failure captured: May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 HTTP/1.1 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedjFcg7L922vc8HP_gGSjZkw4jV_gyZhFI8LgrHCNBj6feSk2xeN9Rkb87lSChP5EgEPnYxwqbhacaAKt0B6hflO9YVVh5QIdWUyiNRBqnUiIgD7jz3y2Z_MR0w3H9ykb0bB0OMXxUa4Zu6p-QjOejQnYiXpqhlGWJbmXDGGftvDGC8 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99bc8147a93448ee99d972b2fd820b20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 37c7f29840bb4875b5f068b101c05072 May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 could not be found. May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '674ec7f2-6913-4d00-a3fb-2bd3072f8d13'} May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 could not be found. May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 could not be found. May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:18:16.787948 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 could not be found. May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Returning 404 to user: Instance 674ec7f2-6913-4d00-a3fb-2bd3072f8d13 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a900f30f-08de-46f4-8659-42d09a9f7d28 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13" status: 404 len: 111 microversion: 2.1 time: 0.031392 May 10 03:18:16.793513 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3616/7269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:16 2022] GET /compute/v2.1/servers/674ec7f2-6913-4d00-a3fb-2bd3072f8d13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:18:20.120438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26f987d1-3438-4da1-a03f-2d52d694b4ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '.version_select at 0x7f3d361d6790>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:20.143030 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26f987d1-3438-4da1-a03f-2d52d694b4ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-760005588" status: 202 len: 0 microversion: 2.1 time: 0.026762 May 10 03:18:20.143616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3654/7270] 10.222.0.52 () {58 vars in 1280 bytes} [Tue May 10 03:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-760005588 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:18:20.173435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f4cec438-2b7c-46ca-bfc9-b0a4ffc72a23 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: .version_select at 0x7f3d35df1b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2024132067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXC36BAIs1t0JzlpJyCh72wcjcesQo/MpXoAIS8zUkQHF01c0giUU3OTlW7MqNXdMmMAmn2PGoAw+OfZPZJ6Vi/r1TT/Dh16gYGaEzHOO5xNn5hq750WFOVfrmzeM5SwA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:20.188502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-f4cec438-2b7c-46ca-bfc9-b0a4ffc72a23 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:20.194393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-f4cec438-2b7c-46ca-bfc9-b0a4ffc72a23 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:20.217037 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f4cec438-2b7c-46ca-bfc9-b0a4ffc72a23 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048024 May 10 03:18:20.217833 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3617/7271] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:18:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:25.832873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-568207832", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "d2fe1e53-fd11-4fd7-a843-f22d6a103d8e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2024132067", "security_groups": [{"name": "tempest-secgroup-smoke-988153394"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:25.956843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] validate_networks() for [('d2fe1e53-fd11-4fd7-a843-f22d6a103d8e', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:18:26.348980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:18:26.349482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:18:26.350040 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:18:26.350529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:18:26.351029 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:18:26.360884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.361460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.362348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:26.362861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:26.384052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:26.390396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:26.403836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:18:26.406156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:18:26.455842 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-84cdeca7-a8c9-4b72-ac63-41bc2e818d55 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.627576 May 10 03:18:26.456838 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3655/7272] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:18:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:18:26.468568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1ad74a40-69c7-405d-8b8e-11a9d5bfee4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:26.469440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1ad74a40-69c7-405d-8b8e-11a9d5bfee4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:26.538999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1ad74a40-69c7-405d-8b8e-11a9d5bfee4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:26.548481 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1ad74a40-69c7-405d-8b8e-11a9d5bfee4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1266 microversion: 2.1 time: 0.085547 May 10 03:18:26.549302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3618/7273] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:26 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:27.567357 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:27.568720 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:27.589504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.589986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.590859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:27.593016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:27.689267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:27.697633 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-76ea778f-f11f-4f88-b8fc-2ef01309a7b7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1326 microversion: 2.1 time: 0.135224 May 10 03:18:27.700319 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3656/7274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:27 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1326 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:28.716565 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:28.717542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:28.732222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.733299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.734828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:28.735450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:28.964644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:28.973053 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-380116c5-e987-42a5-bd36-6428cc53206e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.260358 May 10 03:18:28.973915 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3619/7275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:28 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:29.168042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ba0c9ff6-028b-4aff-bfa1-ddee72f39d6d req-c1cb399c-4914-4196-82ae-9a83ad00c88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:29.178631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ba0c9ff6-028b-4aff-bfa1-ddee72f39d6d req-c1cb399c-4914-4196-82ae-9a83ad00c88a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:29.179465 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ba0c9ff6-028b-4aff-bfa1-ddee72f39d6d req-c1cb399c-4914-4196-82ae-9a83ad00c88a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:29.199394 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ba0c9ff6-028b-4aff-bfa1-ddee72f39d6d req-c1cb399c-4914-4196-82ae-9a83ad00c88a service nova] Creating event network-changed:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h2-841089-2 May 10 03:18:29.205911 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ba0c9ff6-028b-4aff-bfa1-ddee72f39d6d req-c1cb399c-4914-4196-82ae-9a83ad00c88a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042592 May 10 03:18:29.207312 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3657/7276] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:29.990096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:29.990721 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:29.997596 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:29.998059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:29.998845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:29.999343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:30.129143 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:30.136444 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ea381074-9f0b-4c45-b4be-9218f933e39b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.150508 May 10 03:18:30.137055 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3620/7277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:29 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:31.155605 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:31.156354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:31.162481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.162940 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.163769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:31.164217 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:31.297236 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:31.304502 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-33f5fac8-208f-4e1e-aee9-7c96929a6cc7 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.154479 May 10 03:18:31.305077 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3658/7278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:31 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:32.321590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:32.322229 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:32.329162 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.329642 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.330439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:32.330902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:32.468971 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:32.476433 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-30465530-e89e-43b7-99df-c7e0acb40ee4 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.158848 May 10 03:18:32.477029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3621/7279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:32 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:33.493709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:33.494341 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:33.501652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.502116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.502893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:33.503374 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:33.632211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:33.640293 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3da7a09d-11b7-420d-8cdf-434bd17284ac tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.150458 May 10 03:18:33.640813 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3659/7280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:33 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:34.657533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:34.658310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:34.665123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.665611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.666418 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.666886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.697470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-108fd843-81b2-4754-82d5-c7094acd415d req-647e9b2b-33b0-46cf-8fd8-1b042b008bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "name": "network-vif-plugged", "status": "completed", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:34.706441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-108fd843-81b2-4754-82d5-c7094acd415d req-647e9b2b-33b0-46cf-8fd8-1b042b008bb1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:34.706888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-108fd843-81b2-4754-82d5-c7094acd415d req-647e9b2b-33b0-46cf-8fd8-1b042b008bb1 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:34.719191 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-108fd843-81b2-4754-82d5-c7094acd415d req-647e9b2b-33b0-46cf-8fd8-1b042b008bb1 service nova] Creating event network-vif-plugged:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h2-841089-2 May 10 03:18:34.724888 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-108fd843-81b2-4754-82d5-c7094acd415d req-647e9b2b-33b0-46cf-8fd8-1b042b008bb1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 May 10 03:18:34.725925 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3660/7281] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:34.818130 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:34.825627 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c8a2b3b6-8751-497e-a64f-42a0a1d1e13d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.172665 May 10 03:18:34.826216 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3622/7282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:34 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:35.844973 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:35.845722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:35.851894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:35.852358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:35.853140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:35.853592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:35.982609 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:35.989935 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-45fd2cbc-1c42-488f-8f6e-fd46bc849038 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1391 microversion: 2.1 time: 0.150591 May 10 03:18:35.990514 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3661/7283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:35 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:37.006833 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:37.007536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:37.014281 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.014756 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.015582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.016043 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.147151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:37.155123 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-57b36093-1427-4a2f-ba6e-286b3c37499e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1562 microversion: 2.1 time: 0.151741 May 10 03:18:37.155979 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3623/7284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:37 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:37.172190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:37.172807 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:37.179508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.179961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.180734 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:37.181175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:37.311860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:37.319540 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c3bd7428-ffd6-4aa0-9027-86d058688477 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1562 microversion: 2.1 time: 0.151806 May 10 03:18:37.320173 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3662/7285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:37 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:18:39.220111 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:39.224896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:18:39.225676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-733d9215-e854-4810-b0ff-934543860e11 req-668aa1f3-dfa2-46cc-87e3-a9d1c407761c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:39.227986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:39.228473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:39.229273 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:39.229729 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:39.233933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-733d9215-e854-4810-b0ff-934543860e11 req-668aa1f3-dfa2-46cc-87e3-a9d1c407761c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:39.234476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-733d9215-e854-4810-b0ff-934543860e11 req-668aa1f3-dfa2-46cc-87e3-a9d1c407761c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:39.246883 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-733d9215-e854-4810-b0ff-934543860e11 req-668aa1f3-dfa2-46cc-87e3-a9d1c407761c service nova] Creating event network-changed:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h2-841089-2 May 10 03:18:39.252513 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-733d9215-e854-4810-b0ff-934543860e11 req-668aa1f3-dfa2-46cc-87e3-a9d1c407761c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034483 May 10 03:18:39.253557 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3663/7286] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:39.452002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:18:39.459778 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2d092704-a2be-423e-a2f3-08606492dd4f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1562 microversion: 2.1 time: 0.244243 May 10 03:18:39.460370 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3624/7287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:18:39 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:02.756826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:02.757938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:02.764833 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:02.765286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:02.766056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:02.766500 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:02.818545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-98089e67-f361-4812-89d1-c2c542b5bfba tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action" status: 200 len: 24573 microversion: 2.1 time: 0.066788 May 10 03:19:02.824960 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3664/7288] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:19:02 2022] POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action => generated 24573 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:19:13.862157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:13.863176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:13.869763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.870231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.871045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.871521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.953973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:13.960752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=118717) resize /opt/stack/nova/nova/compute/api.py:4166}} May 10 03:19:13.967189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:13.967712 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:13.968211 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:13.968645 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:13.969591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:14.029705 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [96576b52-2072-47c6-a496-4ce4951bf46d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:19:15.037051 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [96576b52-2072-47c6-a496-4ce4951bf46d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55198. May 10 03:19:15.040736 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ba595817-42c0-457f-874c-35f08d1ef543 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action" status: 202 len: 0 microversion: 2.1 time: 1.183377 May 10 03:19:15.041491 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3625/7289] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:19:13 2022] POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:15.051568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:15.052868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:15.059789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:15.060732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.061777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:15.062395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:15.200368 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:15.208320 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5f127b53-e829-4ebb-80f4-8567b13a09ab tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1690 microversion: 2.1 time: 0.162399 May 10 03:19:15.208916 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3665/7290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:15 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:16.226800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:16.227491 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:16.234360 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:16.235477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:16.236249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:16.236703 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:16.373425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:16.382526 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0556bec5-50b3-4aef-9763-5ad2e11e27c0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1690 microversion: 2.1 time: 0.160475 May 10 03:19:16.383512 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3626/7291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:16 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:17.400510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:17.401144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:17.407853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.408309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.409080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:17.409522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.538070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:17.545339 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a4d75905-d4cb-437b-8ab3-b1d39d9377aa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.148748 May 10 03:19:17.545912 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3666/7292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:17 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:18.563898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:18.564521 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:18.571258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.571722 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.572496 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.572948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.702199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:18.709593 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a6e136e-5c70-4900-90cd-c11acc6ced6d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.150433 May 10 03:19:18.710166 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3627/7293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:18 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:19.726569 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:19.727247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:19.734042 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.734560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.735394 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:19.735850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.868491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:19.876584 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41d1034a-bd13-48b8-830c-668ff8aaebe5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.153975 May 10 03:19:19.877168 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3667/7294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:19 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:20.894036 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:20.894585 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:20.901157 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.901627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.902404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.902862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:21.030591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:21.038520 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ec4f2fde-6a4b-47f9-996e-c8d8dd472c13 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.149029 May 10 03:19:21.039114 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3628/7295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:20 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:22.054899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:22.055548 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:22.062524 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.062986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.063810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:22.064261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:22.198872 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:22.206222 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1f5aa98a-0241-450b-b185-e040a9171f4e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.155279 May 10 03:19:22.206796 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3668/7296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:22 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:23.223664 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:23.224297 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:23.230999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.231575 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.232355 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.232807 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.359292 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:23.367240 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-baab0f06-5991-4e59-982c-ead14c7423f6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.147497 May 10 03:19:23.368032 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3629/7297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:23 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:24.384980 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:24.385581 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:24.392307 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.392766 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.393542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.393983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.531653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:24.539142 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7bf463c-189b-4482-8cbc-8282c135f4fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.158128 May 10 03:19:24.539744 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3669/7298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:24 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:25.556742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:25.557371 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:25.564462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.564929 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.565713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:25.566170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:25.693950 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.701326 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c948188f-fe3e-4b23-8185-45c60056e93e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.148533 May 10 03:19:25.701903 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3630/7299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:25 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:26.718805 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:26.719459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.726677 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.727164 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.727944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.728390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.857464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.864785 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-940e3556-320c-4ada-a110-49051e4f5501 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.149934 May 10 03:19:26.865358 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3670/7300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:26 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:27.882834 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:27.883512 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:27.890210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.890624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.891433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.891894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.025333 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.032810 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f2dfd883-708f-4551-97f3-dee205714aec tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.153913 May 10 03:19:28.033393 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3631/7301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:27 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:29.049928 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.050549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.057406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.057893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.058694 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.059179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.187406 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:29.194752 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-59610e8d-e663-4f3e-8d74-9ccf24b066a9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.148767 May 10 03:19:29.195368 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3671/7302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:30.210962 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:30.211620 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:30.218794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.219299 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.220080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.221038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.354407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.362375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d39d7d3-2d8a-429c-96b1-41b8dd32e590 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.155278 May 10 03:19:30.362952 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3632/7303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:30 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:31.379499 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.380128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.386889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.387388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.388175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.388623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.520008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.527391 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49567128-2800-45a9-9295-0f5ff80ad4ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.152544 May 10 03:19:31.527964 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3672/7304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:32.545326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.545966 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.552852 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.553326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.554114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.554577 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.684806 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.693196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-5ba994db-24e1-444f-b730-aac3cc68a132 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.151923 May 10 03:19:32.693783 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3633/7305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:33.709784 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.710424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.717326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.717798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.718584 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.719038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.851786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.859265 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8949591c-fc3c-4a5a-b9dc-d38987a007b9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1695 microversion: 2.1 time: 0.153379 May 10 03:19:33.859851 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3673/7306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:34.871199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f3b0812e-f292-4ae4-81d1-46b2223423ec req-baa6a4f6-2fa4-4bac-a4f9-0fd1fd9ab59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "name": "network-vif-unplugged", "status": "completed", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:34.876976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.878511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.880707 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f3b0812e-f292-4ae4-81d1-46b2223423ec req-baa6a4f6-2fa4-4bac-a4f9-0fd1fd9ab59d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.881267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f3b0812e-f292-4ae4-81d1-46b2223423ec req-baa6a4f6-2fa4-4bac-a4f9-0fd1fd9ab59d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.890636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.891466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.892502 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.892956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.895685 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f3b0812e-f292-4ae4-81d1-46b2223423ec req-baa6a4f6-2fa4-4bac-a4f9-0fd1fd9ab59d service nova] Creating event network-vif-unplugged:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h1-841089-2 May 10 03:19:34.901693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [req-f3b0812e-f292-4ae4-81d1-46b2223423ec req-baa6a4f6-2fa4-4bac-a4f9-0fd1fd9ab59d service nova] Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:19:34.913121 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f3b0812e-f292-4ae4-81d1-46b2223423ec req-baa6a4f6-2fa4-4bac-a4f9-0fd1fd9ab59d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045787 May 10 03:19:34.914089 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3634/7307] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:35.049885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:35.059266 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-3cd195a5-a251-4268-8e08-971c6bcf24b0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1694 microversion: 2.1 time: 0.186134 May 10 03:19:35.060120 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3674/7308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:36.078873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:36.079639 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:36.086403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.086881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.087702 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.088168 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.218774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.226162 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-25b7a737-dd1a-4e80-b637-119d4b17a682 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1692 microversion: 2.1 time: 0.152395 May 10 03:19:36.226763 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3635/7309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:36 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:36.929338 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-96722b9b-485c-4565-bbca-5eecdc1eb8bb req-f4fd1189-7c85-41e9-81d5-05ce37529aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:36.938636 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-96722b9b-485c-4565-bbca-5eecdc1eb8bb req-f4fd1189-7c85-41e9-81d5-05ce37529aed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.939105 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-96722b9b-485c-4565-bbca-5eecdc1eb8bb req-f4fd1189-7c85-41e9-81d5-05ce37529aed service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.953400 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-96722b9b-485c-4565-bbca-5eecdc1eb8bb req-f4fd1189-7c85-41e9-81d5-05ce37529aed service nova] Creating event network-changed:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h1-841089-2 May 10 03:19:36.958739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [req-96722b9b-485c-4565-bbca-5eecdc1eb8bb req-f4fd1189-7c85-41e9-81d5-05ce37529aed service nova] Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-841089-2', 'n-h2-841089-2'} {{(pid=118716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5809}} May 10 03:19:36.970368 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-96722b9b-485c-4565-bbca-5eecdc1eb8bb req-f4fd1189-7c85-41e9-81d5-05ce37529aed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045455 May 10 03:19:36.971592 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3675/7310] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:37.244513 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.245321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.253709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.254343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.255301 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.255895 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.839555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.848063 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bf01f7aa-617d-4d35-9e3b-6a333f181bbf tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1692 microversion: 2.1 time: 0.607506 May 10 03:19:37.848667 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3636/7311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:37 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1692 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:38.866222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:38.867209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:38.874009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.874501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.875265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.875695 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.011475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.018950 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-955944d4-79cd-40d5-a115-b0dde4f9c686 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1689 microversion: 2.1 time: 0.157508 May 10 03:19:39.019565 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3676/7312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:38 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:39.035127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:39.035693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.042289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.042763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.043581 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.044042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.103266 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f23e11e2-749c-4329-bd50-deb89316bd51 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action" status: 204 len: 0 microversion: 2.1 time: 0.071772 May 10 03:19:39.104154 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3637/7313] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:19:39 2022] POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:19:39.113483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.114165 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.120839 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.121305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.122103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.122652 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.347612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.356152 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fd099a55-a5b6-4416-911d-97d6fcfbe0f9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1689 microversion: 2.1 time: 0.247233 May 10 03:19:39.357257 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3677/7314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:39.373477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.374492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.381214 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.381903 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.382479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.382935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.595519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.603612 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0058a369-aa46-4721-bf33-2370cc4f86ce tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1689 microversion: 2.1 time: 0.234388 May 10 03:19:39.604199 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3638/7315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:40.621026 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:40.621653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:40.629188 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.629651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.630440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.630892 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.765131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.773120 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c11c7a1a-b96e-4510-b9e0-6580496e7517 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1681 microversion: 2.1 time: 0.156156 May 10 03:19:40.773694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3678/7316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:19:40 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:40.814661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-02b7a377-d209-48d4-8988-50ebe6b29c94 req-b6a3c98b-f8fd-4097-b44f-1d8a754e0c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "name": "network-vif-plugged", "status": "completed", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:40.830448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-02b7a377-d209-48d4-8988-50ebe6b29c94 req-b6a3c98b-f8fd-4097-b44f-1d8a754e0c76 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.831840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-02b7a377-d209-48d4-8988-50ebe6b29c94 req-b6a3c98b-f8fd-4097-b44f-1d8a754e0c76 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.846957 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-02b7a377-d209-48d4-8988-50ebe6b29c94 req-b6a3c98b-f8fd-4097-b44f-1d8a754e0c76 service nova] Creating event network-vif-plugged:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h1-841089-2 May 10 03:19:40.852090 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-02b7a377-d209-48d4-8988-50ebe6b29c94 req-b6a3c98b-f8fd-4097-b44f-1d8a754e0c76 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041178 May 10 03:19:40.853109 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3639/7317] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:02.958480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:02.959385 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:02.965506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.965997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.966771 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.967244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.018891 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78947160-4149-4719-8c31-ab04a29342ae tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action" status: 200 len: 24581 microversion: 2.1 time: 0.064436 May 10 03:20:03.025415 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3679/7318] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:20:02 2022] POST /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff/action => generated 24581 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:20:10.325022 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:10.326066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-964d475f-8040-4003-a938-546d7c8c0df3 req-e315c86d-dfc9-4edc-9632-78f1054f5e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:10.326482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:10.332731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.333280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.334138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.334869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.335820 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-964d475f-8040-4003-a938-546d7c8c0df3 req-e315c86d-dfc9-4edc-9632-78f1054f5e62 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.336278 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-964d475f-8040-4003-a938-546d7c8c0df3 req-e315c86d-dfc9-4edc-9632-78f1054f5e62 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.347912 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-964d475f-8040-4003-a938-546d7c8c0df3 req-e315c86d-dfc9-4edc-9632-78f1054f5e62 service nova] Creating event network-changed:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h1-841089-2 May 10 03:20:10.353753 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-964d475f-8040-4003-a938-546d7c8c0df3 req-e315c86d-dfc9-4edc-9632-78f1054f5e62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031746 May 10 03:20:10.354380 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3680/7319] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:10.362375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:20:10.450261 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-943f9841-ee8d-4d14-8257-f1880214af77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 204 len: 0 microversion: 2.1 time: 0.129203 May 10 03:20:10.454745 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3640/7320] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:20:10 2022] DELETE /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:10.461471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:10.462334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:10.468911 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.469378 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.470284 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.470740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.670232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:10.678485 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f726dae-436b-4329-9ad5-f8cd58661c9d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1687 microversion: 2.1 time: 0.222284 May 10 03:20:10.679000 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3681/7321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:10 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1687 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:11.696932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:11.697646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:11.704351 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:11.704818 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:11.706249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:11.706700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:11.895755 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:11.903217 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b8debd90-b8a5-44c0-8a07-c1e7772745af tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 200 len: 1687 microversion: 2.1 time: 0.210525 May 10 03:20:11.904011 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3641/7322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:11 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 1687 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:12.369474 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-7bdf775d-f56c-4977-b43c-b9df1fa2a9af req-89f32111-cd20-469a-b80f-c21726ddc203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccf7eed-971b-49d8-af53-51696c7ed2ff", "name": "network-vif-deleted", "tag": "8ef47508-4a13-49e0-ae6e-b22c16951930"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:12.379002 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7bdf775d-f56c-4977-b43c-b9df1fa2a9af req-89f32111-cd20-469a-b80f-c21726ddc203 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.379628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-7bdf775d-f56c-4977-b43c-b9df1fa2a9af req-89f32111-cd20-469a-b80f-c21726ddc203 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.390698 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-7bdf775d-f56c-4977-b43c-b9df1fa2a9af req-89f32111-cd20-469a-b80f-c21726ddc203 service nova] Creating event network-vif-deleted:8ef47508-4a13-49e0-ae6e-b22c16951930 for instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff on n-h1-841089-2 May 10 03:20:12.395581 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-7bdf775d-f56c-4977-b43c-b9df1fa2a9af req-89f32111-cd20-469a-b80f-c21726ddc203 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029876 May 10 03:20:12.396176 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3682/7323] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:12.920382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:12.920940 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 6ccf7eed-971b-49d8-af53-51696c7ed2ff] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:12.927660 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.928126 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.928905 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.929362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.943349 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] HTTP exception thrown: Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff could not be found. May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Request method failure captured: May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff HTTP/1.1 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedjFcg7L922vc8HP_gGSjZkw4jV_gyZhFI8LgrHCNBj6feSk2xeN9Rkb87lSChP5EgEPnYxwqbhacaAKt0B6hflO9YVVh5QIdWUyiNRBqnUiIgD7jz3y2Z_MR0w3H9ykb0bB0OMXxUa4Zu6p-QjOejQnYiXpqhlGWJbmXDGGftvDGC8 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99bc8147a93448ee99d972b2fd820b20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 37c7f29840bb4875b5f068b101c05072 May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff could not be found. May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '6ccf7eed-971b-49d8-af53-51696c7ed2ff'} May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff could not be found. May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff could not be found. May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:20:12.945160 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff could not be found. May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Returning 404 to user: Instance 6ccf7eed-971b-49d8-af53-51696c7ed2ff could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-322bf8f0-6f39-48e1-ba0c-448690a5ee31 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff" status: 404 len: 111 microversion: 2.1 time: 0.030242 May 10 03:20:12.950099 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3642/7324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:12 2022] GET /compute/v2.1/servers/6ccf7eed-971b-49d8-af53-51696c7ed2ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:16.003285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c70523a-d4f7-4f6b-bf5f-dfe47f83f801 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '.version_select at 0x7f3d36631e50>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:16.025451 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c70523a-d4f7-4f6b-bf5f-dfe47f83f801 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2024132067" status: 202 len: 0 microversion: 2.1 time: 0.027762 May 10 03:20:16.026263 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3683/7325] 10.222.0.52 () {58 vars in 1283 bytes} [Tue May 10 03:20:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2024132067 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:20:16.049624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2330fd7d-ce6b-4852-b47f-b73f9694ce77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: .version_select at 0x7f3d3712cee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1389238566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYfJ8Zh9f45gyqbVzXvkQ52WeMCTAGs2AQAbfeVWpj3X/ONGbuEh0bARHdilnAdu2rCnoghCatJhP43SRAtBtRXE4whtTsxq4dLy5oCW2e3fEXA7YFascLNPEn4nVFKjw=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:16.064010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2330fd7d-ce6b-4852-b47f-b73f9694ce77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:16.070176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-2330fd7d-ce6b-4852-b47f-b73f9694ce77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:16.094345 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2330fd7d-ce6b-4852-b47f-b73f9694ce77 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048459 May 10 03:20:16.094829 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3643/7326] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:20:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:21.761947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1318601583", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "08d7ea65-7b9e-4cb4-b191-f22c9ef21b32"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1389238566", "security_groups": [{"name": "tempest-secgroup-smoke-1385523122"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:21.884673 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] validate_networks() for [('08d7ea65-7b9e-4cb4-b191-f22c9ef21b32', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:20:22.293102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:20:22.293542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:20:22.294038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:20:22.294466 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:20:22.294903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:20:22.305305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:22.305769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:22.306818 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:22.307297 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:22.328611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:22.334353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:22.348690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:20:22.351132 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:20:22.407794 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8815b9f8-b6da-4dae-be3a-237e8ab32336 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.649848 May 10 03:20:22.408527 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3684/7327] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:20:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:20:22.419199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b7f73e18-caa3-4246-a260-dade2ae59f7e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:22.420534 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b7f73e18-caa3-4246-a260-dade2ae59f7e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:22.498871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b7f73e18-caa3-4246-a260-dade2ae59f7e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:22.510329 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b7f73e18-caa3-4246-a260-dade2ae59f7e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1267 microversion: 2.1 time: 0.095526 May 10 03:20:22.510932 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3644/7328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:22 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:23.529869 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:23.530475 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:23.543398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:23.545428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:23.546275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:23.548020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:23.754791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:23.769416 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6bbf152-d5a6-458c-9e30-4bb885bba83b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1327 microversion: 2.1 time: 0.245416 May 10 03:20:23.770042 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3685/7329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:23 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1327 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:24.787443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:24.788932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:24.798199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:24.799275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:24.800749 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:24.801875 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:25.022988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:25.038529 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-79282f88-e2d1-4639-bf71-93f425ea4c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.256311 May 10 03:20:25.043990 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3645/7330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:24 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:25.390020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-920dd858-d4b5-4981-8bfe-272428f8dfa7 req-570e857f-0985-4e92-9a25-908e503af8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6", "tag": "5b38bb86-0f52-40cd-bf36-9640c37bb494"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:25.402458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-920dd858-d4b5-4981-8bfe-272428f8dfa7 req-570e857f-0985-4e92-9a25-908e503af8a6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:25.403146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-920dd858-d4b5-4981-8bfe-272428f8dfa7 req-570e857f-0985-4e92-9a25-908e503af8a6 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:25.417193 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-920dd858-d4b5-4981-8bfe-272428f8dfa7 req-570e857f-0985-4e92-9a25-908e503af8a6 service nova] Creating event network-changed:5b38bb86-0f52-40cd-bf36-9640c37bb494 for instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 on n-h2-841089-2 May 10 03:20:25.422735 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-920dd858-d4b5-4981-8bfe-272428f8dfa7 req-570e857f-0985-4e92-9a25-908e503af8a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113715 May 10 03:20:25.424318 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3686/7331] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:26.056021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:26.056667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:26.064132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:26.064709 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:26.065495 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:26.065957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:26.196748 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:26.204175 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-979e88ea-7970-4cbf-9b2f-ff61c87f9138 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.152174 May 10 03:20:26.204754 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3646/7332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:26 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:27.222729 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:27.223467 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:27.230447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:27.230908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:27.231715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:27.232158 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:27.423093 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:27.431525 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a7a1ec5c-77eb-4d11-bdc2-6ec289013fdd tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.213547 May 10 03:20:27.432118 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3687/7333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:27 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:28.448742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:28.449373 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:28.456673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:28.457148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:28.457931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:28.458395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:28.589961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:28.597883 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff4c70a1-23bc-4b2a-872c-4ecb7d108d4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.153141 May 10 03:20:28.598474 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3647/7334] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:28 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:29.615273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:29.615897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:29.622611 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.623095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.623881 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.624327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.757696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:29.766586 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-23c78300-fe0f-4b8d-973b-77726a1dffea tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.155904 May 10 03:20:29.767681 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3688/7335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:29 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:30.784129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:30.784822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:30.791719 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:30.792221 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:30.793020 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:30.793480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:30.926789 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:30.934115 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d0f44864-315b-40ac-8e08-ed43f6005850 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.154061 May 10 03:20:30.934694 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3648/7336] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:30 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:31.350501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-366f83b6-e3ee-4e04-9ccb-7df792481273 req-c7f0459c-8d47-4e6e-b354-801bf14e580a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6", "name": "network-vif-plugged", "status": "completed", "tag": "5b38bb86-0f52-40cd-bf36-9640c37bb494"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:31.359578 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-366f83b6-e3ee-4e04-9ccb-7df792481273 req-c7f0459c-8d47-4e6e-b354-801bf14e580a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:31.360028 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-366f83b6-e3ee-4e04-9ccb-7df792481273 req-c7f0459c-8d47-4e6e-b354-801bf14e580a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:31.371457 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-366f83b6-e3ee-4e04-9ccb-7df792481273 req-c7f0459c-8d47-4e6e-b354-801bf14e580a service nova] Creating event network-vif-plugged:5b38bb86-0f52-40cd-bf36-9640c37bb494 for instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 on n-h2-841089-2 May 10 03:20:31.376400 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-366f83b6-e3ee-4e04-9ccb-7df792481273 req-c7f0459c-8d47-4e6e-b354-801bf14e580a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 May 10 03:20:31.377021 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3689/7337] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:31.950857 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:31.951540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:31.958687 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:31.959202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:31.959991 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:31.960449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:32.096597 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:32.103912 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e61ed915-b3a8-4238-bd15-b0a9471a155e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1393 microversion: 2.1 time: 0.157179 May 10 03:20:32.104495 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3649/7338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:31 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:33.122482 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:33.123222 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:33.129948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:33.130405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:33.131212 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:33.131656 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:33.260305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:33.268255 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-befc3285-1623-40a1-afc6-53222a6823fc tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1565 microversion: 2.1 time: 0.151085 May 10 03:20:33.268822 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3690/7339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:33 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:33.284144 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:33.284779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:33.291745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:33.292217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:33.293035 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:33.293492 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:33.421716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:33.429229 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41c22d0e-b0b5-4497-8ef7-d8b66db21037 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1565 microversion: 2.1 time: 0.148959 May 10 03:20:33.429838 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3650/7340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:33 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:35.085144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:35.085809 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:35.090696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-76bc6fe1-df4f-468f-9b93-bfb6ccf3a1bd req-0420b3f3-dada-4b4f-a95b-fd103315e27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6", "tag": "5b38bb86-0f52-40cd-bf36-9640c37bb494"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:35.092213 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:35.092684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:35.093476 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:35.093932 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:35.099800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-76bc6fe1-df4f-468f-9b93-bfb6ccf3a1bd req-0420b3f3-dada-4b4f-a95b-fd103315e27f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:35.100272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-76bc6fe1-df4f-468f-9b93-bfb6ccf3a1bd req-0420b3f3-dada-4b4f-a95b-fd103315e27f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:35.112086 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-76bc6fe1-df4f-468f-9b93-bfb6ccf3a1bd req-0420b3f3-dada-4b4f-a95b-fd103315e27f service nova] Creating event network-changed:5b38bb86-0f52-40cd-bf36-9640c37bb494 for instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 on n-h2-841089-2 May 10 03:20:35.117318 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-76bc6fe1-df4f-468f-9b93-bfb6ccf3a1bd req-0420b3f3-dada-4b4f-a95b-fd103315e27f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030253 May 10 03:20:35.118119 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3651/7341] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:35.315560 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:35.323456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-79a6a832-c9f5-44b5-869a-e158c62df90f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1565 microversion: 2.1 time: 0.242260 May 10 03:20:35.324181 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3691/7342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:20:35 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1565 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:58.676723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:58.677744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:58.684073 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.684539 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.685574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.686031 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.736931 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-702b4631-33e9-409a-a9bd-c205e3e7eff5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action" status: 200 len: 24568 microversion: 2.1 time: 0.065774 May 10 03:20:58.737479 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3652/7343] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:20:58 2022] POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action => generated 24568 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:21:09.671769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8bea9a12-a136-40d7-b164-a31d757c282e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:09.677878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bea9a12-a136-40d7-b164-a31d757c282e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.678331 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8bea9a12-a136-40d7-b164-a31d757c282e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.700608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8bea9a12-a136-40d7-b164-a31d757c282e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Going to try to stop instance {{(pid=118716) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 03:21:09.741758 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8bea9a12-a136-40d7-b164-a31d757c282e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action" status: 202 len: 0 microversion: 2.1 time: 0.073884 May 10 03:21:09.742609 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3692/7344] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:21:09 2022] POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:09.752241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:09.752964 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:09.761502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.761976 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.762772 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.763258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.902318 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:09.909632 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8444ed2b-ec3c-4c88-b2ed-f0d4f4f80e9c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.162084 May 10 03:21:09.910218 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3653/7345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:09 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:10.927576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:10.928228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:10.935469 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.935927 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.936696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.937137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.069267 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:11.076737 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ac7d9660-776f-4ea1-b2df-d1b41902a52e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.153537 May 10 03:21:11.077329 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3693/7346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:10 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:12.093887 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:12.094551 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:12.101992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.102462 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.103267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.103723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.231654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:12.239509 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-921853c9-7b15-41e0-a7fe-97b9400bbfa0 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.149042 May 10 03:21:12.240111 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3654/7347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:12 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:13.257010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:13.257640 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:13.264432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.264899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.265681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.266134 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.396735 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.404205 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-69e1bb2d-e301-4fc9-b569-93e4e5950b19 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.151669 May 10 03:21:13.404792 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3694/7348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:13 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:14.421402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:14.422017 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:14.429510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.429988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.430768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.431264 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.561196 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:14.569386 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3dc4b5e6-8a7b-47f2-9f8d-cb4103d9b058 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.151750 May 10 03:21:14.570461 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3655/7349] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:14 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:15.587367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:15.587974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:15.595005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.595495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.596321 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.596774 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.792568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:15.799977 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a123dc35-8b45-4257-bf29-a5e05df56388 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.216547 May 10 03:21:15.800776 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3695/7350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:15 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:16.819112 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:16.819682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:16.826449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.826921 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.827742 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.828203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.962158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.969487 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dc550a96-a474-4d74-ba73-750cf0909fe6 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.154439 May 10 03:21:16.970062 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3656/7351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:16 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:17.985699 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:17.986435 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:17.993815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.994271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.995050 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.995516 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:18.121950 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:18.129250 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f9ffcf07-40d8-4a31-8122-e4f86bdb205b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.147495 May 10 03:21:18.129841 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3696/7352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:17 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:19.146161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:19.146786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:19.153637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:19.154103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:19.154879 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:19.155362 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:19.287175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:19.294578 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45772f82-955d-494b-b40b-5100a0c0ad4d tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1694 microversion: 2.1 time: 0.152320 May 10 03:21:19.295201 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3657/7353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:19 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:20.312542 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:20.313160 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:20.320506 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.320960 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.321738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.322186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.455723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:20.463201 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ae68002a-15fb-4b48-a19f-53191ab37ee8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1671 microversion: 2.1 time: 0.154856 May 10 03:21:20.463770 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3697/7354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:20 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:21.555917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:21.556858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:21.563869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.564340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:21.565114 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.565591 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:21.618739 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c6041ec1-23d8-475b-a0ec-43c901ad42a1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action" status: 200 len: 37720 microversion: 2.1 time: 0.066554 May 10 03:21:21.619408 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3658/7355] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:21:21 2022] POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action => generated 37720 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:21:21.631487 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f26a9aac-ab56-475d-92c9-79f700a310e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:21.638283 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f26a9aac-ab56-475d-92c9-79f700a310e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.638740 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f26a9aac-ab56-475d-92c9-79f700a310e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:21.660885 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f26a9aac-ab56-475d-92c9-79f700a310e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Going to try to start instance {{(pid=118716) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 03:21:21.701486 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f26a9aac-ab56-475d-92c9-79f700a310e9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action" status: 202 len: 0 microversion: 2.1 time: 0.074427 May 10 03:21:21.702092 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3698/7356] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:21:21 2022] POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:21.711559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:21.712280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:21.719236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.719711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:21.720498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.720961 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:22.231323 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:22.239452 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a774791f-0f53-44a0-94d0-4885681f696f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1680 microversion: 2.1 time: 0.532197 May 10 03:21:22.240036 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3659/7357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:21 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1680 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:23.258052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:23.258757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:23.265669 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:23.266127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:23.266895 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:23.267383 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:23.397261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:23.404659 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7264761c-7108-42b8-a4b3-a80122ed8eaa tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1684 microversion: 2.1 time: 0.151438 May 10 03:21:23.405231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3699/7358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:23 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:49.596494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:49.598101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:49.605435 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.605910 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.606699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.607201 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.661846 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3cccaad2-3a68-4875-9ec9-ced6c032bb66 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action" status: 200 len: 62272 microversion: 2.1 time: 0.069247 May 10 03:21:49.662546 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3660/7359] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:21:49 2022] POST /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6/action => generated 62272 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:21:56.750921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:56.751508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:56.754782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-52e54baf-a5ba-4409-bf48-254e8364422f req-f92e03e7-f7a6-448f-8cb9-61470d6cbfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6", "tag": "5b38bb86-0f52-40cd-bf36-9640c37bb494"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:56.758269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.758741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.759571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.760024 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.765189 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-52e54baf-a5ba-4409-bf48-254e8364422f req-f92e03e7-f7a6-448f-8cb9-61470d6cbfd5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.765363 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-52e54baf-a5ba-4409-bf48-254e8364422f req-f92e03e7-f7a6-448f-8cb9-61470d6cbfd5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.776936 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-52e54baf-a5ba-4409-bf48-254e8364422f req-f92e03e7-f7a6-448f-8cb9-61470d6cbfd5 service nova] Creating event network-changed:5b38bb86-0f52-40cd-bf36-9640c37bb494 for instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 on n-h2-841089-2 May 10 03:21:56.782069 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-52e54baf-a5ba-4409-bf48-254e8364422f req-f92e03e7-f7a6-448f-8cb9-61470d6cbfd5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031801 May 10 03:21:56.782964 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3661/7360] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:56.786993 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:21:56.874171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-29db8525-9163-4c61-99a0-88694301420b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 204 len: 0 microversion: 2.1 time: 0.127522 May 10 03:21:56.875528 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3700/7361] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:21:56 2022] DELETE /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:21:56.884646 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:56.885473 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:56.892715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.893487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.894286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.894790 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:57.054509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.062168 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff237bc1-f37f-4a37-93d3-1fc215eb0c91 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1690 microversion: 2.1 time: 0.182376 May 10 03:21:57.062750 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3662/7362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:56 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:58.080140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:58.080856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:58.087631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.088097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.088877 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.089323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.217991 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.225957 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a1b8fcdd-cdef-4e0f-820d-61b812dffb32 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1690 microversion: 2.1 time: 0.150103 May 10 03:21:58.226536 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3701/7363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:58 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:59.133068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-413be04c-223d-47ec-8f4b-cc5ad5e3dd56 req-fc18dd97-8903-42e0-86c4-ba2774150801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6", "name": "network-vif-deleted", "tag": "5b38bb86-0f52-40cd-bf36-9640c37bb494"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:59.142249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-413be04c-223d-47ec-8f4b-cc5ad5e3dd56 req-fc18dd97-8903-42e0-86c4-ba2774150801 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.142713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-413be04c-223d-47ec-8f4b-cc5ad5e3dd56 req-fc18dd97-8903-42e0-86c4-ba2774150801 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.154990 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-413be04c-223d-47ec-8f4b-cc5ad5e3dd56 req-fc18dd97-8903-42e0-86c4-ba2774150801 service nova] Creating event network-vif-deleted:5b38bb86-0f52-40cd-bf36-9640c37bb494 for instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 on n-h2-841089-2 May 10 03:21:59.159818 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-413be04c-223d-47ec-8f4b-cc5ad5e3dd56 req-fc18dd97-8903-42e0-86c4-ba2774150801 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031004 May 10 03:21:59.160452 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3663/7364] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:59.243561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:59.244170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:59.251328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.252064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.252851 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.253298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.284970 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.285440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.285896 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lazy-loading 'fault' on Instance uuid 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:21:59.326796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.334009 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8301e010-ebbf-4742-8a2e-bd9f71940b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 200 len: 1357 microversion: 2.1 time: 0.094577 May 10 03:21:59.334585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3702/7365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:21:59 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:00.352936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.353673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.359923 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.360391 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.361172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.361626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.375021 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] HTTP exception thrown: Instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 could not be found. May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Request method failure captured: May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 HTTP/1.1 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedjFcg7L922vc8HP_gGSjZkw4jV_gyZhFI8LgrHCNBj6feSk2xeN9Rkb87lSChP5EgEPnYxwqbhacaAKt0B6hflO9YVVh5QIdWUyiNRBqnUiIgD7jz3y2Z_MR0w3H9ykb0bB0OMXxUa4Zu6p-QjOejQnYiXpqhlGWJbmXDGGftvDGC8 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99bc8147a93448ee99d972b2fd820b20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 37c7f29840bb4875b5f068b101c05072 May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 could not be found. May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6'} May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 could not be found. May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 could not be found. May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:22:00.377009 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 could not be found. May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Returning 404 to user: Instance 80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3a3fd5cd-8521-46c9-bee0-e3cdfe62eb26 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6" status: 404 len: 111 microversion: 2.1 time: 0.030582 May 10 03:22:00.383240 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3664/7366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:00 2022] GET /compute/v2.1/servers/80cd4b38-b1c2-4eb9-97d9-7a4a60c7a9a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:22:04.130739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cafe969e-db36-4b2b-a0f6-7f02d286ad2a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '.version_select at 0x7f3d371e0d30>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.163533 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cafe969e-db36-4b2b-a0f6-7f02d286ad2a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1389238566" status: 202 len: 0 microversion: 2.1 time: 0.037422 May 10 03:22:04.168557 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3703/7367] 10.222.0.52 () {58 vars in 1283 bytes} [Tue May 10 03:22:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1389238566 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:04.196973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c7c0771c-a87a-45ea-be88-9c1f86a3e36f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: .version_select at 0x7f3d361311f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-676120523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNTwQRXxeaKuHqJvV94FrX8PZ4IPR43A6oE64JuaNFdC/dkNxGu41Cm1tp/9z7gyMnLlklPi/mzKLJF7AuRkYGpJoG6cCR7vxWg/w1G6dNkFz53YcHhtOzh3r7IWSIo0g=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:04.214365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c7c0771c-a87a-45ea-be88-9c1f86a3e36f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:22:04.220573 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-c7c0771c-a87a-45ea-be88-9c1f86a3e36f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:22:04.250000 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c7c0771c-a87a-45ea-be88-9c1f86a3e36f tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057108 May 10 03:22:04.256244 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3665/7368] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:22:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:09.762295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-584322291", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "networks": [{"uuid": "21712e40-ce00-4a12-9863-f145700c39ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-676120523", "security_groups": [{"name": "tempest-secgroup-smoke-790206426"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:09.881191 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] validate_networks() for [('21712e40-ce00-4a12-9863-f145700c39ce', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:22:10.330710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:22:10.331178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:22:10.331691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:22:10.332110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:22:10.332529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:22:10.343483 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.344046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.344866 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.345315 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.372551 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:22:10.379426 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Getting quotas for user 37c7f29840bb4875b5f068b101c05072 and project 99bc8147a93448ee99d972b2fd820b20. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:22:10.395827 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:22:10.399156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:22:10.468201 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e234d5f4-a8fd-4385-84cd-39777f98fba5 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710697 May 10 03:22:10.474485 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3704/7369] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:22:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:22:10.480744 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d954b575-a6e5-4621-89b7-18aa6f24be56 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:10.481685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d954b575-a6e5-4621-89b7-18aa6f24be56 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:10.546021 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d954b575-a6e5-4621-89b7-18aa6f24be56 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:10.561103 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d954b575-a6e5-4621-89b7-18aa6f24be56 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1265 microversion: 2.1 time: 0.084245 May 10 03:22:10.562214 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3666/7370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:10 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:11.578594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:11.579830 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:11.588102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.588498 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.589572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.590206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.681141 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:11.690401 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-90203ebc-9c3a-4f20-9628-f225c3179f05 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1325 microversion: 2.1 time: 0.115582 May 10 03:22:11.698812 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3705/7371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:11 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1325 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:12.710191 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.711187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.720768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.723148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.724305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.725026 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.923618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.933495 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fff2cd8b-39d0-47d2-a40d-c9056f91bca8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1390 microversion: 2.1 time: 0.228905 May 10 03:22:12.934102 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3667/7372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:13.235687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-68eed2a8-a5f9-4cbf-a4b3-2fae476d4c20 req-6117abae-c691-47b5-ae43-c9a116e27e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa70928-215d-4329-b329-95a1b24d1574", "tag": "1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:13.246919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-68eed2a8-a5f9-4cbf-a4b3-2fae476d4c20 req-6117abae-c691-47b5-ae43-c9a116e27e60 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.247632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-68eed2a8-a5f9-4cbf-a4b3-2fae476d4c20 req-6117abae-c691-47b5-ae43-c9a116e27e60 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.260795 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-68eed2a8-a5f9-4cbf-a4b3-2fae476d4c20 req-6117abae-c691-47b5-ae43-c9a116e27e60 service nova] Creating event network-changed:1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f for instance 4aa70928-215d-4329-b329-95a1b24d1574 on n-h2-841089-2 May 10 03:22:13.266653 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-68eed2a8-a5f9-4cbf-a4b3-2fae476d4c20 req-6117abae-c691-47b5-ae43-c9a116e27e60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038400 May 10 03:22:13.267519 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3706/7373] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:13.951960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:13.952704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:13.960136 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.960606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.961626 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.962092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.098427 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:14.105828 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-805ab7cb-8f5d-4130-8627-933970e0d34e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1390 microversion: 2.1 time: 0.157777 May 10 03:22:14.106414 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3668/7374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:13 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:15.124074 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:15.124788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:15.132780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.133233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.134018 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.134464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.270899 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:15.278171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c0c3e9ed-3d8a-466e-bdec-00ec03d710d8 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1390 microversion: 2.1 time: 0.158468 May 10 03:22:15.278755 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3707/7375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:15 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:16.294931 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:16.295696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:16.302313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.302782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.303824 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.304278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.433980 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:16.442202 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-43214a73-261c-43c8-99ae-2de1616aecb9 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1390 microversion: 2.1 time: 0.151106 May 10 03:22:16.442780 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3669/7376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:16 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:17.459657 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:17.460281 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:17.466949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:17.467681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:17.468488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:17.468951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:17.602436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:17.609710 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9d299ce0-369d-4d06-98f4-6738ae02641c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1390 microversion: 2.1 time: 0.154734 May 10 03:22:17.610285 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3708/7377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:17 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:17.963259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-bdc0170c-d582-4107-9fa5-584aa02f1820 req-d1f62eec-6120-49ad-9a6b-7a24f119e0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa70928-215d-4329-b329-95a1b24d1574", "name": "network-vif-plugged", "status": "completed", "tag": "1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:17.972470 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bdc0170c-d582-4107-9fa5-584aa02f1820 req-d1f62eec-6120-49ad-9a6b-7a24f119e0c9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:17.973037 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-bdc0170c-d582-4107-9fa5-584aa02f1820 req-d1f62eec-6120-49ad-9a6b-7a24f119e0c9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:17.984036 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-bdc0170c-d582-4107-9fa5-584aa02f1820 req-d1f62eec-6120-49ad-9a6b-7a24f119e0c9 service nova] Creating event network-vif-plugged:1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f for instance 4aa70928-215d-4329-b329-95a1b24d1574 on n-h2-841089-2 May 10 03:22:17.990468 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-bdc0170c-d582-4107-9fa5-584aa02f1820 req-d1f62eec-6120-49ad-9a6b-7a24f119e0c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096633 May 10 03:22:17.991103 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3670/7378] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:18.626265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:18.626884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:18.633748 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.634205 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.634983 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.635453 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.766825 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:18.774663 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c773fe2e-3c87-44b8-ac0f-9bb045cb9a1a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1390 microversion: 2.1 time: 0.152403 May 10 03:22:18.775278 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3709/7379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:18 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:19.792286 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:19.793009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:19.799781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.800291 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.801080 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.801543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.929984 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:19.937636 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4db57b64-f8b0-4ced-b833-a2b53220edf1 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1562 microversion: 2.1 time: 0.149669 May 10 03:22:19.938215 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3671/7380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:19 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:19.953919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:19.954541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:19.961966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.962436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.963241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.963691 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:20.094995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:20.102645 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a8ac8f10-24e6-4866-9aa5-0d4dc9bd3084 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1562 microversion: 2.1 time: 0.152676 May 10 03:22:20.103260 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3710/7381] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:19 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:22.001643 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:22.006984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-8ced66d6-b664-43b7-89fd-66c0d81783cf req-a0f9efbf-44b2-48ac-97bf-fcf062879632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa70928-215d-4329-b329-95a1b24d1574", "tag": "1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:22.012197 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:22.019589 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8ced66d6-b664-43b7-89fd-66c0d81783cf req-a0f9efbf-44b2-48ac-97bf-fcf062879632 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.019762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.020044 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-8ced66d6-b664-43b7-89fd-66c0d81783cf req-a0f9efbf-44b2-48ac-97bf-fcf062879632 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.020260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.021059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.021529 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.034034 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-8ced66d6-b664-43b7-89fd-66c0d81783cf req-a0f9efbf-44b2-48ac-97bf-fcf062879632 service nova] Creating event network-changed:1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f for instance 4aa70928-215d-4329-b329-95a1b24d1574 on n-h2-841089-2 May 10 03:22:22.039938 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-8ced66d6-b664-43b7-89fd-66c0d81783cf req-a0f9efbf-44b2-48ac-97bf-fcf062879632 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 May 10 03:22:22.040557 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3711/7382] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:22.238618 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:22.246327 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d18c6217-0df5-449c-9335-31b8d9781912 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1562 microversion: 2.1 time: 0.248681 May 10 03:22:22.246913 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3672/7383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:21 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:45.535865 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:45.536870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:45.543340 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:45.543814 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:45.544603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:45.545114 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:45.600323 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b7790f6b-4812-49b8-ad2c-a04f7d741c92 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action" status: 200 len: 24573 microversion: 2.1 time: 0.069837 May 10 03:22:45.601015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3712/7384] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:22:45 2022] POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:22:56.499198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:56.499788 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:56.505836 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:56.506314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:56.507132 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:56.507601 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:56.529955 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lazy-loading 'flavor' on Instance uuid 4aa70928-215d-4329-b329-95a1b24d1574 {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:22:56.595027 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ee506633-f9fd-4fce-a067-f4a68bb62b08 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action" status: 202 len: 0 microversion: 2.1 time: 0.100066 May 10 03:22:56.595701 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3673/7385] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:22:56 2022] POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:56.604891 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:56.605597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:56.613722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:56.614388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:56.615464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:56.615922 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:56.753060 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:56.760671 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1977a543-b493-4bb4-bd4f-2672e5fd4a35 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1688 microversion: 2.1 time: 0.159965 May 10 03:22:56.761244 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3713/7386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:56 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:57.778736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:57.779488 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:57.786350 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:57.786821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:57.787644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:57.788105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:57.916866 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:57.924590 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e113d546-f54d-404c-8574-8fa5e6f79487 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1671 microversion: 2.1 time: 0.151087 May 10 03:22:57.925169 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3674/7387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:57 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:59.017051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:59.017984 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:59.025597 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:59.026058 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:59.026835 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:59.027329 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:59.089452 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2212b6f1-7f37-47af-8475-6bc5ff81a46a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action" status: 200 len: 38176 microversion: 2.1 time: 0.076219 May 10 03:22:59.090117 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3714/7388] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:22:59 2022] POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action => generated 38176 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:22:59.101328 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:59.101877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:59.108599 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:59.109064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:59.109839 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:59.110293 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:59.177630 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ce1f1e43-1fe7-42f5-8d23-cca13ce8901b tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action" status: 202 len: 0 microversion: 2.1 time: 0.079935 May 10 03:22:59.178197 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3675/7389] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:22:59 2022] POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:59.187557 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:59.188280 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:59.195943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:59.196441 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:59.197335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:59.197790 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:59.408261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:59.415827 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-77c4d24e-3169-43ad-aa84-c92f2c62670c tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1677 microversion: 2.1 time: 0.232897 May 10 03:22:59.416540 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3715/7390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:22:59 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:00.434275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:00.434992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:00.442882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.443376 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.444159 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.444613 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.582747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:00.590594 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-55a42b8d-007a-4810-b873-fdadeb46c59e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1677 microversion: 2.1 time: 0.160471 May 10 03:23:00.591198 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3676/7391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:00 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:01.608507 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:01.609121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:01.617232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.617696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.618505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.618954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.754555 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:01.762680 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f49611fc-2051-4029-a507-0590bd88f58e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1680 microversion: 2.1 time: 0.158137 May 10 03:23:01.763344 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3716/7392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:01 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:01.852366 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:01.853339 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:01.860102 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.860509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.861288 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.861743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.902286 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7e023d04-90fb-4e37-8ab6-27b657f65e74 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action" status: 200 len: 38176 microversion: 2.1 time: 0.053756 May 10 03:23:01.902913 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3677/7393] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:23:01 2022] POST /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574/action => generated 38176 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:23:02.923439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:02.924741 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:02.948995 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.950653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.951977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.952672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.981480 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:23:03.044542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9669684f-b834-436b-b3a6-9e9989709cf0 req-74297e0a-2611-4293-acd5-afea5495d86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa70928-215d-4329-b329-95a1b24d1574", "tag": "1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:03.057103 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9669684f-b834-436b-b3a6-9e9989709cf0 req-74297e0a-2611-4293-acd5-afea5495d86b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.058081 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9669684f-b834-436b-b3a6-9e9989709cf0 req-74297e0a-2611-4293-acd5-afea5495d86b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.072643 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9669684f-b834-436b-b3a6-9e9989709cf0 req-74297e0a-2611-4293-acd5-afea5495d86b service nova] Creating event network-changed:1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f for instance 4aa70928-215d-4329-b329-95a1b24d1574 on n-h2-841089-2 May 10 03:23:03.080160 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9669684f-b834-436b-b3a6-9e9989709cf0 req-74297e0a-2611-4293-acd5-afea5495d86b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152036 May 10 03:23:03.081522 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3678/7394] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:03.088033 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-04800308-8237-4726-a890-35407f42361a tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 204 len: 0 microversion: 2.1 time: 0.168231 May 10 03:23:03.089063 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3717/7395] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:23:02 2022] DELETE /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:23:03.098768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:03.100030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:03.108246 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.108800 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.109686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.110150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.257137 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:03.266234 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e71531cf-8162-4a24-8f5f-e986eababe50 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1686 microversion: 2.1 time: 0.172627 May 10 03:23:03.267486 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3679/7396] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:03 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:04.285403 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:04.286108 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:04.292631 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.293089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.293856 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.294300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.431265 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:04.438960 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-00f272af-bcb9-400c-a4c7-1e97d6bc5026 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1686 microversion: 2.1 time: 0.158140 May 10 03:23:04.439565 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3718/7397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:04 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:05.457410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:05.458039 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:05.464798 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.465263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.466053 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.466504 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.762898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f29840bb4875b5f068b101c05072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc8147a93448ee99d972b2fd820b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:05.770516 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b2fa905c-a88d-4e0d-9468-e8edcdac8d41 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 200 len: 1686 microversion: 2.1 time: 0.317631 May 10 03:23:05.771235 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3680/7398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:05 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 1686 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:05.949603 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-74cda0ef-5d8b-41e3-b244-e7a48fedbf47 req-ab0145b4-d9a9-45e0-8b06-b8382640e422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa70928-215d-4329-b329-95a1b24d1574", "name": "network-vif-deleted", "tag": "1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:05.960247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-74cda0ef-5d8b-41e3-b244-e7a48fedbf47 req-ab0145b4-d9a9-45e0-8b06-b8382640e422 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.960709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-74cda0ef-5d8b-41e3-b244-e7a48fedbf47 req-ab0145b4-d9a9-45e0-8b06-b8382640e422 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.972977 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-74cda0ef-5d8b-41e3-b244-e7a48fedbf47 req-ab0145b4-d9a9-45e0-8b06-b8382640e422 service nova] Creating event network-vif-deleted:1e8b7a8d-5186-4489-bcaa-8ea97f8e6b7f for instance 4aa70928-215d-4329-b329-95a1b24d1574 on n-h2-841089-2 May 10 03:23:05.979427 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-74cda0ef-5d8b-41e3-b244-e7a48fedbf47 req-ab0145b4-d9a9-45e0-8b06-b8382640e422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 May 10 03:23:05.980055 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3719/7399] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:06.788610 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:06.789249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] [instance: 4aa70928-215d-4329-b329-95a1b24d1574] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:06.796139 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.796647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.797439 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.797902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.812064 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] HTTP exception thrown: Instance 4aa70928-215d-4329-b329-95a1b24d1574 could not be found. May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Request method failure captured: May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 HTTP/1.1 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedjFcg7L922vc8HP_gGSjZkw4jV_gyZhFI8LgrHCNBj6feSk2xeN9Rkb87lSChP5EgEPnYxwqbhacaAKt0B6hflO9YVVh5QIdWUyiNRBqnUiIgD7jz3y2Z_MR0w3H9ykb0bB0OMXxUa4Zu6p-QjOejQnYiXpqhlGWJbmXDGGftvDGC8 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99bc8147a93448ee99d972b2fd820b20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99bc8147a93448ee99d972b2fd820b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: 99bc8147a93448ee99d972b2fd820b20 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1374063873 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 37c7f29840bb4875b5f068b101c05072 May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1374063873-project May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance 4aa70928-215d-4329-b329-95a1b24d1574 could not be found. May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': '4aa70928-215d-4329-b329-95a1b24d1574'} May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa70928-215d-4329-b329-95a1b24d1574 could not be found. May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa70928-215d-4329-b329-95a1b24d1574 could not be found. May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:23:06.813830 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa70928-215d-4329-b329-95a1b24d1574 could not be found. May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Returning 404 to user: Instance 4aa70928-215d-4329-b329-95a1b24d1574 could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-906e955d-4cc5-4427-a836-d0607a73ed1e tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574" status: 404 len: 111 microversion: 2.1 time: 0.030582 May 10 03:23:06.820413 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3681/7400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:06 2022] GET /compute/v2.1/servers/4aa70928-215d-4329-b329-95a1b24d1574 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:23:10.153344 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2ae11a6e-2564-44d8-8107-8c70b4164a89 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] Calling method '.version_select at 0x7f3d36e8a8b0>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:10.176825 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2ae11a6e-2564-44d8-8107-8c70b4164a89 tempest-TestNetworkAdvancedServerOps-1374063873 tempest-TestNetworkAdvancedServerOps-1374063873-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-676120523" status: 202 len: 0 microversion: 2.1 time: 0.027675 May 10 03:23:10.178211 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3720/7401] 10.222.0.52 () {58 vars in 1280 bytes} [Tue May 10 03:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-676120523 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:23:21.338403 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3542adbe-05ae-4633-b711-c9bef33e3b4c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'create', calling method: .version_select at 0x7f3d35c78ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-982309564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHZ/c3Ujb8eb5E4o+KN/CVrlwqXkRdWxKyQnQtZX06vaMmXRbULpwJOkarcNNcHQz/HNWE6IJCytivRcI79YWqQmBEgPmcvUbz8pwc2n4QRGFdXycLeCepOtnX5GSskjA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:21.354378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3542adbe-05ae-4633-b711-c9bef33e3b4c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for project e1bca6e352c04b20a40cba21e343da97. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:21.360793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-3542adbe-05ae-4633-b711-c9bef33e3b4c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for user 0ffdb51f84254d24967df233057f0ca9 and project e1bca6e352c04b20a40cba21e343da97. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:21.394799 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3542adbe-05ae-4633-b711-c9bef33e3b4c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.217249 May 10 03:23:21.395792 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3682/7402] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:23:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:22.418353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1479206594", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-982309564", "security_groups": [{"name": "tempest-secgroup-smoke-476627341"}], "networks": [{"uuid": "23d75947-b79e-44f4-ae75-6c038092c5ce"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:22.526951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] validate_networks() for [('23d75947-b79e-44f4-ae75-6c038092c5ce', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:23:22.938295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:23:22.938725 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:23:22.939245 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:23:22.940196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:23:22.940601 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:23:22.949690 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.950432 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.950952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.951431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.969684 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for project e1bca6e352c04b20a40cba21e343da97. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:22.975334 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for user 0ffdb51f84254d24967df233057f0ca9 and project e1bca6e352c04b20a40cba21e343da97. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:22.989038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:23:22.991459 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:23:23.040718 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-935c5048-da50-4348-9b7d-d0ad20a4f29d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.627182 May 10 03:23:23.041760 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3721/7403] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:23:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:23:23.051522 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b55da0e8-8d06-45f0-be3d-ce4f5e276cd6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:23.052175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b55da0e8-8d06-45f0-be3d-ce4f5e276cd6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.123925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b55da0e8-8d06-45f0-be3d-ce4f5e276cd6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.131707 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b55da0e8-8d06-45f0-be3d-ce4f5e276cd6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1246 microversion: 2.1 time: 0.083848 May 10 03:23:23.132635 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3683/7404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:23 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:24.151254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:24.151919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:24.160431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.161144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.162718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.163367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.263634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.274971 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-57c0c63f-a966-4f6f-a857-9f7c5ff6f430 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1306 microversion: 2.1 time: 0.128574 May 10 03:23:24.275808 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3722/7405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:24 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:25.295448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:25.296092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:25.317448 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.317930 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.321192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.321968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.555337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:25.567805 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f56d4551-8a57-4952-b81d-b9ada5ef759f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.277680 May 10 03:23:25.569600 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3684/7406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:25 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:25.898066 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-01b90197-c4c8-4945-8d21-6fe327fe4bbb req-d641d5e1-2f24-4a38-856c-4b862c6d6dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:25.907511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-01b90197-c4c8-4945-8d21-6fe327fe4bbb req-d641d5e1-2f24-4a38-856c-4b862c6d6dc9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.907969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-01b90197-c4c8-4945-8d21-6fe327fe4bbb req-d641d5e1-2f24-4a38-856c-4b862c6d6dc9 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.928421 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-01b90197-c4c8-4945-8d21-6fe327fe4bbb req-d641d5e1-2f24-4a38-856c-4b862c6d6dc9 service nova] Creating event network-changed:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:23:25.944826 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-01b90197-c4c8-4945-8d21-6fe327fe4bbb req-d641d5e1-2f24-4a38-856c-4b862c6d6dc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050376 May 10 03:23:25.945449 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3723/7407] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:26.586138 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:26.586871 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:26.593763 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:26.594225 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:26.595025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:26.595514 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:26.731894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:26.739928 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-219dca46-bcae-4286-8a5f-2f420c76d0a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.157902 May 10 03:23:26.740510 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3685/7408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:26 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:27.758709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:27.759443 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:27.765679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:27.766204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:27.766920 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:27.767399 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:27.977438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:27.985515 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-de073ed4-272d-4858-9598-6c8c89112f29 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.231834 May 10 03:23:27.986130 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3724/7409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:27 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:29.002805 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:29.003483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:29.010258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.010735 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.012110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.012110 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.140786 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:29.148797 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-69ce8990-cfc1-43a9-b8d2-b82b1d5a2875 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.149923 May 10 03:23:29.149384 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3686/7410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:28 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:30.165986 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:30.166621 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:30.173472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.174442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.175269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.175722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.310521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:30.318840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-608f4583-b948-4b7b-b9ef-1e8319a503e4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.156938 May 10 03:23:30.319589 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3725/7411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:30 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:31.336304 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:31.336947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:31.343835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.344321 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.345096 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.345556 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.487443 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:31.496044 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7dbd8046-138c-441b-91b5-1ddb02cf04b9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.163629 May 10 03:23:31.496632 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3687/7412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:31 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:32.265773 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-01c6e891-486c-418c-9e61-ea722f1bdf56 req-4c6a682e-8e1f-4ad0-b059-3aa254abcda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "name": "network-vif-plugged", "status": "completed", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:32.275777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-01c6e891-486c-418c-9e61-ea722f1bdf56 req-4c6a682e-8e1f-4ad0-b059-3aa254abcda2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.275951 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-01c6e891-486c-418c-9e61-ea722f1bdf56 req-4c6a682e-8e1f-4ad0-b059-3aa254abcda2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.287648 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-01c6e891-486c-418c-9e61-ea722f1bdf56 req-4c6a682e-8e1f-4ad0-b059-3aa254abcda2 service nova] Creating event network-vif-plugged:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:23:32.292767 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-01c6e891-486c-418c-9e61-ea722f1bdf56 req-4c6a682e-8e1f-4ad0-b059-3aa254abcda2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030575 May 10 03:23:32.293504 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3726/7413] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:32.513424 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:32.514056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:32.520804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.521280 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.522065 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.522524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.656123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:32.663926 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f64b29d6-7127-4839-9125-529bcf9abab1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.154454 May 10 03:23:32.664503 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3688/7414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:32 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:33.682496 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:33.683235 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:33.689756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.690210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.691030 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.691501 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.822772 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:33.830078 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cc39b90c-8e47-4c3a-ac3b-d99677e36834 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1371 microversion: 2.1 time: 0.152598 May 10 03:23:33.830656 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3727/7415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:33 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:34.846873 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:34.848074 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:34.854828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.855340 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.856123 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.856583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.984856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:34.992203 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-290cf862-20ab-4f3b-829b-13ab5dc62349 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1554 microversion: 2.1 time: 0.149204 May 10 03:23:34.992773 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3689/7416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:34 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:35.008470 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:35.009095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:35.015549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:35.016010 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:35.016791 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:35.017240 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:35.153503 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:35.160827 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7e70bf4a-488a-4fbe-89e5-8f7ba6cfdc93 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1554 microversion: 2.1 time: 0.156174 May 10 03:23:35.161401 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3728/7417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:23:35 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:36.837474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fc5538c0-cb5d-47ef-a9b8-0e60460ab903 req-5c7f1d45-ef8a-4046-94e9-0d03309ba1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:36.846222 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fc5538c0-cb5d-47ef-a9b8-0e60460ab903 req-5c7f1d45-ef8a-4046-94e9-0d03309ba1bd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:36.846693 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fc5538c0-cb5d-47ef-a9b8-0e60460ab903 req-5c7f1d45-ef8a-4046-94e9-0d03309ba1bd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:36.861259 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fc5538c0-cb5d-47ef-a9b8-0e60460ab903 req-5c7f1d45-ef8a-4046-94e9-0d03309ba1bd service nova] Creating event network-changed:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:23:36.866309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fc5538c0-cb5d-47ef-a9b8-0e60460ab903 req-5c7f1d45-ef8a-4046-94e9-0d03309ba1bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032514 May 10 03:23:36.866923 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3690/7418] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:32.940525 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:24:32.941276 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:25:34.142118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:34.142726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:34.149261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:34.149722 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:34.150493 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:34.150938 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:34.172733 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lazy-loading 'flavor' on Instance uuid b66094dd-d026-4269-b7ca-f59036347f7b {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:25:34.608212 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [845f7b86-84f4-4893-9e67-52eb49aa011a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:25:35.615025 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [845f7b86-84f4-4893-9e67-52eb49aa011a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55920. May 10 03:25:35.618395 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-468bb510-64f8-4907-9636-920d1e6d5176 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b/action" status: 202 len: 0 microversion: 2.1 time: 1.481545 May 10 03:25:35.619052 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3729/7419] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:25:34 2022] POST /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b/action => generated 0 bytes in 1483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:25:35.625305 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0968db2a-2d0b-43e2-b8b2-6e69cd99a6e8] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:25:35.626121 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6038478-86ec-47d6-809b-459960bbf559] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:25:35.631025 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:35.631765 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:35.638758 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:35.639272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:35.640049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:35.640502 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:35.828631 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:35.839045 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ff9d1378-0967-491d-922d-d7eb957c3752 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.215498 May 10 03:25:35.839653 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3691/7420] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:35 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:36.857796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:36.858538 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:36.864897 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:36.865354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:36.866129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:36.866576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:36.994780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:37.002175 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-708a49b9-af03-4f6d-a187-33b627cc9d1f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.149524 May 10 03:25:37.002754 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3730/7421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:36 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:38.019898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:38.020537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:38.033564 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:38.034044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:38.034840 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:38.035326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:38.042073 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6038478-86ec-47d6-809b-459960bbf559] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55934. May 10 03:25:38.053654 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] [0968db2a-2d0b-43e2-b8b2-6e69cd99a6e8] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55932. May 10 03:25:38.167129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:38.174470 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ddcbe0e8-e908-45ab-b5c2-f2a2be2d270e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.158543 May 10 03:25:38.175048 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3692/7422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:38 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:39.192190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:39.193389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:39.200335 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:39.200797 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:39.201571 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:39.202020 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:39.337190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:39.344637 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-476b7453-e9ce-4e2b-be4d-67abc28367bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.156369 May 10 03:25:39.345213 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3731/7423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:39 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:40.361825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:40.362499 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:40.369335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:40.369810 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:40.370594 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:40.371052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:40.503555 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:40.511662 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3043f9f5-e608-44ff-b3ff-f8efd857995c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.153805 May 10 03:25:40.512351 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3693/7424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:40 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:41.529095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:41.529718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:41.536458 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:41.536916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:41.537688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:41.538129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:41.670952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:41.678364 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-734d76a3-69cf-451d-bab2-c1b6b179b5bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.153180 May 10 03:25:41.678947 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3732/7425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:41 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:42.696226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:42.696867 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:42.703658 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:42.704127 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:42.704914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:42.705370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:42.832657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:42.839957 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-771dc96a-fb3c-415a-bb15-99dd4268598a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.148282 May 10 03:25:42.840561 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3694/7426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:42 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:43.857390 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:43.858017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:43.865389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:43.865850 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:43.866630 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:43.867098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:43.997037 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:44.004429 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-61160535-acc7-4fbb-adc2-013636c999a4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.151011 May 10 03:25:44.005011 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3733/7427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:43 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:45.021482 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:45.022106 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:45.028920 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:45.029397 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:45.030184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:45.030648 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:45.161731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:45.169071 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fe07d1dd-b5fa-4d19-a1c0-5b421cf3dfe5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.151550 May 10 03:25:45.169640 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3695/7428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:45 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:46.186921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:46.187563 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:46.194013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:46.194485 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:46.195271 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:46.195713 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:46.322793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:46.330124 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-91b057ef-6eb9-4b04-845e-eaab247923bc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.147437 May 10 03:25:46.330694 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3734/7429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:46 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:47.347682 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:47.348313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:47.355045 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:47.355540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:47.356315 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:47.356768 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:47.491236 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:47.499249 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f293d3a4-fffc-486a-813f-6044dd5f598d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.155510 May 10 03:25:47.500137 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3696/7430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:47 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:48.516495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:48.517129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:48.523949 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:48.524412 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:48.525202 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:48.525635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:48.654837 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:48.662993 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d1fb7568-bb10-4688-b38f-6fa0023a723f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.150413 May 10 03:25:48.663599 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3735/7431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:48 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:49.680279 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:49.680942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:49.687919 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:49.688381 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:49.689153 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:49.689602 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:49.824233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:49.831603 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-62824eb7-d23b-4edd-aed0-ca6aa382934f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.155365 May 10 03:25:49.832174 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3697/7432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:49 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:50.848322 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:50.848982 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:50.856451 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:50.856914 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:50.857703 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:50.858154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:50.986659 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:50.994021 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-97696d91-dae7-4bb4-9bf7-90bcf2ad2160 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.149672 May 10 03:25:50.994598 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3736/7433] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:50 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:52.011082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:52.011794 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:52.018676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.019181 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.019979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.020441 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.148407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:52.155844 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-270d560e-03c0-49a7-bc0b-0abd6bc95741 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1700 microversion: 2.1 time: 0.148767 May 10 03:25:52.156446 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3698/7434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:52 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1700 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:53.174097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:53.174815 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:53.182843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:53.184345 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:53.185650 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:53.186320 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:53.341481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:53.349138 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-63ffb341-301d-44ab-895c-0ce762e10c1d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.179047 May 10 03:25:53.360863 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3737/7435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:53 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:25:54.367537 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:54.368174 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:54.380469 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.381069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.381936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.382628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.548627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.557246 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-99640943-733d-4315-97bd-7a3799868d76 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.194156 May 10 03:25:54.567739 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3699/7436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:54 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:55.141442 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-a785501c-04b5-4d6d-9b56-0705ecbdffa0 req-a8cfe5ef-0f72-4d20-ba7a-fc24add435d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "name": "network-vif-plugged", "status": "completed", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:55.150941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a785501c-04b5-4d6d-9b56-0705ecbdffa0 req-a8cfe5ef-0f72-4d20-ba7a-fc24add435d2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.151628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-a785501c-04b5-4d6d-9b56-0705ecbdffa0 req-a8cfe5ef-0f72-4d20-ba7a-fc24add435d2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.167155 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-a785501c-04b5-4d6d-9b56-0705ecbdffa0 req-a8cfe5ef-0f72-4d20-ba7a-fc24add435d2 service nova] Creating event network-vif-plugged:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:25:55.172888 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-a785501c-04b5-4d6d-9b56-0705ecbdffa0 req-a8cfe5ef-0f72-4d20-ba7a-fc24add435d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035153 May 10 03:25:55.174071 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3738/7437] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:55.575100 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:55.575699 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:55.587385 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.587849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.588863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.589316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.768624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:55.778123 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f398668e-b4a2-4b8f-acbc-d090411c2241 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.207029 May 10 03:25:55.779127 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3700/7438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:55 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:56.805404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:56.806859 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:56.815705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.816828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.817710 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.818170 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.970840 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:56.978984 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ee1d07e3-e396-43b3-9cb4-302df0dffe37 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.187152 May 10 03:25:56.979913 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3739/7439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:56 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:57.996066 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:57.998414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:58.008828 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.009311 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.010387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.010851 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.160316 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:58.167886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3abd966a-dc49-4b4c-8363-efd309feb93b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.175731 May 10 03:25:58.177560 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3701/7440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:57 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:59.185076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:59.186052 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:59.193352 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.196187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.196187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.196187 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.343081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:59.353458 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-49772a39-064b-4aa6-a0fd-0d0ff9aa6cb7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.172187 May 10 03:25:59.354060 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3740/7441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:25:59 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:00.370532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:00.371942 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:00.380213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.380690 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.381518 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.381973 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.528048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:00.538144 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b10153da-705b-4fd6-9625-a27aceb7b781 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.171453 May 10 03:26:00.538813 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3702/7442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:00 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:01.555997 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:01.556620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:01.564112 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:01.564577 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:01.565396 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:01.565849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:01.728736 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:01.736420 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed9fb560-242c-4c60-bc16-e0c5bd69a2ce tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1695 microversion: 2.1 time: 0.184815 May 10 03:26:01.737010 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3741/7443] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:01 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:02.753568 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:02.754199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:02.761898 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:02.762480 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:02.763640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:02.764047 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:02.981880 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:02.990737 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b5e016ba-ad25-413e-8b43-99d2f64caf2e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1677 microversion: 2.1 time: 0.240957 May 10 03:26:02.991476 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3703/7444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:02 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:04.008448 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:04.009178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:04.016137 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.016599 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.017375 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.017822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.153428 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:04.160943 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ea3d312-062d-4331-a930-f77ab209f0c7 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1677 microversion: 2.1 time: 0.156411 May 10 03:26:04.162063 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3742/7445] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:04 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:05.163890 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:05.174936 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.175902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.178711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:05.179989 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:05.186944 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.187440 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.188238 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.188688 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.188806 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] Creating event network-vif-unplugged:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:26:05.192537 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] [347646dd-fdbc-4edc-9ee4-fc7b22e3918a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:26:05.322757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:05.330293 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-09450380-d14f-49c4-94a0-f140ed62c7c6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1680 microversion: 2.1 time: 0.155894 May 10 03:26:05.330882 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3743/7446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:05 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:05.347541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:05.348138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:05.354510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.354976 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.356071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.356552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.446794 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [2578d95e-c7ef-4672-bb3b-885ad1afb475] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:26:06.199687 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] [347646dd-fdbc-4edc-9ee4-fc7b22e3918a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56040. May 10 03:26:06.203236 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-f99638fe-704f-4241-8217-99cb3cc80858 req-31db2bf1-4000-4956-8e8d-b9c487a169ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.044759 May 10 03:26:06.203860 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3704/7447] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:06.453920 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [2578d95e-c7ef-4672-bb3b-885ad1afb475] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56042. May 10 03:26:06.457472 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-28fa2e59-3bb2-4d5b-b6e6-49f6b700f321 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b/action" status: 202 len: 0 microversion: 2.1 time: 1.114534 May 10 03:26:06.458294 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3744/7448] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:26:05 2022] POST /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:26:06.466830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:06.467584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:06.473695 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:06.474673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:06.475494 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:06.475951 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:06.614842 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:06.622378 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-989d08a3-46b2-4504-9b39-1cae8b54fce4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1628 microversion: 2.1 time: 0.159840 May 10 03:26:06.623219 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3705/7449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:06 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1628 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:07.641214 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:07.641842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:07.648792 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:07.649254 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:07.650065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:07.650511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:07.854948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:07.862366 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d2cef847-deb5-46c0-90ca-1ab02dde960c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.225890 May 10 03:26:07.862952 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3745/7450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:07 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:08.881727 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:08.882375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:08.889149 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:08.890014 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:08.891249 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:08.891953 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:09.030992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:09.038536 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c5486501-2024-4693-ae09-ba80828d2ae1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.161876 May 10 03:26:09.039134 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3706/7451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:08 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:10.056261 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:10.057127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:10.064903 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:10.065369 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:10.066156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:10.066812 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:10.210076 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:10.219295 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-955dd6c3-6f67-4f8c-92e6-e315c8019ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.167000 May 10 03:26:10.228951 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3746/7452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:10 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:11.236825 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:11.237563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:11.244796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:11.245378 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:11.246282 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:11.246821 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:11.392285 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:11.400628 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6dc1e30a-892b-4a72-8d6f-da7cdd7d036d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.167617 May 10 03:26:11.401286 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3707/7453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:11 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:12.418450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:12.419628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:12.428953 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:12.429561 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:12.430360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:12.430810 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:12.578857 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:12.587749 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9a26ebd6-f47e-483a-b06b-f67a3bf0ef42 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.173332 May 10 03:26:12.588346 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3747/7454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:12 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:12.932392 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:26:12.933060 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:26:13.357284 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:26:13.357543 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:26:13.606010 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:13.606968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:13.615122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:13.615515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:13.616500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:13.617042 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:13.759896 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:13.768558 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9810ee20-3815-4bfa-a488-634c83af293e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.166118 May 10 03:26:13.768558 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3708/7455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:13 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:14.785505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:14.786199 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:14.793593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:14.794195 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:14.795123 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:14.795653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:14.993013 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:15.002852 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-474d4d0c-35b6-432f-b7f7-1d28fb73baaf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.221331 May 10 03:26:15.006493 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3748/7456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:14 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:16.023200 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:16.023822 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:16.030793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:16.031335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:16.032120 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:16.032582 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:16.170030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:16.177450 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-12210d22-fdb9-4f32-8f87-b1ece7a84de5 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.158905 May 10 03:26:16.178031 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3709/7457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:16 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:17.194864 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:17.195687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:17.202113 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:17.202568 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:17.203370 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:17.203822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:17.331436 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:17.339246 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-34009b11-0c21-42b7-918c-507e479c4bcf tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.148457 May 10 03:26:17.339820 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3749/7458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:17 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:18.356911 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:18.357542 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:18.365161 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:18.365630 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:18.366412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:18.366863 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:18.493290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:18.500697 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2a436b1f-db97-488e-b75f-7f27873bd8f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.147782 May 10 03:26:18.501276 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3710/7459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:18 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:19.517769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:19.518430 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:19.525405 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:19.525861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:19.526632 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:19.527089 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:19.699363 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:19.707096 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-78eb3ca6-c98a-4bcb-b19c-3e612c04a8a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.193321 May 10 03:26:19.707940 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3750/7460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:19 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:20.724105 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:20.724676 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:20.731472 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:20.731947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:20.732731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:20.733192 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:20.860883 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:20.871412 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-8a700651-58cf-4f36-a7da-7b580a5815c8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.151259 May 10 03:26:20.872002 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3711/7461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:20 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:21.304456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-b4282c44-d537-4a7c-a686-e3653d2d8297 req-c0d2308e-970c-4749-9855-d5a9e6d0564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "name": "network-vif-plugged", "status": "completed", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:21.314289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b4282c44-d537-4a7c-a686-e3653d2d8297 req-c0d2308e-970c-4749-9855-d5a9e6d0564d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:21.314749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-b4282c44-d537-4a7c-a686-e3653d2d8297 req-c0d2308e-970c-4749-9855-d5a9e6d0564d service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:21.326048 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-b4282c44-d537-4a7c-a686-e3653d2d8297 req-c0d2308e-970c-4749-9855-d5a9e6d0564d service nova] Creating event network-vif-plugged:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:26:21.331456 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-b4282c44-d537-4a7c-a686-e3653d2d8297 req-c0d2308e-970c-4749-9855-d5a9e6d0564d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031408 May 10 03:26:21.332231 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3751/7462] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:21.889368 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:21.889943 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:21.897260 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:21.897731 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:21.898523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:21.898986 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:22.030536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:22.037956 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f600aa03-9116-4d7b-bd9e-6220539c68a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.152704 May 10 03:26:22.038531 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3712/7463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:21 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:23.055638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:23.056376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:23.064091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:23.064554 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:23.065348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:23.065965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:23.203415 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:23.211494 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21277673-b5a5-4bd4-a15b-dbda192c23ae tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1686 microversion: 2.1 time: 0.160657 May 10 03:26:23.212100 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3752/7464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:23 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:26:24.228651 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:24.229426 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:24.236258 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:24.236733 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:24.237515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:24.237972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:24.368625 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:24.376041 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b08265b4-c830-4bac-ba84-523a1e8c75bb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1673 microversion: 2.1 time: 0.151332 May 10 03:26:24.376616 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3713/7465] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:26:24 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:38.661756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:38.662355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:38.668232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-031116f3-3c9b-4065-9900-26ba9f3fc015 req-5bfd8624-a391-47c5-a168-37c7352d1f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:38.668696 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.669046 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.669919 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.670427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.677653 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-031116f3-3c9b-4065-9900-26ba9f3fc015 req-5bfd8624-a391-47c5-a168-37c7352d1f7c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.678122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-031116f3-3c9b-4065-9900-26ba9f3fc015 req-5bfd8624-a391-47c5-a168-37c7352d1f7c service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.689886 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-031116f3-3c9b-4065-9900-26ba9f3fc015 req-5bfd8624-a391-47c5-a168-37c7352d1f7c service nova] Creating event network-changed:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:27:38.695755 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-031116f3-3c9b-4065-9900-26ba9f3fc015 req-5bfd8624-a391-47c5-a168-37c7352d1f7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032148 May 10 03:27:38.696517 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3714/7466] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:38.697310 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:27:38.788343 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-9f48b9c8-9932-4aa0-96bf-dc05286c1ac4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 204 len: 0 microversion: 2.1 time: 0.130340 May 10 03:27:38.789200 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3753/7467] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:27:38 2022] DELETE /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:38.799404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:38.800723 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:38.807938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.808669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.809730 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.810858 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.967796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:38.976542 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ac302a32-705f-48ca-82ea-ded388cfef84 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.182791 May 10 03:27:38.977123 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3715/7468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:27:38 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:39.995312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:39.996081 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:40.003753 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:40.004706 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:40.006064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:40.006508 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:40.139661 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:40.149335 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c4958734-8211-4891-9d86-4e40490f119f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1679 microversion: 2.1 time: 0.158618 May 10 03:27:40.150027 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3754/7469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:27:39 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:41.153576 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-afd4c059-fec3-4b73-a1f6-fd2fc642cb2b req-baa3157b-9286-45fb-a6f9-adb004d219a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66094dd-d026-4269-b7ca-f59036347f7b", "name": "network-vif-deleted", "tag": "5d1ca793-66a8-4288-925f-e9c587e8ac9c"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:41.161979 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-afd4c059-fec3-4b73-a1f6-fd2fc642cb2b req-baa3157b-9286-45fb-a6f9-adb004d219a5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:41.162442 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-afd4c059-fec3-4b73-a1f6-fd2fc642cb2b req-baa3157b-9286-45fb-a6f9-adb004d219a5 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:41.166016 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:41.166681 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:41.173574 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:41.174034 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:41.174832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:41.175295 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:41.175632 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-afd4c059-fec3-4b73-a1f6-fd2fc642cb2b req-baa3157b-9286-45fb-a6f9-adb004d219a5 service nova] Creating event network-vif-deleted:5d1ca793-66a8-4288-925f-e9c587e8ac9c for instance b66094dd-d026-4269-b7ca-f59036347f7b on n-h2-841089-2 May 10 03:27:41.181638 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-afd4c059-fec3-4b73-a1f6-fd2fc642cb2b req-baa3157b-9286-45fb-a6f9-adb004d219a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087290 May 10 03:27:41.182321 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3716/7470] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:41.210788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:41.211287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:41.211749 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lazy-loading 'fault' on Instance uuid b66094dd-d026-4269-b7ca-f59036347f7b {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:27:41.254777 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:41.262938 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f5b749b3-8d29-4c02-af46-f2dea185a92c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 200 len: 1336 microversion: 2.1 time: 0.100989 May 10 03:27:41.263547 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3755/7471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:27:41 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:42.281779 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:42.282498 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: b66094dd-d026-4269-b7ca-f59036347f7b] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:42.288762 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:42.289233 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:42.290013 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:42.290474 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:42.303317 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] HTTP exception thrown: Instance b66094dd-d026-4269-b7ca-f59036347f7b could not be found. May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Request method failure captured: May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b HTTP/1.1 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedqkuw3rOv-wTtIfNu0o2GLHFsw9TMGre8QqGExY4tQpJNFSTo-SNz5UY99oyOYb0pcbodhV9_PGaCvaYxoMNNEBdMc5g-xPLG7OyY8DTZ5vz8Dp7XBp8VhEOyivB2r9lPLzSd8MGdu4dmJodbpMOBsjdNGmMlscW-xXs8MEarWQqgc May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e1bca6e352c04b20a40cba21e343da97 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestShelveInstance-293094087 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1bca6e352c04b20a40cba21e343da97", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1bca6e352c04b20a40cba21e343da97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1bca6e352c04b20a40cba21e343da97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1bca6e352c04b20a40cba21e343da97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestShelveInstance-293094087 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e1bca6e352c04b20a40cba21e343da97 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestShelveInstance-293094087 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestShelveInstance-293094087-project May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ffdb51f84254d24967df233057f0ca9 May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestShelveInstance-293094087-project May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance b66094dd-d026-4269-b7ca-f59036347f7b could not be found. May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'b66094dd-d026-4269-b7ca-f59036347f7b'} May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66094dd-d026-4269-b7ca-f59036347f7b could not be found. May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66094dd-d026-4269-b7ca-f59036347f7b could not be found. May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:42.304947 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66094dd-d026-4269-b7ca-f59036347f7b could not be found. May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Returning 404 to user: Instance b66094dd-d026-4269-b7ca-f59036347f7b could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-771fd885-0609-4f3d-9a84-5ca19272fe9e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b" status: 404 len: 111 microversion: 2.1 time: 0.029775 May 10 03:27:42.310154 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3717/7472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:27:42 2022] GET /compute/v2.1/servers/b66094dd-d026-4269-b7ca-f59036347f7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:27:42.471540 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-854d66fa-ed0b-402f-9ca6-4eb8c245cfb2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '.version_select at 0x7f3d36f94160>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:42.497303 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-854d66fa-ed0b-402f-9ca6-4eb8c245cfb2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-982309564" status: 202 len: 0 microversion: 2.1 time: 0.029614 May 10 03:27:42.498404 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3756/7473] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 03:27:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-982309564 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:27:42.521956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed97a999-6b3e-46d3-9696-37a8b88e7243 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'create', calling method: .version_select at 0x7f3d36131790>, body: {"keypair": {"name": "tempest-TestShelveInstance-235180144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqjFu5blrQZjIQOT1gDGDABorgKUU2oxs+5k41DLX5DFDFRy1l5gwgf5mX1xZ24BykTRIM3npZ0rsmsGwMK5FVgigyQMOC3MMIPdo3c6NKXtptjLOFYoJVq9L33GGIsCg=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:42.535637 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ed97a999-6b3e-46d3-9696-37a8b88e7243 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for project e1bca6e352c04b20a40cba21e343da97. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:27:42.541358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-ed97a999-6b3e-46d3-9696-37a8b88e7243 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for user 0ffdb51f84254d24967df233057f0ca9 and project e1bca6e352c04b20a40cba21e343da97. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:27:42.567359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed97a999-6b3e-46d3-9696-37a8b88e7243 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.049881 May 10 03:27:42.567984 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3718/7474] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:27:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:52.949008 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:27:52.951327 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:27:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:28:02.768952 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-133343866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-235180144", "security_groups": [{"name": "tempest-secgroup-smoke-1428057831"}], "networks": [{"uuid": "23d75947-b79e-44f4-ae75-6c038092c5ce"}], "block_device_mapping_v2": [{"uuid": "c9dbf20c-7f72-4b66-bcfd-576f57eca36b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:02.880362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] validate_networks() for [('23d75947-b79e-44f4-ae75-6c038092c5ce', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:28:03.308211 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:28:03.308719 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:28:03.309268 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:28:03.309788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:28:03.310277 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:28:03.319769 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:03.320223 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:03.321031 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:03.321472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:03.341828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for project e1bca6e352c04b20a40cba21e343da97. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:28:03.346934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Getting quotas for user 0ffdb51f84254d24967df233057f0ca9 and project e1bca6e352c04b20a40cba21e343da97. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:28:03.408565 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:28:03.410756 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9dbf20c-7f72-4b66-bcfd-576f57eca36b',volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:28:03.535889 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-41329552-ff95-4461-9c31-40fb3168fad1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770942 May 10 03:28:03.541585 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3757/7475] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:28:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:28:03.549738 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98d977d5-c299-4394-88df-51af309b0a4d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:03.551048 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98d977d5-c299-4394-88df-51af309b0a4d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:03.610584 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98d977d5-c299-4394-88df-51af309b0a4d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:03.617882 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98d977d5-c299-4394-88df-51af309b0a4d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1087 microversion: 2.1 time: 0.073854 May 10 03:28:03.618447 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3719/7476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:03 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:04.635328 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:04.636009 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:04.642718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:04.644155 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:04.645005 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:04.645460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:04.713234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:04.720898 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4b862c4f-890d-4856-995e-bfb33c9266bd tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1193 microversion: 2.1 time: 0.090165 May 10 03:28:04.722457 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3758/7477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:04 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:05.738314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:05.739558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:05.749294 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:05.749916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:05.750906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:05.751519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:05.892917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:05.901575 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ede40096-3b72-451c-9542-c0c2282d28f6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.167302 May 10 03:28:05.910895 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3720/7478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:05 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:06.379103 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-187f7c86-f886-4805-87c2-5fcac1cf59ed req-01085507-1817-49af-a5b1-f829b73ea2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:06.391829 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-187f7c86-f886-4805-87c2-5fcac1cf59ed req-01085507-1817-49af-a5b1-f829b73ea2ee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:06.392723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-187f7c86-f886-4805-87c2-5fcac1cf59ed req-01085507-1817-49af-a5b1-f829b73ea2ee service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:06.407497 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-187f7c86-f886-4805-87c2-5fcac1cf59ed req-01085507-1817-49af-a5b1-f829b73ea2ee service nova] Creating event network-changed:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h1-841089-2 May 10 03:28:06.415089 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-187f7c86-f886-4805-87c2-5fcac1cf59ed req-01085507-1817-49af-a5b1-f829b73ea2ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149432 May 10 03:28:06.416463 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3759/7479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:28:06.919152 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:06.919938 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:06.927057 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:06.927640 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:06.929077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:06.929627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:07.069947 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:07.077756 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f59acf7e-ec9e-4d25-8a5f-1e23bb93d9d2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.162582 May 10 03:28:07.078452 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3721/7480] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:06 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:08.096541 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:08.097252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:08.104495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:08.104954 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:08.105739 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:08.106181 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:08.239653 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:08.247704 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7b1da88d-1de8-4fdc-8876-8423278bb37a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.156923 May 10 03:28:08.248289 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3760/7481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:08 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:09.265217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:09.265845 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:09.272097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:09.272563 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:09.273337 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:09.273782 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:09.401773 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:09.409125 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d695c843-4715-4bfe-a6ce-36812fea0133 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.147823 May 10 03:28:09.409693 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3722/7482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:09 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:10.425759 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:10.426393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:10.433941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:10.434410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:10.435241 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:10.435697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:10.573109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:10.580561 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21f3d3dd-8d20-49ad-8143-7f435cb9bc69 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.158719 May 10 03:28:10.581143 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3761/7483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:10 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:11.597359 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:11.597992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:11.604988 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:11.605455 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:11.606275 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:11.606728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:11.739970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:11.747980 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f55b0a5e-1322-4485-8938-b269b09b2867 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.154483 May 10 03:28:11.748561 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3723/7484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:11 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:12.765398 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:12.766025 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:12.773488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:12.773948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:12.774724 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:12.775207 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:12.903957 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:12.911367 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-1a9e6a80-f380-4070-94c7-a3613f781e2a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.149914 May 10 03:28:12.911944 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3762/7485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:12 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:13.928226 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:13.929673 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:13.936459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:13.937553 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:13.937978 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:13.938430 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:14.078367 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:14.086332 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6a5b8136-efde-442b-8eca-68a6d4dc3deb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.162133 May 10 03:28:14.086904 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3724/7486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:13 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:15.103286 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:15.103918 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:15.110804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:15.111303 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:15.112095 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:15.112547 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:15.251965 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:15.259959 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-64d2168e-1366-458a-930e-ebac2c109d51 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1271 microversion: 2.1 time: 0.161135 May 10 03:28:15.260537 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3763/7487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:15 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:16.276030 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:16.276654 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:16.283369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:16.283835 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:16.284606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:16.285055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:16.416305 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:16.423722 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-41cff36d-f4a1-4378-ada6-7b5168227096 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.151564 May 10 03:28:16.424296 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3725/7488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:16 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:17.441439 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:17.442067 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:17.448715 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:17.449178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:17.449955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:17.450401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:17.579776 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:17.587158 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2849eb7a-da70-4320-95a3-92f4af9f709c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.149933 May 10 03:28:17.587747 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3764/7489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:17 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:18.604263 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:18.604894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:18.611746 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:18.612219 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:18.613000 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:18.613459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:18.744278 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:18.751645 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0885ca67-1005-4514-a091-2db73e4d699a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.151770 May 10 03:28:18.752219 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3726/7490] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:18 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:19.768780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:19.769401 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:19.776325 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:19.776785 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:19.777596 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:19.778127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:19.910633 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:19.918570 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ed66f09-dce6-4e13-9f1b-73b634994f81 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.153766 May 10 03:28:19.919161 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3765/7491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:19 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:20.978917 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:20.979649 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:20.985644 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:20.986115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:20.986899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:20.987386 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:21.115493 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:21.123568 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9012dfdf-04e0-4f54-b63a-fe935df94066 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.192177 May 10 03:28:21.124152 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3727/7492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:20 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:22.140232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:22.140874 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:22.148228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:22.148685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:22.149450 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:22.149890 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:22.281126 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:22.288689 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c8b0a13d-454e-4d95-9f94-746308a93dff tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.152374 May 10 03:28:22.289265 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3766/7493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:22 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:23.305129 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:23.305753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:23.313055 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:23.313517 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:23.314303 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:23.314752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:23.447459 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:23.454808 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-56c41f53-6641-4242-8fc6-6a3eed1fb404 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.153571 May 10 03:28:23.455421 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3728/7494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:23 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:24.472461 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:24.473087 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:24.480346 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:24.480801 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:24.481575 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:24.482017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:24.615350 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:24.622819 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e71f207c-9b15-4f8f-8a1e-7e868251bf4f tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.154307 May 10 03:28:24.623422 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3767/7495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:24 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:25.481583 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c68036c9-832c-49e6-9488-cc441d99d048 req-c3133e2a-13eb-4a07-8509-020083b13a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "name": "network-vif-plugged", "status": "completed", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:25.490580 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c68036c9-832c-49e6-9488-cc441d99d048 req-c3133e2a-13eb-4a07-8509-020083b13a6b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:25.491612 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c68036c9-832c-49e6-9488-cc441d99d048 req-c3133e2a-13eb-4a07-8509-020083b13a6b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:25.503583 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c68036c9-832c-49e6-9488-cc441d99d048 req-c3133e2a-13eb-4a07-8509-020083b13a6b service nova] Creating event network-vif-plugged:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h1-841089-2 May 10 03:28:25.509535 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c68036c9-832c-49e6-9488-cc441d99d048 req-c3133e2a-13eb-4a07-8509-020083b13a6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086531 May 10 03:28:25.510148 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3729/7496] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:28:25.642327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:25.642883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:25.650592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:25.651051 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:25.651867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:25.652311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:25.790302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:25.797679 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d66387fe-928c-4c61-ae37-b3d3b6a137c2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1259 microversion: 2.1 time: 0.160708 May 10 03:28:25.798256 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3768/7497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:25 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:26.816369 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:26.817092 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:26.823932 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:26.824402 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:26.825213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:26.825668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:26.953194 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:26.960495 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-32c333fd-d4a0-47d7-ac21-c0dd0b321dcc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1443 microversion: 2.1 time: 0.149436 May 10 03:28:26.961277 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3730/7498] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:26 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:26.976178 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:28:26.976800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:28:26.983625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:26.984091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:26.984867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:26.985316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:27.117510 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:28:27.124910 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f3228113-0b0c-4965-b69b-a320d73c1743 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1443 microversion: 2.1 time: 0.152605 May 10 03:28:27.125483 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3769/7499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:28:26 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:28:28.728500 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-2f8cba9e-fdf9-47e4-a91b-a564a73cae96 req-bed3eeba-b103-4b2d-9007-33c38bbff461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:28:28.737203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2f8cba9e-fdf9-47e4-a91b-a564a73cae96 req-bed3eeba-b103-4b2d-9007-33c38bbff461 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:28:28.737666 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-2f8cba9e-fdf9-47e4-a91b-a564a73cae96 req-bed3eeba-b103-4b2d-9007-33c38bbff461 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:28:28.751775 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-2f8cba9e-fdf9-47e4-a91b-a564a73cae96 req-bed3eeba-b103-4b2d-9007-33c38bbff461 service nova] Creating event network-changed:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h1-841089-2 May 10 03:28:28.756987 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-2f8cba9e-fdf9-47e4-a91b-a564a73cae96 req-bed3eeba-b103-4b2d-9007-33c38bbff461 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032885 May 10 03:28:28.757607 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3731/7500] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:30:23.864083 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [731f6601-793d-46cc-b0da-a258d564ce0a] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 03:30:23.864979 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [788024f5-0b2b-4d85-bd9e-e85f869f797c] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 03:30:23.868912 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:23.869447 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:23.875486 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:23.875966 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:23.876732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:23.877175 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:23.898941 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lazy-loading 'flavor' on Instance uuid bd04ebba-1332-48f7-ba05-5f63f2e69dfb {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:30:23.970917 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8472cbf3-734f-4408-a289-25d158060237 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.108521 May 10 03:30:23.971531 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3770/7501] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:30:23 2022] POST /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:30:23.978373 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6038478-86ec-47d6-809b-459960bbf559] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 10 03:30:23.979548 n-d-841089-2 devstack@n-api.service[118717]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0968db2a-2d0b-43e2-b8b2-6e69cd99a6e8] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 10 03:30:23.983793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:23.984510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:23.991377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:23.991850 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:23.992628 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:23.993077 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:24.124444 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:24.132097 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-e51bcf66-66c6-4c7f-a6b1-43b23bc919b8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.156052 May 10 03:30:24.132670 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3732/7502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:23 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:25.152146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:25.152894 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:25.161109 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:25.161570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:25.162348 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:25.162795 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:25.167049 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] [731f6601-793d-46cc-b0da-a258d564ce0a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56496. May 10 03:30:25.167824 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] [788024f5-0b2b-4d85-bd9e-e85f869f797c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56498. May 10 03:30:25.300177 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:25.307677 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e43bcf80-b470-45c8-a2be-44bbcdbad178 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.161314 May 10 03:30:25.308253 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3771/7503] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:25 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:30:26.324361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:26.325082 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:26.339993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:26.340468 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:26.341266 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:26.341726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:26.342366 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] [0968db2a-2d0b-43e2-b8b2-6e69cd99a6e8] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56504. May 10 03:30:26.347814 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6038478-86ec-47d6-809b-459960bbf559] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56502. May 10 03:30:26.471532 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:26.478858 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-45d995ca-e6b9-43c5-9f9b-b7f7a5384642 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.158445 May 10 03:30:26.479468 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3733/7504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:26 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:27.498933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:27.499604 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:27.507256 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:27.507712 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:27.508491 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:27.508933 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:27.639614 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:27.647635 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f668b4a2-8089-4a36-9095-5651b8f66251 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.152688 May 10 03:30:27.648214 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3772/7505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:27 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:28.664661 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:28.665290 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:28.672093 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:28.672557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:28.673838 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:28.674289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:28.801557 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:28.809276 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-85e0790a-aa23-4679-bab0-58c76a39b562 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.148643 May 10 03:30:28.809846 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3734/7506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:28 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:29.827427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:29.828065 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:29.834788 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:29.835299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:29.836083 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:29.836534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:29.964481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:29.972436 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-967d676a-e03b-43da-b16a-625cea4da710 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.148989 May 10 03:30:29.973007 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3773/7507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:29 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:30.989956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:30.990593 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:30.997382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:30.997876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:30.998665 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:30.999146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:31.430657 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:31.438411 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-b44ae3e7-6502-4b1d-81ab-716e5ce0d526 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.452916 May 10 03:30:31.438979 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3735/7508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:30 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:32.456354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:32.456974 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:32.463893 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:32.464351 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:32.465118 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:32.465570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:32.595860 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:32.603151 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-4220c695-5c23-4207-ac59-e1a2be732f9b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.151018 May 10 03:30:32.603724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3774/7509] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:32 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:33.619713 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:33.620343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:33.627710 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:33.628172 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:33.628956 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:33.629411 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:33.764070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:33.772248 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7867f968-0cb2-49a3-9ad4-67867310184b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.156432 May 10 03:30:33.772825 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3736/7510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:33 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:34.788471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:34.789011 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:34.795834 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:34.796287 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:34.797055 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:34.797497 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:34.924975 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:34.932409 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-26e7f46c-2de9-4ce2-8e52-4730f94844a1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.147964 May 10 03:30:34.932985 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3775/7511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:34 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:35.949968 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:35.950531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:35.957958 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:35.958437 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:35.959262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:35.959726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:36.141754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:36.149307 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-4d952912-f16e-45e4-b583-eadaa5c9c3e3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.203353 May 10 03:30:36.149884 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3737/7512] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:35 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:37.169627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:37.170252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:37.177063 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:37.177521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:37.178293 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:37.178738 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:37.359038 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:37.366467 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7d35af3c-877d-41b3-83f7-8e9b41c18541 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.200813 May 10 03:30:37.367048 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3776/7513] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:37 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:38.384484 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:38.385116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:38.392505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:38.392975 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:38.393753 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:38.394209 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:38.523097 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:38.530617 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-f80eaa22-00ac-4f54-a24b-6a0f11a7edb4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.150108 May 10 03:30:38.531222 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3738/7514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:38 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:39.549308 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:39.549844 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:39.557410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:39.557878 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:39.558687 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:39.559171 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:39.704333 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:39.712373 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7a263a97-b136-4baf-b6cc-eec909dd558c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.167824 May 10 03:30:39.712960 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3777/7515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:39 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:40.088187 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c10c51bf-174c-4806-9218-a81f7c284974 req-baaefa63-f01b-46ca-9def-2e8cb4161c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "name": "network-vif-unplugged", "status": "completed", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:40.098595 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c10c51bf-174c-4806-9218-a81f7c284974 req-baaefa63-f01b-46ca-9def-2e8cb4161c6a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.099899 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c10c51bf-174c-4806-9218-a81f7c284974 req-baaefa63-f01b-46ca-9def-2e8cb4161c6a service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.112589 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c10c51bf-174c-4806-9218-a81f7c284974 req-baaefa63-f01b-46ca-9def-2e8cb4161c6a service nova] Creating event network-vif-unplugged:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h1-841089-2 May 10 03:30:40.118120 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c10c51bf-174c-4806-9218-a81f7c284974 req-baaefa63-f01b-46ca-9def-2e8cb4161c6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033630 May 10 03:30:40.119295 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3739/7516] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:30:40.729627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:40.730273 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:40.736963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.737416 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.738186 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.738625 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.865751 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:40.873171 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-85223929-892c-4bf0-88c2-b7100b94eeed tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1509 microversion: 2.1 time: 0.147462 May 10 03:30:40.873754 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3778/7517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:40 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:40.889793 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:40.890515 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:40.897087 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.897561 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:40.898346 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:40.898804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.026914 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-84f9ab07-13c2-443f-9583-bb621a5fae71 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "POST /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb/action" status: 202 len: 0 microversion: 2.1 time: 0.141232 May 10 03:30:41.027588 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3740/7518] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:30:40 2022] POST /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:30:41.035593 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:41.036209 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:41.042017 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:41.042472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.043282 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:41.043732 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:41.180594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:41.188007 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-ed3e934f-2dfe-4e09-a4be-b7d8c5c3ffc9 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1517 microversion: 2.1 time: 0.156313 May 10 03:30:41.189134 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3779/7519] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:41 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:42.206056 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:42.206686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:42.213538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:42.214002 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:42.214781 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:42.215270 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:42.343706 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:42.351996 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfec3574-c94e-4cf4-989e-33cd10ec2d83 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1517 microversion: 2.1 time: 0.150319 May 10 03:30:42.352577 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3741/7520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:42 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:43.369156 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:43.369783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:43.377298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:43.377782 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:43.378576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:43.379200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:43.508570 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:43.515982 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-dbde0368-935f-49ca-a7c0-a376443dd023 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1517 microversion: 2.1 time: 0.150755 May 10 03:30:43.516497 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3780/7521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:43 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:44.533750 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:44.534384 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:44.541184 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:44.541652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:44.542440 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:44.542892 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:44.677051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:44.684438 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ed565034-1239-4459-96a8-78b78d0f70f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1517 microversion: 2.1 time: 0.155706 May 10 03:30:44.685019 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3742/7522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:44 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:45.702296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:45.702934 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:45.710494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:45.710963 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:45.711796 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:45.712252 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:45.848196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:45.855741 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-60a87e2f-aa04-403d-8c75-7dc29db8f905 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.157383 May 10 03:30:45.856320 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3781/7523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:45 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:30:46.873538 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:46.874175 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:46.881797 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:46.882267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:46.883049 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:46.883524 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:47.015116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:47.022714 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-84da66cb-02bb-4b6a-9247-522e53a61afa tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.153089 May 10 03:30:47.023316 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3743/7524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:46 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:48.039638 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:48.040339 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:48.047204 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:48.048172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:48.048943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:48.049386 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:48.178460 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:48.185937 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e82bff63-baef-4b6e-a813-1d7444584f78 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.150253 May 10 03:30:48.186513 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3782/7525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:48 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:49.203770 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:49.204407 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:49.211343 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:49.211814 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:49.212607 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:49.213061 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:49.349526 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:49.357392 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-821fd512-b87a-4a27-b521-b13a8d5e6b1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.157494 May 10 03:30:49.357970 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3744/7526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:49 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:50.375311 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:50.375945 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:50.382826 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:50.383327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:50.384122 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:50.384573 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:50.521237 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:50.529032 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d6daf696-043c-41ef-a1a9-b0b0264a5092 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.157753 May 10 03:30:50.539546 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3783/7527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:50 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:51.546829 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:51.547445 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:51.554761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:51.555876 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:51.556667 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:51.557124 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:51.687523 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:51.695236 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-01b1f30d-3daa-4e6b-aaff-5089d1acfdfe tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.152343 May 10 03:30:51.695811 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3745/7528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:51 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:52.714121 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:52.714787 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:52.721828 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:52.722354 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:52.723272 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:52.723731 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:52.859395 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:52.867316 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8cf7e9d3-fd1d-4e44-af9f-6b7a31fc6da3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.158659 May 10 03:30:52.867899 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3784/7529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:52 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:53.885064 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:53.885843 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:53.892761 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:53.893171 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:53.893952 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:53.894408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:54.024119 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:54.031553 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-fce92bd9-4a82-4f59-9162-87be87f3ebcb tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.150493 May 10 03:30:54.035847 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3746/7530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:53 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:55.050154 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:55.050804 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:55.057594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:55.058056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:55.058832 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:55.059312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:55.190676 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:55.199227 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b57e85be-e5c8-465b-bc48-b803e172302c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1519 microversion: 2.1 time: 0.153588 May 10 03:30:55.199777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3785/7531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:55 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:56.216232 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:56.216862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:56.223662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:56.224160 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:56.224960 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:56.225417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:56.423509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:56.430940 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-53a964e6-61fe-44ce-9ab1-88b6abea5b12 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.218679 May 10 03:30:56.431761 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3747/7532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:56 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:57.126347 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-784e0907-f01a-4bac-911d-795ca564e8f2 req-c86c584f-57de-43b8-af5d-bba045a73dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:30:57.140697 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-784e0907-f01a-4bac-911d-795ca564e8f2 req-c86c584f-57de-43b8-af5d-bba045a73dcd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:57.141151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-784e0907-f01a-4bac-911d-795ca564e8f2 req-c86c584f-57de-43b8-af5d-bba045a73dcd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:57.153738 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-784e0907-f01a-4bac-911d-795ca564e8f2 req-c86c584f-57de-43b8-af5d-bba045a73dcd service nova] Creating event network-changed:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h2-841089-2 May 10 03:30:57.159925 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-784e0907-f01a-4bac-911d-795ca564e8f2 req-c86c584f-57de-43b8-af5d-bba045a73dcd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037332 May 10 03:30:57.161314 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3786/7533] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:30:57.448882 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:57.449685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:57.457254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:57.457732 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:57.458536 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:57.458992 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:57.660471 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:57.667890 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9d2c1548-d479-427c-9a28-c0a25a5d28f1 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.223071 May 10 03:30:57.668462 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3748/7534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:57 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:58.686097 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:58.687147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:58.693479 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:58.693948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:58.694730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:58.695215 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:58.825090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:58.833088 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-d8aa6a4c-c4cf-4f84-800a-8b2a0b3dda27 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.152142 May 10 03:30:58.833672 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3787/7535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:58 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:30:59.850412 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:30:59.851090 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:30:59.857745 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:59.858217 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:59.858995 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:30:59.859475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:30:59.991326 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:30:59.998689 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a753d7b-cac1-486b-ad38-8f3efdcf5e82 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.152150 May 10 03:30:59.999302 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3749/7536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:30:59 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:01.015456 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:01.016090 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:01.023424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:01.023886 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:01.024664 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:01.025110 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:01.151128 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:01.159354 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-590b41ac-2540-463f-880e-1fb3023604cc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.147895 May 10 03:31:01.159935 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3788/7537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:01 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:02.177259 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:02.177894 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:02.185404 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:02.185878 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:02.186680 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:02.187173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:02.321388 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:02.329791 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-956ef243-22df-4399-871c-5ff1799caea2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.156631 May 10 03:31:02.330380 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3750/7538] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:02 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:03.347161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:03.347817 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:03.354576 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:03.355033 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:03.355831 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:03.356275 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:03.488269 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:03.495840 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7c85f2bc-98fe-4c34-b9a9-8bd2465ae1e0 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.152721 May 10 03:31:03.496424 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3789/7539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:03 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:04.512704 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:04.513335 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:04.520743 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:04.521238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:04.521969 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:04.522416 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:04.653946 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:04.661401 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-187400e5-5388-4faa-8175-c8674d9c7573 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.152611 May 10 03:31:04.661978 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3751/7540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:04 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:05.677700 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:05.678326 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:05.685404 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:05.685870 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:05.686660 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:05.687140 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:05.818120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:05.825600 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-df2d5c7a-a24d-4c09-a8ea-ceb6cd3e8ca2 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.151783 May 10 03:31:05.826178 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3790/7541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:05 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:06.842505 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:06.843101 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:06.850072 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:06.850547 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:06.851358 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:06.851811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:06.979033 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:06.986987 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-a1a0e081-a1bf-4ae5-a7d9-a6b379da56f4 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.148480 May 10 03:31:06.987599 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3752/7542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:06 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:08.003990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:08.004623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:08.011454 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:08.011921 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:08.012709 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:08.013161 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:08.144244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:08.151890 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-74271dc6-065a-4154-8add-4e5f219eb04c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.151826 May 10 03:31:08.152476 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3791/7543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:07 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:08.704711 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-fa0e90bb-ac5a-4393-b5d7-ababf630ce28 req-03160c30-9654-4e57-9822-fc80310c40ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "name": "network-vif-plugged", "status": "completed", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:31:08.714855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fa0e90bb-ac5a-4393-b5d7-ababf630ce28 req-03160c30-9654-4e57-9822-fc80310c40ec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:08.715349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-fa0e90bb-ac5a-4393-b5d7-ababf630ce28 req-03160c30-9654-4e57-9822-fc80310c40ec service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:08.726660 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-fa0e90bb-ac5a-4393-b5d7-ababf630ce28 req-03160c30-9654-4e57-9822-fc80310c40ec service nova] Creating event network-vif-plugged:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h2-841089-2 May 10 03:31:08.732030 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-fa0e90bb-ac5a-4393-b5d7-ababf630ce28 req-03160c30-9654-4e57-9822-fc80310c40ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031642 May 10 03:31:08.732620 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3753/7544] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:31:09.169249 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:09.169811 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:09.177070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:09.177532 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:09.178312 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:09.178760 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:09.312309 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:09.320597 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e03b28e0-f5c7-446f-91da-51a09b7aa3a8 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1575 microversion: 2.1 time: 0.155356 May 10 03:31:09.321171 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3792/7545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:09 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:10.337429 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:31:10.338170 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:31:10.345689 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:10.346151 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:10.346925 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:31:10.347414 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:31:10.475450 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:31:10.482860 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-dcde48e7-cf44-4987-8fa3-d151378dcfa6 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1562 microversion: 2.1 time: 0.149663 May 10 03:31:10.483474 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3754/7546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:31:10 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:31:13.448614 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:31:13.449116 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:27.081481 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:27.082091 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:27.084611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-9dc00eec-bc42-4c14-bc76-bac648f8ad0d req-81bf238b-87f7-4ac7-a466-944f5a4faa60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:27.088495 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:27.089258 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:27.089853 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:27.090300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:27.093003 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9dc00eec-bc42-4c14-bc76-bac648f8ad0d req-81bf238b-87f7-4ac7-a466-944f5a4faa60 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:27.093544 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-9dc00eec-bc42-4c14-bc76-bac648f8ad0d req-81bf238b-87f7-4ac7-a466-944f5a4faa60 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:27.104939 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-9dc00eec-bc42-4c14-bc76-bac648f8ad0d req-81bf238b-87f7-4ac7-a466-944f5a4faa60 service nova] Creating event network-changed:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h2-841089-2 May 10 03:32:27.110148 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-9dc00eec-bc42-4c14-bc76-bac648f8ad0d req-81bf238b-87f7-4ac7-a466-944f5a4faa60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 May 10 03:32:27.111053 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3755/7547] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:32:27.116323 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:32:27.198772 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5a9c6891-ce6f-4ecc-a412-feb1ea3d658d tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 204 len: 0 microversion: 2.1 time: 0.122577 May 10 03:32:27.202616 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3793/7548] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:32:27 2022] DELETE /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:32:27.209016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:27.209904 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:27.216415 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:27.216889 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:27.217685 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:27.218148 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:27.383774 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:27.391820 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2464aeb9-683b-4180-b03a-e5e91e097e60 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.187559 May 10 03:32:27.392418 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3756/7549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:27 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:32:28.409948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:28.410783 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:28.418045 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:28.419150 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:28.419336 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:28.419789 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:28.578438 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:28.585870 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-17c3e3c4-4f9c-4158-8a44-9e7293babedc tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1568 microversion: 2.1 time: 0.180238 May 10 03:32:28.586447 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3794/7550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:28 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:29.501395 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b97779fa-24a4-4d8e-a594-eb2f3641bb9a req-67cc6f36-d60e-4147-8273-d8eba7fca35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd04ebba-1332-48f7-ba05-5f63f2e69dfb", "name": "network-vif-deleted", "tag": "30b3fae4-9ca6-4ec4-b186-0c84042b5152"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:29.512237 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b97779fa-24a4-4d8e-a594-eb2f3641bb9a req-67cc6f36-d60e-4147-8273-d8eba7fca35e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:29.512700 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b97779fa-24a4-4d8e-a594-eb2f3641bb9a req-67cc6f36-d60e-4147-8273-d8eba7fca35e service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:29.527929 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b97779fa-24a4-4d8e-a594-eb2f3641bb9a req-67cc6f36-d60e-4147-8273-d8eba7fca35e service nova] Creating event network-vif-deleted:30b3fae4-9ca6-4ec4-b186-0c84042b5152 for instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb on n-h2-841089-2 May 10 03:32:29.533104 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b97779fa-24a4-4d8e-a594-eb2f3641bb9a req-67cc6f36-d60e-4147-8273-d8eba7fca35e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035454 May 10 03:32:29.533705 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3757/7551] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:32:29.603172 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:29.603800 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:29.610793 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:29.611300 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:29.612098 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:29.612550 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:29.683381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:29.691129 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-644b01f5-8830-4455-9fe2-524dff58bc1e tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.091931 May 10 03:32:29.691798 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3795/7552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:29 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:30.712298 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:30.713019 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:30.719948 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:30.720422 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:30.721210 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:30.721670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:30.783624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:30.791018 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-2791b756-1416-4f36-9c92-e9fe7bfe8167 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.083833 May 10 03:32:30.791616 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3758/7553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:30 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:31.808737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:31.809358 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:31.816080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:31.816536 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:31.817302 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:31.817745 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:31.880592 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:31.888667 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f76fe45d-c6fb-4049-be84-d8adb223db26 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.083882 May 10 03:32:31.889246 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3796/7554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:31 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:32.906662 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:32.907967 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:32.914588 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:32.915393 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:32.916379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:32.916916 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:33.000377 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:33.008169 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0aed3175-bcb9-4afd-b710-3e48dcdb8c1b tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.105361 May 10 03:32:33.008755 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3759/7555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:32 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:34.024737 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:34.025360 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:34.032389 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:34.032847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:34.033627 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:34.034070 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:34.098558 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:34.106807 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c245f732-a8d1-4baa-9938-47faacfa6cf3 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.085970 May 10 03:32:34.107418 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3797/7556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:34 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:35.124146 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:35.124869 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:35.131726 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:35.132203 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:35.132990 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:35.133449 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:35.498668 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:35.506245 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-988a26f8-baa1-4e95-a5b4-55e109232d80 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.386569 May 10 03:32:35.506822 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3760/7557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:35 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:36.523519 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:36.524138 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:36.530873 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:36.531359 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:36.532232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:36.532711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:36.601008 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:36.609666 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-385f380d-c816-4c4c-872d-fda9cff5ab8c tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.090474 May 10 03:32:36.610485 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3798/7558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:36 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:37.627083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:37.627736 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:37.634692 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:37.635267 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:37.636716 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:37.637180 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:37.699239 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:37.706755 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfd779b9-8338-49dc-9c3c-dd40c092ef79 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1218 microversion: 2.1 time: 0.083708 May 10 03:32:37.707354 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3761/7559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:37 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:38.723533 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:38.724183 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:38.731727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:38.732299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:38.733056 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:38.733512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:38.764613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:38.765071 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:38.765527 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.objects.instance [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lazy-loading 'fault' on Instance uuid bd04ebba-1332-48f7-ba05-5f63f2e69dfb {{(pid=118716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:32:38.806218 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffdb51f84254d24967df233057f0ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bca6e352c04b20a40cba21e343da97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:32:38.814261 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e83dd914-c491-4bc0-b673-61741b69de46 tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 200 len: 1223 microversion: 2.1 time: 0.094657 May 10 03:32:38.814836 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3799/7560] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:38 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:32:39.831408 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:39.832182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [instance: bd04ebba-1332-48f7-ba05-5f63f2e69dfb] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:32:39.838972 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:39.839533 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:39.840338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:32:39.840816 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:32:39.853862 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.wsgi [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] HTTP exception thrown: Instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb could not be found. May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Request method failure captured: May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: request: GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb HTTP/1.1 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Accept: application/json May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Accept-Encoding: identity May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Connection: close May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Content-Length: 0 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Content-Type: application/json May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Host: 10.222.0.52 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: Openstack-System-Scope: None May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: User-Agent: python-urllib3/1.26.9 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Auth-Token: gAAAAABiedqkuw3rOv-wTtIfNu0o2GLHFsw9TMGre8QqGExY4tQpJNFSTo-SNz5UY99oyOYb0pcbodhV9_PGaCvaYxoMNNEBdMc5g-xPLG7OyY8DTZ5vz8Dp7XBp8VhEOyivB2r9lPLzSd8MGdu4dmJodbpMOBsjdNGmMlscW-xXs8MEarWQqgc May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Id: None May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Domain-Name: None May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Identity-Status: Confirmed May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Is-Admin-Project: True May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Id: default May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Domain-Name: Default May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Id: e1bca6e352c04b20a40cba21e343da97 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Project-Name: tempest-TestShelveInstance-293094087 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Role: member,reader May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Roles: member,reader May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1bca6e352c04b20a40cba21e343da97", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1bca6e352c04b20a40cba21e343da97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1bca6e352c04b20a40cba21e343da97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1bca6e352c04b20a40cba21e343da97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant: tempest-TestShelveInstance-293094087 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Id: e1bca6e352c04b20a40cba21e343da97 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-Tenant-Name: tempest-TestShelveInstance-293094087 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-User: tempest-TestShelveInstance-293094087-project May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Id: default May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Domain-Name: Default May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Id: 0ffdb51f84254d24967df233057f0ca9 May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: X-User-Name: tempest-TestShelveInstance-293094087-project May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: method: > May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: exception: Instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb could not be found. May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: action_args: {'id': 'bd04ebba-1332-48f7-ba05-5f63f2e69dfb'} May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb could not be found. May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb could not be found. May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:32:39.855647 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb could not be found. May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: ERROR nova.api.openstack.wsgi May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Returning 404 to user: Instance bd04ebba-1332-48f7-ba05-5f63f2e69dfb could not be found. {{(pid=118717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d97866cc-599f-46c5-a162-e22d1706c5ac tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb" status: 404 len: 111 microversion: 2.1 time: 0.029608 May 10 03:32:39.860375 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3762/7561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:32:39 2022] GET /compute/v2.1/servers/bd04ebba-1332-48f7-ba05-5f63f2e69dfb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:32:40.019362 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-56ac7fc0-c05f-4a16-807f-799830da807a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] Calling method '.version_select at 0x7f3d3796d820>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:32:40.023693 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56ac7fc0-c05f-4a16-807f-799830da807a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [af0ce678-38af-40ed-bccb-524a4108395c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:32:41.033947 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [None req-56ac7fc0-c05f-4a16-807f-799830da807a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] [af0ce678-38af-40ed-bccb-524a4108395c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56688. May 10 03:32:41.052838 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-56ac7fc0-c05f-4a16-807f-799830da807a tempest-TestShelveInstance-293094087 tempest-TestShelveInstance-293094087-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-235180144" status: 202 len: 0 microversion: 2.1 time: 1.037750 May 10 03:32:41.053448 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3800/7562] 10.222.0.52 () {58 vars in 1250 bytes} [Tue May 10 03:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-235180144 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:32:52.945106 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:52.945840 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:52.959397 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:52.959573 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:58.936231 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9fbf6bc9-f465-4140-8346-11bba477476a tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Action: 'create', calling method: .version_select at 0x7f3d3425ac10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1097883548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbMMsz5AYX/Nn4v8C9xb4NCm4N4dsLc1P8QarBq6PSuXZSJNc3H6LbBfp08MdUqNgXGobmkQP/zFFstVReQ9XHhbynhyofo4pgWVbGqECOY/xHkAjXQqcGlFrE4MnSDoA=="}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:32:58.952254 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9fbf6bc9-f465-4140-8346-11bba477476a tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Getting quotas for project 5abd5d0bbf8344aeaa9adcf44a995883. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:32:58.957741 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-9fbf6bc9-f465-4140-8346-11bba477476a tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Getting quotas for user 87647790e7ff4829b26c9b98e7b32578 and project 5abd5d0bbf8344aeaa9adcf44a995883. Resources: {'key_pairs'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:32:58.986808 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9fbf6bc9-f465-4140-8346-11bba477476a tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.240319 May 10 03:32:58.987503 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3763/7563] 10.222.0.52 () {60 vars in 1158 bytes} [Tue May 10 03:32:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:33:00.008129 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-114111174", "imageRef": "193324a5-9e6a-4320-a184-bbef949b550f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1097883548", "security_groups": [{"name": "tempest-secgroup-smoke-500573561"}], "networks": [{"uuid": "6dcde81f-2c28-468a-9ab8-cb03ae021968"}]}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:33:00.111353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.network.neutron [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] validate_networks() for [('6dcde81f-2c28-468a-9ab8-cb03ae021968', None, None, None, None, None)] {{(pid=118716) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:33:00.497023 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Flavor limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:33:00.497471 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Image limits 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:33:00.497969 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Flavor pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:33:00.498393 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Image pref 0:0:0 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:33:00.498823 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.virt.hardware [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:33:00.511505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:00.512628 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:00.513504 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:00.513916 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:00.532655 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Getting quotas for project 5abd5d0bbf8344aeaa9adcf44a995883. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:33:00.538580 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.quota [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Getting quotas for user 87647790e7ff4829b26c9b98e7b32578 and project 5abd5d0bbf8344aeaa9adcf44a995883. Resources: {'cores', 'ram', 'instances'} {{(pid=118716) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:33:00.552367 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Going to run 1 instances... {{(pid=118716) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:33:00.554948 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='193324a5-9e6a-4320-a184-bbef949b550f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:33:00.604197 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6d6a971e-51c9-4b76-a46a-aa04211a3a05 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.600865 May 10 03:33:00.605127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3801/7564] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:33:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:33:00.616052 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-1a905e6d-1469-4ed3-b752-707f6115b40c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:00.616696 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-1a905e6d-1469-4ed3-b752-707f6115b40c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:00.673348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-1a905e6d-1469-4ed3-b752-707f6115b40c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:00.680230 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-1a905e6d-1469-4ed3-b752-707f6115b40c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1248 microversion: 2.1 time: 0.068965 May 10 03:33:00.680807 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3764/7565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:00 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:01.700658 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-2b4a633f-7709-45f7-8659-b937c37d7435 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:01.701289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-2b4a633f-7709-45f7-8659-b937c37d7435 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:01.766255 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-2b4a633f-7709-45f7-8659-b937c37d7435 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:01.774969 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-2b4a633f-7709-45f7-8659-b937c37d7435 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1248 microversion: 2.1 time: 0.080957 May 10 03:33:01.781114 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3802/7566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:01 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:02.792479 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-bd8fc479-ee12-47cf-acc4-c65fc5e5dd7c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:02.794085 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-bd8fc479-ee12-47cf-acc4-c65fc5e5dd7c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:02.859365 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-bd8fc479-ee12-47cf-acc4-c65fc5e5dd7c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:02.878679 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-bd8fc479-ee12-47cf-acc4-c65fc5e5dd7c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1248 microversion: 2.1 time: 0.089987 May 10 03:33:02.881788 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3765/7567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:02 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:03.897822 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fb82293f-d96c-4260-9c2f-0d93a51fb072 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:03.898388 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fb82293f-d96c-4260-9c2f-0d93a51fb072 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:03.957692 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fb82293f-d96c-4260-9c2f-0d93a51fb072 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:03.964650 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fb82293f-d96c-4260-9c2f-0d93a51fb072 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1248 microversion: 2.1 time: 0.070784 May 10 03:33:03.966101 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3803/7568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:03 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:04.982737 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:04.983387 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:04.990332 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:04.990795 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:04.991619 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:04.992076 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:05.055199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:05.062747 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0f3413c6-3bf0-4c4d-b1e7-331dbf507f1d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1252 microversion: 2.1 time: 0.084803 May 10 03:33:05.063361 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3766/7569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:04 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:06.079861 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:06.080505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:06.088234 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:06.088701 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:06.089494 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:06.089947 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:06.151529 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:06.159574 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-a5d871a6-88a7-46ba-846d-4a00c41b7c46 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1306 microversion: 2.1 time: 0.083440 May 10 03:33:06.160190 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3804/7570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:06 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:07.177374 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:07.178338 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:07.185635 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:07.186255 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:07.187287 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:07.187747 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:07.356243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:07.368959 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-61cb32dc-3cd4-44e0-8231-ca9467f13e3c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1373 microversion: 2.1 time: 0.195587 May 10 03:33:07.369759 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3767/7571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:07 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:07.511228 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-0318c769-8da9-4680-aac5-217403878eca req-687e46b4-5950-499d-b3b6-0e968ea41943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:33:07.519962 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0318c769-8da9-4680-aac5-217403878eca req-687e46b4-5950-499d-b3b6-0e968ea41943 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:07.520424 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-0318c769-8da9-4680-aac5-217403878eca req-687e46b4-5950-499d-b3b6-0e968ea41943 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:07.532153 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-0318c769-8da9-4680-aac5-217403878eca req-687e46b4-5950-499d-b3b6-0e968ea41943 service nova] Creating event network-changed:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:33:07.537533 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-0318c769-8da9-4680-aac5-217403878eca req-687e46b4-5950-499d-b3b6-0e968ea41943 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112510 May 10 03:33:07.538154 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3805/7572] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:33:08.387015 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:08.387694 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:08.395238 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:08.395717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:08.396510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:08.396970 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:08.527050 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:08.534457 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-adc8b53d-66bd-440d-998b-b88728fee941 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1373 microversion: 2.1 time: 0.151427 May 10 03:33:08.535029 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3768/7573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:08 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:09.552888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:09.553552 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:09.559648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:09.560131 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:09.560898 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:09.561342 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:09.695353 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:09.703207 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fdab6d90-4728-4951-82b9-feacaa7c10a1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1373 microversion: 2.1 time: 0.155449 May 10 03:33:09.703777 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3806/7574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:09 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:10.719796 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:10.720425 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:10.727142 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:10.727606 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:10.728379 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:10.728830 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:10.860566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:10.867551 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-ca1abd65-051b-46bf-9faa-066873aa0fbb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1373 microversion: 2.1 time: 0.152202 May 10 03:33:10.868122 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3769/7575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:10 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:10.998534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-98e2b3ee-f7cd-4f93-b3c4-d7f030ccecd8 req-0acf48f1-b2e4-48c0-b192-76cbb14c5d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "name": "network-vif-plugged", "status": "completed", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:33:11.007843 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-98e2b3ee-f7cd-4f93-b3c4-d7f030ccecd8 req-0acf48f1-b2e4-48c0-b192-76cbb14c5d1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:11.008299 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-98e2b3ee-f7cd-4f93-b3c4-d7f030ccecd8 req-0acf48f1-b2e4-48c0-b192-76cbb14c5d1f service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:11.019532 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-98e2b3ee-f7cd-4f93-b3c4-d7f030ccecd8 req-0acf48f1-b2e4-48c0-b192-76cbb14c5d1f service nova] Creating event network-vif-plugged:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:33:11.024538 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-98e2b3ee-f7cd-4f93-b3c4-d7f030ccecd8 req-0acf48f1-b2e4-48c0-b192-76cbb14c5d1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 May 10 03:33:11.025135 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3807/7576] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:33:11.884519 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:11.885176 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:11.892009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:11.892483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:11.893262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:11.893715 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:12.020083 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:12.027325 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9faab3e8-f038-4dfc-930c-8ed9ad5edc25 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1373 microversion: 2.1 time: 0.146677 May 10 03:33:12.027880 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3770/7577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:11 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1373 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:13.046305 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:13.047015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:13.053534 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:13.053990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:13.054757 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:13.055298 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:13.192012 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:13.199549 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-8f66f41a-5b57-45c3-92e0-9c6f6c697ec6 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1558 microversion: 2.1 time: 0.158893 May 10 03:33:13.200127 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3808/7578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:13 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:13.216289 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:33:13.216935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:33:13.223669 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:13.224145 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:13.224935 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:13.225396 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:13.352739 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:33:13.360923 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-60510cfe-1359-4b39-bfda-e6ff6bd36100 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1558 microversion: 2.1 time: 0.148488 May 10 03:33:13.361532 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3771/7579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:33:13 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:33:15.075888 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-3f9bb35a-1db4-4eac-80d0-a73e888a1706 req-a93f86e5-9c87-494a-8e33-58e9104432e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:33:15.083728 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3f9bb35a-1db4-4eac-80d0-a73e888a1706 req-a93f86e5-9c87-494a-8e33-58e9104432e2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:33:15.084190 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-3f9bb35a-1db4-4eac-80d0-a73e888a1706 req-a93f86e5-9c87-494a-8e33-58e9104432e2 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:33:15.095106 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-3f9bb35a-1db4-4eac-80d0-a73e888a1706 req-a93f86e5-9c87-494a-8e33-58e9104432e2 service nova] Creating event network-changed:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:33:15.100577 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-3f9bb35a-1db4-4eac-80d0-a73e888a1706 req-a93f86e5-9c87-494a-8e33-58e9104432e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083264 May 10 03:33:15.101724 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3809/7580] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:35:08.331266 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:35:08.331853 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:35:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:35:10.165487 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1758500042"}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:10.166611 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:10.172686 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:10.173158 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:10.173933 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:10.174382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:10.441819 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c6f3e7f6-9437-4e78-adc5-8d104585b1c4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "POST /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.281109 May 10 03:35:10.442386 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3772/7581] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:35:10 2022] POST /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 03:35:15.735301 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-ddc529ad-a6ff-455e-98d8-b69d1c21db0a req-68e0d887-1c84-4a2d-9ec7-7a1f95c23d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "name": "network-vif-plugged", "status": "completed", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:15.751685 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ddc529ad-a6ff-455e-98d8-b69d1c21db0a req-68e0d887-1c84-4a2d-9ec7-7a1f95c23d37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:15.752146 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-ddc529ad-a6ff-455e-98d8-b69d1c21db0a req-68e0d887-1c84-4a2d-9ec7-7a1f95c23d37 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:15.764026 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-ddc529ad-a6ff-455e-98d8-b69d1c21db0a req-68e0d887-1c84-4a2d-9ec7-7a1f95c23d37 service nova] Creating event network-vif-plugged:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:35:15.769308 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-ddc529ad-a6ff-455e-98d8-b69d1c21db0a req-68e0d887-1c84-4a2d-9ec7-7a1f95c23d37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114846 May 10 03:35:15.769920 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3810/7582] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:35:23.956872 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-446416015", "imageRef": "ff52af3d-86ec-45a8-a3c2-e312343289ae", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1097883548", "security_groups": [{"name": "tempest-secgroup-smoke-500573561"}], "networks": [{"uuid": "6dcde81f-2c28-468a-9ab8-cb03ae021968"}]}} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:24.060465 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.network.neutron [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] validate_networks() for [('6dcde81f-2c28-468a-9ab8-cb03ae021968', None, None, None, None, None)] {{(pid=118717) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:35:24.428624 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Flavor limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:35:24.429070 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Image limits 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:35:24.429592 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Flavor pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:35:24.430038 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Image pref 0:0:0 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:35:24.430453 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.virt.hardware [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:35:24.439559 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:24.440027 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:24.440849 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:24.441313 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:24.460812 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Getting quotas for project 5abd5d0bbf8344aeaa9adcf44a995883. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:35:24.465999 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.quota [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Getting quotas for user 87647790e7ff4829b26c9b98e7b32578 and project 5abd5d0bbf8344aeaa9adcf44a995883. Resources: {'cores', 'ram', 'instances'} {{(pid=118717) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:35:24.478068 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Going to run 1 instances... {{(pid=118717) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:35:24.480546 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ff52af3d-86ec-45a8-a3c2-e312343289ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:35:24.527363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-356956bc-339c-42bf-84c7-47fd99c85192 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.576276 May 10 03:35:24.528024 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3773/7583] 10.222.0.52 () {60 vars in 1146 bytes} [Tue May 10 03:35:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:35:24.539472 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cd97970f-dcc6-4053-9878-f674d1bd20d1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:24.540196 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cd97970f-dcc6-4053-9878-f674d1bd20d1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:24.595147 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-cd97970f-dcc6-4053-9878-f674d1bd20d1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:24.601902 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cd97970f-dcc6-4053-9878-f674d1bd20d1 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1248 microversion: 2.1 time: 0.067657 May 10 03:35:24.602496 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3811/7584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:24 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:25.620179 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:25.620811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:25.628633 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:25.629348 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:25.630320 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:25.630777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:25.707372 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:25.714680 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-c2105b16-8f0e-456d-b3e3-1d76c625f3d4 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1318 microversion: 2.1 time: 0.099275 May 10 03:35:25.715282 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3774/7585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:25 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:26.732572 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:26.733221 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:26.749431 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:26.759210 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:26.760410 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:26.761231 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:26.957035 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:26.965993 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e788b4b1-0d29-41b8-9132-c8d16b296e6e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.237689 May 10 03:35:26.976731 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3812/7586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:26 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:27.612040 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-cc05d1bf-6d53-4d12-b3d3-e7a08ab215ad req-0a703fbe-d9ca-4a2c-aec5-7ada91588515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "name": "network-vif-unplugged", "status": "completed", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:27.620590 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cc05d1bf-6d53-4d12-b3d3-e7a08ab215ad req-0a703fbe-d9ca-4a2c-aec5-7ada91588515 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:27.621370 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-cc05d1bf-6d53-4d12-b3d3-e7a08ab215ad req-0a703fbe-d9ca-4a2c-aec5-7ada91588515 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:27.660381 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-cc05d1bf-6d53-4d12-b3d3-e7a08ab215ad req-0a703fbe-d9ca-4a2c-aec5-7ada91588515 service nova] Creating event network-vif-unplugged:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:35:27.674798 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-cc05d1bf-6d53-4d12-b3d3-e7a08ab215ad req-0a703fbe-d9ca-4a2c-aec5-7ada91588515 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067198 May 10 03:35:27.676013 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3775/7587] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:35:27.983727 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:27.985078 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:27.991646 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:27.992289 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:27.993096 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:27.993535 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:28.145015 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:28.152995 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-5e3b5a73-79db-4274-912e-a405cfa7fc56 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.173123 May 10 03:35:28.153592 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3813/7588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:27 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:29.172009 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:29.172841 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:29.179477 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:29.179886 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:29.180718 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:29.181182 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:29.321804 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:29.329747 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d7447c60-f555-49b2-8125-4966d3620e42 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.163288 May 10 03:35:29.330551 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3776/7589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:29 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:30.346545 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:30.347316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:30.354206 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:30.354723 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:30.355505 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:30.355956 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:30.498200 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:30.506526 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e0c79855-de3c-4757-8bef-cc3891fc5ac9 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.163845 May 10 03:35:30.507524 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3814/7590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:30 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:31.523438 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:31.524078 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:31.531670 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:31.532150 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:31.532957 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:31.533417 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:31.684754 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:31.694314 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-6d2f3ed3-bf58-424f-8b16-83723ec3621e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.174491 May 10 03:35:31.695556 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3777/7591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:31 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:32.712244 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:32.712868 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:32.720711 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:32.721179 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:32.721977 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:32.722427 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:32.861032 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:32.869367 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-fedfbc0c-ec13-4b65-b313-d5ab2af91588 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.160921 May 10 03:35:32.870858 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3815/7592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:32 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:35:33.886531 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:33.888199 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:33.899855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:33.899855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:33.900241 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:33.900714 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:34.065115 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:34.073150 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-16752654-ee47-421d-8841-0436084d8bc3 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.190505 May 10 03:35:34.073728 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3778/7593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:33 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:35.095990 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:35.096612 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:35.103522 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:35.103985 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:35.104780 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:35.105232 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:35.319867 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:35.329343 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-c35772bc-91a0-4957-a9e0-2816b6e71edd tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.237911 May 10 03:35:35.330237 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3816/7594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:35 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:35.553652 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-b19d2bd5-7d68-4cd8-9fe0-4fa3aac77d50 req-6ecb3428-f5ab-406e-a09d-18509025181b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:35.564856 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b19d2bd5-7d68-4cd8-9fe0-4fa3aac77d50 req-6ecb3428-f5ab-406e-a09d-18509025181b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:35.565314 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-b19d2bd5-7d68-4cd8-9fe0-4fa3aac77d50 req-6ecb3428-f5ab-406e-a09d-18509025181b service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:35.579245 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-b19d2bd5-7d68-4cd8-9fe0-4fa3aac77d50 req-6ecb3428-f5ab-406e-a09d-18509025181b service nova] Creating event network-changed:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:35:35.591741 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-b19d2bd5-7d68-4cd8-9fe0-4fa3aac77d50 req-6ecb3428-f5ab-406e-a09d-18509025181b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041675 May 10 03:35:35.592352 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3779/7595] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:35:36.347521 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:36.348290 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:36.355786 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:36.356259 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:36.357039 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:36.357730 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:36.553316 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:36.560616 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-6ee468ad-e88e-4781-852d-faa27c2cc2be tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.217914 May 10 03:35:36.561201 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3817/7596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:36 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:35:37.578877 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:37.579605 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:37.585771 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:37.586243 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:37.587059 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:37.587541 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:37.771881 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:37.779196 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-d4337008-f344-46a5-ba7e-927e0cc82ac8 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.205302 May 10 03:35:37.779767 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3780/7597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:37 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:38.797075 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:38.797705 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:38.804594 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:38.805059 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:38.805836 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:38.806285 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:38.938847 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:38.946684 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e4dd1650-819b-4556-85c3-13e31d58c02e tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.154068 May 10 03:35:38.947310 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3818/7598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:38 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:39.963993 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:39.964622 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:39.971566 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:39.972032 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:39.972811 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:39.973262 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:40.025135 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-d3edc180-1780-438e-b9b3-2dc14fe69199 req-6be27098-3c18-44da-9e9b-98a3be4db8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "name": "network-vif-plugged", "status": "completed", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:40.035080 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d3edc180-1780-438e-b9b3-2dc14fe69199 req-6be27098-3c18-44da-9e9b-98a3be4db8de service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:40.036549 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-d3edc180-1780-438e-b9b3-2dc14fe69199 req-6be27098-3c18-44da-9e9b-98a3be4db8de service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:40.048740 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-d3edc180-1780-438e-b9b3-2dc14fe69199 req-6be27098-3c18-44da-9e9b-98a3be4db8de service nova] Creating event network-vif-plugged:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:35:40.054514 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-d3edc180-1780-438e-b9b3-2dc14fe69199 req-6be27098-3c18-44da-9e9b-98a3be4db8de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 May 10 03:35:40.055333 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3819/7599] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:35:40.124862 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:40.132586 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-3699f65a-045d-4799-9653-3a7f7b51f491 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.172572 May 10 03:35:40.133172 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3781/7600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:39 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:41.151488 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:41.152193 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:41.159120 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:41.159579 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:41.160349 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:41.160798 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:41.297955 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:41.305849 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-7f95940f-4361-420e-a837-a1fd06124b40 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1373 microversion: 2.1 time: 0.159324 May 10 03:35:41.306447 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3820/7601] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:41 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:42.323697 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:42.324558 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:42.331230 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:42.331717 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:42.332508 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:42.332963 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:42.462319 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:42.470332 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-98e26007-4341-4cdb-84ee-dd562d82f719 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1558 microversion: 2.1 time: 0.151312 May 10 03:35:42.470901 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3782/7602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:42 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:42.486464 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:35:42.487116 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:35:42.494151 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:42.494617 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:42.495433 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:42.495908 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:42.626327 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:35:42.633923 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-67a0342b-c43e-4ac2-a002-ea78db1bc2bb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1558 microversion: 2.1 time: 0.151323 May 10 03:35:42.634509 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3821/7603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:35:42 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:35:44.233433 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-3fe67516-4580-40ba-a4bc-c04ebc40dfe3 req-41b2d880-4c9f-43e7-b9f5-b56ff1604b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:35:44.242046 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3fe67516-4580-40ba-a4bc-c04ebc40dfe3 req-41b2d880-4c9f-43e7-b9f5-b56ff1604b35 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:35:44.242509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-3fe67516-4580-40ba-a4bc-c04ebc40dfe3 req-41b2d880-4c9f-43e7-b9f5-b56ff1604b35 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:35:44.253104 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-3fe67516-4580-40ba-a4bc-c04ebc40dfe3 req-41b2d880-4c9f-43e7-b9f5-b56ff1604b35 service nova] Creating event network-changed:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:35:44.258164 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-3fe67516-4580-40ba-a4bc-c04ebc40dfe3 req-41b2d880-4c9f-43e7-b9f5-b56ff1604b35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028463 May 10 03:35:44.258747 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3783/7604] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:36:12.957124 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:36:12.957786 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:36:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:36:13.458396 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:36:13.458991 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:37:12.348613 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2106264077"}} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:12.349663 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:12.355842 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:12.356296 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:12.357064 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:12.357539 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:12.633546 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-f4936e9c-c7b2-4acd-b3cc-0d4503bd5f99 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "POST /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2/action" status: 202 len: 0 microversion: 2.1 time: 0.289796 May 10 03:37:12.634112 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3822/7605] 10.222.0.52 () {60 vars in 1277 bytes} [Tue May 10 03:37:12 2022] POST /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 10 03:37:18.610116 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-23e4f0b7-2d15-42a7-94e6-89e89fbe687d req-b75db454-8642-4114-b2c5-a59ae161c1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "name": "network-vif-plugged", "status": "completed", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:18.634855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-23e4f0b7-2d15-42a7-94e6-89e89fbe687d req-b75db454-8642-4114-b2c5-a59ae161c1d0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:18.634855 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-23e4f0b7-2d15-42a7-94e6-89e89fbe687d req-b75db454-8642-4114-b2c5-a59ae161c1d0 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:18.647764 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-23e4f0b7-2d15-42a7-94e6-89e89fbe687d req-b75db454-8642-4114-b2c5-a59ae161c1d0 service nova] Creating event network-vif-plugged:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:37:18.653958 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-23e4f0b7-2d15-42a7-94e6-89e89fbe687d req-b75db454-8642-4114-b2c5-a59ae161c1d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053572 May 10 03:37:18.666411 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3784/7606] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:37:26.543144 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:26.543849 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:26.546549 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [788024f5-0b2b-4d85-bd9e-e85f869f797c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:37:26.547574 n-d-841089-2 devstack@n-api.service[118716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [731f6601-793d-46cc-b0da-a258d564ce0a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:37:26.549486 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-ac6caf17-2c93-4573-9f5c-085b7df1e8fb req-2f2e9082-b6ff-4029-9abc-4a6ab7df7a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:26.552726 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:26.553260 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:26.554127 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:26.554647 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:26.558503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ac6caf17-2c93-4573-9f5c-085b7df1e8fb req-2f2e9082-b6ff-4029-9abc-4a6ab7df7a39 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:26.559202 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-ac6caf17-2c93-4573-9f5c-085b7df1e8fb req-2f2e9082-b6ff-4029-9abc-4a6ab7df7a39 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:26.571359 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-ac6caf17-2c93-4573-9f5c-085b7df1e8fb req-2f2e9082-b6ff-4029-9abc-4a6ab7df7a39 service nova] Creating event network-changed:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:37:26.577313 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-ac6caf17-2c93-4573-9f5c-085b7df1e8fb req-2f2e9082-b6ff-4029-9abc-4a6ab7df7a39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032064 May 10 03:37:26.578133 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3785/7607] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:37:26.581884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Going to try to terminate instance {{(pid=118716) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:37:26.671416 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-cadab419-273b-4e00-bb63-22ca5b47839c tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 204 len: 0 microversion: 2.1 time: 0.132640 May 10 03:37:26.672015 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3823/7608] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:37:26 2022] DELETE /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:37:26.681069 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:26.682173 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:26.688906 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:26.689382 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:26.690349 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:26.690809 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:26.862005 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:37:26.870248 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-9ca40e4d-026a-434c-b270-b5276e118f20 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1683 microversion: 2.1 time: 0.193364 May 10 03:37:26.870840 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3786/7609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:26 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:37:27.887889 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:27.888511 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:27.899124 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:27.899620 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:27.900512 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:27.900967 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:27.904865 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] [731f6601-793d-46cc-b0da-a258d564ce0a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57356. May 10 03:37:27.919227 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] [788024f5-0b2b-4d85-bd9e-e85f869f797c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57354. May 10 03:37:28.038263 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:37:28.045689 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-21172b9b-5b7f-424c-9241-838e36439c54 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1683 microversion: 2.1 time: 0.162236 May 10 03:37:28.046271 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3824/7610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:27 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:37:28.568540 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [req-c731619b-26ba-493b-a99a-7641306a1251 req-4d4cc64f-e23c-4e5f-bde4-6a76b65d53fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "name": "network-vif-unplugged", "status": "completed", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:28.578503 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c731619b-26ba-493b-a99a-7641306a1251 req-4d4cc64f-e23c-4e5f-bde4-6a76b65d53fd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:28.579198 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [req-c731619b-26ba-493b-a99a-7641306a1251 req-4d4cc64f-e23c-4e5f-bde4-6a76b65d53fd service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:28.591375 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.compute.server_external_events [req-c731619b-26ba-493b-a99a-7641306a1251 req-4d4cc64f-e23c-4e5f-bde4-6a76b65d53fd service nova] Creating event network-vif-unplugged:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:37:28.596219 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [req-c731619b-26ba-493b-a99a-7641306a1251 req-4d4cc64f-e23c-4e5f-bde4-6a76b65d53fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031998 May 10 03:37:28.596819 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3787/7611] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:37:29.024233 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-cf3544e0-0bf2-4a6d-9c3c-ed8e53fc21e6 req-b8b66f0a-c6ad-4c8a-8e37-5833e31ac3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e6e033-3a94-44b5-ad93-cc11b231f6d2", "name": "network-vif-deleted", "tag": "7c3f3e88-f97f-49a3-ae08-8869a900ecad"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:29.033526 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cf3544e0-0bf2-4a6d-9c3c-ed8e53fc21e6 req-b8b66f0a-c6ad-4c8a-8e37-5833e31ac3e4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:29.034119 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-cf3544e0-0bf2-4a6d-9c3c-ed8e53fc21e6 req-b8b66f0a-c6ad-4c8a-8e37-5833e31ac3e4 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:29.049545 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-cf3544e0-0bf2-4a6d-9c3c-ed8e53fc21e6 req-b8b66f0a-c6ad-4c8a-8e37-5833e31ac3e4 service nova] Creating event network-vif-deleted:7c3f3e88-f97f-49a3-ae08-8869a900ecad for instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 on n-h2-841089-2 May 10 03:37:29.056037 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-cf3544e0-0bf2-4a6d-9c3c-ed8e53fc21e6 req-b8b66f0a-c6ad-4c8a-8e37-5833e31ac3e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 May 10 03:37:29.056954 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3825/7612] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:37:29.064475 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:29.066310 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:29.077574 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:29.078044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:29.079272 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:29.079728 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:29.144543 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:37:29.153309 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-7878fc25-6808-4520-b388-3413a9d84713 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 200 len: 1333 microversion: 2.1 time: 0.093653 May 10 03:37:29.153880 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3788/7613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:29 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:37:30.171537 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:30.172247 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 79e6e033-3a94-44b5-ad93-cc11b231f6d2] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:30.178429 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:30.178884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:30.179679 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:30.180648 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:30.193468 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] HTTP exception thrown: Instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 could not be found. May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Request method failure captured: May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 HTTP/1.1 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedzlsetMpEMWvXetEb63aA6JN8NpdsG0CF90rToxrBISQItP31709H0ll_sFuWtusYIs3w63h98XzRo6UDPAWLZZUq7R7zm84e8Vj-33iUvSBOx3T4A_qt0zzH1rVsguxoyEer6sSvzBZ4ZdYhbihHbdsBq5AedxRx69x7EdqA73GCs May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5abd5d0bbf8344aeaa9adcf44a995883 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestSnapshotPattern-1285723495 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5abd5d0bbf8344aeaa9adcf44a995883", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5abd5d0bbf8344aeaa9adcf44a995883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5abd5d0bbf8344aeaa9adcf44a995883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5abd5d0bbf8344aeaa9adcf44a995883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestSnapshotPattern-1285723495 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5abd5d0bbf8344aeaa9adcf44a995883 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestSnapshotPattern-1285723495 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestSnapshotPattern-1285723495-project May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 87647790e7ff4829b26c9b98e7b32578 May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestSnapshotPattern-1285723495-project May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 could not be found. May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '79e6e033-3a94-44b5-ad93-cc11b231f6d2'} May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 could not be found. May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 could not be found. May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:37:30.195163 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 could not be found. May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Returning 404 to user: Instance 79e6e033-3a94-44b5-ad93-cc11b231f6d2 could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-e175d004-eb68-4526-91c8-eff4681219fe tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2" status: 404 len: 111 microversion: 2.1 time: 0.030734 May 10 03:37:30.200102 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3826/7614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:30 2022] GET /compute/v2.1/servers/79e6e033-3a94-44b5-ad93-cc11b231f6d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:37:31.545672 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-6ab82205-348f-4275-8099-e55db4be84d9 req-f290adeb-fdb4-4a03-8b46-079ac354d709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:31.547914 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:31.548446 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:31.555376 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6ab82205-348f-4275-8099-e55db4be84d9 req-f290adeb-fdb4-4a03-8b46-079ac354d709 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:31.555943 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-6ab82205-348f-4275-8099-e55db4be84d9 req-f290adeb-fdb4-4a03-8b46-079ac354d709 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:31.556044 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:31.556410 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:31.557213 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:31.557672 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:31.567273 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-6ab82205-348f-4275-8099-e55db4be84d9 req-f290adeb-fdb4-4a03-8b46-079ac354d709 service nova] Creating event network-changed:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:37:31.572972 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-6ab82205-348f-4275-8099-e55db4be84d9 req-f290adeb-fdb4-4a03-8b46-079ac354d709 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030863 May 10 03:37:31.573564 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3827/7615] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:37:31.587016 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Going to try to terminate instance {{(pid=118717) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:37:31.680363 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-0c753eff-67d4-4fdd-ab21-c0a615b7cecb tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 204 len: 0 microversion: 2.1 time: 0.141079 May 10 03:37:31.681579 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3789/7616] 10.222.0.52 () {58 vars in 1238 bytes} [Tue May 10 03:37:31 2022] DELETE /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:37:31.690608 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:31.691355 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:31.699717 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:31.700381 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:31.701184 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:31.701635 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:31.841718 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.policy [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118716) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:37:31.849099 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b32c03b0-b50e-411b-a05c-c45e49d3eedf tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1683 microversion: 2.1 time: 0.163170 May 10 03:37:31.849674 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3828/7617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:31 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:37:32.866510 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:32.867752 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:32.874483 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:32.874954 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:32.875777 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:32.876240 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:33.012361 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:37:33.020025 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-636de5d6-e91d-4d60-8a4e-b46228dca013 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1683 microversion: 2.1 time: 0.157729 May 10 03:37:33.020612 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3790/7618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:32 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:37:33.638689 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [req-faa20b2d-24e3-47f4-8858-d7079f664fa3 req-abbdf7ff-fc24-4abf-868a-bade1de13539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f32e3a1-f630-49f1-907f-56d0ea842c0e", "name": "network-vif-deleted", "tag": "11532090-bc57-460c-8f0b-26b0391e680d"}]} {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:37:33.648201 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-faa20b2d-24e3-47f4-8858-d7079f664fa3 req-abbdf7ff-fc24-4abf-868a-bade1de13539 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:33.649243 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [req-faa20b2d-24e3-47f4-8858-d7079f664fa3 req-abbdf7ff-fc24-4abf-868a-bade1de13539 service nova] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:33.661275 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.compute.server_external_events [req-faa20b2d-24e3-47f4-8858-d7079f664fa3 req-abbdf7ff-fc24-4abf-868a-bade1de13539 service nova] Creating event network-vif-deleted:11532090-bc57-460c-8f0b-26b0391e680d for instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e on n-h1-841089-2 May 10 03:37:33.666475 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [req-faa20b2d-24e3-47f4-8858-d7079f664fa3 req-abbdf7ff-fc24-4abf-868a-bade1de13539 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 May 10 03:37:33.667082 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3829/7619] 10.222.0.52 () {64 vars in 1317 bytes} [Tue May 10 03:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:37:34.037937 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:34.038509 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.compute.api [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118717) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:34.046902 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:34.047431 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:34.048228 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:34.048859 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:34.083586 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:34.084122 n-d-841089-2 devstack@n-api.service[118717]: DEBUG oslo_concurrency.lockutils [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:34.084627 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.objects.instance [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lazy-loading 'fault' on Instance uuid 1f32e3a1-f630-49f1-907f-56d0ea842c0e {{(pid=118717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:37:34.130051 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.policy [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87647790e7ff4829b26c9b98e7b32578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abd5d0bbf8344aeaa9adcf44a995883', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118717) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:37:34.137264 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-cfde7237-e800-4b26-b292-05e8fadd1078 tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 200 len: 1338 microversion: 2.1 time: 0.103658 May 10 03:37:34.137836 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3791/7620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:34 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:37:35.155883 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '>' {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:35.156634 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.compute.api [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] [instance: 1f32e3a1-f630-49f1-907f-56d0ea842c0e] Fetching instance by UUID {{(pid=118716) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:37:35.162884 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:35.163384 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:35.164168 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:37:35.164623 n-d-841089-2 devstack@n-api.service[118716]: DEBUG oslo_concurrency.lockutils [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Lock "50c27daa-103b-4462-9947-4d3303b846b7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:37:35.178318 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.wsgi [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] HTTP exception thrown: Instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e could not be found. May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Request method failure captured: May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: request: GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e HTTP/1.1 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Accept: application/json May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Accept-Encoding: identity May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Connection: close May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Content-Length: 0 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Content-Type: application/json May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Host: 10.222.0.52 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: Openstack-System-Scope: None May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: User-Agent: python-urllib3/1.26.9 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Auth-Token: gAAAAABiedzlsetMpEMWvXetEb63aA6JN8NpdsG0CF90rToxrBISQItP31709H0ll_sFuWtusYIs3w63h98XzRo6UDPAWLZZUq7R7zm84e8Vj-33iUvSBOx3T4A_qt0zzH1rVsguxoyEer6sSvzBZ4ZdYhbihHbdsBq5AedxRx69x7EdqA73GCs May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Id: None May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Domain-Name: None May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Identity-Status: Confirmed May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Is-Admin-Project: True May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Id: default May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Domain-Name: Default May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Id: 5abd5d0bbf8344aeaa9adcf44a995883 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Project-Name: tempest-TestSnapshotPattern-1285723495 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Role: member,reader May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Roles: member,reader May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5abd5d0bbf8344aeaa9adcf44a995883", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5abd5d0bbf8344aeaa9adcf44a995883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5abd5d0bbf8344aeaa9adcf44a995883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5abd5d0bbf8344aeaa9adcf44a995883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant: tempest-TestSnapshotPattern-1285723495 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Id: 5abd5d0bbf8344aeaa9adcf44a995883 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-Tenant-Name: tempest-TestSnapshotPattern-1285723495 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-User: tempest-TestSnapshotPattern-1285723495-project May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Id: default May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-User-Domain-Name: Default May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-User-Id: 87647790e7ff4829b26c9b98e7b32578 May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: X-User-Name: tempest-TestSnapshotPattern-1285723495-project May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: method: > May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: exception: Instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e could not be found. May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: action_args: {'id': '1f32e3a1-f630-49f1-907f-56d0ea842c0e'} May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: {{(pid=118716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e could not be found. May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e could not be found. May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:37:35.179961 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e could not be found. May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: ERROR nova.api.openstack.wsgi May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: DEBUG nova.api.openstack.wsgi [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Returning 404 to user: Instance 1f32e3a1-f630-49f1-907f-56d0ea842c0e could not be found. {{(pid=118716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: INFO nova.api.openstack.requestlog [None req-b3d50e3d-3e27-4364-bd20-af86e0565f4d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e" status: 404 len: 111 microversion: 2.1 time: 0.030682 May 10 03:37:35.183651 n-d-841089-2 devstack@n-api.service[118716]: [pid: 118716|app: 0|req: 3830/7621] 10.222.0.52 () {58 vars in 1235 bytes} [Tue May 10 03:37:35 2022] GET /compute/v2.1/servers/1f32e3a1-f630-49f1-907f-56d0ea842c0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:37:35.339650 n-d-841089-2 devstack@n-api.service[118717]: DEBUG nova.api.openstack.wsgi [None req-591e7c6d-d853-41db-817d-2e48d2a2197d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] Calling method '.version_select at 0x7f3d34209dc0>' {{(pid=118717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:37:35.363471 n-d-841089-2 devstack@n-api.service[118717]: INFO nova.api.openstack.requestlog [None req-591e7c6d-d853-41db-817d-2e48d2a2197d tempest-TestSnapshotPattern-1285723495 tempest-TestSnapshotPattern-1285723495-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1097883548" status: 202 len: 0 microversion: 2.1 time: 0.028177 May 10 03:37:35.364161 n-d-841089-2 devstack@n-api.service[118717]: [pid: 118717|app: 0|req: 3792/7622] 10.222.0.52 () {58 vars in 1256 bytes} [Tue May 10 03:37:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1097883548 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:37:52.972347 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:37:52.973006 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:37:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:37:53.376797 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:37:53.377327 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:39:33.466619 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:39:33.467288 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:39:52.383517 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:39:52.384708 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:40:08.341404 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:40:08.341974 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:41:12.981454 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:41:12.982119 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:41:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:41:13.385240 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:41:13.385774 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:41:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:42:52.970348 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:42:52.970846 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:42:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:42:53.475218 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:42:53.475780 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:42:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:43:12.393491 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:43:12.394201 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:43:28.349456 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:43:28.350053 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:44:32.992493 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:44:32.993314 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:44:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:44:33.393417 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:44:33.393995 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:46:12.978775 n-d-841089-2 devstack@n-api.service[118717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:46:12.979390 n-d-841089-2 devstack@n-api.service[118717]: Tue May 10 03:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:46:13.483293 n-d-841089-2 devstack@n-api.service[118716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:46:13.483825 n-d-841089-2 devstack@n-api.service[118716]: Tue May 10 03:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!